Get the position of each point in the original image from the stitched image

I have provided a simple example for the warping issue. It appears that the main issue occurred when I used warpPoint function (possibly incorrectly). The code is available at the following link

A simple Example

Trying making CmakeList.txt and running the project will allow you to see my problem. I appreciate it in advance.