Hello Steve,
thank you very much for your detailed reply.
1: Yes that was my intention. These pictures were just as an example. But I guess I should have chosen better ones. Which software did you use to calculate the angles?
2: Okay so I will focus on the accurate detection of the points of interest and not further dig into interpolation.
3: Is there any feature you could recommend out of your experiance? Best would be one that is stable and already implemented in OpenCV. Maybe 4 aruco markers in the corners?
4: I am planing on using a big charuco board. This gives me many of these desired references.
Your point 5 sounds very interesting, but I wasn’t able to follow all of it. As far as I understand you mean that I should find features, calculate the homography and apply it. Without unditorting the image in the first place?
Is that right, could you explain it, maybe using an example?