SolvePNP and world relative rotation

problem is still: you dont have the required data, the camera pose in world coords, and computer-vision alone cannot tell you, it would need gps data or similar to know, where your scene is “in the world”.

however, once you have this information, it’s just another matrix multiplication (and that’s where we would need your MRE )