How to improve PnP pose estimation?

I’ve run into the same problem as well. Were you able to find a solution?