OK, another attempt, another set of crappy calibration matrices. They are more consistent using the code that constantly calls the set() method to supposedly maintain focus but I could still see the camera trying to change as the process went forward.
We’re going to halt work until we figure out an appropriate camera (and the next round of funding comes in - April!).
In the meantime Steve if you have time I would appreciate seeing a working setup. I will reach out to you via a direct message. Thanks.