Coordinates issues

Hello good people, I’m trying to make a robotic arm do classic pick and sort by color recognition. I’m using Dobot Magician, hooked up a camera to my notebook and python with opencv. I’m having waaay too many issues syncing the coordinates of the camera with the robotic arm. I can provide code if needed, I would be glad if anyone here could give me pointers.