How can I copy elements from one type of Mat to a different type of Mat

Thank you for the explanation. It’s clear this is going to be harder than I hoped. I need to do some more thinking! The frames are relatively small so maybe I can get away with the original commented out solution.