Perhaps in this case you could use contour/shape matching, see this tutorial for example: Shape Matching using Hu Moments (C++ / Python) | LearnOpenCV
Perhaps in this case you could use contour/shape matching, see this tutorial for example: Shape Matching using Hu Moments (C++ / Python) | LearnOpenCV