official OpenCV-Python builds do not come with the Qt-themed imshow window. you are running third party packages or your own build.
OpenCV-Python 4.7.0 is compatible with all Pythons starting from 3.6 onwards. If you have Python 3.8, you can use many many versions of OpenCV-Python, going back several years.