replicate the issue with plain gstreamer on the command line. then you will know that it’s not an opencv issue.
or do what berak suggested, bypass gstreamer.
when in doubt, always go to the raspberry pi forum, and stick with the raspberry pi forum, because your situation involves raspberry pi.