I really doubt its the network but this would depend on the network and the resolution. I also wouldn’t say you can imply from the fact your CPU isn’t at 100% that it isn’t caused by your machine. My guess would be your CPU can’t decode that many streams simultaneously at that frame rate.
Do you still get errors if you don’t display the video?
At what number of camera’s do you start getting errors?