statements like these tell me this task exceeds your training and expertise significantly. I’m not saying threads are bad. I’m saying, if that’s the level you’re thinking about this, you are missing the big picture.
there is simply no way you’re gonna decode and run AI on 100 video streams on a single computer.
you can do some napkin math. your bottlenecks will be the AI inference and the actual video decoding.
you need to deploy “smart cameras” that do the processing right there at the edge, and only report the important data back (detections/counts).
industrial vision does that all the time. there are manufacturers that simply make those things (and all the smarts that go into them), and there are integrator companies that know how to use those things and will deliver you an entire solution including setup and operation.