Multiple cameras, motion detection, classification

1

Hi Midhun, I’ve been working on a similar project. I ended up using Amcrest Cameras, their 4k H264 was most compatible with the PyAv Library that can be used to snag both video and audio and stream it into a file for recording. I record 1 minute blocks at a time. I also use Open CV for frame over frame processing of the video. With A good AMD Ryzen9, I was able to process 1 stream at about ever 6th frame at full 4k resolution. This was doing motion detection, and then sending the motion area over to Ultralytics to categorize the blob as a person, vehicle, animal. If I went headless, I might have been able to do 2 streams with the Ryzen9. I bit the bullet and bought an NVIDIA 3070 Super 12GB GPU. I converted most of the Image processing code to CUDA code. With that, I can do about 6 streams simultaneously. If I went headless (no Ubunti UI / 4 x 4k monitors going) I could probably do double that 12 x4k streams. The fact that I am processing at full resolution on 4k streams gives me the ability to detect a human walking about 350 feet away in daylight. Maybe 100 feet away with IR Illumination at night farther if they are carrying a flashlight. I tried compiling the ffmpeg with CUDA support but never could get the blasted thing to compile right. There are glitches with PyAV decoding the Video streams. It’s best if you have it on a Gigabyte+ Hard Wired Ethernet network. Too much latency/interference with WiFi stuff. I do have one camera on a TP Link wireless bridge. It works ok, but there is ghosting from time to time for some reason and it’s only like 350 feet away. So I will convert this over to a POE+ connector as well in the future. The computer was about 3k to build with GPU, 20TB Drive, 4TB SSD, 64GB RAM, Ryzen 9 with 32 core. Might have been cheaper to just go with the NVIDA Jetson Orion for each camera. $250 board, less power consumption. Running this Computer Night and Day and 4 monitors drove my electric bill up $100/month. $3/day for 24x7 security isn’t that bad, but would like to still reduce that cost. Ultralytics doens’t work that well with black and white IR illuminated images, so a night color camera might be better if you can find one. I’ll be putting some tools up online for download soon.