There are hundreds of consecutively timestamped frames in which the object keeps moving except for a few frames that the object is static and then again moving and static. I was wondering how I can identify the frames in which the object is static.
for a pair of adjacent frames, compute their per-pixel differences (absolute or squared).
then you can do various statistics, like thresholding of the difference or using the differences as is, summing it all, standard deviation, histogram, …
video encoding is often “lossy”. expect tiny differences when frames look the same.