Why must I not delay VideoCapture read() calls?

[matti.vuori]

A more generic solution would be to read all frames as they come, keep track of elapsed time between interesting frames and discard the rest.