just hook into the game process. that’s a debugging technique and requires operating system APIs.
using an AI to understand the game state from the video output requires serious knowledge of AI.
anything less than AI might not work anywhere near reliably.
yes, you can entirely forget Canny. nobody ever uses that for anything useful. it has specific narrow uses, and 50% of those are “here’s a tutorial that looks useful but isn’t, but I won’t tell you because I’m doing this for the ad revenue”.
that might give you some information. try it. go for “DIS” optical flow, implemented in OpenCV.
if the game makes a “bump” sound, you can use cheap AI to recognize that sound from the game’s sound output.