Help system for monitoring a padel game

I’m creating a system for monitoring a padel game, I’m currently tracking the ball and I can get the coordinates of the ball, what I want is to be able to know when it’s a point and when it’s not, I’m using the technique of waiting a few seconds but Doesn’t solve it, does anyone have a suggestion?