Augmented reality for a boat camera

1

I’m looking into ways to create augmented reality application for a boat.
Let’s say a boat has a forward looking camera. It has IMU which gives compass heading,
true north heading is calculated automatically from it,
pitch and roll from boat inertial sensor. All of it is nearly real time data.

So first step I would like to overlay video from a camera with heading data.

Then add more. Label ships, buoys which are visible in camera with data from AIS.
Like in this discussion: Feature Request: Augmented Reality Nav Aid · Discussion #241 · bareboat-necessities/lysmarine_gen · GitHub

Visible stars from Stellarium models.

Anyone would be willing to help with it:

Thanks,
–MG

2

maybe you can look at the tutorials, and, based on that, be some more specific about what you have already, and what you need help with ?