AR rock climbing wall

Howdy folks.

I have a strong strategic interest in building something like this;

I know Python and basic cpp and js, and I understand the basics of opencv. Any hints?

human pose estimation.

that’ll give you points for hands and feet. match that to previously known (manually noted down) positions of these holds. if hand/foot is close enough to some hold, ā€œactivateā€ the hold.

add some perspective transforms to map between the walls and the camera view.

1 Like

Have you seen any solution with ā€œmultipleā€ perspective transforms?

Meaning, assume a wall of polygons with handholds and the distance from the camera is the z axis. Some handholds are further from the camera, others are closer to the camera. Can I find x y z coordinates with any degree of accuracy? How about coords for vertices of the polygons? Hands and feet?

If it’s unmanageable without additional hardware (beyond a webcam) Iā€˜ll look into it.