reprojectImageTo3D() produces discretized point cloud

depth estimation uses block matching. that has a finite resolution.

what resolution do you expect?

the viewing frustum of the camera is a “cone” (pyramid). of course the point cloud would fit in that shape. what is your expectation?