Getting a reasonable disparity map

that’s not much. go higher. also check what you have for mindisparity (or whatever that was). you can see how many pixels of disparity those nearby objects have.