Objects are far away, what to mind in camera calibration?

Hi, Ive read the calibration best practices, and I have a couple of questions,
If I understand correctly it says that the pattern should take atleast have the image and to have it at varied angles no more than 45°,
If my objects in the real world are at varied distances and sometimes they are far and take a small amount of pixels ( but my image size is large 3024 by 4032)
How do I account for that in the calibration process?