Why we don't use Physical Address directly to reduce the handling and conversion against logical address in Operating System?

Question

I have been learning the Operating System for a week. But I am still confused that why we don’t use Physical Address directly despite using Logical Address. In this way, the