Is there a difference between a physical address and a residence address?

IRS makes a distinction. For example, if you are physically residing in Japan for a while, perhaps working there for a year, but are a citizen of and actually reside normally in the United States, your physical address is Japan, but your residence address is in the United States.