Do you capitalize Administrative Office in a sentence?

Yes, "Administrative Office" should be capitalized in a sentence if it is used as a proper noun, such as when referring to a specific office or department within an organization.