Does foreign office need capital letters?

Yes, "Foreign Office" should be capitalized as it is a proper noun referring to a specific government department or ministry responsible for handling a country's foreign affairs.