Can you go to passport office to renew passport?

Yes, however, it is not a requirement to show up, you can just send the passport renewal application and documents by Mail. However, if you intend to expedite it or rush it, you need to be there in person.