Is love's austere and lonely offices a literary symbol?

An office-holder is one that has a position of great responsibility. Unfortunately, it's usually lonely at the top. Assuming that you're refering to Robert Hayden's 'Those Winter Sundays', this would fit in very nicely with the speaker's characterization of his father.