In The Scarlet Letter Why would dimmesdale live with guilt and not confess his sin openly?

In fear f losing his place within the town.

He doesn't want the townspeople to think about him differently.