What is the town's view of Dimmesdale and his speech in The Scarlet Letter?

The town generally holds Dimmesdale in high regard as a pious and respected minister. His eloquent and moving sermons are well-received by the townspeople. However, there are some who feel that there is a hidden darkness or hypocrisy in his character due to his secretive nature and physical decline.