Why did the puritan wear buckles on their hats belt and shoes?

They didn’t. The paintings we see are 18th century views of what they thought they looked like and how they dressed. It was a fictional representation not based on fact.