Why is a goat associated with bock beer?

The earliest of the style came out of the German city of Einbeck. With a little creativity, the beer became associated with it's founding city, by calling it "ein bock" or "a bock" a male goat, which is why there is usually a goat on the label.