What is the brown build up on the shower head?

It is calcium from the water as well as mold that forms from wet conditions. Put some white vinegar and water in a baggie and tie it to the shower head over night. That should make it easier to remove the gunk on the shower head.