What does the author mean when he says his brother grew up to wear his manhood on his sleeve (paragraph 3)?

The author likely means that his brother openly displayed his masculinity or maturity as he got older. This could suggest that his brother took pride in his adulthood and projected confidence in his abilities and character.