Was everyone allowed to play sports?

While I would say the majority of people in the world were allowed to play sports, I would imagine there were some that were not permitted to participate in sports due to political, religious or other reasons.