When might a castle have become overcrowded?

When it was besieged. Then, the regular occupants (the castle's lord and his family and servants) would get company from all the lord's knights and soldiers and their servants, sometimes families and other hangers-on.