How many people attend the Olympics each year?

As the first records we have are of the games held at Olympia in 776BC and these are very basic it is not known how many took part or watched.