Where were the first Olympics held other than in Athens Greece?

Athens was first, and then Paris. You could find more information here: http://en.wikipedia.org/wiki/Olympic_Games#Modern_Olympics (Scroll down to the Olympic Games host cities section.)