How do you stop getting tweets from people you do not follow?

You can block them by clicking on the "block [username]" link found on users profile pages. Twitter well then show you 2 buttons asking you to confirm that you really mean to block this person from following you.