Can you deactivate a Twitter account?

Yes. However many, possibly all, of your tweets are stored on other sites that track tweets, topics, and trends. So, while you may delete them from being viewed on Twitter, it's not too hard to search for your old user name, etc., and find plenty of links that go to old tweets of yours.