Do you take the apostrophe out of teacher's?

If you're talking about something that belongs to the teacher, then you need the apostrophe. Teacher's desk, teacher's computer, etc.

If you're talking about teacher as a plural noun, then you don't need the apostrophe.