Is it legal to record someone talking without them knowing it?

Sometimes. But there are some state laws that prohibit secret recordings, especially of telephone conversations, where there is an expectation of privacy.