Does masterbationg affect a mans sperm count?

I was just given an informational handout from the doctor and it says that you should limit masturbation if you are trying to have a baby. It can affect your sperm count.