Does the man's sperm come from the prostate?

No, sperm is produced in the testicles. The prostate gland produces a fluid that helps nourish and protect the sperm as it moves through the reproductive system.