What happens to sperm that aren't used?

Sperm that are not ejaculated are either reabsorbed by the body or broken down and expelled through urine. The body continuously produces new sperm, so there is a turnover of unused sperm to make way for fresh ones.