Why is catholic boys' school spelled with the apostrophe after the s of boys?

Because "Boys' " is a plural possessive. "Boy" become plural with the addition of the "-S" and "Boys" becomes possessive with the apostrophe.