What do they call 6 books in a series?

Although the term is not in common usage, the appropriate term is "tetralogy," which has the same derivation as "trilogy," for 3 publications.

For what it's worth, "Tetra" means 4, and the suffix "logy" refers to a publication.