How do you get past the librarian and guards the second time you go to the dungeon on Astro Knights island?

You can't get past the guards. Once you have retrieved the cheese and thrown the switch, you cannot enter through the library again. To return to the dungeon, you have to go through the back way, which connects to Mordred's underground laboratory.

(see the related question)