A rock made up tiny connected air spaces?

This type of rock is called pumice. Pumice is formed from volcanic eruptions, where the rapid cooling of lava traps gas bubbles inside the rock, creating its lightweight and porous structure.