Is sound made when matter vibrates?

Ideally (as in, if things in science were perfect and all transfers of energy were completely transferable) no, sound is not necessarily made when matter vibrates.

What do you mean by matter vibrating? like... atoms vibrating or chunks of ice vibrating or what?