Is there a black hole at the center of every galaxy?

Yes, most galaxies, including our own Milky Way, are believed to have a supermassive black hole at their center.