Are all states are divided into counties?

No, Louisiana is divided into parishes and Alaska into boroughs. However, parishes and boroughs are called "county-equivalents" by the U.S. federal government.