Were there only white people in the civil war?

No. There where also former slaves and African Americans. Most of them fought for the Union, but others fought for the south to defend themselves.