Is it considered fair use when creating song covers?

Yes, creating song covers can be considered fair use under certain circumstances, such as if the cover is transformative, non-commercial, and does not negatively impact the market for the original song.