How long ago did bacteria first appear on earth?

Scientists believe that the earth's atmosphere has been in existence for over 3.5 billion years. This is based on the fossil records that are found which date to so many years.