Can tape recorders still be purchased in physical stores?

Yes, although tape recorders has been overtook by digital voice recorders in recent years. These could possibly be found in second hand shops or thrift shops.