Is a bullet a bullet if there is no powder and no primer present?

Yes. The bullet is only the projectile. A bullet with case, powder, and primer is a cartridge. A cartridge without powder or primer is called a dummy cartridge because it will fit into a firearm but will not fire. Dummies are used for non firing training with weapons, and for display purposes.