Is it normal to have bump next to a closed tongue piercing?

No Having any form of lump or bump next to a closed piercing indicates there is some form of issue with the piercing. This also depends on how long the jewellery has been out of the piercing and how long you had the piercing before removing the jewellery. If you develop any pain or discomfort seek the assistance of your doctor.