Is it serious if a baby bumps his head?

Probably not.

I was holding my 6 month old son in my arms as I sat in a rocking chair. He suddenly jerked in my arms and fell to the floor, hitting his head on the carpet, which was laid over concrete.

I was sick with worry.

He's now 22 and shows no signs of any ill effects.