Why does the 20th century starts in 1901?

The 1st century is 1 to 100,

the 2nd century is 101 to 200,

the 3rd century is 201 to 300,

the 4th century is 301 to 400, and so on.