Is library is a common noun?

Yes, the noun library is a common noun, a Word for any library.

A proper noun is the name of a person, place, thing, or a title; for example:

• The New York Public Library
• The Library of Congress
• The Library Cafe, Farmingdale, NY
• Library Street, Wigan, UK