What is call number books called?

Do you mean 'what are call books called?'. It is 'are' because 'the books' are plural! Is the answer you are looking for phone books or directories. These contain contact (phone) numbers of residents in a specific place.