Why does Telemachus have a hard time believing that Odysseus is his father?

Telemachus has a hard time believing that Odysseus is his father because he was just a baby when Odysseus left for the Trojan War, so he has no memories of his father. Additionally, there have been suitors in their home claiming Odysseus will never return, which has further fueled Telemachus's doubts.