What was Odysseus scared of?

When you think of how Odysseus reacted when he landed on Calypso's island, Ogygia, I think Odysseus was scared of losing his men. Which had happened, obviously. Also I think he was afraid of not returning home, all through the story he talks of Ithaca and wanting to return.