In The Old Man and the Sea why does the man take down the picture of his wife?

The man takes down the picture of his wife because he feels guilty about bringing bad luck upon himself by not catching any fish. He believes that having the picture up is a reminder of his misfortune and wants to change his luck by removing it.