Where does the phrase sleeping with the fishes come from?

Although many assume that "sleeping with the fishes" is an old mafia saying, the phrase does not appear until 1969 when it is used in the book The Godfather.