What does the albatross have to do with the cross?

From http://en.wikipedia.org/wiki/Albatross_(metaphor)

The symbolism used in the Coleridge poem is its highlight. For example: Ah ! well a-day ! what evil looks

Had I from old and young !

Instead of the cross, the Albatross

About my neck was hung.