What does the idiom 'go down the drain' mean?

It's as if you were washing something away and it drained down the sink or bathtub drain. It's gone, it's not coming back, and there's no sense trying to get it back.