Did Ned Rorem say Nothing is a waste that makes a memory?

Yes he did, and you can find the entire quote on page 286 of "A Ned Rorem Reader," published in 2001.