Who was the fifth Beatle?

At various times, keyboardist Billy Preston, arranger George Martin or manager Brian Eptein have all been referred to as "the fifth Beatle". Also, a NYC DJ "Murry the K" took to calling himself this when The Beatles came to the US in 1964.