Was there ever a Supreme Court Justice who was removed from office?

Yes, there has been one Supreme Court Justice who was removed from office: Justice Samuel Chase. He was impeached by the House of Representatives in 1804 primarily for political reasons and was tried by the Senate in 1805 but ultimately acquitted, allowing him to remain in his position. No other Supreme Court Justice has been removed from office since then.