Do you keep your items on Club Penguin when your membership runs out?

No you cannot. But it saves in your inventory and you cant click it. When you become a member again, It is click able.This only applies for the membership items, The non-membership items are never gonna go away.