How can you improve a bicycle?

Check that bits that are supposed to stay on are firmly attached, that bits that are supposed to move actually does that freely, that the chain is reasonably clean and lubed, that brake/shifter wires aren't frayed, that tires are well inflated and doesn't show signs of cracking.