How do you take off sticky residue without damaging drywall?

Try using a product known as "Goo Gone". It can remove the residue left by tape and various other sticky, greasy, and oily inconveniences. You will find it in most hardware stores such as Lowe's and Home Depot, and it can probably also be found in the cleaning supplies aisle of most grocery stores. Check out the website link below.