Should I go back to the doctor if I still have swelling and pain in my knee after a week?

You should at least give your doctor's office a call and ask about what is going on and what you should expect over time.