Sometimes I will recommend that you temporarily wear a brace which helps align and support your knee cap. I may ask you to use this for a month or so while you start the exercises and activity modifications. Wear the brace during the day. Don’t wear it to bed.
Keep the brace even after your pain is better. You never know when you’ll need it again. Perhaps you’ll use it specifically for activities you know will irritate your knee cap, like hiking up hills or climbing up and down ladders.
You can buy braces like these on-line: http://www.amazon.com/90128-Breathable-Neoprene-Stabilizing-Support/dp/B0019D4EXG/ref=sr_1_2?ie=UTF8&qid=1333507568&sr=8-2. You can also get them at places like Academy.