No, Naproxen does not contain penicillin. You can take it for pain relief (if you don't have any contraindications or allergies to anti-inflammatory drugs), in addition to applying ice in a wet bag or towel for 10-15 minutes at a time.
I hope this has been helpful to you, and if you have any further questions, please don't hesitate to ask!