Do not disturb your throat. Rinse with salt in lukewarm water after every meal atleast 5 times a day. Theyl come out on their own overtime.Sip warm liquids. Do steam inhalation. Avoid cold and spicy food and drinks.
Next Steps
If you cannot handle the pain, take plain paracetamol tablet 500mg 1 every 6 hourly if you are not allergic to the tablet for pain.
Health Tips
Call an ent and talk to them regarding the issue. Hope you do not have fever or any other symptoms. If you do, please talk to your doctor.