Kindly consult your dentist and remove that teeth...There might be some infection which is causing pain, so better go for extraction as soon as possible because it may lead to a swelling.....Some painkillers and antibiotics can be taken to reduce the pain, but it will give you only temporary relief...So better go for removal....
Health Tips
Do some warm saline gargle to reduce your pain....