Pain killer is never a permanent solution and it is not advised to take pain killers unnecessarily and over a long period.
You need to find the cause of the pain and then treat the cause rather than relying on a pain killer.
Next Steps
Visit a dentist and get a checkup done.
Health Tips
It might be due to a tooth decay, which can easily be treated with a filling. If left unattended it might lead to further damage of the tooth.