You need to get an X-ray done, but a cracked tooth as you mention may not show up on the X-ray, but will help clinician decide on a definitive treatment plan. Is it diagnosed as cracked tooth?
Next Steps
Medication will only give transitory relief. Based on clinical examination and the tooth involved your dentist needs to decide on a definitive treatment.