U should consult with a picture of the boil for further guidance and prescription it can be anything from a lymph node to carcinoma or a simple abscess. U had not mentioned it’s size and colour
If it’s a abscess pain killer will not help much, should be supplemented by antibiotics.
Kindly share ur complete concern nd picture
Next Steps
Feel free to consult with detail history for further guidance and prescription