Hello!! The condition described by you seems to be hair follicle infection known as folliculitis.
If there isn't any scaly patch than clindamycin solution can be applied twice a day for 5 days will help.
Next Steps
But if the boils are painful than oral antibiotics will be required.
Health Tips
Avoid swimming for 1 week till the infection is resolved.