Foot muscle strengthening may help. Simple exercises like newspaper crumpling with your feet,curling your toes and opening them out,moving foot clockwise and counterclockwise are some basic exercises which you may try.Contrast bath i.e immersion of foot alternately in warm water and cold water for about 10 minutes,once or twice a day may help with pain relief. At some point in time,please learn some core muscle strengthening exercises from a qualified physiotherapist.

This may b due to Morton’s neuroma . Morton's neuroma involves a thickening of the tissue around one of the nerves leading to your toes. This can cause a sharp, burning pain in the ball of your foot. Your toes also may sting, burn or feel numb. Hot water bath vl b good Use of soft pads or insoles

Any particular activity recently that started the pain? Dip your feet in hot to warm water for 8 minutes. Remove your feet and immediately dip in icecold refrigerated water for 5 minutes . When under water, spread out your toes and get them closer back again. Do this 10 times. Repeat once again hot- cold- exercise . This should relieve the pain as of now . If pain persists, visit orthopaedic doctor.

Use pain'relieving gel like volini gel or diclofenac gel. Use contrast foot bath like use hot water to dip your feet and then use ice water to dip feet. Do foot strengthening exercises three times a day. Towel curling with toes Ice bottle roll under feet. Foot movement like upand down., Clockwise and anticlockwise.inside outside.

From what you are describing it sounds like it is Morton's Nueroma... would have originally developed from compressive foot wear. Yes, as has been mentioned do heat baths 10 to 15 mins. In it curl your toes, then extend to stretch out out toes. Repeat at least 20 reps and 2 rounds of it. Make sure that water is not too hot. You could use heat because you mention that there is no constant pain and pain relieves after some time. Now there is taping that you could do to rectify the pain. But hard to explain here...