If you are uncomfortable with a certain Medicine, then stop that Medicine.
Diabetes can damage nerves and cause burning feet. Usually it affects both legs. You are having problem in only one leg, that is unusual in diabetic neuropathy. Better to do nerve conduction study or other tests to find out the cause. You should consult a Neuro Specialist.