Hello. What other symptoms do you have along with the feeling of fever? Sometimes people with anemia can feel feverish due to over working of heart and blood vessels to make up for the low hemoglobin. Your hemoglobin is 8.5 g/dl, it can be due to that. Since you've already taken antibiotics, no need for further course and temperature isn't rising significantly, so serious infection is unlikely.
Next Steps
Further evaluation for cause of anemia and consultation for further management.
Health Tips
Avoid exertion and eat green leafy vegetables, jaggery, pista etc and other food items rich in iron.