U can definitely feed ur baby anytime. Ur fever doesn't spread to baby through breast milk. If u have high grade fever make sure u take medicine and u are comfortable enough to give feed.
But if u have cough,coryza along with fever, take simple, necessary precauations to prevent spread of infection.
Mother's milk is the best and there is no alternative.
Next Steps
Consult ur family physician to take treatment for ur fever.
Health Tips
Don't stop breastfeeding unless u have some breast related infection.