Cold weather can cause these kind of skin allergies..
Avoid taking baby outdoors in evenings..
Next Steps
U can try baby moisturizers like Tep-AD which is dermatologically tested,hypoallergenic with no added fragrances..
Health Tips
If rashes persist after 1week plz do visit a pediatrician..as direct examination can reveal more clues in diagnosing the condition.