Hi, thanks for writing to Practo consult.
Yes you may very well take the mentioned medication for yourself without hesitation. It will not affect baby.
Next Steps
But since you seem to have either allergic or viral ailment, baby might have some cough cold, if it happens please visit doctor.