Abnormal sperms reaching uterus is difficult, if in case it reaches uterus & fertilize ovum then may cause abnormalities in baby.
Good medicines available in Ayurveda for this problem.
Next Steps
consult Doctor in private, & use prescribed medicines for minimum 3 to 4 months & then try for conception.