It would be difficult to put a pin on it and say whether its okay or not that you do not feel guilty. It is unwise to continue this pattern of living. Mostly because it would affect your kids, in the long run.
Marriage problems are inevitable and need to be handled with great care and maturity.
Next Steps
Please take a professional counselling session from a counsellor in your city or online. Infidelity is never fully accepted, no matter the issues or problems.
Health Tips
Kindly get professional help soon, as you maybe able tot provide more information and understand the issue better.