Talk to the person about the same and ask why does he feels the need to get intimate with other person despite of the relation with you, then only we can get to the conclusion
Next Steps
Also please don't take it as a problem if he does it happily and willingly, don't make yourself suffer because someone's mistake
Health Tips
Give him assurance, talk to him, make sure he share his feelings with you