Hello Friend, Good that you are seeking a help here. Over thinking about others view and their perception is also a kind of anxiety. Pre occupying your mind with such negative thoughts will affect your happiness in present moments. Your husband is right. Just focus on what's important for you in life.
If you are experiencing such thoughts and feelings is affecting your day to day life and relationships, then better take a professional help to manage it.
Take a counseling support to manage and control such anxious thoughts.
Next Steps
Feel free to reach out to me online through Practo app for further detailed evaluation and recommendation. Be positive. You will be alright soon.