There are thousands of colours that all human beings are (and will never be able to) see. Colour blindness is no sin that you have to feel so disappointed and guilty about. There are very few careers that requires full color vision and that ensures near normal career choices. A large number of people in the society may be colour blind and they will never ever come to know about it. You don't have to regret knowing about it. So, overall I would say that you are unduly worried and reading too much into what others may be thinking about your condition. Yours is not a serious problem. If your close friends reject you because you are colour blind, I think they don't deserve you as a friend.
Next Steps
If your stress level is high because of your colour blindness issue, please consult a psychologist to get a better awareness of your condition and to get stress management tips.