Everyone notices your weight loose. They just don't say anything. I am going through the very same thing. Whenever somebody does say something, they make the change sound so much bigger than I think it is. I posted the very same message 4 months ago.

I went swimming yesterday, it felt SO GOOD to not feel self conscious about my body. I think that is the key, to feel good about yourself.