I can not even begin to count how many times someone has said to me "You don’t need to be on a diet." Oh, really? Because professional doctors say that I’m a few pounds away from obesity so I think I need to be.
Like Brandice recently wrote, everyone seems to know better, but you should never allow that to detract from your goals. Sure, if you’re doing well on your diet people are going to compare your old-self to your new-self and that will probably be a fairly dramatic difference. I recently dropped 20 pounds in 35 days. People instantly think I’m "skinny" but in reality I’m simply "thinner than I was a month ago", especially in the face which is where I seem to lose it first.
Stick to your goals and take the commentary as compliments on your progress so far.