I guess you just have to tell them you like your curls
As far as getting sick from the cold - I'm fortunate to live in a warm climate but if you're in a cold place, I wouldn't want to go out with a wet head. Can you diffuse instead of air drying? I actually get better results diffusing than air drying (but your hair is probably different than mine; mine is 3A)