I walk away if anyone gets on at me about my lack of alcohol in my glass ;-). Long time ago I got ratty so people learned to back off and eventually, not even make the suggestion that a 'small one won't hurt'. Then I began to explain that, as a medical secretary, I had seen the results of 'a small one' and once I went into fine detail: i.e. injuries, blood, guts, amputations : they either turned green or shut up!
Now that I'm old my response is 'it is my choice as a responsible adult not to drink, who is the adult in this conversation?' and then walk away ;-)