You'd have to define what elitist means with you. It gets throw around as a pejorative (or as the flip-side of mediocrity as above), but it's a pretty fluid, relative concept in its definition, to say nothing of the variability of how different people behave.
I've been accused of being elitist before, but half the time it's because I was drinking Perrier.