The problem with any idea of elitism is that it is too subjective to be the basis of any policy.

But, if it makes you happy, you could use words like "aristocracy" or "upper class" or "bourgeoisie."