The meaning of "driving is privilege" is that it can be taken away if you violate rules or if you are deemed unfit to drive, etc. It doesn't mean that the government can arbitrarily rule that only a certain group (e.g. people with certain income level) can enjoy the privilege.

It is totally different from a country club membership, or the ownership of a yacht...