>People who don't care about other people's opinions aren't that common and aren't called extroverts.

Actually the definition of extraversion is deriving gratification from that which is outside the self, so I'd say it's actually introverts who are less likely to care what others think.