They can be impeached by Congress which itself is installed by the people. It's a good level of indirection to keep the court from pandering to the passions of the public while retaining the ability to remove a justice that goes rouge.

At least in theory.