I think the rules governing the SCOTUS are fine the way they are. They would be no different than any other regular person and have their opinions change as times change. That doesn't excuse them from deviating from the intent of the Constitution (legislating from the bench), but it allows for opinions to be weighed with the times.
While I have disagreed with decisions in the past, they know more about the law than I do and I have a trust in them that allows me to accept their decisions. The opinions they give that ruffle feathers could be changed in the future given different approaches to cases.