The Voice and the Verdict: On Giving Machines a Character

“The voice is model character, but the verdict is human judgment.”Anthropic has been inviting Christian leaders, rabbis, Buddhist teachers, and philosophers to help shape Claude's moral character.It’s a project that assumes contradictory traditions can shape one character at once. Philosopher Brendan McCord calls this incoherent because if no tradition is privileged, competing visions of the good end up treated as equally valid, and a machine built to be our moral superior becomes one we lean on instead of exercising our own judgment.What’s worse, neutrality was never on the table. Models are trained on human preference data, and people reliably reward answers that confirm what they already believe. Left unchecked, this produces not a neutral assistant but a flatterer, and research suggests today's models already out-argue professional debaters and endorse users' harmful or deceptive choices far more often than humans do.It’s important to separate two things usually treated as one. The voice is how a model speaks; honest, willing to disagree, resistant to manipulating you. The verdict is what you should actually do, which belongs entirely to the person asking.Refusing to build character just hands the job to biased training data by default; letting one company set all the rules creates a mirror that only reflects your own values back, removing the friction you actually need to grow.As a proposed fix, let’s think in architectural terms. Imagine a thin, universal floor of honesty and non-manipulation, with distinct character layers built above it that are transparent, competing, and chosen by users rather than imposed by one maker.In other words, imagine a machine that doesn’t rule your life, but one that argues with you and then steps back, leaving the decision where it belongs: with you.Key Topics:The Moral Formation of AI Models (00:24)There is No Neutral Machine (02:42)What Accidental Character Does (06:03)Who Changes the Character in Models? (09:50)Who Forms the Voice? (16:34)What Formation Owes the Person Being Formed (20:11)More info, transcripts, and references can be found at ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ethical.fm