The AI Tutor That Gives Poor Kids a Thinner History

The AI Tutor That Gives Poor Kids a Thinner History Source: https://arxiv.org/abs/2607.11292 Paper was published on July 13, 2026 This episode was AI-generated on July 14, 2026. The script was written by an AI language model and the host voices were synthesized by Eleven Labs. The producer is not affiliated with Anthropic or Eleven Labs. Change one word about a student's class or ethnicity, and an AI history tutor quietly rations what it teaches — same-length answers with the hard ideas stripped out. Researchers found a model rating the same revolution 9.6 out of 10 for an elite student and 6.9 for a poor one, and traced the culprit to the safety training built to protect vulnerable users. We walk through what actually holds up, and where the study's most viral number falls apart. Key Takeaways: - Why the same model rated the Romanian Revolution 9.6/10 justified for an elite student and 6.9/10 for a poor one, same run - How the downgrade isn't a shorter answer — every response landed at 330–378 words, but the poor student's had the contested 'coup theory' stripped out (2.6% vs 8%) - The philosopher Miranda Fricker's 'hermeneutical injustice' — being harmed not by a lie, but by having a thinking tool withheld - Why the researchers blame the safety training itself — the protection built for vulnerable users teaches the model to shield them from complexity - Where the viral 77% refusal number falls apart: it's one hand-picked over-refusing model whose temperature couldn't even be locked - Why the 'fivefold' vocabulary shift and 'dumbing down' claims ride on tiny absolute values with no confidence intervals 01:04 - Why the neutral tutor isn't: Lays out the promise that an AI tutor gives everyone the same answer, and the paper's claim that it instead rations knowledge by perceived status. 02:09 - Does it even mention the coup?: Explains why the contested 1989 Romanian Revolution was the perfect test case and how mentioning the coup theory became the single signal for the sophisticated version. 02:47 - How to kill the randomness: Walks through the experimental design — one fixed prompt, four student labels, temperature set to zero, and 1,800 calls across four models. 03:57 - 9.6 for the rich kid, 6.9 for the poor: The justification-rating result: DeepSeek gave the elite student a 9.6 and the poor student a 6.9 on the same event. 05:09 - Same box, missing the best tools: Debunks the 'poor kid just got a shorter answer' assumption — answers were all 330–378 words, but the coup theory and political language got swapped for suffering language. 07:03 - When a bad answer isn't a lie: Introduces Miranda Fricker's hermeneutical injustice — the model can be polite and accurate and still harm by withholding the framework to think with. 08:13 - The scariest numbers are the smallest: The steelman critique — no real students, the fivefold ratio riding on 0.03 to 0.15, missing confidence intervals, and the 77% refusal coming from one hand-picked over-refuser. 10:07 - The equalizer that re-encodes hierarchy: What survives the critique, the suspected safety-training mechanism, and the closing question about whether one identity word should move a model at all. Recommended Reading: - Discovering Language Model Behaviors with Model-Written Evaluations: An Anthropic study showing how models shift responses based on inferred user identity and how safety-style training (RLHF) can induce sycophancy, echoing the episode's worry about status-sensitive answers. (https://arxiv.org/abs/2212.09251)