EPISODE · May 24, 2026 · 23 MIN
Causal Scope Laundering: When Evidence Closes the Wrong Question
from Mechanism Realism · host Elias Kunnas
What if the evidence is real, the citation is accurate — and the argument is still invalid?This episode of Mechanism Realism examines causal scope laundering: the public-discourse failure where a bounded study is used to settle a larger policy question that the study was never designed to answer.A treatment-effect study can tell us what happened to a defined population, under a defined intervention, against a defined counterfactual, over a defined window. That is valuable evidence. But policy arguments often smuggle that narrow estimate into a much larger claim: whether a whole accountability system, labor-market structure, school architecture, or incentive regime should exist.The episode walks through examples like body-worn camera trials, minimum-wage studies, charter-school lotteries, class-size experiments, and grade-retention research. In each case, the study may be rigorous and correctly summarized. The problem appears when the citation becomes a stopping rule for a composite policy question whose decisive mechanisms were not varied by the study.The repair is not anti-science. It is stricter evidence discipline. Before a citation closes a dispute, ask three questions: what exactly did the study estimate, what exact policy action is the citation being used to close, and which action-relevant mechanisms or contexts were outside the study’s scope?A study cannot close a question it did not identify.https://kunnas.com/articles/causal-scope-laundering
What this episode covers
What if the evidence is real, the citation is accurate — and the argument is still invalid?This episode of Mechanism Realism examines causal scope laundering: the public-discourse failure where a bounded study is used to settle a larger policy question that the study was never designed to answer.A treatment-effect study can tell us what happened to a defined population, under a defined intervention, against a defined counterfactual, over a defined window. That is valuable evidence. But policy arguments often smuggle that narrow estimate into a much larger claim: whether a whole accountability system, labor-market structure, school architecture, or incentive regime should exist.The episode walks through examples like body-worn camera trials, minimum-wage studies, charter-school lotteries, class-size experiments, and grade-retention research. In each case, the study may be rigorous and correctly summarized. The problem appears when the citation becomes a stopping rule for a composite policy question whose decisive mechanisms were not varied by the study.The repair is not anti-science. It is stricter evidence discipline. Before a citation closes a dispute, ask three questions: what exactly did the study estimate, what exact policy action is the citation being used to close, and which action-relevant mechanisms or contexts were outside the study’s scope?A study cannot close a question it did not identify.https://kunnas.com/articles/causal-scope-laundering
NOW PLAYING
Causal Scope Laundering: When Evidence Closes the Wrong Question
No transcript for this episode yet
Similar Episodes
Jul 4, 2026 ·96m
Jun 30, 2026 ·46m
Jun 27, 2026 ·150m