Correlation Is Not Causation — Research Design, Reliability, Validity, and Ethics Explained

Send us Fan MailIn 1974 a psychologist named Elizabeth Loftus showed participants a film of a car accident and asked one simple question. She used the word "smashed" with one group and the word "hit" with another. One week later the "smashed" group was significantly more likely to report seeing broken glass in the film.There was no broken glass.One word in a question changed what people remembered seeing with their own eyes.That experiment didn't just change how courts think about eyewitness testimony. It demonstrated something that every clinician who reads research needs to understand: the way you design a study determines what the data can actually tell you. Measurement is not neutral. Every research design decision shapes the findings that come out.This is why research methodology matters — not as abstract academic content, but as the framework that allows you to look at any study and ask the right questions about what it actually proves.In this episode of Licensure Lifeline we make the most dreaded domain on every licensing exam genuinely learnable — no math required.What we cover:🧠 The history — Elizabeth Loftus, the misinformation effect, and why one word in a question can change everything a participant remembers📋 Research design — experimental research and what random assignment actually allows you to conclude, quasi-experimental research and its limitations, and non-experimental designs including correlational, descriptive, and ex post facto research🔬 Reliability — the four types you need to know: test-retest, internal consistency, inter-rater, and parallel forms — what each measures and how they differ✅ Validity — content validity, face validity, concurrent validity, predictive validity, and construct validity — the hierarchy of evidence and the distinction that costs the most exam points⚖️ Ethics in research — the Tuskegee Syphilis Study and why it matters, the Belmont Report's three foundational principles (Respect for Persons, Beneficence, Justice), informed consent requirements, and the role of the IRB🎯 The four-question exam method — every research and statistics question on a licensing exam is asking about design and what it can conclude, reliability, validity, or research ethics. Identify the category. Apply the framework.Five exam-style multiple choice questions covering experimental research design and causal conclusions, test-retest reliability, face validity versus construct validity, the Belmont Report's three principles, and ex post facto research and its limitations.Also in this episode:A rapid review commissioned by the National Institute for Health and Care Research examining interdisciplinary mental health research — and what it tells us about who gets included in research and why that matters methodologically. And the July 2026 APA journals featuring new research on the impact of redlining on mental health — a perfect real-world example of what correlational research can and cannot establish.Want to go deeper? This week's Licensure Lifeline newsletter covers statistical concepts the exam tests most — measures of central tendency, standard deviation, Type I and Type II errors, effect size, statistical significance, and a research critique exercise where you evaluate a real study abstract using today's frameworks. Always free — link in the show notes.The cheat sheet, 12-question deep dive quiz, and live study session are inside Licensure Lifeline Circle — home of the Licensure Lifeline 90-Day Study System. Fourteen-day free trial. And the founding member offer opens next week — stay tuned. Link in the show notes.Have a story to share — an exam win, a clinical moment, something from supervision that changed how you see the work? Email us. You might appear in The Fifty-First Minute. Link in the show notes.And before you close this page — if this podcast has helped you study, share it with one person who's preparing for their exam right now. A five-star rating on Apple Podcasts takes ten seconds and helps other pre-licensed therapists find the show.Resources:📥 Free Study Roadmap PDF — 12-domain NCE exam prep guide → licensurelifeline.com📩 Free weekly newsletter → licensurelifeline.com⚡ Licensure Lifeline Circle — 90-Day Study System → licensurelifeline.comSupport the show