EPISODE · Jun 15, 2026 · 10 MIN
How a Pre-Registration Log Prevents A-B Test Bias
from Conversion Rate Optimization with Fexingo: A/B Testing, Landing Pages, and CRO Strategy · host Fexingo
Episode 53 of Conversion Rate Optimization with Fexingo dives into a common but overlooked A/B testing pitfall: pre-registration bias. Lucas and Luna explain why logging your hypotheses, sample sizes, and success metrics before running a test can prevent p-hacking and false positives. They walk through a real example from a B2B SaaS company that halved its false-positive rate by adopting a public pre-registration log, and discuss how tools like GitHub or simple spreadsheets can enforce discipline. The hosts also share a practical framework for writing a pre-registration entry in under 10 minutes. No more 'I knew it all along'—this episode gives listeners a concrete tactic to make their A/B tests more trustworthy. #PreRegistrationLog #ABTesting #CRO #PValue #PValueHacking #StatisticalSignificance #Frequentist #Bayesian #HypothesisTesting #DataIntegrity #ConversionOptimization #SaaS #MarketingAnalytics #Experimentation #FexingoBusiness #BusinessPodcast #Marketing #CROStrategy Keep every episode free: buymeacoffee.com/fexingo
What this episode covers
Episode 53 of Conversion Rate Optimization with Fexingo dives into a common but overlooked A/B testing pitfall: pre-registration bias. Lucas and Luna explain why logging your hypotheses, sample sizes, and success metrics before running a test can prevent p-hacking and false positives. They walk through a real example from a B2B SaaS company that halved its false-positive rate by adopting a public pre-registration log, and discuss how tools like GitHub or simple spreadsheets can enforce discipline. The hosts also share a practical framework for writing a pre-registration entry in under 10 minutes. No more 'I knew it all along'—this episode gives listeners a concrete tactic to make their A/B tests more trustworthy. #PreRegistrationLog #ABTesting #CRO #PValue #PValueHacking #StatisticalSignificance #Frequentist #Bayesian #HypothesisTesting #DataIntegrity #ConversionOptimization #SaaS #MarketingAnalytics #Experimentation #FexingoBusiness #BusinessPodcast #Marketing #CROStrategy Keep every episode free: buymeacoffee.com/fexingo
NOW PLAYING
How a Pre-Registration Log Prevents A-B Test Bias
No transcript for this episode yet
Similar Episodes
Mar 26, 2026 ·1m
Mar 19, 2026 ·34m
Feb 18, 2026 ·11m
Feb 11, 2026 ·45m