EPISODE · Jun 18, 2026 · 8 MIN
How to A-B Test Email Subject Lines Without Wasting Your List
from Conversion Rate Optimization with Fexingo: A/B Testing, Landing Pages, and CRO Strategy · host Fexingo
Testing subject lines via email sounds easy, but most companies destroy their data by sending at the wrong time, to the wrong segment, or without accounting for recency bias. In this episode, Lucas walks through a concrete case: a B2B SaaS company that ran a 50-50 split on a newsletter subject line — 'Your Monthly Report' vs. 'Your Custom Report Is Ready' — and got radically different open rates depending on whether the test ran on Tuesday morning or Thursday afternoon. He explains why email A-B tests need a holdout group, why you should never test on your entire list at once, and how one marketer accidentally inflated open rates by 18 percent just by sending the same subject line two hours later. Luna challenges the standard '10 percent sample' rule and brings in a counter-example from a DTC brand that learned the hard way that subject line winners don't always lift click-through. By the end, listeners will know how to structure an email A-B test that actually tells them something about their subscribers, not their server clock. #EmailMarketing #ABTesting #SubjectLines #ConversionRateOptimization #MarketingAnalytics #OpenRate #ClickThroughRate #SaaS #DTC #Segmentation #HoldoutGroup #RecencyBias #DataScience #CRO #Newsletter #FexingoBusiness #BusinessPodcast #MarketingStrategy Keep every episode free: buymeacoffee.com/fexingo
What this episode covers
Testing subject lines via email sounds easy, but most companies destroy their data by sending at the wrong time, to the wrong segment, or without accounting for recency bias. In this episode, Lucas walks through a concrete case: a B2B SaaS company that ran a 50-50 split on a newsletter subject line — 'Your Monthly Report' vs. 'Your Custom Report Is Ready' — and got radically different open rates depending on whether the test ran on Tuesday morning or Thursday afternoon. He explains why email A-B tests need a holdout group, why you should never test on your entire list at once, and how one marketer accidentally inflated open rates by 18 percent just by sending the same subject line two hours later. Luna challenges the standard '10 percent sample' rule and brings in a counter-example from a DTC brand that learned the hard way that subject line winners don't always lift click-through. By the end, listeners will know how to structure an email A-B test that actually tells them something about their subscribers, not their server clock. #EmailMarketing #ABTesting #SubjectLines #ConversionRateOptimization #MarketingAnalytics #OpenRate #ClickThroughRate #SaaS #DTC #Segmentation #HoldoutGroup #RecencyBias #DataScience #CRO #Newsletter #FexingoBusiness #BusinessPodcast #MarketingStrategy Keep every episode free: buymeacoffee.com/fexingo
NOW PLAYING
How to A-B Test Email Subject Lines Without Wasting Your List
No transcript for this episode yet
Similar Episodes
Mar 26, 2026 ·1m
Mar 19, 2026 ·34m
Feb 18, 2026 ·11m
Feb 11, 2026 ·45m