How to A-B Test Email Subject Lines Without Wasting Your List episode artwork

EPISODE · Jun 18, 2026 · 8 MIN

How to A-B Test Email Subject Lines Without Wasting Your List

from Conversion Rate Optimization with Fexingo: A/B Testing, Landing Pages, and CRO Strategy · host Fexingo

Testing subject lines via email sounds easy, but most companies destroy their data by sending at the wrong time, to the wrong segment, or without accounting for recency bias. In this episode, Lucas walks through a concrete case: a B2B SaaS company that ran a 50-50 split on a newsletter subject line — 'Your Monthly Report' vs. 'Your Custom Report Is Ready' — and got radically different open rates depending on whether the test ran on Tuesday morning or Thursday afternoon. He explains why email A-B tests need a holdout group, why you should never test on your entire list at once, and how one marketer accidentally inflated open rates by 18 percent just by sending the same subject line two hours later. Luna challenges the standard '10 percent sample' rule and brings in a counter-example from a DTC brand that learned the hard way that subject line winners don't always lift click-through. By the end, listeners will know how to structure an email A-B test that actually tells them something about their subscribers, not their server clock. #EmailMarketing #ABTesting #SubjectLines #ConversionRateOptimization #MarketingAnalytics #OpenRate #ClickThroughRate #SaaS #DTC #Segmentation #HoldoutGroup #RecencyBias #DataScience #CRO #Newsletter #FexingoBusiness #BusinessPodcast #MarketingStrategy Keep every episode free: buymeacoffee.com/fexingo

Testing subject lines via email sounds easy, but most companies destroy their data by sending at the wrong time, to the wrong segment, or without accounting for recency bias. In this episode, Lucas walks through a concrete case: a B2B SaaS company that ran a 50-50 split on a newsletter subject line — 'Your Monthly Report' vs. 'Your Custom Report Is Ready' — and got radically different open rates depending on whether the test ran on Tuesday morning or Thursday afternoon. He explains why email A-B tests need a holdout group, why you should never test on your entire list at once, and how one marketer accidentally inflated open rates by 18 percent just by sending the same subject line two hours later. Luna challenges the standard '10 percent sample' rule and brings in a counter-example from a DTC brand that learned the hard way that subject line winners don't always lift click-through. By the end, listeners will know how to structure an email A-B test that actually tells them something about their subscribers, not their server clock. #EmailMarketing #ABTesting #SubjectLines #ConversionRateOptimization #MarketingAnalytics #OpenRate #ClickThroughRate #SaaS #DTC #Segmentation #HoldoutGroup #RecencyBias #DataScience #CRO #Newsletter #FexingoBusiness #BusinessPodcast #MarketingStrategy Keep every episode free: buymeacoffee.com/fexingo

NOW PLAYING

How to A-B Test Email Subject Lines Without Wasting Your List

0:00 8:38

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Frequently Asked Questions

How long is this episode of Conversion Rate Optimization with Fexingo: A/B Testing, Landing Pages, and CRO Strategy?

This episode is 8 minutes long.

When was this Conversion Rate Optimization with Fexingo: A/B Testing, Landing Pages, and CRO Strategy episode published?

This episode was published on June 18, 2026.

What is this episode about?

Testing subject lines via email sounds easy, but most companies destroy their data by sending at the wrong time, to the wrong segment, or without accounting for recency bias. In this episode, Lucas walks through a concrete case: a B2B SaaS company...

Can I download this Conversion Rate Optimization with Fexingo: A/B Testing, Landing Pages, and CRO Strategy episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!