EPISODE · Aug 17, 2026 · 41 MIN
Why most A/B tests fail—and what actually improves conversion rates
from Brandformance · host Pranav Piyush
Why do most A/B tests fail to produce any meaningful improvement—and what separates a useful experiment from another inconclusive result?In this episode of Brandformance, Pranav Piyush speaks with Casey Hill, CMO at Do What Works, about what thousands of real-world website experiments reveal about conversion rate optimization.They explore:Why most A/B test variants fail to move the needleThe three checks to make before launching an experimentWhy specific messaging consistently beats generic benefitsHow reassurance copy can remove conversion barriersWhat marketers misunderstand about benchmarks and confidenceWhy customer logos alone may no longer build trustHow to position AI products without relying on empty languageWhether websites still matter in a world of AI agents and LLMsFor CMOs, growth leaders and B2B marketers looking to make smarter website and experimentation decisions, this conversation offers practical lessons grounded in actual testing data.
Embed this episode
What this episode covers
Why do most A/B tests fail to produce any meaningful improvement—and what separates a useful experiment from another inconclusive result? In this episode of Brandformance, Pranav Piyush speaks with Casey Hill, CMO at Do What Works, about what thousands of real-world website experiments reveal about conversion rate optimization. They explore: Why most A/B test variants fail to move the needle The three checks to make before launching an experiment Why specific messaging consistently beats g...
Ready to play
Why most A/B tests fail—and what actually improves conversion rates
No transcript for this episode yet
Similar Episodes
No similar episodes found.