Why most A/B tests fail—and what actually improves conversion rates episode artwork

EPISODE · Aug 17, 2026 · 41 MIN

Why most A/B tests fail—and what actually improves conversion rates

from Brandformance · host Pranav Piyush

Why do most A/B tests fail to produce any meaningful improvement—and what separates a useful experiment from another inconclusive result?In this episode of Brandformance, Pranav Piyush speaks with Casey Hill, CMO at Do What Works, about what thousands of real-world website experiments reveal about conversion rate optimization.They explore:Why most A/B test variants fail to move the needleThe three checks to make before launching an experimentWhy specific messaging consistently beats generic benefitsHow reassurance copy can remove conversion barriersWhat marketers misunderstand about benchmarks and confidenceWhy customer logos alone may no longer build trustHow to position AI products without relying on empty languageWhether websites still matter in a world of AI agents and LLMsFor CMOs, growth leaders and B2B marketers looking to make smarter website and experimentation decisions, this conversation offers practical lessons grounded in actual testing data.

Episode metadata supplied by the publisher feed · Published Aug 17, 2026

Embed this episode

Why do most A/B tests fail to produce any meaningful improvement—and what separates a useful experiment from another inconclusive result? In this episode of Brandformance, Pranav Piyush speaks with Casey Hill, CMO at Do What Works, about what thousands of real-world website experiments reveal about conversion rate optimization. They explore: Why most A/B test variants fail to move the needle The three checks to make before launching an experiment Why specific messaging consistently beats g...

Distinct summary based on available episode metadata or transcript content.

Ready to play

Why most A/B tests fail—and what actually improves conversion rates

0:00 41:59

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

No similar episodes found.

O Experimento com Guta Tolmasquim e Gabriel Mineiro O Experimento Branding e Growth têm uma certa rivalidade histórica. Cada um tende a trabalhar de forma isolada no marketing, disputar espaço, importância e orçamento. Para acabar com essa "tensão", Guta Tolmasquim - Fundadora do Purple Metrics - e Gabriel Costa (Mineiro) - Fundador do Merlin e Growth Leaders Academy - ícones de Branding e Growth respectivamente, se uniram para lançar O Experimento, o podcast que pretende fazer as pazes entre as duas áreas!O programa te convida a desafiar suas verdades absolutas, mostrando que as marcas só tendem a ganhar resultados mais expressivos com "brandformance". #PorTuPyme Brandformance AR "Achatemos la curva de la negatividad". Somos creyentes de la frase «En tiempo de crisis, hay oportunidades». Por ello, traemos un espacio para que emprendedores, Pymes y empresas medianas puedan hacer networking en streaming y dar a conocer su proyecto de forma gratuita. Te invitamos a achatar la curva de la negatividad y a motivar a otros emprendedores como nosotros. Do Change Marketing Now Matthias Riedl Welcome to Do Change Marketing Now – the podcast for marketers, founders, and brand builders who are tired of the same old playbook. Hosted by Matthias Riedl, CEO of DCMN and pioneer of Brandformance Marketing, this show is your backstage pass to bold strategies and smart leadership insights that actually move the needle.Matthias has helped over 400 digital brands scale with a unique mix of performance and brand thinking. Whether you’re building awareness, expanding internationally, or trying to break through a saturated market. He’s been there, done that, and is ready to share what works now.Each monthly episode delivers punchy perspectives and honest takes on modern marketing – from cutting through the noise to making people actually care about your brand.What to Expect:Monthly Drops: One high-impact episode per month, perfect for your commute, coffee break, or strategy reset.Brandformance-First: Deep dives into combining brand and performance for sustainable growth.Expert Inte

Frequently Asked Questions

How long is this episode of Brandformance?

This episode is 41 minutes long.

When was this Brandformance episode published?

This episode was published on August 17, 2026.

Can I download this Brandformance episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.
URL copied to clipboard!