PODCAST · business
Experiment Nation: The Podcast
by Rommil from Experiment Nation
Every week we share:- Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world- Conference sessions / TutorialsRecent recognition:- Top 10% of most followed Podcasts on Spotify experimentnation.substack.com
Episodes
-
S6E13 - Stop Running A/B Tests One at a Time
High-velocity experimentation can dramatically increase how quickly organizations learn, optimize their products, and drive revenue. But many teams still run A/B tests sequentially, waiting for one experiment to finish before starting the next. In this video, Varun, co-founder of Geeks of…
more -
S6E12 - CRO Lessons I Wish I Knew Earlier with Edd Saunders
Starting a career in Conversion Rate Optimization (CRO) can be surprisingly difficult. Getting your first experience, working with developers, prioritizing experiments, dealing with failed tests, and proving the value of experimentation all come with a learning curve.In this episode of Experiment...
-
S6E11 - Ethical CRO: How Better Experiments Build Trust, Retention & Revenue
Jon Crowder joins Tracy Laranjo to explain why ethical experimentation is not just better for customers—it is better for long-term growth. They unpack fake urgency, misleading pricing and subscription tactics, short-term A/B test wins that erode trust, and practical ways to design experiments…
more -
S6E10 - Why CRO “Best Practices” Keep Failing (And AI Might Make It Worse)
In this episode, we dive into CRO “best practices” that completely failed in real-world experimentation. From homepage carousels unexpectedly winning tests to why most experimenters still don’t trust AI-generated CRO workflows, we unpack the messy reality behind optimization advice.We also debate...
-
S6E9 - Your A/B Test Dropped Conversion 8% in 6 Days… Now What?
What do you do when an experiment tanks conversion rate by 8% in less than a week?In this episode, Gerda and Rommil break down real CRO and experimentation scenarios submitted by the community, including failed tests, executive pressure, guardrail metrics, knowledge management, developer…
more -
S6E8 - AI vs Humans in Research… Who Actually Wins?
Most teams say they “do research”… but very few actually do it well.In this episode, we break down what real customer research looks like in CRO and growth. From analyzing 200+ survey responses manually, to why AI still struggles with qualitative data, to the politics that slow everything down.We...
-
S6E7 - Ways to destroy an experimentation culture
In this episode, we dive into the realities of CRO (Conversion Rate Optimization) today — from AI anxiety to experimentation culture and how teams should actually be structured. We start with a surprisingly philosophical take on photography and overthinking, then quickly shift into what’s really...
-
S6E6 - The Uncomfortable Truth About AI, ROI, and CRO Careers
In this episode, we answer real, unfiltered questions from the CRO and experimentation community. We dig into how far AI can realistically help with experimentation, why revenue metrics like ARPU are a nightmare for MDE calculations, how to handle sketchy interview “audits,” and why ROI...
-
S6E5 - The Biggest Myths in A/B Testing (Why CRO Fails)
A real conversation about why A/B testing doesn’t magically fix broken businesses.We break down the biggest CRO myths, why copying case studies fails, how experimentation tools really get chosen, and what actually causes friction between CRO, UX, and research teams.For CROs, experimenters…
more -
S6E4 - CRO, Burnout, and Finding Meaning in the Work
In this episode, we go off-script and cover everything from CRO strategy to existential questions.We talk through:How to recover after being shaken at workWhy long-form content still matters in experimentationCRO differences between B2B, SaaS, and ecommerceWhy website redesigns without A/B…
more -
S6E3 - AI Skeptics, CRO Burnout, and Toxic Bosses. Oh my
Koalatative's Gerda Thomas and Experiment Nation's Rommil Santiago answer questions from the CRO community.Chapters3:35 – Is there room in CRO for AI skeptics anymore?4:58 – How can I feel like I'm using my CRO skills for good?11:29 – AI is boring and speeding up the decline of civilization.…
more -
S6E2 - CRO in 2025: Is the Industry Falling Apart? We Break It Down.
Koalatative's Gerda Thomas and Experiment Nation's Rommil Santiago answer CRO questions from the community.Chapters:1:51 – What's the one thing people on internet still refuse to automate or use AI for that you think they should?”5:07 – How do you measure the impact of your CRO program over...
-
S6E1 - The things that CROs refuse to automate with AI with Gerda Thomas and Rommil Santiago
Koalatative's Gerda Thomas and Experiment Nation's Rommil Santiago answer your CRO questionsPart 1 of 3Chapters:8:05 – What is the right balance between big tests versus small and medium tests?12:47 – How many iterations per test will you run knowing the first test was negative but still see some...
-
S5E5 - Building Experimentation Programs from Scratch with Emiliano Blanco
In this episode of Experiment Nation, host Jason Gossit sits down with Ameliano Blanca, a senior growth and product leader with 10+ years of experience driving revenue through data-driven experimentation.They dive deep into:How to build experimentation programs from the ground upThe balance…
more -
S5E4 - Ethical Testing & Design in Experimentation: Leaks vs. Puddles Framework (w/ Namata Agarwal)
In this episode of Experiment Nation, host Jason sits down with Namata Agarwal, a seasoned product designer with over 17 years of experience building digital products, websites, and apps.Together, they explore:- Ethical testing: how to balance user needs with business goals.- Leaks vs. puddles...
-
S5E3: Eppo, Datadog & The Future of Experimentation | Ryan Lucht on Advanced Testing & Culture
In this episode of the Experiment Nation Podcast, host Ward Vanestra sits down with Ryan Lux, one of the first team members at Eppo and now Experimentation Evangelist at Datadog.They dive into:What Eppo is and how it helps companies experiment at scaleWhy data warehouses are critical for...
-
S5E2: Why Most Experimentation Programs Fail featuring Manuel Da Costa
In this episode of the Experiment Nation Podcast, host Richard Joe welcomes Manuel Da Costa, founder of Effective Experiments and now Efestra, to unpack a critical issue in the experimentation industry: the trust gap between practitioners and business decision-makers.🎯 Manuel shares how running...
-
S5E1: Create a Growth & Experimentation Strategy with Paul Randall from Speero
In this episode, we dive into Speero’s shift from CRO to Experiment-Led Growth, how they structure their testing systems, where to start with a new client, and what makes a good growth bet. Plus, we discuss the power of insights, the rise of EXL meetups and the future of Speero.Chapters----00:00…
more -
S4E33 - Building a Mature CRO Program with Achille Vaulot
This episode features Achille Vaulot, a CRO expert, discussing the evolution of conversion rate optimization (CRO) and the steps to building a mature program. He highlights the shift from basic A/B testing to a data-driven, strategic approach encompassing research, thorough analysis (including...
-
S4E32 - Navigating App Optimization with Ekaterina (Shpadareva) Gamsriegler
Ekaterina (Shpadareva) Gamsriegler, a seasoned growth and marketing expert, shared her insights on mobile app experimentation. Here are 5 key takeaways: Mobile experimentation is more complex: Release cycles are longer, and dependencies on app versions can slow down learning. Think beyond the…
more -
S4E31 - Building Your CRO Brand with Tracy Laranjo
Tracy Laranjo shares learnings from years of growing her career with Suchita Srinivasan, here are some key takeaways: 1. CRO vs Experimentation: CRO focuses on driving performance and results, while experimentation centers around decision-making and validating ideas. 2. Agency vs In-House…
more -
S4E30 - Have a narrow and well-defined ICP with Dr. Else van der Berg
This episode of Experiment Nation features an interview with Dr. Else van der Berg, a product management consultant for B2B SaaS startups and scale-ups. Dr. Else van der Berg discusses her process for helping companies become more outcome-driven, focusing on understanding the ideal customer…
more -
S4E29 - Product pages are the Grand Central Station of conversions with Rishi Rawat
We recently had the pleasure of chatting with Rishi, a Shopify product expert. Here are 5 key takeaways for optimizing your product pages: 1) Product pages are the Grand Central Station of conversions. They’re where buyers make the decision to buy or leave. 2) Pop-ups aren’t as effective as you...
-
S4E28 - Speak the language of Profit with Ilan Hurwitz
Black Friday is coming, and the pressure is on. But don’t worry, Ilan Hurwitz has some expert advice to help you navigate the chaos. Here are five key takeaways from his chat with Tracy Laranjo: 1) Start now! Don’t wait until the last minute to get buy-in and start testing. 2) Speak the language…
more -
S4E27 - Leadership buy-in is essential with Lukas Vermeer
Experimentation is a journey, not a destination. Don’t expect to build a culture of experimentation overnight. Cross-functional teams are critical. Breaking down silos and bringing together engineers, product managers, and designers will create a unified vision and drive faster iteration....
-
S4E26 - Uncovering Solution Bias with Iqbal Ali
In this podcast episode of Experiment Nation, hosted by Charlotte Bomford, guest Iqbal Ali, an experienced web designer, researcher, and comic book writer, discusses the concept of solution bias and the importance of identifying underlying problems before diving into solutions. Ali emphasizes…
more -
S4E25 - Optimizing organizational processes with Ruben de Boer
Ruben de Boer, a lead consultant at Online Dialogue and the founder of Conversion Ideas, shares his approach to conversion rate optimization (CRO) and experimentation. With 15 years of experience, Ruben emphasizes the importance of data-driven decision-making and understanding human behavior. He...
-
S4E24 - Growth cannot be siloed featuring Tymur Donets
Tymur Donets, a seasoned Growth PM and experimentation consultant, shared some powerful insights during his Experiment Nation talk. Here are five key takeaways: Growth PMs are holistic: Don’t be siloed! Growth PMs work across the entire customer journey, ensuring marketing and product teams are...
-
S4E23 - CRO isn’t just for marketers with Kelly Wortham
Kelly Wortham dropped some serious knowledge bombs in our recent Experiment Nation chat. Here’s what stood out: - CRO isn’t just for marketers: Lawyers, project managers, even developers can thrive in this field. It’s all about a love of learning and adaptability. - Don’t underestimate the power…
more -
S4E22 - Don’t rely on macro goals with Gursimran (Simar) Gujral
Simar, CEO and Founder of OptiPhoenix, shared invaluable insights on A/B testing and CRO at Experiment Nation. Here are 5 key takeaways: Don’t rely solely on macro goals: Micro goals reveal user behavior, driving better testing strategies and informing future hypotheses. Iterative testing trumps...
-
S4E21 - Navigating Experimentation at Startups with Avishek Basu Mallick
Avishek Basu Mallick, a Senior PM at CheapOair, talks about: - Experimentation at scale: Even with high traffic, rigorous experimentation is crucial. - Idea generation: User research, NPS surveys, and internal stakeholders are valuable sources of experiment ideas. - Communicating progress…
more -
S4E20 - People are the biggest challenge featuring Michael St Laurent
Michael St Laurent, a seasoned CRO expert, shared his insights on large-scale testing Here are 5 key takeaways for marketers: Prioritization is key: Large-scale testing requires prioritizing tests based on potential impact and aligning with overall business goals. AI is the future, but humans…
more -
S4E19 - Start Small and Stay Curious featuring Ellie Hughes
Ellie Hughes, a top CRO expert and Experimentor of the Year, shared some incredible insights in her recent Experiment Nation interview. Here are 5 takeaways to boost your experimentation game: - Start Small and Stay Curious: Ellie emphasizes that experimentation is a journey, not a destination....
-
S4E18 - Using measurement to test on low-traffic sites featuring Chris Mercer
Join us for a deep dive into conversion rate optimization on low-traffic sites with these actionable insights Chris Mercer Measure before optimizing: Understand the current user journey and behaviors to identify areas for improvement. Test sequentially: Iterate faster on low-traffic websites by...
-
S4E17 - Build a Learning Library featuring Nick Murphy
Discover the power of experimenting to learn and win! 💪 Nick Murphy shares his expertise on building learning libraries. Here are 5 key takeaways: - Learning libraries capture the “why” behind successful and unsuccessful tests. - Organize your learning library with consistent and digestible...
-
S4E16 - How To Build An Unstoppable Alliance With CX Feat. Courtney Leblanc
In this episode, senior customer experience leader, Courtney LeBlanc, reveals the ideal partnership between CX and experimenters and shares invaluable insights on: Forging powerful partnerships between CX and experimenters Navigating the daily demands of a CX leader Simplifying CX workflows with...
-
S4E15 - Product Experimentation: How to get Product Managers to Experiment ft. Shagun Aulakh
How do you get Product Managers to adopt Experimentation? Shagun Aulakh, the Director of Product Management - Experimentation at American Express shares with Rommil here tips. Here are just a few of the takeaways: 1- Leadership advocacy is critical for embedding experimentation practices in a...
-
S4E14 - AI and the Experimentation Lifecycle featuring Joey Herzberg
In this episode, we have Joey Herzberg who shares his thoughts on how AI fits in the experimentation life cycle, the utility of keeping easily referenced records of test results, and the importance of experimentation strategy with regard to sample ratios. This is a public episode. If you would…
more -
S4E13 - Use automation to build optimal flow states with Shawn David
Learn about human-first engineering in this in-depth interview where Shawn David discusses strategies to organize work and to break down tasks into smaller digestible sessions. He explained the most effective ways for teams to discover the work that should be automated the most by focusing on the...
-
S4E12 - Being Purpose-Driven in CRO: How to Focus on the Right Things featuring Jyoti Malik
Jyoti Malik, the founder of Blue Bagels, built a successful CRO agency by only working with ethical brands. In this chat with Tracy Laranjo, she shares: How to run CRO programs with purpose instead of random guesses - Her favourite underrated user research methods - Tips for creating a CRO…
more -
S4E11 - The Challenges of Building a Culture of Experimentation: Insights from Industry Leader Nima Yassini
Join Nima Yassini as he dives into experimentation culture, the journey of building a brand UX and digital marketing agency focused on conversion rate optimization, the integration of digital marketing and experimentation cultur, the struggles and benefits of adopting a culture of…
more -
S4E10 - Don't A/B Test?! featuring Solomon Kahn
CEO and founder of Decision Layer, Solomon Kahn chats with Rommil Santiago about why he thinks that most companies should not be A/B testing and shares what we should instead. He also discusses his recent debate with Ron Kohavi on LinkedIn on this same topic. Solomon's LinkedIn:...
-
S4E9 - Experiment Nation's 2024 CRO Salary Report and how to paid what you're worth with Tracy Laranjo
It's that time of year again! It's time for Experiment Nation's 2024 CRO Salary Report. In this episode, we explore some of the report's highlights with Tracy Laranjo as well as ask her for her thoughts on how CROs and Experimenters can get paid fairly. Find the CRO Salary report here:...
-
S4E8 - Always start by testing your best variation with Zach Lebovics
Zach Lebovics shares insights on experimentation and product management. He discusses the importance of documenting assumptions, testing the best-case scenario first, and understanding that experiment failure isn't solely tied to the outcome. Zach also shares personal experiences and learnings…
more -
S4E7 - Navigating Stakeholder Management and Gaining Buy-In with Shiva Manjunath
Shiva Manjanath, discusses with Ana Kerkovic the significance of collaboration with stakeholders and stakeholder management, optimizing CRO processes, transitioning from testing to experimentation, the impact of copy testing, and the need for research-backed strategies in CRO. Chapters…
more -
S4E6 - The truth about app development and optimization with Juliana Jackson
Media.Monk's Juliana Jackson shares the truth about app development, optimization, and how web and app should work together. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com
-
S4E5 -The power of CRO mentorship with Tracy Laranjo
Fractional Head of CRO, Tracy Laranjo talks about the power of Mentorship for Conversion Rate Optimizers (CROs). We cover: Why would CROs need mentorship? How do you find one? When are you ready to be a mentor and how do you get that word out? Would Tracy be a mentor for our listeners?...
-
S4E4 - Product Management vs. CRO with Bryce York
🔥 Check out this insightful interview with Bryce York, Director of Product Management at Tatari, on Experiment Nation’s Conference! Here are 5 key takeaways from the interview: The similarities and differences between CRO and product management. The importance of overlapping skills and work in...
-
S4E3 - Create a more impactful testing roadmap with this framework - ft. Edmund Beggs
Documentation. The unsung, yet incredibly important part of any experimentation program. Great documentation allows you to look back at past experiments and find patterns of what were the most effective levers to inform your testing roadmap and levers you probably can deprioritize. In today's...
-
S4E2 - How to learn from failures (from losing and winning tests) with Simon Girardin
🚀 Exciting Insights from Simon Girardin about learning from failure!🚀 📊 Takeaways from the conversation with Simon Girardin, CRO Program Manager at Conversion Advocates: 1️⃣ Speak Stakeholder Language: Report results in terms of uplifts, decreases, and revenue. Ensure clarity for stakeholders...
We're indexing this podcast's transcripts for the first time — this can take a minute or two. We'll show results as soon as they're ready.
No matches for "" in this podcast's transcripts.
No topics indexed yet for this podcast.
Loading reviews...
ABOUT THIS SHOW
Every week we share:- Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world- Conference sessions / TutorialsRecent recognition:- Top 10% of most followed Podcasts on Spotify
experimentnation.substack.com
HOSTED BY
Rommil from Experiment Nation
Loading similar podcasts...
Frequently Asked Questions
How many episodes does Experiment Nation: The Podcast have?
Experiment Nation: The Podcast currently has 185 episodes available on PodParley. New episodes are automatically indexed when they're published to the podcast feed.
What is Experiment Nation: The Podcast about?
Every week we share:- Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world- Conference sessions / TutorialsRecent recognition:- Top 10% of most followed Podcasts on Spotify experimentnation.substack.com
How often does Experiment Nation: The Podcast release new episodes?
Experiment Nation: The Podcast publishes regularly with 185 episodes available. Check the episode list for the typical release schedule.
Where can I listen to Experiment Nation: The Podcast?
You can listen to Experiment Nation: The Podcast on PodParley by clicking any episode. We provide an embedded audio player for direct listening, and you can also subscribe via your preferred podcast app using the RSS feed.
Who hosts Experiment Nation: The Podcast?
Experiment Nation: The Podcast is created and hosted by Rommil from Experiment Nation.
URL copied to clipboard!