A/B Testing vs. Multi-Armed Bandits: A Simulated Study [Vanguard]

Episode 103 of the Snacks Weekly on Data Science podcast, hosted by Pan Wu, titled "A/B Testing vs. Multi-Armed Bandits: A Simulated Study [Vanguard]" was published on September 15, 2025 and runs 10 minutes.

September 15, 2025 ·10m · Snacks Weekly on Data Science

0:00 / 0:00

Summary

In this episode, we explore how Vanguard evaluated standard A/B testing against multi-armed bandits for digital experimentation. Their simulated study showed that A/B testing is often the better choice when dealing with a small number of variations, while bandit strategies, such as Thompson Sampling, become more effective as the number of variations increases. The broader lesson is that experimentation design should always be context-aware—balancing simplicity, speed, and interpretability based on your business needs.For more details, you can refer to their published tech blog, linked here for your reference: https://medium.com/vanguard-technology/smarter-web-wins-a-b-testing-vs-multi-armed-bandits-unpacked-7f5032358513

Episode Description

In this episode, we explore how Vanguard evaluated standard A/B testing against multi-armed bandits for digital experimentation. Their simulated study showed that A/B testing is often the better choice when dealing with a small number of variations, while bandit strategies, such as Thompson Sampling, become more effective as the number of variations increases. The broader lesson is that experimentation design should always be context-aware—balancing simplicity, speed, and interpretability based on your business needs.

For more details, you can refer to their published tech blog, linked here for your reference: https://medium.com/vanguard-technology/smarter-web-wins-a-b-testing-vs-multi-armed-bandits-unpacked-7f5032358513

Share this episode

Similar Episodes

Lights! (Explaining Hanukkah & How Candles Work)

Dec 11, 2025 ·20m

The Neuroscience of Bad Guys & Superheroes!

Nov 12, 2025 ·19m

Playing Bad Guys!

Nov 4, 2025 ·16m

Disguises! (Halloween!)

Oct 8, 2025 ·31m

What's a Muppet? (Happy Birthday, Jim Henson!)

Sep 24, 2025 ·5m

Pirates! (Talk Like a Pirate Day!)

Sep 18, 2025 ·19m

Similar Podcasts

The B.S. Podcast Royal Bison Studios Brett and Sadie (B & S) are here to, well, BS about a variety of topics. Like rating their favorite midnight snacks, their all-time favorite Disney movies, and even pondering head-scratchers such as "Why do so many people love The Greatest Showman?" Catch new episodes weekly on all your favorite podcast platforms. The Yapp Session The Yapp Session hosted by Snacks and Pooba on UMSL radio On this podcast we have a weekly Yapping Session. We yapp about just about anything here like National Holidays, Current Events, Movies, Sports etc etc. You get the point we are here to Yapp. The yappers Snacks and Pooba will fill your daily word quota for you. You can find Snacks on Instagram @dezycapturesYou can find Pooba on Instagram @dylan.harrell22 Francophone Fridays Radio Laurier We are pleased to present the third season of Radio Laurier’s collaboration with the students from FR240: Media and the News in French. Francophone Fridays will broadcast weekly French language programming for students and community members at Laurier to listen to.Sit back and relax with your favourite drink or snack and celebrate French and Francophone culture with original programming created by this fantastic group of individuals.Tune in weekly on Fridays to some fantastic Francophone and French culture programming, ranging from interviews with artists, conversations amongst the students and biographical pieces on filmmakers, musicians and more. Chocolate Suburbia Podcast Chocolate Suburbia Podcast So let's be for real, this is Chocolate Suburbia. A weekly podcast hosted by Rianne and Carlene, 2 black sisters who currently live and have grown up in the suburbs in Wales. Created with the intention to speak our truths and opinions unapologetically, join us while we delve into touchy topics and stories about our experiences, while still trying to navigate ourselves in this world. So grab your snacks, sit back and welcome to Chocolate Suburbia!

URL copied to clipboard!