How GPT4All Built Open Source AI: Data Quality vs Fancy A...

What this episode covers

When one startup founder realized that fancy AI algorithms weren't the problem with modern AI systems, he discovered something way more unsettling: the data we're feeding these models is fundamentally broken. Quinn Palmer breaks down how Andriy Mulyar's journey with GPT4All exposed the dirty secret that's making AI hallucinate, and why fixing it might be impossible at scale. 🎯 What You'll Learn: • Why spurious correlations in training data cause more AI failures than bad algorithms • How medical AI applications demand 99.99% accuracy because one wrong answer kills patients • The surprising reason data quality now matters more than algorithmic sophistication • Why GPT4All's local-first approach might be our only defense against centralized AI control 👤 Perfect for: developers, creators, and anyone curious about what's really happening behind the AI hype without needing a computer science degree. 📍 Chapters: [00:00] Quinn Palmer introduces the GPT4All origin story [01:45] Why Andriy Mulyar started questioning mainstream AI development [03:30] The data quality crisis that's breaking modern AI systems [05:15] Medical AI's life-or-death accuracy requirements [07:00] How spurious correlations create dangerous AI hallucinations [09:30] GPT4All's radical bet on local AI without cloud dependence [11:15] What this means for the future of accessible AI 🔔 Never miss an episode: Follow Open Weights on Spotify or Apple Podcasts and turn on notifications. New episodes drop daily, your next AI breakthrough insight is one tap away. 🔍 Topics: AI, machine learning, GPT, data quality, neural networks, open source -------- Keywords: tech podcast, ai safety, generative ai, tech explained simply, coding ai, ai regulation Learn more about your ad choices. Visit megaphone.fm/adchoices

Share this episode

Similar Episodes

Episode 62: Cautionary Tales From A Linux Beginner (with Edward Crisler)

Mar 10, 2026 ·83m

Games For Everyone #2: Linux Gaming Is Winning

Feb 17, 2026 ·94m

Episode 61: Down The NAS Rabbit Hole (with Joe Ressington)

Jan 19, 2026 ·90m

Games For Everyone #1: Valve's Third Act

Jan 5, 2026 ·98m

Episode 60: The Computer Upcycle Project (with Mike Kelly)

Dec 22, 2025 ·85m

Episode 59: Valve’s ARM Gamble + The Future of Linux VR (with Graham Morrison)

Dec 8, 2025 ·56m

Similar Podcasts

NEWMORROW SESSIONS - A PodCast Series on the Future of Hospitality Mario C. Bauer, Florian Schneider, Axel Weber & Dr. Tillman Bardt The Newmorrow PodCast is more than a podcast — it's a platform for open dialog on the future of our business, a platform for those building what doesn’t exist yet. Here, we share and embrace our passion for the hospitality industry, but we won’t romanticize the journey. We ask the tough questions, confront uncomfortable truths, and prepare for a future that resists easy answers. We believe that the tougher and wilder times become, the more openly, honestly and humanely people need to talk to each other and act together. We believe, openness, togetherness, and truthfulness should also be cornerstones of a professional community to develop our utopian idea of „open source“. This is a space where visionaries don’t just imagine the future — they wrestle with the paradoxes that shape it: success vs. happiness, data vs. instinct, stability vs. reinvention. Join leaders, entrepreneurs, and thinkers as they share not what made them — but what’s actively shaping them, now and next. So tune in LE HAWKESBURY SOCIAL ’BACK TO LIFE’ ADAM STACEY Welcome to the ‘Le Hawkesbury Social’, 'Back to Life’ a space where we celebrate life in all its colors: happiness, joy, love, connection, and even the moments of sadness that make us human. A space where we celebrate life in all its colors: happiness, joy, love, connection, and even the moments of sadness that make us human. Hosted by a passionate mental health advocate, this show dives deep into the topics that truly matter to today’s culture and community. Each episode offers honest conversations, thoughtful reflections, and real stories that bring people together. Whether you’re here for mental health discussions, community connections, or just looking to feel seen and heard in a fast-paced world, you’re in the right place. Adam believes in building a diverse and inclusive community where voices from every background can come together, share, and support one another. That’s why every Wellness Podcast, we open the mic to local community partners, support services, and inspiring voi PMA: Sculpture Garden - Art Tours Philadelphia Museum of Art The Sculpture,Garden presents a superb and versatile outdoor setting for the appreciation of art, offering a lively experience of sculpture for both the casual passerby and devoted art lovers. Gracefully integrated into the existing landscape, the Sculpture,Garden extends the Museum’s vast galleries to the outdoors while strengthening the Museum’s connections to the city and Fairmount Park. Its pathways and vistas, green space, and water feature create a variety of spaces for art while maintaining an open setting that invites Philadelphia’s public to explore a new expression of the Museum’s goal to make more art available to an ever-growing audience. Linux For Everyone Jason Evangelho An upbeat, conversational show about the exciting world of desktop Linux, open source software, and the community creating it.

Frequently Asked Questions

How long is this episode of Open Weights?

This episode is 18 minutes long.

When was this Open Weights episode published?

This episode was published on February 24, 2026.

What is this episode about?

When one startup founder realized that fancy AI algorithms weren't the problem with modern AI systems, he discovered something way more unsettling: the data we're feeding these models is fundamentally broken. Quinn Palmer breaks down how Andriy...

Can I download this Open Weights episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.