How Red Pajama is Building the First True Open Source AI Model episode artwork

EPISODE · Feb 25, 2026 · 15 MIN

How Red Pajama is Building the First True Open Source AI Model

from Open Weights · host Quinn Palmer

Meta's LLaMA model claims to be "open source," but here's the catch: you can't actually build a commercial product with it. Quinn Palmer breaks down why Red Pajama is about to change everything by creating the first truly open AI model that anyone can use without legal restrictions. 🎯 What You'll Learn: • Why Meta's "open" LLaMA license actually blocks commercial use (and what that means for developers) • How Together AI, ETH Zurich, and Stanford are rebuilding LLaMA from scratch with zero restrictions • The brutal math behind training GPT-4 level models: $10-100 million in compute costs • Red Pajama's three-stage strategy for creating genuinely open training data and base models 👤 Perfect for: developers, AI enthusiasts, and anyone wondering why true open source AI matters for the future of technology. 📍 Chapters: [00:00] Quinn Palmer reveals the LLaMA license loophole [01:45] What "truly open source" AI actually means [03:30] The massive collaboration behind Red Pajama [05:15] Breaking down the $100 million training cost reality [07:45] Why this could democratize AI development [09:30] What happens when anyone can build commercial AI products [11:15] Timeline and next steps for the project Red Pajama isn't just another AI model. It's potentially the foundation for thousands of AI products that couldn't exist under current licensing restrictions. This episode explains why that matters and how a coalition of universities and companies is making it happen. 🔔 Never miss an episode: Follow Open Weights on Spotify or Apple Podcasts and turn on notifications. New episodes drop daily - your next favorite insight is one tap away. 🔍 Topics: open source AI, LLaMA model, Red Pajama, machine learning, AI licensing, neural networks, commercial AI development --------------- Keywords: ai development, google ai, artificial intelligence explained, neural networks, ai trends, generative ai Learn more about your ad choices. Visit megaphone.fm/adchoices

Meta's LLaMA model claims to be "open source," but here's the catch: you can't actually build a commercial product with it. Quinn Palmer breaks down why Red Pajama is about to change everything by creating the first truly open AI model that anyone can use without legal restrictions. 🎯 What You'll Learn: • Why Meta's "open" LLaMA license actually blocks commercial use (and what that means for developers) • How Together AI, ETH Zurich, and Stanford are rebuilding LLaMA from scratch with zero restrictions • The brutal math behind training GPT-4 level models: $10-100 million in compute costs • Red Pajama's three-stage strategy for creating genuinely open training data and base models 👤 Perfect for: developers, AI enthusiasts, and anyone wondering why true open source AI matters for the future of technology. 📍 Chapters: [00:00] Quinn Palmer reveals the LLaMA license loophole [01:45] What "truly open source" AI actually means [03:30] The massive collaboration behind Red Pajama [05:15] Breaking down the $100 million training cost reality [07:45] Why this could democratize AI development [09:30] What happens when anyone can build commercial AI products [11:15] Timeline and next steps for the project Red Pajama isn't just another AI model. It's potentially the foundation for thousands of AI products that couldn't exist under current licensing restrictions. This episode explains why that matters and how a coalition of universities and companies is making it happen. 🔔 Never miss an episode: Follow Open Weights on Spotify or Apple Podcasts and turn on notifications. New episodes drop daily - your next favorite insight is one tap away. 🔍 Topics: open source AI, LLaMA model, Red Pajama, machine learning, AI licensing, neural networks, commercial AI development --------------- Keywords: ai development, google ai, artificial intelligence explained, neural networks, ai trends, generative ai Learn more about your ad choices. Visit megaphone.fm/adchoices

NOW PLAYING

How Red Pajama is Building the First True Open Source AI Model

0:00 15:43

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

NEWMORROW SESSIONS - A PodCast Series on the Future of Hospitality Mario C. Bauer, Florian Schneider, Axel Weber & Dr. Tillman Bardt The Newmorrow PodCast is more than a podcast — it's a platform for open dialog on the future of our business, a platform for those building what doesn’t exist yet. Here, we share and embrace our passion for the hospitality industry, but we won’t romanticize the journey. We ask the tough questions, confront uncomfortable truths, and prepare for a future that resists easy answers. We believe that the tougher and wilder times become, the more openly, honestly and humanely people need to talk to each other and act together. We believe, openness, togetherness, and truthfulness should also be cornerstones of a professional community to develop our utopian idea of „open source“. This is a space where visionaries don’t just imagine the future — they wrestle with the paradoxes that shape it: success vs. happiness, data vs. instinct, stability vs. reinvention. Join leaders, entrepreneurs, and thinkers as they share not what made them — but what’s actively shaping them, now and next. So tune in LE HAWKESBURY SOCIAL ’BACK TO LIFE’ ADAM STACEY Welcome to the ‘Le Hawkesbury Social’, 'Back to Life’ a space where we celebrate life in all its colors: happiness, joy, love, connection, and even the moments of sadness that make us human. A space where we celebrate life in all its colors: happiness, joy, love, connection, and even the moments of sadness that make us human. Hosted by a passionate mental health advocate, this show dives deep into the topics that truly matter to today’s culture and community. Each episode offers honest conversations, thoughtful reflections, and real stories that bring people together. Whether you’re here for mental health discussions, community connections, or just looking to feel seen and heard in a fast-paced world, you’re in the right place. Adam believes in building a diverse and inclusive community where voices from every background can come together, share, and support one another. That’s why every Wellness Podcast, we open the mic to local community partners, support services, and inspiring voi PMA: Sculpture Garden - Art Tours Philadelphia Museum of Art The Sculpture,Garden presents a superb and versatile outdoor setting for the appreciation of art, offering a lively experience of sculpture for both the casual passerby and devoted art lovers. Gracefully integrated into the existing landscape, the Sculpture,Garden extends the Museum’s vast galleries to the outdoors while strengthening the Museum’s connections to the city and Fairmount Park. Its pathways and vistas, green space, and water feature create a variety of spaces for art while maintaining an open setting that invites Philadelphia’s public to explore a new expression of the Museum’s goal to make more art available to an ever-growing audience. Linux For Everyone Jason Evangelho An upbeat, conversational show about the exciting world of desktop Linux, open source software, and the community creating it.

Frequently Asked Questions

How long is this episode of Open Weights?

This episode is 15 minutes long.

When was this Open Weights episode published?

This episode was published on February 25, 2026.

What is this episode about?

Meta's LLaMA model claims to be "open source," but here's the catch: you can't actually build a commercial product with it. Quinn Palmer breaks down why Red Pajama is about to change everything by creating the first truly open AI model that anyone...

Can I download this Open Weights episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!