How Red Pajama is Building the First True Open Source AI Model episode artwork

EPISODE · Feb 25, 2026 · 15 MIN

How Red Pajama is Building the First True Open Source AI Model

from Open Weights · host Quinn Palmer

Meta's LLaMA model claims to be "open source," but here's the catch: you can't actually build a commercial product with it. Quinn Palmer breaks down why Red Pajama is about to change everything by creating the first truly open AI model that anyone can use without legal restrictions. 🎯 What You'll Learn: • Why Meta's "open" LLaMA license actually blocks commercial use (and what that means for developers) • How Together AI, ETH Zurich, and Stanford are rebuilding LLaMA from scratch with zero restrictions • The brutal math behind training GPT-4 level models: $10-100 million in compute costs • Red Pajama's three-stage strategy for creating genuinely open training data and base models 👤 Perfect for: developers, AI enthusiasts, and anyone wondering why true open source AI matters for the future of technology. 📍 Chapters: [00:00] Quinn Palmer reveals the LLaMA license loophole [01:45] What "truly open source" AI actually means [03:30] The massive collaboration behind Red Pajama [05:15] Breaking down the $100 million training cost reality [07:45] Why this could democratize AI development [09:30] What happens when anyone can build commercial AI products [11:15] Timeline and next steps for the project Red Pajama isn't just another AI model. It's potentially the foundation for thousands of AI products that couldn't exist under current licensing restrictions. This episode explains why that matters and how a coalition of universities and companies is making it happen. 🔔 Never miss an episode: Follow Open Weights on Spotify or Apple Podcasts and turn on notifications. New episodes drop daily - your next favorite insight is one tap away. 🔍 Topics: open source AI, LLaMA model, Red Pajama, machine learning, AI licensing, neural networks, commercial AI development --------------- Keywords: ai development, google ai, artificial intelligence explained, neural networks, ai trends, generative ai Learn more about your ad choices. Visit megaphone.fm/adchoices

Episode metadata supplied by the publisher feed · Published Feb 25, 2026

Embed this episode

Ready to play

How Red Pajama is Building the First True Open Source AI Model

0:00 15:43

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

No similar episodes found.

Frequently Asked Questions

How long is this episode of Open Weights?

This episode is 15 minutes long.

When was this Open Weights episode published?

This episode was published on February 25, 2026.

Can I download this Open Weights episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.
URL copied to clipboard!