Skip to content
Mamba & Jamba episode artwork

Apr 24, 2024 41 min

Mamba & Jamba

from Practical AI Hosted by Daniel Whitenack and Chris Benson

First there was Mamba… now there is Jamba from AI21. This is a model that combines the best non-transformer goodness of Mamba with good ‘ol attention layers. This results in a highly performant and efficient model that AI21 has open sourced! We hear all about it (along with a variety of other LLM things) from AI21’s co-founder Yoav. Sponsors: Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today. Featuring: Yoav Shoham – LinkedIn, X Chris Benson – Website, GitHub, LinkedIn, X Daniel Whitenack – Website, GitHub, X Show Notes: Jamba - A Groundbreaking SSM - Transformer Open Model AI21 Labs Upcoming Events: Register for upcoming webinars here!

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Mamba & Jamba

0:00 41:13

Chapters

  1. 0:00 Welcome to Practical AI
  2. 0:43 Introducing Yoav!
  3. 1:41 AI21's background
  4. 5:47 Enterprise use-cases
  5. 8:42 Deciding value
  6. 14:26 Sponsor: Changelog News
  7. 16:25 Architecting AI systems
  8. 19:38 Interacting with AIOS
  9. 22:08 Jamba heritage
  10. 24:46 Why switch architecture?
  11. 28:16 What it took to get here
  12. 32:39 Why go open source?
  13. 34:45 Jamba family innovation
  14. 37:04 Where is Jamba going?
  15. 39:36 Thanks AI21!
  16. 40:26 Outro

No transcript yet.

Requests help us decide what to transcribe next.

Share this episode

Similar podcasts

CISO Perspectives (public) N2K Networks This season on CISO Perspectives, host Kim Jones explores some of the challenges of leading through uncertainty. We explore the complexity of the changing nature of regulation and working with the federal government, the evolution of privacy and fraud, and how emerging technologies like AI and quantum computing are changing cyber. When you don’t know what questions to ask, you’re afraid to ask, or don’t know who to ask, CISO Perspectives provides the foundation for learning in this brave new world.

Frequently asked questions

How long is this episode of Practical AI?

This episode is 41 minutes long.

When was this Practical AI episode published?

This episode was published on April 24, 2024.

Can I download this Practical AI episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.