The new AI app stack (Practical AI #236)
Recently a16z released a diagram showing the "Emerging Architectures for LLM Applications." In this episode, we expand on things covered in that diagram to a more general mental model for the new AI app stack. We cover a variety of things from model "middleware" for caching and control to app orchestration.
Embed this episode
Chapters
- 0:07 Welcome to Practical AI
- 0:43 Deep dive into LLMs
- 2:25 Emerging LLM app stack
- 4:35 Playgrounds
- 8:07 App Hosting
- 10:46 Stack orchestration
- 15:50 Maintenance breakdown
- 19:08 Sponsor: Changelog News
- 20:43 Vector databases
- 22:36 Embedding models
- 24:27 Benchmarks and measurements
- 26:59 Data & poor architecture
- 29:42 LLM logging
- 33:01 Middleware Caching
- 37:32 Validation
- 40:53 Key takeaways
- 42:36 Closing thoughts
- 44:23 Outro
No transcript yet.
Frequently asked questions
How long is this episode of Changelog Master Feed?
This episode is 45 minutes long.
When was this Changelog Master Feed episode published?
This episode was published on August 23, 2023.
Is there a transcript available for this episode?
Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.
Can I download this Changelog Master Feed episode?
Yes. Use the download control on the episode player to save the publisher-provided media file.