Generative models: exploration to deployment (Practical AI #240)
What is the model lifecycle like for experimenting with and then deploying generative AI models? Although there are some similarities, this lifecycle differs somewhat from previous data science practices in that models are typically not trained from scratch (or even fine-tuned). Chris and Daniel give a high level overview in this effort and discuss model optimization and serving.
Embed this episode
Chapters
- 0:07 Welcome to Practical AI
- 0:43 Daniel at GopherCon & IIC
- 3:31 Local inference & TDX
- 8:23 Cloudflare Workers AI
- 9:43 Implementing new models
- 16:14 Sponsor: Neo4j
- 17:11 Navigating HuggingFace
- 20:21 Model Sizes
- 24:34 Running the model
- 30:20 Model optimization
- 34:17 Cloud vs local
- 39:26 Cloud standardization
- 43:00 Open source go-to tools
- 46:21 Keep trying!
- 48:18 Outro
No transcript yet.
Frequently asked questions
How long is this episode of Changelog Master Feed?
This episode is 49 minutes long.
When was this Changelog Master Feed episode published?
This episode was published on October 3, 2023.
Is there a transcript available for this episode?
Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.
Can I download this Changelog Master Feed episode?
Yes. Use the download control on the episode player to save the publisher-provided media file.