EPISODE · Aug 29, 2024 · 42 MIN
Metrics Driven Development (Practical AI #284)
How do you systematically measure, optimize, and improve the performance of LLM applications (like those powered by RAG or tool use)? Ragas is an open source effort that has been trying to answer this question comprehensively, and they are promoting a "Metrics Driven Development" approach. Shahul from Ragas joins us to discuss Ragas in this episode, and we dig into specific metrics, the difference between benchmarking models and evaluating LLM apps, generating synthetic test data and more.
Embed this episode
NOW PLAYING
Metrics Driven Development (Practical AI #284)
0:00
42:14
1×
No transcript for this episode yet
Similar Episodes
No similar episodes found.
Similar Podcasts
No similar podcasts found.
Frequently Asked Questions
How long is this episode of Changelog Master Feed?
This episode is 42 minutes long.
When was this Changelog Master Feed episode published?
This episode was published on August 29, 2024.
Is there a transcript available for this episode?
Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.
Can I download this Changelog Master Feed episode?
Yes. Use the download control on the episode player to save the publisher-provided media file.
URL copied to clipboard!