Skip to content
Creating tested, reliable AI applications episode artwork

Nov 13, 2024 50 min

Creating tested, reliable AI applications

from Practical AI Hosted by Daniel Whitenack and Chris Benson

It can be frustrating to get an AI application working amazingly well 80% of the time and failing miserably the other 20%. How can you close the gap and create something that you rely on? Chris and Daniel talk through this process, behavior testing, and the flow from prototype to production in this episode. They also talk a bit about the apparent slow down in the release of frontier models. Sponsors: Fly.io – The home of Changelog.com — Deploy your apps close to your users — global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes. Timescale – Purpose-built performance for AI Build RAG, search, and AI agents on the cloud and with PostgreSQL and purpose-built extensions for AI: pgvector, pgvectorscale, and pgai. You can try it for free for 30 days - but we’re confident you will not want to return it (we love ours). Once you experience AI-optimized sleep, you’ll wonder how you ever slept without it. Currently shipping to: United States, Canada, United Kingdom, Europe, and Australia. Featuring: Chris Benson – Website, GitHub, LinkedIn, X Daniel Whitenack – Website, GitHub, X Show Notes: MLOps Community “Agents in Production” event Upcoming Events: Register for upcoming webinars here!

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Creating tested, reliable AI applications

0:00 50:07

Chapters

  1. 0:00 Welcome to Practical AI
  2. 0:57 Sponsor: Fly
  3. 3:32 Thanksgiving preparations
  4. 4:57 Agents in production
  5. 6:27 AI ceiling & current hype
  6. 8:38 Level of transformation
  7. 10:49 Current models are mostly good enough
  8. 16:55 Sponsor: Timescale
  9. 19:34 Robust AI workflows
  10. 24:38 Finding the right workflow
  11. 30:46 Transition from notebook to code
  12. 34:06 Sponsor: Eight Sleep
  13. 36:44 Testing and integrating
  14. 40:06 Sketching out a good framework
  15. 47:23 Roles have shifted
  16. 49:20 Outro

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Practical AI?

This episode is 50 minutes long.

When was this Practical AI episode published?

This episode was published on November 13, 2024.

Can I download this Practical AI episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.