Skip to content
Practical workflow orchestration episode artwork

Oct 15, 2024 58 min

Practical workflow orchestration

from Practical AI Hosted by Daniel Whitenack and Chris Benson

Workflow orchestration has always been a pain for data scientists, but this is exacerbated in these AI hype days by agentic workflows executing arbitrary (not pre-defined) workflows with a variety of failure modes. Adam from Prefect joins us to talk through their open source Python library for orchestration and visibility into python-based pipelines. Along the way, he introduces us to things like Marvin, their AI engineering framework, and ControlFlow, their agent workflow system. Sponsors: WorkOS – A platform that gives developers a set of building blocks for quickly adding enterprise-ready features to their application. Add Single Sign-On (Okta, Azure, Google, Microsoft OAuth), sync users from any SCIM directory, HRIS integration, audit trails (SIEM), free magic link sign-in. WorkOS is designed for developers and offers a single, elegant interface that abstracts dozens of enterprise integrations. Learn more and get started at WorkOS.com Shopify – Sign up for a $1/month trial period at shopify.com/practicalai Notion – Notion is a place where any team can write, plan, organize, and rediscover the joy of play. It’s a workspace designed not just for making progress, but getting inspired. Notion is for everyone — whether you’re a Fortune 500 company or freelance designer, starting a new startup or a student juggling classes and clubs. Featuring: Adam Azzam – LinkedIn, X Chris Benson – Website, GitHub, LinkedIn, X Daniel Whitenack – Website, GitHub, X Show Notes: Prefect Marvin ControlFlow Upcoming Events: Register for upcoming webinars here!

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Practical workflow orchestration

0:00 58:24

Chapters

  1. 0:00 Welcome to Practical AI
  2. 0:35 Sponsor: WorkOS
  3. 4:08 Workflow orchestration
  4. 9:32 Common pain points
  5. 14:37 What makes ML orchestration different
  6. 20:57 Sponsor: Shopify
  7. 22:45 Intro to Prefect
  8. 29:52 Conversion experience
  9. 37:24 Sponsor: Notion
  10. 39:43 Adam's friend Marvin
  11. 44:32 Agentic approach
  12. 51:50 What's next?
  13. 57:01 Thanks for joining us
  14. 57:37 Outro

No transcript yet.

Requests help us decide what to transcribe next.

Share this episode

Similar podcasts

CISO Perspectives (public) N2K Networks This season on CISO Perspectives, host Kim Jones explores some of the challenges of leading through uncertainty. We explore the complexity of the changing nature of regulation and working with the federal government, the evolution of privacy and fraud, and how emerging technologies like AI and quantum computing are changing cyber. When you don’t know what questions to ask, you’re afraid to ask, or don’t know who to ask, CISO Perspectives provides the foundation for learning in this brave new world.

Frequently asked questions

How long is this episode of Practical AI?

This episode is 58 minutes long.

When was this Practical AI episode published?

This episode was published on October 15, 2024.

Can I download this Practical AI episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.