Skip to content
The Real E2E RAG Stack // Sam Bean, Rewind AI // #217 episode artwork

Mar 8, 2024 1 hr 10 min

The Real E2E RAG Stack // Sam Bean, Rewind AI // #217

from Agentic Conversations (formally mlops.community) Hosted by Demetrios

Thank you to Zilliz, our wonderful sponsors of this episode create some amazing stuff with Zilliz RAG - https://zilliz.com/vector-database-use-cases/llm-retrieval-augmented-generation Sam Bean is a seasoned AI and machine learning expert, specializing in Large Language Models (LLMs) and search tech. With a computer science background and a drive for innovation, Sam leads the team at Rewind AI in leveraging advanced tech to tackle complex challenges.MLOps podcast #217 with Sam Bean, Software Engineer (Applied AI) at Rewind.ai, The Real E2E RAG Stack. // Abstract What does a fully operational LLM + Search stack look like when you're running your own retrieval and inference infrastructure? What does the flywheel really mean for RAG applications? How do you maintain the quality of your responses? How do you prune/dedupe documents to maintain your document quality? // Bio Sam has been training, evaluating, and deploying production-grade inference solutions for language models for the past 2 years at You.com. Prior to that, he built personalization algorithms at StockX. // MLOps Jobs board jobs.mlops.community // MLOps Swag/Merch https://mlops-community.myshopify.com/ // Related Links Website: https://github.com/sam-h-bean/ REinforced Self Training (REST) - https://arxiv.org/pdf/2308.08998.pdf REST meets REACT - https://arxiv.org/pdf/2312.10003.pdf --------------- ✌️Connect With Us ✌️ ------------- Join our Slack community: https://go.mlops.community/slack Follow us on Twitter: @mlopscommunity Sign up for the next meetup: https://go.mlops.community/register Catch all episodes, blogs, newsletters, and more: https://mlops.community/ Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/ Connect with Sam on LinkedIn: https://www.linkedin.com/in/samuel-h-bean/ Timestamps: [00:00] Sam's preferred coffee [00:11] Takeaways [03:52] A competitive coding pinball player [07:18] Sam's MLOps journey [10:33] Search Challenges with ML [15:04] Expensive evaluation [21:04] Labeling Parties Boost Data Quality [24:10] Zeno's Paradox of Motion [25:51] Sam's job at Rewind AI [29:35] Multimodal RAG [30:59 - 32:06] Zilliz Ad [32:07] University of Prague paper leak [36:38] Signals behind the scenes [39:28] Content Over Metadata Approach [43:22] Optionality around evaluation and search [48:35] Incremental Robustness Building [51:33] Solid Foundations for Success [53:42] Production RAGs [1:00:06] Thoughts on DSPy [1:05:40] Using DSPy in Production [1:08:26] Wrap up

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

The Real E2E RAG Stack // Sam Bean, Rewind AI // #217

0:00 1:10:06

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Agentic Conversations (formally mlops.community)?

This episode is 1 hour and 10 minutes long.

When was this Agentic Conversations (formally mlops.community) episode published?

This episode was published on March 8, 2024.

Can I download this Agentic Conversations (formally mlops.community) episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.