Evolving user intent understanding prediction [Udemy]

Episode 124 of the Snacks Weekly on Data Science podcast, hosted by Pan Wu, titled "Evolving user intent understanding prediction [Udemy]" was published on February 9, 2026 and runs 11 minutes.

February 9, 2026 ·11m · Snacks Weekly on Data Science

0:00 / 0:00

Summary

In this episode, we explore how Udemy tackled the tricky challenge of understanding learner intent in their AI Assistant — from a simple similarity-based embedding model, through experiments with larger models and fine-tuning, to a hybrid system that intelligently leverages both embeddings and large language model classification. This evolution demonstrates how real-world ML systems often require balancing accuracy, cost, latency, and user experience — especially in AI features that directly interact with users.For more details, you can refer to their published tech blog, linked here for your reference: https://medium.com/udemy-engineering/evolution-of-the-udemy-ai-assistant-intent-understanding-system-ec3ee0039364

Episode Description

In this episode, we explore how Udemy tackled the tricky challenge of understanding learner intent in their AI Assistant — from a simple similarity-based embedding model, through experiments with larger models and fine-tuning, to a hybrid system that intelligently leverages both embeddings and large language model classification. This evolution demonstrates how real-world ML systems often require balancing accuracy, cost, latency, and user experience — especially in AI features that directly interact with users.
For more details, you can refer to their published tech blog, linked here for your reference: https://medium.com/udemy-engineering/evolution-of-the-udemy-ai-assistant-intent-understanding-system-ec3ee0039364