Skip to content
Personalized reasoning: just-in-time personalization and why LLMs fail at it episode artwork

Oct 5, 2025 14 min

Personalized reasoning: just-in-time personalization and why LLMs fail at it

from Best AI papers explained Hosted by Enoch H. Kang

This paper introduces the concept of personalized reasoning for Large Language Models (LLMs), defining it as the ability to dynamically discover user preferences through strategic questioning and adapt the underlying problem-solving logic accordingly. Current LLMs treat personalization as a sequential step, often failing to serve individual needs, especially in cold-start scenarios where no prior user data exists. To evaluate this capability, the authors introduce PREFDISCO, a new evaluation methodology that transforms existing benchmarks into interactive tasks using sparse, psychologically-grounded personas. Evaluation of frontier models using PREFDISCO reveals systematic failures in preference discovery, demonstrating a fundamental accuracy-personalization trade-off, particularly in mathematical reasoning, and highlighting the need for dedicated architectural development.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Personalized reasoning: just-in-time personalization and why LLMs fail at it

0:00 14:10

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Best AI papers explained?

This episode is 14 minutes long.

When was this Best AI papers explained episode published?

This episode was published on October 5, 2025.

Can I download this Best AI papers explained episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.