EPISODE · Jan 30, 2026 · 15 MIN
GameTalk: Training LLMs for Strategic Multi-Turn Conversation
from Best AI papers explained · host Enoch H. Kang
This paper introduces **GameTalk**, a novel framework designed to train large language models (LLMs) for **strategic, multi-turn conversations**. While standard LLM training typically focuses on static, single-turn tasks, this research optimizes models to achieve **long-term goals** through complex interactions like negotiation and coordination. The authors adapt advanced fine-tuning methods—specifically **DPO, GRPO, and STaR**—to incorporate rewards based on the outcome of entire dialogues across various game environments. To diagnose and improve performance, the study utilizes three behavioral signals: **Internal State Evaluation**, **State-Relative Performance**, and **Leverage Opportunity**. Experimental results across games like Rock-Paper-Scissors and bargaining scenarios demonstrate that **DPO** is particularly effective at teaching models to use language as a persuasive tool. Ultimately, the framework shifts the focus of AI development toward **dynamic, goal-oriented reasoning** in interactive settings.
What this episode covers
This paper introduces **GameTalk**, a novel framework designed to train large language models (LLMs) for **strategic, multi-turn conversations**. While standard LLM training typically focuses on static, single-turn tasks, this research optimizes models to achieve **long-term goals** through complex interactions like negotiation and coordination. The authors adapt advanced fine-tuning methods—specifically **DPO, GRPO, and STaR**—to incorporate rewards based on the outcome of entire dialogues across various game environments. To diagnose and improve performance, the study utilizes three behavioral signals: **Internal State Evaluation**, **State-Relative Performance**, and **Leverage Opportunity**. Experimental results across games like Rock-Paper-Scissors and bargaining scenarios demonstrate that **DPO** is particularly effective at teaching models to use language as a persuasive tool. Ultimately, the framework shifts the focus of AI development toward **dynamic, goal-oriented reasoning** in interactive settings.
NOW PLAYING
GameTalk: Training LLMs for Strategic Multi-Turn Conversation
No transcript for this episode yet
Similar Episodes
Mar 31, 2026 ·54m
Mar 27, 2026 ·14m
Mar 24, 2026 ·42m
Mar 20, 2026 ·42m
Mar 17, 2026 ·41m
Mar 13, 2026 ·44m