EPISODE · Jul 29, 2024 · 8 MIN
Abstracts: July 29, 2024
from Microsoft Research Podcast · host Researchers across the Microsoft research community
A lack of appropriate data, decreased model performance, and other obstacles have made it difficult to expand the input language models can receive. Li Lyna Zhang introduces LongRoPE, a method capable of extending content windows to more than 2 million tokens.Read the paperGet the code
NOW PLAYING
Abstracts: July 29, 2024
No transcript for this episode yet
Similar Episodes
Mar 26, 2026 ·1m
Jan 2, 2026 ·47m
Dec 21, 2025 ·46m