EPISODE · Jul 29, 2024 · 8 MIN
Abstracts: July 29, 2024
from Microsoft Research Podcast · host Researchers across the Microsoft research community
A lack of appropriate data, decreased model performance, and other obstacles have made it difficult to expand the input language models can receive. Li Lyna Zhang introduces LongRoPE, a method capable of extending content windows to more than 2 million tokens.Read the paperGet the code
Embed this episode
NOW PLAYING
Abstracts: July 29, 2024
No transcript for this episode yet
Similar Episodes
No similar episodes found.
Similar Podcasts
No similar podcasts found.