![Microsoft Research Podcast - Abstracts](https://cdn.statically.io/img/www.microsoft.com/en-us/research/uploads/prodnew/2024/07/Episode-12_Abstracts_Hero_Feature_No_Text_1400x788.jpg)
Abstracts: July 29, 2024
A lack of appropriate data, decreased model performance, and other obstacles have made it difficult to expand the input language models can receive. Li Lyna Zhang introduces LongRoPE, a method capable of extending content windows to more than 2 million tokens.