Microsoft Research Podcast

Abstracts: July 29, 2024

July 29, 2024 | Gretchen Huizinga and Li Lyna Zhang
A lack of appropriate data, decreased model performance, and other obstacles have made it difficult to expand the input language models can receive. Li Lyna Zhang introduces LongRoPE, a method capable of extending content windows to more than 2 million tokens.

Recent Podcasts

  1. Microsoft Research Podcast - Abstracts

    Abstracts: July 29, 2024 

    July 29, 2024 | Gretchen Huizinga and Li Lyna Zhang

    A lack of appropriate data, decreased model performance, and other obstacles have made it difficult to expand the input language models can receive. Li Lyna Zhang introduces LongRoPE, a method capable of extending content windows to more than 2 million tokens.

  2. Microsoft Research Podcast - Abstracts

    Abstracts: July 18, 2024 

    July 18, 2024 | Gretchen Huizinga and Arindam Mitra

    Senior Researcher Arindam Mitra introduces AgentInstruct. Using raw data sources, the automated multi-agent framework can create diverse, high-quality synthetic data at scale for the post-training of small and large language models.

  3. Microsoft Research Podcast | What's Your Story | Weishung Liu

    What’s Your Story: Weishung Liu 

    May 30, 2024 | Johannes Gehrke and Weishung Liu

    Principal PM Manager Weishung Liu shares how a career delivering products and customer experiences aligns with her love of people and storytelling and how—despite efforts to defy the expectations that come with growing up in Silicon Valley—she landed in tech.

  4. Microsoft Research Podcast - Abstracts | May 20, 2024 | Andrey Kolobov

    Abstracts: May 20, 2024 

    May 20, 2024 | Andrey Kolobov and Gretchen Huizinga

    Andrey Kolobov discusses WindSeer, a small CNN capable of estimating the wind field around an sUAV in flight more finely and with less compute and data than traditional models. The advancement can help support longer and safer autonomous flights.

  5. Circle photo of Jacki O'Neill, director of the Microsoft Africa Research Institute (MARI), with a microphone in the corner on a blue and green gradient background

    What’s Your Story: Jacki O’Neill 

    May 16, 2024 | Johannes Gehrke and Jacki O'Neill

    Jacki O'Neill saw an opportunity to expand Microsoft research efforts to Africa. She now leads Microsoft Research Africa, Nairobi (formerly MARI). O'Neill talks about the choices that got her there, the lab’s impact, and how living abroad is good for innovation.

  6. Stylized microphone and sound waves illustration.

    Abstracts: May 6, 2024 

    May 6, 2024 | Michel Galley and Gretchen Huizinga

    Researcher Michel Galley explores how he and fellow researchers combined new and existing data to create MathVista, an open-source benchmark for measuring the mathematical reasoning capabilities of foundation models in scenarios that involve text and images.

  7. Stylized microphone and sound waves illustration.

    Abstracts: April 16, 2024 

    April 16, 2024 | Gretchen Huizinga and Tusher Chakraborty

    Tusher Chakraborty talks about the paper “Spectrumize: Spectrum-efficient Satellite Networks for the Internet of Things,” including a method for supporting communication between a large IoT-satellite constellation and devices on Earth within a limited spectrum.