Abstracts: NeurIPS 2024 with Weizhu Chen

from Microsoft Research Podcast · host Researchers across the Microsoft research community

Next-token prediction trains a language model on all tokens in a sequence. VP Weizhu Chen discusses his team’s 2024 NeurIPS paper on how distinguishing between useful and “noisy” tokens in pretraining can improve token efficiency and model performance.Read the paperGet the code

Episode metadata supplied by the publisher feed · Published Dec 6, 2024

Embed this episode

Attribution link and audio player

NOW PLAYING

Abstracts: NeurIPS 2024 with Weizhu Chen

0:00 8:27

1×

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Share this episode

Similar Episodes

No similar episodes found.

Similar Podcasts

No similar podcasts found.

Frequently Asked Questions

How long is this episode of Microsoft Research Podcast?

This episode is 8 minutes long.

When was this Microsoft Research Podcast episode published?

This episode was published on December 6, 2024.

Is there a transcript available for this episode?

Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.

Can I download this Microsoft Research Podcast episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.

URL copied to clipboard!