Skip to content
Decoupling the "What" and "Where" With Polar Coordinate Positional Embeddings episode artwork

Mar 20, 2026 20 min

Decoupling the "What" and "Where" With Polar Coordinate Positional Embeddings

from Mechanical Dreams Hosted by Mechanical Dirk

In this episode: • Introduction: Linda and Professor Norris introduce the podcast and the focus of the episode: the PoPE paper. • The Problem with RoPE: A discussion on Rotary Position Embedding and how it entangles content and positional information. • Introducing PoPE: Linda explains the mathematical shift to polar coordinates to decouple the what and the where. • Empirical Triumphs: Reviewing the massive performance jump on the Indirect Indexing task, plus music, genomics, and language modeling. • Length Extrapolation and Conclusion: Analyzing PoPE's zero-shot length extrapolation capabilities compared to YaRN, followed by episode wrap-up.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Decoupling the "What" and "Where" With Polar Coordinate Positional Embeddings

0:00 20:28

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Mechanical Dreams?

This episode is 20 minutes long.

When was this Mechanical Dreams episode published?

This episode was published on March 20, 2026.

Is there a transcript available for this episode?

Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.

Can I download this Mechanical Dreams episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.