Irina Rish | AI & Scale - Foresight Institute Radio

What this episode covers

How has the history of AI been shaped by the "bitter lesson" that simple scaling beats complex algorithms, and what comes next? In this talk, Irina Rish traces AI's evolution from rule-based systems to today's foundation models, exploring how scaling laws predicted performance improvements and recent shifts toward more efficient approaches. She covers the progression from GPT scaling laws to Chinchilla's compute-optimal training, the rise of inference-time computation with models like OpenAI's o1, and why we might need to move beyond transformers to truly brain-inspired dynamical systems.Irina Rish is a professor at the University of Montreal and Mila Quebec AI Institute. She also co-founded a startup focused on developing more efficient foundation models and recently released a suite of open-source compressed models.This talk was recorded at Vision Weekend Puerto Rico 2025. To see the slides and more talks from the event, please visit our YouTube channel. Hosted on Acast. See acast.com/privacy for more information.

Share this episode

Similar Episodes

No similar episodes found.

Similar Podcasts

The Professionals Infosys Knowledge Institute Lawyers, accountants, and consultants reveal their secrets to success and discuss future trends in The Professionals, an Infosys Knowledge Institute podcast. Hosted by Samad Masood, a former journalist and industry analyst with more than 20 years experience observing this dynamic and ever growing industry. La Corrobra Canal Extremadura El espacio de la radio pública que pone en valor las lenguas autóctonas de Extremadura: el estremeñu, la fala y el portugués rayano.Con Juan Pedro Sánchez. Radio Maria Kenya Radio Maria Kenya A Christian voice in Kenya and in the World The Brackenfield Records Anvil Audio Productions An off-beat homage to classic radio detectives of the 1940s and '50s, The Brackenfield Records offers comforting genre fare, sitting somewhere between cosy and hard-boiled crime fiction.Whether it's dealing with unfaithful spouses, off-the-rails celebrities, crooked businesspeople, or gun-toting no-gooders, Brackenfield never falters!

Frequently Asked Questions

How long is this episode of Foresight Institute Radio?

This episode is 12 minutes long.

When was this Foresight Institute Radio episode published?

This episode was published on June 11, 2025.

What is this episode about?

How has the history of AI been shaped by the "bitter lesson" that simple scaling beats complex algorithms, and what comes next? In this talk, Irina Rish traces AI's evolution from rule-based systems to today's foundation models, exploring how...

Can I download this Foresight Institute Radio episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.