Machine Learning Street Talk (MLST) cover art

All Episodes

Machine Learning Street Talk (MLST) — 261 episodes

#
Title
1

Designing How AI Grows — Tom McGrath

2

Stealing Reasoning Traces from Proprietary LLM APIs — Ilia Shumailov & Alexander Panfilov

3

Every Exponential Ends — Silicon Valley Forgot — Adam Becker

4

AI Is Learning at the Wrong Level of Abstraction — Matthieu Wyart

5

How Researchers Test AI for Hidden Goals — Apollo Research

6

Why a Nation Can't Outsource Its Frontier AI - Alistair Pullen (Cosine AI)

7

The Benchmark With No Instructions — ARC-AGI-3 (winning team!)

8

The Thermodynamic AI Computing Chip - Thomas Ahle

9

He won a Nobel here for AlphaFold. Then he left. - John Jumper

10

When AI Decides You're a Threat — Brad Carson

11

Intelligence is collective, not artificial — Prof. Michael I. Jordan (UC Berkeley / Inria)

12

The AI Models Smart Enough to Know They're Cheating — Beth Barnes & David Rein [METR]

13

When AI Discovers The Next Transformer - Robert Lange (Sakana)

14

"Vibe Coding is a Slot Machine" - Jeremy Howard

15

Evolution "Doesn't Need" Mutation - Blaise Agüera y Arcas

16

VAEs Are Energy-Based Models? [Dr. Jeff Beck]

17

Abstraction & Idealization: AI's Plato Problem [Mazviita Chirimuuta]

18

Why Every Brain Metaphor in History Has Been Wrong [SPECIAL EDITION]

19

Bayesian Brain, Scientific Method, and Models [Dr. Jeff Beck]

20

Your Brain is Running a Simulation Right Now [Max Bennett]

21

The 3 Laws of Knowledge [César Hidalgo]

22

"I Desperately Want To Live In The Matrix" - Dr. Mike Israetel

23

Making deep learning perform real algorithms with Category Theory (Andrew Dudzik, Petar Velichkovich, Taco Cohen, Bruno Gavranović, Paul Lessard)

24

Are AI Benchmarks Telling The Full Story? [SPONSORED] (Andrew Gordon and Nora Petrova - Prolific)

25

The Mathematical Foundations of Intelligence [Professor Yi Ma]

26

Pedro Domingos: Tensor Logic Unifies AI Paradigms

27

He Co-Invented the Transformer. Now: Continuous Thought Machines - Llion Jones and Luke Darlow [Sakana AI]

28

Why Humans Are Still Powering AI [Sponsored]

29

The Universal Hierarchy of Life - Prof. Chris Kempes [SFI]

30

Google Researcher Shows Life "Emerges From Code" - Blaise Agüera y Arcas

31

The Secret Engine of AI - Prolific [Sponsored] (Sara Saab, Enzo Blindow)

32

AI Agents Can Code 10,000 Lines of Hacking Tools In Seconds - Dr. Ilia Shumailov (ex-GDM)

33

New top score on ARC-AGI-2-pub (29.4%) - Jeremy Berman

34

Deep Learning is Not So Mysterious or Different - Prof. Andrew Gordon Wilson (NYU)

35

Karl Friston - Why Intelligence Can't Get Too Large (Goldilocks principle)

36

The Day AI Solves My Puzzles Is The Day I Worry (Prof. Cristopher Moore)

37

Michael Timothy Bennett: Defining Intelligence and AGI Approaches

38

Superintelligence Strategy (Dan Hendrycks)

39

DeepMind Genie 3 [World Exclusive] (Jack Parker Holder, Shlomi Fruchter)

40

Large Language Models and Emergence: A Complex Systems Perspective (Prof. David C. Krakauer)

41

Pushing compute to the limits of physics

42

The Fractured Entangled Representation Hypothesis (Kenneth Stanley, Akarsh Kumar)

43

The Fractured Entangled Representation Hypothesis (Intro)

44

Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)

45

How AI Learned to Talk and What It Means - Prof. Christopher Summerfield

46

"Blurring Reality" - Chai's Social AI Platform (SPONSORED)

47

Google AlphaEvolve - Discovering new science (exclusive interview)

48

Prof. Randall Balestriero - LLMs without pretraining and SSL

49

How Machines Learn to Ignore the Noise (Kevin Ellis + Zenna Tavares)

50

Eiso Kant (CTO poolside) - Superhuman Coding Is Coming!

51

The Compendium - Connor Leahy and Gabriel Alfour

52

ARC Prize v2 Launch! (Francois Chollet and Mike Knoop)

53

Test-Time Adaptation: the key to reasoning with DL (Mohamed Osman)

54

GSMSymbolic paper - Iman Mirzadeh (Apple)

55

Reasoning, Robustness, and Human Feedback in AI - Max Bartolo (Cohere)

56

Tau Language: The Software Synthesis Future (sponsored)

57

John Palazza - Vice President of Global Sales @ CentML ( sponsored)

58

Transformers Need Glasses! - Federico Barbero

59

Sakana AI - Chris Lu, Robert Tjarko Lange, Cong Lu

60

Clement Bonnet - Can Latent Program Networks Solve Abstract Reasoning?

61

Prof. Jakob Foerster - ImageNet Moment for Reinforcement Learning?

62

Daniel Franzen & Jan Disselhoff - ARC Prize 2024 winners

63

Sepp Hochreiter - LSTM: The Comeback Story?

64

Want to Understand Neural Networks? Think Elastic Origami! - Prof. Randall Balestriero

65

Nicholas Carlini (Google DeepMind)

66

Subbarao Kambhampati - Do o1 models search?

67

How Do AI Models Actually Think? - Laura Ruis

68

Jurgen Schmidhuber on Humans co-existing with AIs

69

Yoshua Bengio - Designing out Agency for Safe AI

70

Francois Chollet - ARC reflections - NeurIPS 2024

71

Jeff Clune - Agent AI Needs Darwin

72

Neel Nanda - Mechanistic Interpretability (Sparse Autoencoders)

73

Jonas Hübotter (ETH) - Test Time Inference

74

How AI Could Be A Mathematician's Co-Pilot by 2026 (Prof. Swarat Chaudhuri)

75

Nora Belrose - AI Development, Safety, and Meaning

76

Why Your GPUs are underutilised for AI - CentML CEO Explains

77

Eliezer Yudkowsky and Stephen Wolfram on AI X-risk

78

Pattern Recognition vs True Intelligence - Francois Chollet

79

The Elegant Math Behind Machine Learning - Anil Ananthaswamy

80

Michael Levin - Why Intelligence Isn't Limited To Brains.

81

Speechmatics CTO - Next-Generation Speech Recognition

82

Dr. Sanjeev Namjoshi - Active Inference

83

Joscha Bach - Why Your Thoughts Aren't Yours.

84

Decompiling Dreams: A New Approach to ARC? - Alessandro Palmarini

85

It's Not About Scale, It's About Abstraction - Francois Chollet

86

Bold AI Predictions From Cohere Co-founder

87

Open-Ended AI: The Key to Superhuman Intelligence? - Prof. Tim Rocktäschel

88

Ben Goertzel on "Superintelligence"

89

Taming Silicon Valley - Prof. Gary Marcus

90

Prof. Mark Solms - The Hidden Spring

91

Patrick Lewis (Cohere) - Retrieval Augmented Generation

92

Ashley Edwards - Genie Paper (DeepMind/Runway)

93

Cohere's SVP Technology - Saurabh Baji

94

David Hanson's Vision for Sentient Robots

95

The Fabric of Knowledge - David Spivak

96

Jürgen Schmidhuber - Neural and Non-Neural AI, Reasoning, Transformers, and LSTMs

97

"AI should NOT be regulated at all!" - Prof. Pedro Domingos

98

Adversarial Examples and Data Modelling - Andrew Ilyas (MIT)

99

Joscha Bach - AGI24 Keynote (Cyberanimism)

100

Gary Marcus' keynote at AGI-24

101

Is ChatGPT an N-gram model on steroids?

102

Jay Alammar on LLMs, RAG, and AI Engineering

103

Can AI therapy be more effective than drugs?

104

Prof. Subbarao Kambhampati - LLMs don't reason, they memorize (ICML2024 2/13)

105

Sayash Kapoor - How seriously should we take AI X-risk? (ICML 1/13)

106

Sara Hooker - Why US AI Act Compute Thresholds Are Misguided

107

Prof. Murray Shanahan - Machines Don't Think Like Us

108

David Chalmers - Reality+

109

Ryan Greenblatt - Solving ARC with GPT4o

110

Aiden Gomez - CEO of Cohere (AI's 'Inner Monologue' – Crucial for Reasoning)

111

New "50%" ARC result and current winners interviewed

112

Cohere co-founder Nick Frosst on building LLM apps for business

113

What’s the Magic Word? A Control Theory of LLM Prompting.

114

CAN MACHINES REPLACE US? (AI vs Humanity) - Maria Santacaterina

115

Dr. Thomas Parr - Active Inference Book

116

Connor Leahy - e/acc, AGI and the future.

117

Prof. Chris Bishop's NEW Deep Learning Textbook!

118

Philip Ball - How Life Works

119

Dr. Paul Lessard - Categorical/Structured Deep Learning

120

Can we build a generalist agent? Dr. Minqi Jiang and Dr. Marc Rigter

121

Prof. Nick Chater - The Language Game (Part 1)

122

Kenneth Stanley created a new social network based on serendipity and divergence

123

Dr. Brandon Rohrer - Robotics, Creativity and Intelligence

124

Showdown Between e/acc Leader And Doomer - Connor Leahy + Beff Jezos

125

Mahault Albarracin - Cognitive Science

126

$450M AI Startup In 3 Years | Chai AI

127

DOES AI HAVE AGENCY? With Professor. Karl Friston and Riddhi J. Pitliya

128

Understanding Deep Learning - Prof. SIMON PRINCE [STAFF FAVOURITE]

129

Prof. BERT DE VRIES - ON ACTIVE INFERENCE

130

MULTI AGENT LEARNING - LANCELOT DA COSTA

131

THE HARD PROBLEM OF OBSERVERS - WOLFRAM & FRISTON [SPECIAL EDITION]

132

DR. JEFF BECK - THE BAYESIAN BRAIN

133

Prof. Melanie Mitchell 2.0 - AI Benchmarks are Broken!

134

Autopoitic Enactivism and the Free Energy Principle - Prof. Friston, Prof Buckley, Dr. Ramstead

135

STEPHEN WOLFRAM 2.0 - Resolving the Mystery of the Second Law of Thermodynamics

136

Prof. Jürgen Schmidhuber - FATHER OF AI ON ITS DANGERS

137

Can We Develop Truly Beneficial AI? George Hotz and Connor Leahy

138

Dr. MAXWELL RAMSTEAD - The Physics of Survival

139

MUNK DEBATE ON AI (COMMENTARY) [DAVID FOSTER]

140

[SPONSORED] The Digitized Self: AI, Identity and the Human Psyche (YouAi)

141

Joscha Bach and Connor Leahy on AI risk

142

Neel Nanda - Mechanistic Interpretability

143

Prof. Daniel Dennett - Could AI Counterfeit People Destroy Civilization? (SPECIAL EDITION)

144

Decoding the Genome: Unraveling the Complexities with AI and Creativity [Prof. Jim Hughes, Oxford]

145

ROBERT MILES - "There is a good chance this kills everyone"

146

AI Senate Hearing - Executive Summary (Sam Altman, Gary Marcus)

147

Future of Generative AI [David Foster]

148

PERPLEXITY AI - The future of search.

149

#114 - Secrets of Deep Reinforcement Learning (Minqi Jiang)

150

Unlocking the Brain's Mysteries: Chris Eliasmith on Spiking Neural Networks and the Future of Human-Machine Interaction

151

#112 AVOIDING AGI APOCALYPSE - CONNOR LEAHY

152

#111 - AI moratorium, Eliezer Yudkowsky, AGI risk etc

153

#110 Dr. STEPHEN WOLFRAM - HUGE ChatGPT+Wolfram announcement!

154

#109 - Dr. DAN MCQUILLAN - Resisting AI

155

#108 - Dr. JOEL LEHMAN - Machine Love [Staff Favourite]

156

#107 - Dr. RAPHAËL MILLIÈRE - Linguistics, Theory of Mind, Grounding

157

#106 - Prof. KARL FRISTON 3.0 - Collective Intelligence [Special Edition]

158

#105 - Dr. MICHAEL OLIVER [CSO - Numerai]

159

#104 - Prof. CHRIS SUMMERFIELD - Natural General Intelligence [SPECIAL EDITION]

160

#103 - Prof. Edward Grefenstette - Language, Semantics, Philosophy

161

#102 - Prof. MICHAEL LEVIN, Prof. IRINA RISH - Emergence, Intelligence, Transhumanism

162

#100 Dr. PATRICK LEWIS (co:here) - Retrieval Augmented Generation

163

#99 - CARLA CREMER & IGOR KRAWCZUK - X-Risk, Governance, Effective Altruism

164

[NO MUSIC] #98 - Prof. LUCIANO FLORIDI - ChatGPT, Singularitarians, Ethics, Philosophy of Information

165

#98 - Prof. LUCIANO FLORIDI - ChatGPT, Superintelligence, Ethics, Philosophy of Information

166

#97 SREEJAN KUMAR - Human Inductive Biases in Machines from Language

167

#96 Prof. PEDRO DOMINGOS - There are no infinities, utility functions, neurosymbolic

168

#95 - Prof. IRINA RISH - AGI, Complex Systems, Transhumanism

169

#94 - ALAN CHAN - AI Alignment and Governance #NEURIPS

170

#93 Prof. MURRAY SHANAHAN - Consciousness, Embodiment, Language Models

171

#92 - SARA HOOKER - Fairness, Interpretability, Language Models

172

#91 - HATTIE ZHOU - Teaching Algorithmic Reasoning via In-context Learning #NeurIPS

173

(Music Removed) #90 - Prof. DAVID CHALMERS - Consciousness in LLMs [Special Edition]

174

#90 - Prof. DAVID CHALMERS - Consciousness in LLMs [Special Edition]

175

#88 Dr. WALID SABA - Why machines will never rule the world [UNPLUGGED]

176

#86 - Prof. YANN LECUN and Dr. RANDALL BALESTRIERO - SSL, Data Augmentation, Reward isn't enough [NEURIPS2022]

177

#85 Dr. Petar Veličković (Deepmind) - Categories, Graphs, Reasoning [NEURIPS22 UNPLUGGED]

178

#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]

179

#83 Dr. ANDREW LAMPINEN (Deepmind) - Natural Language, Symbols and Grounding [NEURIPS2022 UNPLUGGED]

180

#82 - Dr. JOSCHA BACH - Digital Physics, DL and Consciousness [UNPLUGGED]

181

#81 JULIAN TOGELIUS, Prof. KEN STANLEY - AGI, Games, Diversity & Creativity [UNPLUGGED]

182

#80 AIDAN GOMEZ [CEO Cohere] - Language as Software

183

#79 Consciousness and the Chinese Room [Special Edition] (CHOLLET, BISHOP, CHALMERS, BACH)

184

MLST #78 - Prof. NOAM CHOMSKY (Special Edition)

185

#77 - Vitaliy Chiley (Cerebras)

186

#76 - LUKAS BIEWALD (Weights and Biases CEO)

187

#75 - Emergence [Special Edition] with Dr. DANIELE GRATTAROLA

188

#74 Dr. ANDREW LAMPINEN - Symbolic behaviour in AI [UNPLUGGED]

189

#73 - YASAMAN RAZEGHI & Prof. SAMEER SINGH - NLP benchmarks

190

#72 Prof. KEN STANLEY 2.0 - On Art and Subjectivity [UNPLUGGED]

191

#71 - ZAK JOST (Graph Neural Networks + Geometric DL) [UNPLUGGED]

192

#70 - LETITIA PARCALABESCU - Symbolics, Linguistics [UNPLUGGED]

193

#69 DR. THOMAS LUX - Interpolation of Sparse High-Dimensional Data

194

#68 DR. WALID SABA 2.0 - Natural Language Understanding [UNPLUGGED]

195

#67 Prof. KARL FRISTON 2.0

196

#66 ALEXANDER MATTICK - [Unplugged / Community Edition]

197

#65 Prof. PEDRO DOMINGOS [Unplugged]

198

#64 Prof. Gary Marcus 3.0

199

#063 - Prof. YOSHUA BENGIO - GFlowNets, Consciousness & Causality

200

#062 - Dr. Guy Emerson - Linguistics, Distributional Semantics

201

061: Interpolation, Extrapolation and Linearisation (Prof. Yann LeCun, Dr. Randall Balestriero)

202

#60 Geometric Deep Learning Blueprint (Special Edition)

203

#59 - Jeff Hawkins (Thousand Brains Theory)

204

#58 Dr. Ben Goertzel - Artificial General Intelligence

205

#57 - Prof. Melanie Mitchell - Why AI is harder than we think

206

#56 - Dr. Walid Saba, Gadi Singer, Prof. J. Mark Bishop (Panel discussion)

207

#55 Self-Supervised Vision Models (Dr. Ishan Misra - FAIR).

208

#54 Gary Marcus and Luis Lamb - Neurosymbolic models

209

#53 Quantum Natural Language Processing - Prof. Bob Coecke (Oxford)

210

#52 - Unadversarial Examples (Hadi Salman, MIT)

211

#51 Francois Chollet - Intelligence and Generalisation

212

#50 Christian Szegedy - Formal Reasoning, Program Synthesis

213

#49 - Meta-Gradients in RL - Dr. Tom Zahavy (DeepMind)

214

#48 Machine Learning Security - Andy Smith

215

047 Interpretable Machine Learning - Christoph Molnar

216

#046 The Great ML Stagnation (Mark Saroufim and Dr. Mathew Salvaris)

217

#045 Microsoft's Platform for Reinforcement Learning (Bonsai)

218

#044 - Data-efficient Image Transformers (Hugo Touvron)

219

#043 Prof J. Mark Bishop - Artificial Intelligence Is Stupid and Causal Reasoning won't fix it.

220

#042 - Pedro Domingos - Ethics and Cancel Culture

221

#041 - Biologically Plausible Neural Networks - Dr. Simon Stringer

222

#040 - Adversarial Examples (Dr. Nicholas Carlini, Dr. Wieland Brendel, Florian Tramèr)

223

#039 - Lena Voita - NLP

224

#038 - Professor Kenneth Stanley - Why Greatness Cannot Be Planned

225

#037 - Tour De Bayesian with Connor Tann

226

#036 - Max Welling: Quantum, Manifolds & Symmetries in ML

227

#035 Christmas Community Edition!

228

#034 Eray Özkural- AGI, Simulations & Safety

229

#033 Prof. Karl Friston - The Free Energy Principle

230

#032- Simon Kornblith / GoogleAI - SimCLR and Paper Haul!

231

#031 WE GOT ACCESS TO GPT-3! (With Gary Marcus, Walid Saba and Connor Leahy)

232

#030 Multi-Armed Bandits and Pure-Exploration (Wouter M. Koolen)

233

#029 GPT-3, Prompt Engineering, Trading, AI Alignment, Intelligence

234

NLP is not NLU and GPT-3 - Walid Saba

235

AI Alignment & AGI Fire Alarm - Connor Leahy

236

Kaggle, ML Community / Engineering (Sanyam Bhutani)

237

Sara Hooker - The Hardware Lottery, Sparsity and Fairness

238

The Social Dilemma Part 3 - Dr. Rebecca Roache

239

The Social Dilemma - Part 1

240

Capsule Networks and Education Targets

241

Programming Languages, Software Engineering and Machine Learning

242

Computation, Bayesian Model Selection, Interactive Articles

243

Kernels!

244

Explainability, Reasoning, Priors and GPT-3

245

SWaV: Unsupervised Learning of Visual Features by Contrasting Cluster Assignments (Mathilde Caron)

246

UK Algoshambles, Neuralink, GPT-3 and Intelligence

247

Sayak Paul

248

Robert Lange on NN Pruning and Collective Intelligence

249

WelcomeAIOverlords (Zak Jost)

250

Facebook Research - Unsupervised Translation of Programming Languages

251

Francois Chollet - On the Measure of Intelligence

252

OpenAI GPT-3: Language Models are Few-Shot Learners

253

Jordan Edwards: ML Engineering and DevOps on AzureML

254

One Shot and Metric Learning - Quadruplet Loss (Machine Learning Dojo)

255

Harri Valpola: System 2 AI and Planning in Model-Based Reinforcement Learning

256

ICLR 2020: Yoshua Bengio and the Nature of Consciousness

257

ICLR 2020: Yann LeCun and Energy-Based Models

258

The Lottery Ticket Hypothesis with Jonathan Frankle

259

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

260

CURL: Contrastive Unsupervised Representations for Reinforcement Learning

261

Exploring Open-Ended Algorithms: POET