Skip to content
Computational Neuroscience, Machine Learning vs. Biological Learning, Large Language Models | Marius Pachitariu | 235 episode artwork

Jun 26, 2025 1 hr 47 min

Computational Neuroscience, Machine Learning vs. Biological Learning, Large Language Models | Marius Pachitariu | 235

from Mind & Matter Podcast with Nick Jikomes, PhD: Biology, Nutrition and Health Science Hosted by Nick Jikomes

Wide release date: June 25, 2025 Episode Summary: Dr. Marius Pachitariu discusses how the brain computes information across scales, from single neurons to complex networks, using mice to study visual learning. He explains the differences between supervised and unsupervised learning, the brain’s high-dimensional processing, and how it compares to artificial neural networks like large language models. The conversation also covers experimental techniques, such as Neuropixels probes and calcium imaging, and the role of reward prediction errors in learning. About the guest: Marius Pachitariu, PhD is a group leader at the Janelia Research Campus, leading a lab focused on neuroscience with a blend of experimental and computational approaches. Discussion Points: * The brain operates at multiple scales, with single neurons acting as computational units and networks creating complex, high-dimensional computations. * Pachitariu’s lab uses advanced tools like calcium imaging to record from tens of thousands of neurons simultaneously in mice. * Unsupervised learning allows mice to form visual memories of environments without rewards, speeding up task learning later. * Brain activity during sleep or anesthesia is highly correlated, unlike the high-dimensional, less predictable patterns during wakefulness. * The brain expands sensory input dimensionality (e.g., from retina to visual cortex) to simplify complex computations, a principle also seen in artificial neural networks. * Reward prediction errors, driven by dopamine, signal when expectations are violated, aiding learning by updating internal models. * Large language models rely on self-supervised learning, predicting next words, but lack the forward-modeling reasoning humans excel at. Related episode: * M&M 44: Consciousness, Perception, Hallucinations, Selfhood, Neuroscience, Psychedelics & "Being You" | Anil Seth *Not medical advice. * Full audio version: [Apple] [Spotify] [Elsewhere] * Full video version: [YouTube] * Support M&M if you find value in this content. * Episode transcript below. Episode Chapters: 00:00:00 Intro00:05:25 Neural Computations & Scales00:13:30 Single Neuron Computations00:21:35 Network Dynamics & Complexity00:30:33 Recording Techniques & Tools00:39:32 Brain Efficiency & Metabolism00:47:30 Population Activity & Correlations00:56:10 High-Dimensional Brain Activity01:03:46 Supervised & Unsupervised Learning01:12:37 Experimental Paradigm & Mouse Behavior01:22:29 Visual Memory & Neural Changes01:34:58 LLMs & Brain Reasoning Comparison01:45:01 Closing Thoughts & Future Directions Full AI-generated transcript below. Beware of typos & mistranslations! Marius Pachitariu 1:36 Yeah, sure. Thanks for having me. I am a group leader at the Janila research campus. What that means is that I have a lab here. I've been here for eight years now. I'm not at a university. I'm at a research institute. We are funded through a charity. That means that I don't have some of the responsibilities that come with being a professor at university, so I can spend most of my time doing research, and that's what we've been doing. And I think we're here to talk about some of this research. Nick Jikomes 2:11 Yeah, yeah. And so what is your field of study? Would you say that you're a computational neuroscientist? What is your field that you're in now? But also, what's your background in terms of how you were trained? Marius Pachitariu 2:22 Yeah, I would say right now I am a neuroscientist. Period, I did certainly arrive here via computational neuroscience. It's not unusual for people in this field of neuroscience to need to have multiple kind of backgrounds, and they get here from all sorts of disciplines. In my case, I started with kind of a pure math undergraduate degree, and kind of transitioning slowly into more applied math. Then the Applied Math became computational neuroscience. Then the computational neuroscience mixed a little bit with machine learning in my PhD that I did at the Gatsby unit in London, and then eventually my post doc, I realized I can make more progress if I also do some of my own experiments. So that's when I actually picked up some experimental skills as well. Started doing experiments, and that just kept going in my lab, where I now have kind of a full complement of kind of experimental side to the lab and computational side to the lab, and everything else that's needed to run such such a lab. Nick Jikomes 3:31 And so what is your lab study at a high level? What are the kinds of neuroscience questions and the kinds of systems that you're working with, Marius Pachitariu 3:41 I would say, at the very highest level, maybe the lab studies just how network computations happen in the brain through kind of coordinated activity between all these neurons that we have in our heads, right? A lot of it, a lot of the complexity emerges from just the vastness of the neural networks that each of us has in their heads, but also that the animals that we study have in their heads something as, you know, small as a mouse, which is the organism that we Study, has, you know, more than a million neurons. And if you put that in perspective, that's actually more than some of the biggest neural networks that we have today, the artificial neural networks that we have today. And so a lot of the complexity arises from the kind of high dimensional nature of this system. And I would say that where our computational kind of skills come together with the experiments that we can do, is to really develop new methods to study such high dimensional systems, Nick Jikomes 4:55 before we get into like, some of your work, concretely, some of the recent research. Some of the tools and the methods and all that. Let's just talk at a high level about computational neuroscience, and neuroscience more generally, you said something earlier about network activity. Can you define for people who aren't familiar with neuroscience, or not intimately familiar, how do we think about things at different scales when we start to think about how neurons compute things and how information is encoded, going from individual neurons to circuits to networks. What do these things mean? Marius Pachitariu 5:25 Yeah, yeah, good. We can certainly start at a single neuron level, but one could start even below that, right? So like you said, there's multiple scales at which computation takes place. They all happen simultaneously, kind of all at once, and when we think of any one particular computation that eventually leads to something measurable, like I can reach my hand out to pick a cup, there was the effect of all these different scales and all these systems, kind of computing, you know, kind of propagating neural activity until it led to me reaching out my my hand. And so it starts at the level of single neurons, which are themselves computational devices. Single neurons are very small, right? Something like 1010s, of microns across, like a single cell. However, they have these processes that extend pretty far away relative to their sizes, their dendrites, their axons, those integrate all sorts of inputs from other neurons. This happens at very, very small, microscopic level. Synapses get triggered. Voltages inside of this neurons kind of accumulate this activity. Ion channels open and close. So a lot of stuff goes on and on and on until, kind of the output of this neuron, classically thought, is an action potential that travels down of its axon and then goes to kind of contact other neurons that are going to be receiving this message. And it's this property that makes it a network of neurons. Every neuron is connected to something like from 1000 to 10,000 other neurons, and of course, they're all kind of recurrently connected to each other. Not every neuron is connected to every other neuron, so the exact properties of which neurons connect to the to each other leads to this kind of dynamic of exchanging messages back and forth with action potentials, this kind of dynamic through the par… This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit mindandmatter.substack.com/subscribe

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Computational Neuroscience, Machine Learning vs. Biological Learning, Large Language Models | Marius Pachitariu | 235

0:00 1:47:48

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Mind & Matter Podcast with Nick Jikomes, PhD: Biology, Nutrition and Health Science?

This episode is 1 hour and 47 minutes long.

When was this Mind & Matter Podcast with Nick Jikomes, PhD: Biology, Nutrition and Health Science episode published?

This episode was published on June 26, 2025.

Can I download this Mind & Matter Podcast with Nick Jikomes, PhD: Biology, Nutrition and Health Science episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.