Machine's Learning

Can a model trained only on birdsong classify elephant calls — without any fine-tuning at all? A new paper from Geldenhuys and Niesler runs frozen-embedding transfer from bird-trained and speech-trained foundation models to African and Asian elephant calls, and gets within 2.2 percent of an end-to-end supervised baseline. Even more striking: the second layer of the network outperforms the final layer, and ten percent of the parameters do most of the work. Cross-domain parallel: the convergent evolution of vocal learning across songbirds, parrots, cetaceans, and elephants — different anatomies, different ecologies, similar architectural primitives.

When you ask a modern language model to "think step by step," it writes out intermediate reasoning before answering and tends to do better on hard problems. The field has been treating those written steps as the reasoning itself. A new position paper from Wenshuo Wang argues that the evidence currently favors a different picture: the real reasoning happens in the hidden internal states moving through the network's layers, and the chain of thought is more like a transcript — sometimes faithful, often not. The cross-domain parallel is Nisbett and Wilson's 1977 stocking experiment, where shoppers gave confident, articulate explanations for choices that were actually driven by something they never mentioned.

The dominant recipe for building capable language models is depth — more layers, more parameters, more distinct transformer blocks. A new mechanistic interpretability paper from Nam, Gromov, Yaida and colleagues looks at what happens when you take a much smaller model and run the same block over and over again in a loop. Inside, the internal state moves through cyclic trajectories that settle into fixed points; the attention heads stay consistent across iterations; each pass through the loop is doing the work that a separate layer would do in a traditional deep model. The cross-domain parallel: an assembly line versus a solo sculptor walking around the same piece of marble many times. The forward question is where capability actually lives — in the parameters, in the computation graph, or in the trajectory through state-space.

A puzzling result from a recent paper on multi-agent AI: more capable, reasoning-enabled language models cooperate LESS in social dilemmas than older, weaker ones. CoopEval takes the puzzle seriously and tests four classic mechanisms for restoring cooperation — repeated play, reputation, mediation, and binding contracts — across six modern LLMs. Without any mechanism, welfare collapses to 7% of optimal; contracts pull it back to 80%. The cross-domain parallel: this is, in miniature, the evolutionary story of human institutions under increasing scale, from small-band reciprocity to courts and contract law — and the gap that remains is the question of what 'binding' even means for an AI agent.

When AI agents play poker against each other, do they start modeling each other's minds the way humans do? A recent paper ran three Claude agents through a hundred hands of Texas Hold'em with a clean factorial design — memory present or absent, poker skill present or absent — and found a perfectly categorical result: agents with memory climbed a five-level ladder of theory-of-mind sophistication. Agents without memory stayed at level zero. Forever. Cross-domain parallel: human children develop theory of mind in a similar categorical jump between ages 3 and 4, and developmental psychologists have argued for forty years about what changes.

AI isn't just chatbots and agents. There are microphones in forests right now using machine learning to count chimpanzees, elephants, and rare birds — and that count is increasingly the basis for real money decisions about habitat conservation. Today we look at DeepForestSound, a region-specific acoustic detector for African tropical forests, and what it means when the detector layer becomes the measurement layer that markets depend on. Satellite remote sensing as the cross-domain parallel.

Last episode we talked about keeping AI agents from being attacked. Today we look at the failure mode that emerges when no one is attacking the agent at all — when the agent's own memory drifts over time through accumulated biased input. Memory misevolution as a path-dependent phenomenon, with institutional drift and the Overton window as the cross-domain parallel.

AI agents that can use tools — browse the web, read files, call APIs — face a serious vulnerability called indirect prompt injection. Today we look at ClawGuard, a runtime security framework that takes a different approach than training models to refuse: it sits between the AI and its tools, checking each action against rules the user has pre-approved. The shift from behavioral to architectural security, with hospital surgical safety checklists as the cross-domain parallel.