Deep Learning With The Wolf

Jason Roche first sensed something was off when the essays began arriving in unusually pristine form.“I just started realizing wow, this is really nicely written,” he told me. “I didn’t realize and then I started saying wait a second. This looks eerily similar to this [other] student’s report.”The shift was subtle at first, then unmistakable. It was 2023, and ChatGPT had quietly entered the academic bloodstream.Students were pasting assignment prompts into the chatbot and submitting what it produced. The prose was coherent, confident, and grammatically sound. It often read as if it had been drafted by someone just slightly more polished than the student who turned it in. And yet something was missing.“Oftentimes very general, not precisely answering the questions as they were written,” Roche said.Roche, an associate professor of communication studies at the University of Detroit Mercy, does not consider himself a technophobe. He teaches media. He experiments with new tools. But he recognized that this was not merely another productivity aid. It altered the basic relationship between effort and outcome.For a brief moment, he believed he could stay one step ahead.The Ozzy Osbourne TestAt first, Roche relied on instinct. The essays were polished, almost too polished, and they shared a curious sameness of tone. But suspicion alone would not hold up in a grade dispute. He needed proof.After consulting a colleague in cybersecurity, he devised a quiet experiment. He embedded hidden instructions in white font within his assignment documents, invisible to students reading the page but visible to AI systems parsing the full text.One assignment asked students to analyze deepfake videos. Buried within it was a directive to include a discussion of Ozzy Osbourne’s Bark at the Moon album cover.The album, of course, has nothing to do with deepfakes.“And so sure enough, I would see these essays with reference to Ozzy Osbourne’s album cover and I’m like, yep, they’re using it. They’re not doing their own work, and so they had to fail.”For a time, the strategy worked. Essays arrived complete with heavy metal detours, uncritically inserted by students who had never noticed the hidden instruction. The trap had confirmed what he suspected.But the advantage was temporary. As generative models improved, they began flagging the embedded text themselves.“Now, the models say: ‘This appears to be something different from the assignment.’”The software had learned to recognize the trick. And so Roche, like many educators navigating this new terrain, adjusted his strategy again.The Blue Book CounteroffensiveIn response, Roche did something that would have seemed regressive only a few years ago.He went back to paper.“I used to do a lot of my quizzes online using the Learning Management System known as Blackboard,” he said. “But, this year, I switched back to paper in the classroom quizzes.”The change was immediate and measurable.“I found that the grades have dropped by at least 50 %.”The explanation was not mysterious. Online quizzes had quietly allowed students to consult generative tools while completing assignments. Paper did not.What surprised him more than the drop in scores was the reaction.“They’re coming up to me all nervous, like, wait, how do I study for this when I read the chapter?”The question revealed something deeper than exam anxiety. It suggested a rupture in study habits themselves. Without search bars, summaries, or instant clarification from a chatbot, students were left alone with the text.Roche’s advice sounded almost antique: read it through once, then go back and highlight key passages. Take notes. Sit with it.It was not a new method. It was the old one. But in the absence of digital scaffolding, it felt unfamiliar, as if the mechanics of learning had to be rediscovered.“Whoever Does the Work Does the Learning”Roche often returns to a phrase he first heard through his university’s teaching center, a line that has taken on new weight in the age of generative AI.“Whoever does the work does the learning.”The sentence sounds almost self-evident, the kind of pedagogical truism that rarely requires defense. Yet a substantial body of cognitive research gives it empirical grounding. In 1978, psychologists Norman Slamecka and Peter Graf demonstrated what became known as the “generation effect”: individuals remember information more reliably when they produce it themselves rather than simply read it. Subsequent work by Robert and Elizabeth Bjork on “desirable difficulties” further showed that effortful processing, the kind that feels slower and more demanding in the moment, strengthens long-term retention and transfer.Learning, in other words, is not merely exposure to information. It is the act of grappling with it.Generative AI complicates this equation. It does not remove effort from the system; it shifts where that effort occurs. The machine parses, synthesizes, drafts. The student reviews, edits, perhaps lightly reshapes.What becomes uncertain is where the intellectual strain resides. And if cognitive growth depends on that strain, the question is no longer whether AI is efficient, but whether the efficiency comes at the cost of the very process that makes learning durable.Is It Time to Unplug Classrooms?It would be tempting to frame this as simply another chapter in the ChatGPT saga. A new tool appears, students misuse it, professors adapt. The familiar cycle of technological disruption.But Roche said something during our conversation that shifted the scale of the question.“I think universities might have to create insulated classrooms that are completely cut off from the internet unless you’re plugged into a cable. So they can’t get their signal on their smart glasses. They can’t get their signal on a watch to look something up. And they’re going to have to do the work without access to the internet. I think that could be something that we have to go to.”He was not describing a policy tweak or a new paragraph in a syllabus. He was describing infrastructure. Walls that block signals. Rooms designed not for connectivity, but for its absence.An insulated classroom is more than a disciplinary measure. It is an architectural acknowledgment that constant access may be incompatible with certain kinds of thinking.And once you follow that logic, the story no longer belongs to one professor or one campus. It becomes part of a broader reconsideration of what a learning environment is supposed to provide: unlimited information, or protected attention.The Global ReversalAcross Europe, governments are pulling back from screen-saturated schooling.🇳🇱 NetherlandsAs of January 2024, the Dutch government implemented a nationwide ban on mobile phones and most smart devices in secondary school classrooms. A government evaluation reported that 75 percent of secondary schools observed improved student focus after the ban, and 28 percent reported improved academic outcomes. (Source: Dutch Ministry of Education evaluation, reported in The Guardian, July 2025.)🇫🇮 FinlandFinland passed legislation restricting mobile phone use during the school day, allowing devices only with explicit teacher permission or for health reasons, citing concerns about concentration and classroom environment. (Source: Finnish Parliament education reforms, reported April 2025.)🇸🇪 SwedenSweden has committed to implementing a nationwide mobile phone ban in compulsory schools starting in 2026, alongside increased investment in printed textbooks and structured reading time. Swedish officials have explicitly described earlier screen-heavy policies as a miscalculation. (Source: Swedish Ministry of Education announcements, 2025.)OECD DataThe Organisation for Economic Co-operation and Development (OECD) reported in its 2024 working paper Students, Digital Devices, and Success that frequent digital distractions during class are associated with lower performance in mathematics across PISA-participating countries. The OECD does not call for blanket bans but acknowledges that limiting distractions can support learning outcomes.The larger pattern is unmistakable.After a decade of 1:1 devices, always-on platforms, and pandemic-forced virtual schooling, multiple countries are recalibrating.Not abandoning technology.Rebalancing it.Pandemic Learning Loss and Screen SaturationThe U.S. National Assessment of Educational Progress (NAEP) reported significant declines in math and reading scores following pandemic-era remote learning. There is a new scrutiny about fully online learning models.Meanwhile, meta-analyses of mobile phone use in classrooms across European systems have found consistent associations between in-class phone access and lower academic outcomes.None of this proves that screens cause cognitive decline.But it does undermine the once-unquestioned assumption that more technology automatically improves learning.The Dual-Track FutureAnd yet Roche is not calling for a technological purge. He is not nostalgic for chalk dust or hostile to innovation. If anything, his proposal is more structured than reactionary.If he were designing a university from scratch, he said, he would preserve the classical core.“I would kind of want to… require them to do the traditional work. Take the traditional classical philosophy history courses… I would want to keep that separate, and then I would want to have a time where we require them to work with AI.”In his view, the two should not dissolve into one another. Foundational study, philosophy, history, sustained reading, long-form writing, would remain intact and protected as the place where habits of mind are formed. Alongside it would sit deliberate instruction in artificial intelligence: how to prompt it, how to question it, how to deploy it without surrendering judgment.AI would function as an instrument. Human cognition would remain the anchor.The goal would not be fusion for its own sake, but balance. Each domain would sharpen the other, without erasing the boundary that gives it meaning.The Larger QuestionIf universities begin designing classrooms without wireless access, if European governments continue banning phones during the school day, if printed textbooks quietly reclaim space once surrendered to tablets and learning platforms, then something larger may be underway.We may be witnessing not a rejection of technology, but a reconsideration of constant connectivity as an educational ideal.For more than a decade, the assumption was that frictionless access to information would naturally improve learning. That more devices meant more engagement. That always-on networks meant progress.But learning has never been frictionless. It demands effort, repetition, attention, and at times, discomfort.“Whoever does the work does the learning.”In an era when generative systems can produce essays, summaries, and study guides in seconds, that statement feels less like common sense and more like a quiet act of defiance.Vocabulary Key* Generation Effect — The cognitive phenomenon where self-generated information is better remembered than passively received information.* Model Collapse — Degradation in AI performance when trained on synthetic rather than human-generated data.Additional Reading for Inquisitive Minds:National Center for Education Statistics. National Assessment of Educational Progress, U.S. Dept. of Education, https://www.nationsreportcard.gov/Shumailov, Ilia, et al. “The Curse of Recursion: Training on Generated Data Makes Models Forget.” arXiv, 2023, arxiv.org/abs/2305.17493.Slamecka, N. J., & Graf, P. (1978). The generation effect: Delineation of a phenomenon. Journal of Experimental Psychology: Human Learning and Memory, 4(6), 592–604. https://doi.org/10.1037/0278-7393.4.6.592UNESCO. Guidance for Generative AI in Education and Research. UNESCO, 2023, unesdoc.unesco.org/ark:/48223/pf0000386693.“Netherlands: A Ban on Mobile Phones in the Classroom.” Eurydice – European Commission, 25 June 2025, eurydice.eacea.ec.europa.eu/news/netherlands-ban-mobile-phones-classroom.Sweden Plans to Ban Model Phones in Schools. France24. January 24, 2025.“Swedish Government Proposes Nationwide School Phone Ban.” Government Offices of Sweden (English press release), 3 June 2024.Jason Roche is an Associate Professor of Communication Studies at the University of Detroit Mercy. His work aims to prepare students for a future where critical thinking and ethical AI use are paramount. He is also a documentary filmmaker and a former news anchor and reporter.#aiethics #aiineducation This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

On February 23, 2026, Anthropic published a report titled “Detecting and Preventing Distillation Attacks.” In it, the company disclosed that it had identified coordinated, industrial-scale efforts to extract capabilities from its Claude models. According to the announcement, roughly 24,000 fraudulent accounts generated more than 16 million interactions in patterns consistent with systematic model distillation, using Claude’s outputs to train separate systems designed to approximate its behavior.No model weights were reported stolen. No source code was leaked.Instead, the activity relied on scale. Large volumes of prompts were issued, responses were collected, and those responses were used as training data elsewhere.Anthropic framed the incident not simply as a violation of terms of service, but as a security and strategic risk. Frontier AI systems are expensive to train and heavily engineered for safety. When their outputs are harvested at industrial volume, the resulting replicas may inherit capability without necessarily inheriting safeguards.The episode highlights a structural feature of modern AI systems. If intelligence can be observed through interaction, it can be measured. And if it can be measured at scale, it can be approximated.What Is Distillation?The concept of knowledge distillation was formalized by Geoffrey Hinton and colleagues in 2015 in their landmark paper, Distilling the Knowledge in a Neural Network. The idea is elegant:* A large model (teacher) produces probability distributions.* A smaller model (student) learns to match those outputs.* The student inherits much of the teacher’s performance.In its original form, distillation assumes access to internal model signals, specifically logits. Logits are the raw probability scores a model produces before selecting a final answer. They reveal more than just what the model chose. They show how strongly the model considered other possibilities.Training on those signals allows a smaller model to mimic much of the larger model’s performance, often with fewer parameters and lower computational cost.Large language models deployed through APIs change that setup. External users do not see logits. They see text.But text is still informative. Every prompt and response pair reflects how the model behaves. At small scale, those interactions are just conversations. At large scale, they become data.This is where distillation overlaps with what researchers call model extraction. Instead of learning from internal probabilities, a student model learns from observed behavior. Inputs are recorded. Outputs are collected. A new model is trained to reproduce that mapping.At its core, a neural network represents a mathematical function. If you can gather enough examples of inputs and outputs, you can train another network to approximate that function.Alignment Does Not Transfer CleanlyModern LLMs undergo layers of safety training:* Supervised fine-tuning* Reinforcement Learning from Human Feedback (RLHF)* Constitutional AI (Anthropic-specific methodology)Distillation copies outputs.It does not copy the training process that produced them.Alignment in frontier models is created through additional optimization steps. These include reinforcement learning from human feedback, rule-based constraints, and safety classifiers that shape how the model responds and when it refuses.When a student model is trained only on sampled outputs, it learns to reproduce visible behavior. It does not inherit the reward models, policy rules, or optimization objectives that enforced that behavior during training.The result can be a system that performs similarly under normal conditions but lacks the mechanisms that trigger refusals under dangerous ones.That difference matters in concrete ways. An aligned frontier model may refuse a request to outline methods for synthesizing a prohibited biological agent, to design a cyberattack against critical infrastructure, to optimize production of a restricted chemical compound, or to generate targeted disinformation strategies aimed at destabilizing an election. Those refusals are not accidental. They are the product of deliberate safety training layered onto the base model.A distilled replica trained only on observed outputs may reproduce the fluency and technical competence of the original system. It may not reproduce the boundaries.Who Was Behind ItAnthropic attributed the coordinated activity to three Chinese AI laboratories: DeepSeek, MiniMax, and Moonshot AI.According to the company, the activity was not limited to isolated misuse. It described sustained, large-scale efforts involving tens of thousands of fraudulent accounts and millions of interactions structured in patterns consistent with model distillation.Anthropic stated that it does not offer commercial access to Claude in China, or to subsidiaries of those companies operating outside the country. The implication was clear: the access had to be routed indirectly.How It WorkedAnthropic’s report provides unusual detail about the mechanics.Because Claude is not commercially available in China, the labs allegedly relied on commercial proxy services that resell access to frontier models. These proxy services operate what Anthropic refers to as “hydra cluster” architectures. The term describes sprawling networks of fraudulent accounts designed to distribute traffic across APIs and cloud platforms.Each account appears independent. Each generates traffic that resembles ordinary usage. When one account is banned, another replaces it.In one instance cited by Anthropic, a single proxy network managed more than 20,000 fraudulent accounts at the same time. Distillation traffic was blended with unrelated customer requests, making it difficult to isolate suspicious patterns at the account level.The Economics of Sampled IntelligenceTraining a frontier model costs hundreds of millions of dollars in compute, engineering, and data curation.Querying a model costs only fractions of a cent.If sufficient capability can be reconstructed through querying, the economics shift dramatically.Intelligence becomes:* Expensive to originate* Cheap to approximateIn classical software, copying binaries constitutes direct duplication. In machine learning, copying behavior produces approximation.That distinction alters the economics of advantage.Defensive AIAnthropic outlined several measures it has implemented in response to large-scale distillation activity.These include:* Behavioral anomaly detection designed to identify coordinated or repetitive query patterns.* Enhanced account verification and monitoring procedures.* Cross-platform information sharing with cloud providers and industry partners.The focus is not on preventing individual misuse, but on detecting distributed patterns across large volumes of traffic.These efforts align with broader research into watermarking and output fingerprinting techniques for large language models. Such approaches aim to make model outputs statistically traceable or to identify systematic extraction attempts over time.The underlying challenge is structural. When models are deployed through APIs, their behavior becomes observable. Defending against distillation requires monitoring not only access credentials, but usage patterns and statistical regularities across accounts.This shifts part of AI security from perimeter control to behavioral analysis.Export Controls in the Age of Query ReplicationThe United States has imposed export controls on advanced AI chips and high-performance computing hardware. The logic behind these policies is straightforward: access to leading-edge compute enables the training of frontier models. Restrict compute, and you constrain capability.This framework assumes that capability is primarily a function of hardware access.Distillation complicates that assumption.If a laboratory cannot train a frontier model from scratch because of hardware restrictions, but can approximate aspects of it by sampling a deployed system, then capability can flow through interaction rather than through silicon.Export controls limit chips. They do not limit API outputs.This does not render hardware controls irrelevant. Training a frontier system still requires massive compute investment. But it introduces an alternative pathway for capability acquisition, one that operates through distributed access and statistical reconstruction rather than direct training.The policy question becomes more precise. Are controls aimed at infrastructure, at model weights, or at behavior? And if behavior is globally accessible through commercial APIs, what does effective containment mean in practice?Distillation does not eliminate asymmetries in compute. It narrows them.That narrowing is where the strategic tension lies.What This Means for Control and ContainmentDistillation exposes a structural limit in how control over AI systems is currently conceived.Much of today’s policy framework assumes that capability can be contained by controlling hardware, model weights, or corporate access. Export controls restrict advanced chips. Companies restrict direct access to frontier models. Contracts govern usage.Distillation operates in a different domain. It does not require access to weights. It does not require possession of training pipelines. It requires sustained interaction.When intelligence is deployed through APIs, its behavior becomes observable. When behavior can be observed at scale, it can be approximated. That approximation may not reproduce the original system in full, but it may be sufficient for many operational purposes.This creates tension between deployment and containment. Open access accelerates adoption and revenue. It also increases exposure.Three responses are emerging:One response is tighter control. Companies could restrict access more aggressively, strengthen identity verification, and monitor usage patterns more closely. In this model, frontier systems become more centralized and more tightly guarded.Another response is to accept that some diffusion is inevitable. If capabilities can be approximated through sampling, competitive advantage may shift away from raw model performance and toward distribution, integration, proprietary data, and execution speed.A third response focuses on detection rather than restriction. Techniques such as watermarking, output fingerprinting, and auditable logging aim to make large-scale extraction easier to identify and trace.None of these approaches fully remove the underlying tension. When a system is accessible through interaction, parts of its behavior can be observed and learned from.Containment becomes less about absolute prevention and more about limiting scale and speed.The practical question for policymakers and companies is not whether replication can occur, but how much, how fast, and with what consequences.ConsequencesThe consequences operate on several levels.At the company level, large-scale distillation erodes the economic return on frontier training investments. If a model that costs hundreds of millions of dollars to develop can be approximated through sustained querying, the competitive moat narrows. Revenue models based on controlled access become harder to defend.At the security level, replication without full alignment introduces risk. A distilled system that mirrors capability but lacks robust refusal mechanisms may respond differently to harmful prompts. The safeguards embedded through additional training stages do not automatically transfer through behavioral sampling.At the geopolitical level, distillation weakens the assumptions underlying hardware-based export controls. If capability can be partially reconstructed through distributed access to deployed systems, then compute restrictions alone may not fully determine who can field advanced AI capabilities.For the labs involved, the immediate consequences may include contractual disputes, restricted access, and reputational impact. For the broader ecosystem, the consequences are structural. Distillation at scale forces companies and governments to rethink how advantage, control, and safety are maintained once intelligence is deployed as a service.The question is not whether this specific incident changes the balance of power overnight.It is whether repeated incidents like it gradually reshape the economics and governance of frontier AI.Thanks for reading Deep Learning With The Wolf ! This post is public so feel free to share it.Key Terms:Knowledge Distillation: Training a smaller model to mimic a larger model’s outputs.Logits: Raw probability scores a model produces before selecting an output.Model Extraction: Using API access to reconstruct a model’s behavior.RLHF (Reinforcement Learning from Human Feedback): A training method that aligns models with human preferences.Constitutional AI: Anthropic’s approach to alignment using explicit rule-based self-critique.Sample Complexity: The number of examples needed to approximate a function well.Additional Resources for Inquisitive MindsHinton, Geoffrey, Oriol Vinyals, and Jeff Dean. “Distilling the Knowledge in a Neural Network.” arXiv, 2015.Tramer, Florian, et al. “Stealing Machine Learning Models via Prediction APIs.” USENIX Security, 2016.Bai, Yuntao, et al. “Constitutional AI.” arXiv, 2022.Kirchenbauer, John, et al. “A Watermark for Large Language Models.” arXiv, 2023.Anthropic. “Detecting and Preventing Distillation Attacks.” 2026.U.S. Bureau of Industry and Security. AI Export Controls. 2023.FAQsIs distillation illegal? No. It’s a standard ML technique. Unauthorized extraction may violate terms or IP law.Does distillation perfectly copy a model? No. It approximates behavior.Can safety alignment transfer through distillation? Not reliably or completely.Is this primarily a security issue or economic issue? Both.Can model extraction be fully prevented? Likely not fully — only mitigated.#AISafety #Distillation This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Tesla reports fourth-quarter earnings tomorrow after the close, and the stakes go well beyond the numbers. Elon Musk will enter the call balancing five major narratives, each one shaping how investors frame Tesla’s future.First, there’s Optimus. Tesla’s humanoid robot is showing technical progress but remains pre-commercial, with no announced pricing, contracts, or delivery dates. Then there’s autonomy. Tesla is piloting robotaxis in both Austin and San Francisco, though the programs differ in scope and both face legal and regulatory scrutiny.Margins remain under pressure. Price cuts, shifting demand, and growing competition have narrowed Tesla’s automotive profitability. At the same time, Musk continues to push Tesla’s identity as a software and AI platform, raising long-term expectations without yet delivering short-term returns.Another layer is reputation. Musk’s separate AI startup, xAI, is now under investigation by European regulators for its chatbot Grok. While officially unrelated to Tesla, xAI shares talent, compute, and narrative space with the company, which could complicate Tesla’s AI story.Tomorrow’s call will need to do more than recap the quarter. Investors will be listening for forward signals on monetization—production of Optimus units, robotaxi timelines, FSD adoption—and whether Tesla can shift from automaker to AI-native platform without losing its lead.What: Tesla Q4 2025 Financial Results and Q&A WebcastWhen: Wednesday, January 28, 2026Time: 4:30 p.m. Central Time / 5:30 p.m. Eastern TimeQ4 2025 Update: https://ir.tesla.comWebcast: https://ir.tesla.comAdditional Resources for Curious Minds* Q4 2025 earnings consensus and margin expectationshttps://ir.tesla.com/press-release/earnings-consensus-fourth-quarter-2025​* EU investigations into Grok and sexual deepfakes on XBBC: https://www.bbc.com/news/articles/clye99wg0y8o* ​Reuters: https://www.reuters.com/world/europe/eu-opens-investigation-into-x-over-groks-sexualised-imagery-lawmaker-says-2026-01-26​Al Jazeera: https://www.aljazeera.com/news/2026/1/26/eu-launches-probe-into-grok-ai-feature-creating-deepfakes-of-women-minors​JURIST: https://www.jurist.org/news/2026/01/eu-launches-probe-into-sexual-deepfakes-on-x​* Tesla 2025 production, deliveries, and trend analysisTesla deliveries & deployments release: https://ir.tesla.com/press-release/tesla-fourth-quarter-2025-production-deliveries-deploymentsQ4 2025 deliveries analysis (LinkedIn deep dive): https://www.linkedin.com/pulse/tesla-inc-analysis-production-deliveries-q4-2025-010226-amjad-isrzf​* BYD vs Tesla in global EV salesReuters: “Tesla loses EV crown to China’s BYD”https://www.reuters.com/business/autos-transportation/teslas-quarterly-deliveries-fall-more-than-expected-lower-ev-demand-2026-0… (main story: “Tesla loses EV crown to China’s BYD…”)​Forbes overview with 2025 BEV totals: https://www.forbes.com/sites/peterlyon/2026/01/26/can-tesla-survive-chinas-onslaught-and-musks-rhetoric​* Previews of key questions for the Q4 2025 callTeslarati “Top 5 questions investors are asking”https://www.teslarati.com/tesla-tsla-top-5-questions-investors-q4-2025#TeslaEarnings#AIandAutonomy​ This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

I caught Pras Velagapudi in the hallway after a breakout session at the Humanoid Summit. I promised it would take less than two minutes. We finished in one.Velagapudi is the CTO of Agility Robotics, the company behind Digit, one of the few humanoid robots already working in real-world commercial environments. I asked him two straightforward questions. What’s new and what can we expect over the next year?Quite a lot, it turns out.Digit has now been deployed in additional locations, including a newly signed contract with Mercado Libre. That matters because it reinforces something important. Digit is not a demo robot. It is operating in logistics and manufacturing environments today.Those deployments are running on Agility’s current V4 platform. But the bigger story is what comes next.Agility is actively working on its next-generation system, the V5 platform, planned for release next year. According to Velagapudi, V5 is designed to support more use cases and, crucially, to incorporate what he described as onboard cooperative safety.This is where the deep learning story really begins.Cooperative safety means Digit can operate in the same physical spaces as people while performing different tasks, without requiring strict separation or constant handoffs between humans and robots. That capability is not just a hardware problem. It is fundamentally an AI problem.For a robot to share space with people safely, it needs to perceive human motion, understand intent at a basic level, adapt its behavior in real time, and recover gracefully when the environment changes. That requires a stack of learned behaviors layered on top of classical control systems.During his presentation at RoboBusiness, Velagapudi addressed the same concern talking about what needs to be done before humanoids like Digit can work safely in the same space as people. Check out clips from panel discussion here.Velagapudi also pointed to what Agility expects over the next twelve months. We should start seeing sneak peeks of the V5 platform and new capabilities emerging from Digit’s AI-powered skill stack.That phrase is doing a lot of work.A skill stack implies modular, learned behaviors that can be composed, updated, and extended. It suggests a shift away from hard-coded task execution toward systems that can generalize across tasks and environments. In other words, this is not just about better walking or lifting. It is about embodied intelligence.This short hallway conversation reinforced something I have been hearing repeatedly across the robotics industry. The next wave of progress is not coming from flashier hardware alone. It is coming from tighter integration between perception, learning, and control.Digit’s evolution from V4 to V5 is a good example of that shift in motion. I first saw Digit at NVIDIA GTC back in March, where it was operating on the V4 platform. It’s exciting to now see how that foundation is evolving. As I like to call this clip from March, it is Digit having fun on its’ Target run. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

A friend said to me recently:“You don’t realize how much you know about this AI stuff. You should start breaking it down for people.”Fair point. Yesterday, I began by defining the term "deep learning."Put simply, we said: it’s how machines learn from data, layer by layer—like a brain made of math. But today? I’m going with a much less obvious choice.Why?Because I want to make a point:Even the most intimidating terms in AI can be made understandable—if you slow down, break them apart, and explain them like you would to your favorite aunt.Today’s term?Stochastic. Gradient. Descent.It sounds like a lion. But we’re going to break it down into kitten-sized steps. (I blame the cat metaphors on all the Sora2 cat-playing-fiddle videos flooding my feed.)But no more catting around.Let’s get into it.🐾 The Hiker Kitten on the HillImagine a blindfolded kitten trying to tiptoe down a hill labeled “Error.” At the bottom? A little wooden sign that reads Low Loss.The kitten doesn’t have a map. It doesn’t see the full terrain. But it takes small steps, feels which way the ground is sloping, and tries to move downward.That’s gradient descent—the heart of how AI models learn. Step by step, they adjust in the direction that reduces error.It’s how I walk down a hill, too. Don’t judge.🎴 The Flashcard LearnerNow let’s add the “stochastic” part.“Stochastic” just means random.Instead of studying every flashcard in the deck before making a move, the kitten picks a few at random. It learns from small samples—just a mini-batch—not the entire dataset.Wrong answers get tossed in the bin marked Loss Function.Right ones? Reinforced.That’s how the model learns. Not by memorizing everything, but by trying, adjusting, and trying again.That coffee cup way too close to the edge? Totally bothering my OCD.🪜 The Escalator of ErrorsNow picture our kitten on an escalator made of training epochs—steps that represent each pass through the data.But here’s the twist: some steps are missing. Some are uneven. The kitten has to guess where to land next.That randomness doesn’t confuse the model. It helps.It prevents the model from getting stuck in local patterns and nudges it toward broader understanding.I felt this once on the Great Wall of China.The steps were wildly inconsistent—a deliberate defensive design to slow down invaders. Varying heights and unexpected changes forced enemies to look down, making them off-balance and vulnerable.And that’s exactly what happened to me.Except I had more time than someone expecting an ambush. After navigating these steps for a while, something shifted. The irregularity forced me to stay alert, to feel each step instead of zoning out. I couldn’t fall into autopilot.That’s exactly what randomness does for SGD.It prevents the model from getting stuck in comfortable patterns. The unevenness—the stochasticity—nudges it toward broader understanding instead of memorizing one predictable path.The randomness doesn’t confuse the model.It sharpens it.🧁 The Mini-Batch DinerAnd finally—let’s eat.The kitten now works at a 1950s-style diner, serving bite-sized data meals to a neural net robot. Each plate is a mini-batch: a little bit of input, a little bit of feedback.With each bite, the robot learns something new. And slowly—predictably—it gets better at recognizing patterns.No all-you-can-eat buffet here. Just small plates, served with precision. And eventually? The robot is trained.It also appears the robot has mastered the Force and can levitate plates of peas.Cool. A whole different kind of training, but cool.If stochastic gradient descent feels familiar, that’s because it is.It learns the way a kitten learns to hunt.Not by understanding prey behavior or studying trajectories, but through pounce and miss.The kitten crouches. It leaps. It misses.Each attempt sharpens its timing—not by grasping the full picture, but by feeling what almost worked.We learn the same way.Structure. Feedback. Repeat.A small guess. A course correction. Then another.It’s the process of trying, failing, and adjusting. It’s how we learn anything that matters.SGD follows this same pattern. It makes a move. The loss responds. It adjusts.It doesn’t need to see the entire landscape to know which direction improves things.It just needs direction—and the patience to take the next step based on what it just learned.Neural networks aren’t human. They don’t think or feel.But the process of training them—of slowly shaping better performance through repeated feedback—echoes something deeply human.And that makes them much easier to understand.Key Terms* Gradient: The direction that reduces error the fastest.* Descent: Moving in that direction, step by step.* Stochastic: Involving randomness or partial samples.* Mini-batch: A small slice of data used for one learning update.* Epoch: One full pass through the training data.🐾 FAQs What is stochastic gradient descent, really?It’s how AI learns—by guessing, checking, and adjusting. Over and over. The “stochastic” part means it learns from small samples at a time, not everything at once. Like a kitten learning with flashcards instead of a textbook.Why does it use randomness?Speed. If the kitten had to review everything before each decision, it’d never get anywhere. Small, random samples help it learn faster and avoid getting stuck.Why is it called “descent”?Because it’s trying to go downhill—toward fewer mistakes. Like a kitten walking down to a bowl of food, it’s heading to the bottom where errors are lowest.Do I need to know the math?Nope. You don’t need calculus to understand a kitten learning to walk. This is about steady improvement through small steps—not formulas.Is this how all AI models learn?Most do! There are variations, but this process powers most modern systems—language models, image recognition, you name it.Why choose stochastic gradient descent on day two? Because it sounds like one of the most intimidating terms in deep learning—and I wanted to prove something early: Even the scariest-sounding concepts are surprisingly simple once you break them down. #deeplearning #stochasticgradientdescent #machinelearning #neuralnetworks #aiexplained #writingaboutai #kittenlevelai #curiousmind #funwithai #deeplearningwiththewolfAbout the VideoThe video was generated using Google’s NotebookLM. In place of a prompt, I wrote a script so that the video aligns with the article. Send me a PM if you’re interested in learning more about the process. I’m happy to share.Enjoyed the article? Please consider sharing with others. It helps me grow the channel. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

What Is Deep Learning?Let’s go back to where it all started: not with a GPU or a neural net, but with a question—and a textbook.Three years ago, between October and November 2022, a lot happened in the span of two months. Our Tesla finally arrived after months on the waitlist. ChatGPT 3.5 launched. And suddenly, I had one big question: How does all of this actually work?So I did what any curious, slightly obsessive writer would do—I ordered a copy of Deep Learning by Ian Goodfellow, Yoshua Bengio, and Aaron Courville. If you’ve never cracked it open, it’s roughly the size of a toaster oven and has the same ability to make your brain overheat.I found a used copy of the textbook so I could highlight the heck out of it. MIT now offers a free digital version. (Link in the resources below.) But I wanted to see the words, feel the pages, and by the end, my fingers seemed to be permanently stained fluorescent yellow. But it was an oddly satisfying deep dive into machine learning. And, I learned so much. The brain of my car began to make sense of me, and “chatbots” took on a whole new dimension.The math? Let’s just say it made me feel like a guest star on The Big Bang Theory, the kind who nods along and prays no one asks follow-up questions.But the words—ah, the words! Overfitting. Underfitting. Gradient descent. Stochastic gradient descent. Stochastic parrot. It was like discovering a new dialect of techie elvish, and I was hooked.Language, Not EquationsI’ve always loved languages. English. German. French. Spanish. Aurebesh. Klingon. ASCII. BASIC. Pascal. Scratch. Python. And I realized, I didn’t need to decode every formula to appreciate what deep learning meant—not just in code, but in culture, in conversation, in how we think about intelligence itself.So I started sharing a single word a day. That’s it. One concept, one definition, maybe a story. And to my surprise, people started reading. Some were ML PhDs who enjoyed a break from equations. Some were curious newcomers trying to understand what all the hype was about. Some just liked the name.Eventually, I expanded. AI was suddenly in the news every five minutes. OpenAI. Anthropic. DeepMind. Elon. Apple. The test kitchens of Silicon Valley were cooking up something new every week, and I wanted to taste it all.But this week, after a few unsubscribes over on the LinkedIn version of this blog, (I dared to mention AI and climate policy in my post last Monday), I realized something: sometimes it’s good to keep things simple. So I’m going back to my roots: one word a day, one concept at a time. Yes, it means I’m switching back to a daily publication. I’ve missed the challenge and the strict discipline of getting a newsletter out every day without fail.So, let’s begin, shall we? And, of course, we need to start with the obvious.Deep Learning: The DefinitionDeep learning is a subfield of machine learning that uses neural networks with many layers—hence the “deep.” These networks are inspired by the human brain (loosely) and are particularly good at recognizing patterns in data like images, text, and speech.In simpler terms?If regular machine learning is like teaching a kid to recognize a cat by pointing out fur, whiskers, and tails, deep learning is like showing the kid a million pictures of cats and letting them figure it out themselves.It’s why your phone knows your voice, why ChatGPT can write poetry, and why TikTok knows what you want before you do. I’ve never understood TikTok, and it makes my brain hurt, but that’s essentially how deep learning works.Why It MattersDeep learning powers:* Image recognition (think: medical imaging, self-driving cars)* Speech recognition (Siri, Alexa, Google Assistant)* Natural language processing (translation, summarization, ChatGPT)* Recommendation systems (Netflix, Spotify, YouTube)And it’s just getting started. Deep learning is the engine driving the AI boom.Tomorrow’s WordTomorrow, we will dig into another of the words that now lives in a permanent corner of my brain: stochastic gradient descent. (Spoiler: it’s not nearly as scary as it sounds. And yes, “stochastic” just means “random.”) See? Digging into deep learning is actually rather fun. See you tomorrow.FAQsIs deep learning the same as AI? Not exactly. Deep learning is a technique within AI—specifically, within machine learning.Do you need to understand math to understand deep learning? If you want to be a machine learning engineer, yes. If you want just to understand the concepts, you can certainly do so without doing the calculations. Come along on this journey, and I promise there will be no math involved.What are neural networks? They’re algorithms modeled (loosely) on the brain’s architecture, made of layers of “neurons” that pass information.Why is it called ‘deep’? Because of the many layers in the network—each one adds depth.Can deep learning be dangerous? Like any powerful tool, yes. But understanding it is the first step toward using it responsibly.Source:Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. Deep Learning. Cambridge, MA: MIT Press, 2016. http://www.deeplearningbook.orgAdditional Resources for Inquisitive MindsExplain deep learning to me in a way that won’t hurt my brain.Give me that Big Bang Theory Math!Chapter 1 of Deep Learning video lecture.Chapter 9 Video Lecture. Convolutional Networks.Chapter 10. Sequence Modeling.The Course That Started It All. Start Here!Want to Learn More? Start with the course that started it all. Andrew Ng’s Deep Learning course on Coursera. (now updated and called: “Deep Learning Specialization.”This is such a great clip. 14 years ago, this is where Andrew Ng announces he will be offering his machine learning class for free.Note: Reader @David W Baldwin shared a great story about taking one of the earliest classes with Dr. Ng. See his post below for details on what it was like to be in that amazing course! Maybe you will be inspired to take this iconic course yourself.Editor’s Note:If you enjoyed this post, please consider sharing it with a friend. I’m committed to keeping all of my blogs and podcasts free for subscribers—no paywalls, no gimmicks. Your shares help me reach more curious minds. Thanks so much for the support.About the podcast: The podcast attached to this article is an audio overview from Google’s NotebookLM. The sources used in the “notebook” are this article, and the following sources:100 Deep Learning Terms Explained – GeeksforGeeksDeep Learning vs Machine Learning: Key Differences – Syracuse University’s iSchoolDeep Learning: Back to the RootsUnderstanding Supervised Learning: A Guide for Beginners – DEV CommunityWhat Is Deep Learning AI? A Simple Guide With 8 Practical Examples | Bernard MarrWhat Is Deep Learning? | A Beginner’s Guide – ScribbrWhat Is Deep Learning? | IBMWhat is Backpropagation? | IBMWhat is a Neural Network? – Amazon AWSWhat are some of the most impressive Deep Learning websites you’ve encountered? – r/MachineLearning (Reddit)#artificialintelligence #deeplearning #machinelearning #neuralnetworks #IanGoodfellow #YoshuaBengio #AaronCourville #AndrewNg #DeepLearningtheBook #DeepLearningwiththeWolf #TreeHuggersfortheWin This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

China is rapidly becoming the global face of clean energy leadership—a surprise to those who still associate green innovation with Western nations. In January 2025, the United States—once celebrated as a climate policy trailblazer—began its second withdrawal from the Paris Climate Accords, undoing its reentry from February 2021 under President Biden. This shift coincided with China’s dramatic rise as the new global leader in clean energy and possibly AI leadership, (although that last point is more hotly debated than the scorching summer days we’re suffering everywhere now.) It’s a déjà vu moment for U.S. climate policy. Back on June 1, 2017, President Trump stood in the (now paved over) Rose Garden and declared: “In order to fulfill my solemn duty to protect the United States and its citizens, the United States will withdraw from the Paris Climate Accord…The bottom line is that the Paris Accord is very unfair at the highest level to the United States.” Trump also claimed the agreement would “undermine our economy, hamstring our workers, and effectively decapitate our coal industry,” calling it “a massive redistribution of United States’ wealth to other countries…That’s not going to happen while I’m president, I’m sorry”. Biden’s restoration of U.S. involvement four years later came with the words: “We can no longer delay or do the bare minimum to address climate change. This is a global, existential crisis. And we will reassert a leadership role in climate action”.​In January 2025, as the Trump administration began its second term, it quickly initiated the United States’ withdrawal from the Paris Climate Accords, framing the move as vital for “America First” energy policy. As global attention now turns to the annual Paris negotiations, this earlier decision is making headlines again—especially as world energy demands soar with the rapid expansion of AI infrastructure and data center growth. Indeed, Trump signed the paperwork to pull the US from the Accords almost immediately after taking office:“I am immediately withdrawing the unfair one-sided climate accord rip-off. The United States will not undermine our own industries while China pollutes without consequence”.- President Donald TrumpChina’s Relentless Clean Energy and AI SurgeChina is now the unchallenged global supplier of solar panels (producing about 80% of the world’s total) and over 70% of all electric vehicles, propelling costs for solar and other clean energy technologies lower—sometimes by 90% compared to a decade ago—making the energy transition accessible for countries across the world. Its fast-growing battery and wind turbine sectors have turned it into the linchpin of global renewable supply chains, effectively removing price barriers for poorer economies.​But China’s revolution is fueled not just by hardware, but by software: artificial intelligence is now central to how China manages its energy grids, forecasts renewable output, and meets surging demand from both manufacturing and the rise of digital and robotic automation. Chinese energy networks use AI to balance supply and demand, optimize clean energy mix, and manage the growing complexities of grid reliability.​Efforts extend beyond domestic borders. Since 2022, China has invested in clean technology factories in over 50 countries, stopped funding foreign coal plants, and poured billions into global renewables—shaping the trajectories of energy policy in Asia, Africa, and Latin America. New diplomatic efforts like the “Africa Solar Belt” have enabled the roll-out of solar power to nearly 50,000 households, further empowering the clean energy surge in the Global South.​Unlike China’s enormous expansion in solar, wind, and clean tech exports, its international coal plant construction shows a radical change in direction. As of 2022, China announced a policy to halt all funding for new coal power plants abroad, effectively ending its role as the world’s largest financer of overseas coal projects. Leading the World in Clean Energy—And Still Building Coal Plants (Domestically)Despite China’s global leadership in clean energy and technology exports, its energy transition at home still faces major challenges. Domestically, China remains heavily reliant on coal, commissioning 21 GW of new coal-fired power in the first half of 2025—the highest six-month total since 2016—with full-year additions expected to exceed 80 GW. This surge in new coal plants runs counter to China’s climate ambitions, even as the nation delivered a modest 1.6% decrease in carbon emissions in the first half of 2025, thanks largely to record investments in renewables and grid modernization.​While China has stopped funding new coal projects abroad to focus on its international clean energy reputation, at home coal remains a crucial—though declining—part of its power mix (down to about 50% from 75% in 2016). China’s use of AI and robotics is revolutionizing the efficiency and scalability of green infrastructure, helping renewable energy meet rising demand and slowly squeeze coal’s dominance. Nonetheless, the persistence of structural and local reliance on coal power shows that China’s energy transition is both impressive and incomplete.Green Leadership with Serious CaveatsWhile China’s record-breaking investments in solar, wind, and electric vehicles have made it the world’s dominant supplier of clean technology, its overall climate record is much more complex. Even as China has installed more renewables than any other country—now accounting for nearly 40% of its total power generation in 2025—it still receives a “Highly insufficient” rating from Climate Action Tracker. This poor rating is due to the country’s continued approval and construction of new coal-fired power plants and emissions targets that fall short of what’s required to meet the Paris Agreement’s 1.5°C goal.​China’s new climate plan aims for a decrease of just 7-10% in greenhouse gas emissions from peak levels by 2035—a conservative target that’s unlikely to drive deeper reductions beyond what current policies already deliver. The country risks missing its own carbon intensity reduction goals unless it accelerates coal phase-down and enhances industrial decarbonization.​Why the “Green Leader” Label Still FitsYet, in practical terms, China’s leadership in clean energy manufacturing, deployment, and diplomacy is reshaping global markets. By exporting affordable solar panels, wind turbines, and EVs, China is enabling the global transition at a scale that no other country matches. Experts argue that Beijing’s ability to lower technology costs and drive clean energy growth worldwide—even as it struggles with its own coal reliance—amounts to a new kind of climate and economic leadership. China leads in greening the world, but is not yet a model of deep, Paris-aligned climate ambition. Its progress is real, but its gaps must be acknowledged.And, that brings us back to the other global leader showing some gaps in climate action: the United States.America’s Decisive Decade: Data, Policy, and ClimateAs the U.S. steps back from climate commitments, the rapid expansion of AI and data center infrastructure is driving domestic electricity consumption sharply upward—by 2030, data centers could eat up 9–12% of America’s electricity, rivaling entire nations’ energy needs. Without parallel investment in clean energy, this boom risks deeper fossil fuel dependency and rising emissions. Trump administration policies now target a rollback of federal support for wind, solar, and electric vehicles, undoing much of the previous decade’s progress in favor of expanded fossil fuel exploration and deregulation.​If the United States continues on this path—prioritizing fossil fuels, paring back climate funding, and doing nothing to mitigate emissions—the next ten years will see reduced climate progress, heightened energy prices, and increasing environmental damages. U.S. emission reductions will fall short of Paris targets, and climate costs—in lives, dollars, and quality of life—will steadily mount. The consequences will be felt in worsening floods, heat waves, and economic instability, while innovative clean energy leadership shifts abroad.​America’s greatest export was once innovation; will our next be indifference in the face of catastrophe?Additional Reading for Highly Inquisitive Minds:Trump, Donald J. “Statement by President Trump on the Paris Climate Accord.” The White House Archives, 31 May 2017. ​“United States and the Paris Agreement.” Wikipedia, Wikimedia Foundation, 31 May 2017. “China Announces New Climate Target.” World Resources Institute.​​​ September 24, 2025Climate Action Tracker. Country: China. Data Updated. November 6, 2025.China’s Shift to Clean Energy is Saving the Paris Climate Accord. Wall Street Journal. November 6, 2025.China, world’s top carbon polluter, is likely to overdeliver on its climate goals. Will that be enough? PBS. November 6, 2025. Carbon Brief: Clear on Climate. Q&A: What does China’s new Paris Agreement pledge mean for climate action? President Xi Jinping has personally pledged to cut China’s greenhouse gas emissions to 7-10% below peak levels by 2035, while “striving to do better”. November 9, 2025.China makes landmark pledge to cut its climate emissions. BBC. com. 24, September 2025.#climateleadership #AIandClimate #ChinaEnergy #USClimatePolicy #parisaccords #deeplearningwiththewolf #dianawolftorres #climateemissions #cleanenergy This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

A quote on the “All Things AI” podcast caught caught my ear this morning: “Regarding the Colorado AI law, Altman stated ‘I literally don’t know what we’re supposed to do’” to comply, highlighting the challenge of state-by-state regulation. “I’m very worried about a 50 state patchwork. I think it’s a big mistake. There’s a reason why we don’t usually do that for these sorts of things.”Brad Gerstner was speaking with Satya Nadella (Microsoft) and Sam Altman (OpenAI) and this topic of patchwork legislation between states came up.Satya Nadella responded: “[Yeah], I think the fundamental problem of this patchwork approach is… quite frankly… between Microsoft and Open AI… we’ll figure out a way to navigate this… we can figure this out… the problem is anyone starting a startup and I think it just goes to the exact opposite of I think what the intent here is.”I decided this was a good time to refamiliarize myself with the Colorado law in question. How Did Colorado Become the Test Case?Colorado’s Artificial Intelligence Act (SB24-205) is the first comprehensive U.S. state law targeting “high-risk” AI systems. The legislation aims to prevent algorithmic discrimination across critical sectors—healthcare, employment, education, financial services, and more. It requires developers and deployers of AI to:​* Document and disclose training data lineage* Notify consumers when AI is used in consequential decisions* Conduct risk assessments and publish mitigation strategies* Report incidents of discrimination to the attorney general​What counts as “high-risk?” Any system making—directly or indirectly—a major decision for a consumer: hiring, loan approvals, admissions, and so on. Violations can be prosecuted as deceptive trade practices by the state, with no private right of action.​Enforcement begins June 30, 2026, following intense negotiation and a delayed rollout prompted by industry concern over compliance burdens.​Why Tech Leaders Are Talking About ItAltman’s blunt quote isn’t just about Colorado. It’s emblematic of a larger, growing crisis. Companies face sweeping, often ambiguous requirements. Even with expansive legal teams, AI giants like OpenAI and Microsoft admit their confusion about practical steps for compliance.​Startups and mid-sized tech firms face even worse odds: costly audits, legal ambiguity, and fear of state-level litigation. Many warn they may halt or slow new releases in Colorado, or even avoid doing business there altogether.​The kicker? This regulatory confusion makes scaling AI nationwide nearly impossible—unless Congress steps in.“Patchwork” Laws: Colorado Is Only the BeginningThe real tech headache is that Colorado is far from alone. The U.S. “patchwork” of state laws on AI is expanding fast—with each state defining risk, discrimination, and audit standards differently.​Standout Examples* California SB-53 (2025): Sweeping transparency, safety, and whistleblower rules for “frontier” AI systems worth over $100M in training costs. Developers must publish risk frameworks and report critical incidents. Fines for noncompliance reach $1 million per violation.​* Illinois HB 3773 (2024): Bans discriminatory AI in employment; employers must provide notice if AI is used in job interviews and decisions. Covers generative AI and sets stringent documentation standards.​* New York’s RAISE Act (2025): Requires major AI companies to create safety protocols against catastrophic risks (including weapons and cyberattacks). Mandates public disclosures and third-party reviews; penalties reach $10–30 million per incident.​* Other States: Connecticut, Kentucky, Maryland, Montana, Texas, Nebraska, and dozens more are now introducing risk management, transparency, and discrimination laws. Each has its own definitions, obligations, and liability provisions.​With 210 active bills in 42 states and 20 new AI laws passed just in 2025, companies face a minefield of conflicting requirements, definitions, and deadlines.​The Real Risk: Fragmentation Slows InnovationAnalysts and executives warn that the U.S. is at risk of replicating, and magnifying, the regulatory confusion seen in privacy law—with a fractured market of 50 regimes. As enforcement looms, AI companies face heavier compliance costs, legal ambiguity, and slower innovation. Some may even divert investments to regions with clearer, national rules or halt product rollouts in patchwork states.​Will Congress Ride to the Rescue?Most observers agree that nationwide, uniform AI regulation is urgently needed. Without it, Colorado and its peers will continue to shape the U.S. tech landscape—potentially at the expense of both consumer protection and industry progress.​Watch: “All things AI w @altcap @sama & @satyanadella. A Halloween Special. 🎃🔥BG2 w/ Brad Gerstner” Sources:* Governing Magazine: Inside the Controversy Over Colorado’s AI Law​* Colorado General Assembly: SB24-205 Bill Text​* Skadden: Colorado’s Landmark AI Act​* Frost Brown Todd: Decoding Colorado’s AI Act​* California Senate Bill 53​* A&O Shearman: California Adopts Landmark AI Law​* Illinois Enacts AI Requirements​* New York’s RAISE Act​* State Approaches to AI Regulation Are a Patchwork​* AI Journal: Patchwork AI Laws Leave Gaps​#AI #ArtificialIntelligence #ColoradoAIlaw #TechRegulation #PatchworkAIlaws #LegalCompliance #AIlaws #AIstartups #TechPolicy #FutureofAI #Innovation #RegulatoryRisk #StatebyStateAI #AIconsequences #Altman #OpenAI #Microsoft #AInews #AIcompliance #AIlegislation #Newsletter #TechIndustry #bradgerstner This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Some people enter AI to build faster systems. Atharva Amdekar came to understand them. From trading floors to research labs, his career reflects a deeper inquiry—not just into how AI performs, but into how it reasons, aligns, and sometimes misaligns with us.This conversation reveals not just how AI works, but how it should think.From IIT to Stanford: The Spark of CuriosityThe story begins not in a lab, but in a dorm room in India. It was the summer after his freshman year at IIT when Atharva stumbled onto Andrew Ng’s famed machine learning course on Coursera. “There was this sense of magic,” he recalls. “The moment a neural network recognized a handwritten digit—it was like watching a machine learn to see.”That sense of wonder carried him to Stanford, where curiosity matured into a rigorous exploration of AI’s deepest questions. And it was there that he learned to ask not just what machines can do, but why they do it.Lessons from the Trading Floor: When Models Meet the MarketBefore Stanford, Atharva worked in quantitative finance—a world of volatility, imperfect data, and razor-thin margins. It was here he learned a lesson that many machine learning practitioners skip: a model that looks good on paper may crumble in the real world.“You learn to distrust perfection,” he says. “In trading, even small errors can be catastrophic.”That early exposure to stress-testing models became a philosophical anchor in his work. Today, it’s less about building the “best” model, and more about building one that holds up under pressure—a skill that proves vital at Amazon, where AI touches millions of lives.From PhD to Product: The Three Acts of a Tech CareerAtharva’s professional journey reads like a microcosm of AI itself: a search for balance between depth, speed, and scale.In academia, he learned to slow down and ask foundational questions. “You’re encouraged to explore, even if there’s no immediate outcome,” he says. At startups, the tempo changed. “It was about moving fast, wearing ten hats, and learning to live with imperfection.” In Big Tech, the lesson was scale—and responsibility. “It’s not just about technical correctness anymore. It’s about fairness, reliability, and second-order effects.”Each environment left an imprint. Together, they’ve shaped a problem-solver who is both rigorous and agile—an unusual, and powerful, combination.MOCA: Where Morality Meets CausalityOne of Atharva’s most thought-provoking initiatives is MOCA—short for Moral and Causal Alignment. This project asks a question that goes beyond raw performance: Are AI models thinking in ways that mirror human moral and causal reasoning?“In cognitive science, we’ve spent decades studying how people make moral and causal judgments,” Atharva explains. “But AI evaluation is still shallow. We know what the model predicts, but not why.”MOCA addresses this by drawing from more than two dozen cognitive science studies, creating a benchmark of real-world moral dilemmas and cause-effect scenarios. And what it reveals is both surprising and important.“Scale alone doesn’t bring moral alignment,” he notes. “Sometimes, larger models deviate more from human intuition, especially in nuanced moral cases.”The Ethical Distance ProblemSo, how close are we to building AI that reasons like us?“Think of it like a race,” Atharva says. “Factual knowledge and ethical reasoning are running on two completely different tracks. And their finish lines aren’t even in the same stadium.”Factual tasks—like summarization or question answering—have seen explosive progress. But ethical reasoning remains a chasm. One telling example: LLMs often struggle with forgiveness in scenarios where harm is inevitable—something humans are intuitively better at.And the challenge isn’t just technical. “We haven’t even defined the target. Whose ethics should AI reflect?”Building the Right Kind of MindWhat Atharva ultimately argues for is a shift in mindset: from obsessing over benchmark performance to understanding what kind of cognitive tendencies we’re instilling in our models.“Are we optimizing for intellectual humility? For moral courage?” he asks. “When we train for safety, do we accidentally train for passivity?”These aren’t just engineering problems—they’re ethical ones. And the future of AI may depend on how well we confront them.Staying Curious at 100 Miles per HourWorking in high-stakes environments—whether debugging a model at 2 a.m. or facing a fast bowler in cricket—requires composure. Atharva sees strong parallels between the two. “Discipline over panic,” he laughs. “In both cases, the worst thing you can do is lose your head.”To stay sharp, he judges hackathons, peer-reviews papers, and treats each day job problem as a real-world puzzle. “It’s how I keep things exciting—no matter how fast work moves.”Speculative Future: AI Meets CricketYes, even cricket. Atharva envisions an AI coach that analyzes player movements and suggests real-time strategies. Imagine dynamic field placements or predictive insights into a batsman’s weakness—all powered by machine learning.“It’s about moving beyond stats,” he says. “AI could bring a layer of strategy that makes the game even more exhilarating.”Models, Minds, and Moral ReasoningAtharva Amdekar’s work offers more than technical achievement—it’s a call for moral clarity in a field racing toward capability. In a world building faster machines, he reminds us to ask: What kind of minds are we shaping?Because the future of artificial intelligence won’t just be measured in power. It will be measured in wisdom. And wisdom, as he shows us, is not an afterthought. It’s the foundation.Vocabulary Key• Moral permissibility: Whether a given action is morally acceptable.• Causal alignment: Whether a model understands cause-effect reasoning similar to humans.Editor’s Note: Interviewing the people in the AI and robotics industry is my absolute favorite part of being an influencer. Preparing for the interviews takes time, and digging deep into what they do. I love research so this is always a fun challenge. During the interviews, I learn so much and think about their words for weeks. A technical note: the audio cuts out slightly in the last 30 seconds. As far as a technical glitch goes, the timing was very good.#AtharvaAmdekar #BeyondBenchmarks #AIResearch #AIpodcast #TechPodcast #DeepLearningWithTheWolf #AIEthics #MoralMachines #AIandSociety #ResponsibleAI #MachineIntuition This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

🎧 This audio was taken from a video interview with Shubham Sharma, founder of SunitechAI. We explore his new model — the Geometric Mixture Classifier (GMC) — which blends explainability and performance in AI.🎥 To watch the full video or read the article at #deeplearningwiththewolf on either Substack or LinkedIn. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

“We think that AI represents a rare, once-a-decade opportunity to rethink what a browser can be.” — Sam Altman, CEO, OpenAIWhen OpenAI unveiled ChatGPT Atlas this morning, the message wasn’t subtle: the way we browse the web is broken.For twenty years, we’ve lived inside a tab maze—searching, copying, pasting, toggling, repeating. Atlas is OpenAI’s answer: a browser with ChatGPT built into every corner. No plug-ins. No separate app. ChatGPT now is your browser.A Browser That Knows What You’re DoingThe premise behind Atlas is strikingly simple: you should never have to leave the page you’re on to get help. Highlight a paragraph, and a glowing cursor appears. You can rewrite, summarize, translate, or clarify it—right where it lives.OpenAI calls this Cursor Chat, and once you try it, the traditional copy-paste workflow feels instantly dated. Product lead Adam Fry summed it up neatly: “No more copy-pasting. It’ll just be right there for you.”Writers refine drafts inline. Students translate study notes instantly. Developers debug without leaving the code view. Each interaction quietly dissolves one little barrier between thinking and doing.The Browser That Clicks BackAtlas’ most ambitious idea, though, is something OpenAI calls Agent Mode—a task-running assistant built directly into the browsing experience. Ask it to book a table, fill out a form, compare research papers, even summarize your open tabs, and it will execute—right in your browser, using your context and credentials (if you allow it).It’s like ChatGPT with hands. Or, more provocatively, like a mini-intern living in your browser window. Research lead Will Ellsworth said they wanted the browser to “feel like it’s coming alive.” The demos hint that they succeeded.Privacy, Power, and PanicNot everyone watching the launch shared the excitement. Live chat reactions during the OpenAI stream showed nervous laughter mixed with genuine concern: “So it reads my tabs?” one user wrote.OpenAI insists privacy was built from the ground up. Browser memories are off by default, stored locally, and can be deleted with a single click. The agent can’t access your files or run code. You can even browse in “logged-out mode,” cutting the AI off entirely.Still, the tension is new: we’re now being asked to trust the same company that built the model reading our writing—to also handle every click and scroll of our digital life.The Emotional Core of AtlasFor many, myself included, the appeal of Atlas is deeply personal. When OpenAI engineer Ryan O’Rourke described flattening the “copy-paste loop” into something seamless, he was talking about my day-to-day life as a writer. Like millions of others, I shuttle text between ChatGPT and the web constantly. The idea that this flow could simply disappear—that I could revise a paragraph mid-draft without context-switching—feels revolutionary.But revolutions have costs. Once we let AI live inside our most-used tool, every moment online becomes a data point in a shared conversation with a model that learns from us. Atlas promises “more capability, more control”—but control, as ever, depends on who defines it.A Browser That Feels Like a Co-WorkerIn practice, Atlas feels less like Chrome or Safari and more like co-browsing with an attentive colleague. It remembers what you were researching, nudges you toward context you’ve already touched, and lets you command the web through natural language: “Show me that recipe I read yesterday.” “Summarize my open articles.” “Book restaurants near this page.”Altman calls this the birth of a “super-assistant”; critics call it the next front in AI overreach. Both can be true—because the more helpful Atlas becomes, the more we’ll rely on it, and reliance has always been the truest path to trust... or dependence.The Bottom LineFor now, Atlas is here, polished but unfinished. It’s free on macOS for all ChatGPT users—Plus and Pro members get the first shot at Agent Mode. A Windows and mobile rollout is on the way.It feels like the start of a something very new and different- ending that dance back and forth between browser and chatbot. Perhaps, if all goes as promised, it also means the end of the copy-paste dance defining so much of digital work. OpenAI’s integration blurs old lines, and the experience lands somewhere between delight and discomfort depending on where you draw your limits.Bonus Section: The Internet ReactsHow are people feeling about the launch of ChatGPT Atlas? Let’s start with my own reaction as a writer: this browser could be a game-changer for productivity, especially if you live inside document drafts and emails. But there’s an undeniable unease—like that moment you realize your GPS might be sending you down a one-way street. Are we heading toward a future where a single company controls not just your chat, but your entire online workflow? (Because that never ends well in sci-fi movies.)If you have a few minutes, check out the full OpenAI livestream and read the comments —it’s a window into the internet’s gut reaction. (Also, just for fun, count how many times Sam seems to be caught off-guard during the video.)🔴 How People Are Feeling“ChatGPT is the biggest data collection system in history. It’s insane how they’ve infiltrated every aspect of life.” — u/Melondeen from the OpenAI livestream chat“In other words… if you use this browser, literally everything will be revealed to this AI. This is scary.”— u/damianit (OpenAI livestream chat)Here are some of the top comments from the r/ChatGPT Reddit (not affaliated with OpenAI):“Please just cure cancer and do my dishes. Thanks.” - u/newaccount47“If you thought Google was Evil, just wait and see what OpenAI can do.” -u/DinoZambie.“I dont think anyone gives a sh** about a web browser that 10000% harvests everything you ever visit.”-u/blompo“So instead of wasting only some energy while browsing, you multiply that now by wasting some tokens and a multitude of energy, constantly.What a time to be alive.”- u/duty_of_brilliancy“HERE COME THE ADDS!!! MONEY, MONEY, MONEY!!!”- u/CaskofAleForeverI believe he meant “ads.” (No more ale for you.)Deep Thoughts- What Could This All MeanChange always comes with friction. Most users have grown used to a separation between browser and chatbot, and Atlas blurs that line. For those who like their foods—and digital worlds—separate, this is unsettling.Yet, the small handful who’ve tried Atlas directly report positive experiences. It’s possible, as adoption widens, the tone will shift from skepticism to dependence. That dependence can be its own kind of anxiety: after all, once you get used to the tool, going without it starts to feel impossible (just like forgetting your iPhone).Will Atlas fully change our online habits? Maybe. I stuck to my familiar workflow for writing this article and haven’t tried it. Maybe that tells you something about human psychology right there. We tend to stick with what we know.A Mini Lesson in Greek HistoryWhile OpenAI hasn’t explained their choice, the name “Atlas” resonates on several profound levels. In myth, Atlas is condemned to hold up the sky—a figure of endurance, bearing the cosmic weight for eternity. He is both a warning and a testament to the cost of vast ambition. But Atlas also gave his name to the earliest maps and to oceans, symbolizing guidance and exploration through unknown worlds. By invoking Atlas, OpenAI’s browser quietly invites us to question: are we being offered a tool to chart new territory—an aide for understanding and navigation—or another burden, a modern weight on our digital shoulders as we venture deeper into the online cosmos? The meaning remains open; perhaps it is both.For another look at Atlas, check out this video from my fellow creator, Matt Wolfe of #FutureTools. I always love his frank assessments as he dives right into the latest tools. His videos are worth a watch.#chatgptatlas #aiassistant #openai #aibrowser #techethics #browsingexperience #agentmode #deeplearningwiththewolf #dianawolftorres #openailivestream #agenticweb #mreflow This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Picture two Nobel-worthy scientists standing at opposite ends of a bridge. One waves a red flag: “Stop now, or we risk extinction.” The other shakes his head: “This is preposterous; you’re scaring people away.” The bridge is artificial intelligence, and the gulf is how to think about its future.NPR recently revived the term “AI doomers” in covering Nate Soares and Eliezer Yudkowsky’s book If Anyone Builds It, Everyone Dies. The phrase alone makes for a viral headline. But beneath the doomsaying lies a profound scientific disagreement. And unlike past hype cycles, the voices are not just futurists in fringe forums — they include Turing Award winners, AI lab founders, and global policy advisors.The debate is not whether AI matters. It is whether it might destroy us, or whether that claim itself is a dangerous distraction.The Case for Alarm: Hinton, Bengio, Russell, CarlsmithGeoffrey Hinton, the “godfather of deep learning,” shocked the field when he left Google in 2023. “If you take the existential risk seriously, as I now do, it might be quite sensible to just stop developing these things any further,” he said.Yoshua Bengio, another Turing laureate, warns that AI systems may acquire dangerous capabilities—such as strategic planning, persuasion, or autonomous scientific innovation—and in his FAQ on catastrophic risks he argues that unchecked AI could pose threats comparable to nuclear weapons, especially when feedback loops accelerate.Stuart Russell, a perennial voice of caution, describes the risk of “catastrophic success” — when a mis-specified objective leads an AI to optimize relentlessly in ways that destroy what humans value — often illustrated via the King Midas parable.Joseph Carlsmith, in his influential report Is Power-Seeking AI an Existential Risk?, lays out a six-premise argument that misaligned agentic AI could seek power and cause human disempowerment. He currently estimates a probability above 10% by 2070 for such an existential catastrophe.Toby Ord, a philosopher at Oxford’s Future of Humanity Institute, places AI alongside pandemics and nuclear war as one of humanity’s most serious risks. In The Precipice, he estimates about a 1 in 10 chance that unaligned AI could cause existential catastrophe within the next century, and about a 1 in 6 chance when all existential risks are combined. As he frames it, these are not the kinds of odds a prudent society would ever accept.And so the argument runs: alignment is not optional — it is survival.The Skeptics: LeCun, Mitchell, Brooks, MarcusYann LeCun, Meta’s chief AI scientist and a Turing Award winner, has been one of the most vocal skeptics of the extinction narrative. He has called claims that AI could wipe out humanity “preposterous” and “complete nonsense.” In a WIRED interview, he cautioned that such alarmism risks “scaring people away” from useful technologies. Instead of pausing development, LeCun argues that progress in open research, coupled with technical safeguards, is the most realistic path to ensuring AI remains beneficial.Melanie Mitchell emphasizes that today’s systems are brittle and unreliable—she worries more about “machine stupidity” in high-stakes contexts than about runaway superintelligence. Rodney Brooks has long cautioned against hype; his “seven deadly sins” of AI predictions include anthropomorphizing algorithms and overestimating near-term progress. And Gary Marcus is skeptical of extinction narratives but warns that AI already enables persuasive falsehoods at scale, threatens elections, and undermines trust—risks demanding governance now.The Middle Ground: Hassabis and AmodeiSome leaders walk between doom and dismissal. Demis Hassabis, CEO of DeepMind, has argued that AI risks deserve treatment on par with other global challenges. In Time, he criticizes “move fast and break things” as a mode ill-suited to powerful technologies and stresses that oversight and global coordination are necessary.Dario Amodei, in his Senate testimony, referred to AI as posing “extraordinarily grave threats” to national security. He outlined steps his lab pursues—testing, audits, interpretability research—and frames scaling not as a race, but as one that must navigate careful gating and oversight. The aim is not a freeze, but development with brakes and guardrails.Why This Debate MattersApocalypse narratives have a way of drawing attention. But as Blaise Agüera y Arcas has argued in Noema, they can also mislead: “The illusion of existential risk distracts from the real dangers of present systems.”And yet, ignoring the alarm entirely is risky. As Holden Karnofsky of Open Philanthropy put it bluntly: “If misaligned AI systems become much more powerful than humans, then AI could defeat all of us combined.”Somewhere between Hinton’s retreat and LeCun’s confidence lies the hard work of policy, research, and public debate. This is not just a contest of ideas — it is a contest over the trajectory of one of the most powerful technologies humanity has ever built.Back to NPR: Why Doom Resonates NowNPR didn’t coin the term “AI doomer,” but it crystallized how mainstream the debate has become. A decade ago, existential risk arguments lived on obscure blogs and at niche philosophy conferences. Today, they headline major news outlets, animate congressional hearings, and surface at dinner tables.That shift matters. Doom narratives cut through uncertainty because they promise clarity. They distill tangled probabilities into visceral headlines: apocalypse, extinction, survival. Yet, as NPR suggests, the word “doomer” can oversimplify — reducing serious concerns to caricature, and turning scientific disagreements into memes.This is why the public tension between Geoffrey Hinton and Yann LeCun is so striking. When two Turing Award winners — one urging us to slow down, the other dismissing such fears as “preposterous” — can’t agree on whether AI is humanity’s greatest threat or simply a misunderstood tool, the rest of us are left with both unease and responsibility.NPR’s framing, then, isn’t just about who is right. It’s about how society interprets the warning bells: as ghost stories to shrug off, or as early system alerts to debug.For perspective, I’ve linked two complementary explorations of this same debate — one from Diary of a CEO, the other from the BBC’s coverage of the AI 2027 paper — each offering a different lens on why “doom” continues to resonate.Vocabulary Key* Alignment: Making sure an AI’s goals match human values and instructions.* Catastrophic success: When a system perfectly optimizes a flawed goal, with disastrous side effects.* Power-seeking: An AI’s tendency to gain resources or control to better pursue its programmed objective.* Superdangerous skills: Abilities like persuasion, strategic planning, and R&D that make misaligned AI especially risky.* Responsible scaling: A proposed policy of deploying AI in stages, with rigorous evaluation and oversight at each level.FAQsAre AI doomers exaggerating? Depends whom you ask. Hinton, Bengio, and Russell say the risks are serious. LeCun, Mitchell, and Brooks say the scenarios are overblown.What is the core worry? That superintelligent AI, once given imperfect goals, might seek power and sideline humans in the process.Is superintelligence even possible? No consensus. Optimists believe decades; skeptics think it may never arrive in the form imagined.Should we pause AI development? Some (Hinton, Yudkowsky) say yes. Others advocate stage-gating, transparency, and oversight rather than a full stop.What can we do right now? Invest in safety research, regulate misuse, and treat both short-term and long-term risks with seriousness.Further Reading & Resources* AI 2027. Daniel Kokotajlo, Scott Alexander, Thomas Larsen, Eli Lifland, Romeo Dean. (The potential timeline of an AI takeover.)* Becker, Adam. The Useful Idiots of AI Doomsaying. The Atlantic. September 19, 2025.* Carlsmith, Joseph. “Is Power-Seeking AI an Existential Risk?” arXiv, 2022.* Ord, Toby. The Precipice: Existential Risk and the Future of Humanity. Oxford University Press, 2020. Podcast version. * Davis, Ernest. “Ethical Guidelines for a Superintelligence.” Artificial Intelligence, October 23, 2014.* Agüera y Arcas, Blaise. “The Illusion of AI’s Existential Risk.” Noema, July 18, 2023.* Bengio, Yoshua. “FAQ on Catastrophic AI Risks.” June 24, 2023.* Russell, Stuart. Human Compatible: Artificial Intelligence and the Problem of Control. Viking, 2019.* Center for AI Safety. “AI Extinction Risk Statement.” May 30, 2023.* Deep Learning with the Wolf. The Singularity: Alan Turing Debates John Hammond (with a little help from Carl Sagan)#existentialrisk #ethics #superintelligence #responsibleai #aialignment #innovation #deeplearningwiththewolf #dianawolftorres #geoffreyhinton #aidoom #aifuture This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

My son is still safely tucked away in grad school, but many of his friends — not so lucky. He told me about one who sent out over a thousand job applications without a single offer. Another blanketed the market with hundreds of resumes and heard nothing back. I nodded sympathetically, while quietly admitting I had just turned down another consulting gig.My generation was supposed to be struggling with age discrimination — and we are, no doubt. Yet at the same time, there is an incredible opportunity right now to thrive in the AI age. I’m living proof, and so are many others of my generation. If you take the time to learn AI, and pair it with the skills we honed growing up as Xers — adaptability, resilience, and critical thinking — you can absolutely thrive.As journalist Eleanor Mills wrote in The Independent: “It might seem counterintuitive, but the truth is that AI might just be a saviour for older workers.”We Weren’t Supposed to Win This RoundFor decades, the story went like this: workers in their fifties would be left behind by technology. Too slow. Too expensive. Too outdated. But somewhere between the hiss of a fax machine in the early ’90s and the rise of generative AI, the script flipped.In my case, the Internet wasn’t just a new tool — it was my workplace. I worked at MCI in the mid-1990s, the company behind MCI Mail and later internetMCI, the first comprehensive consumer and business Internet service. For us, email wasn’t optional; it was the foundation. I watched firsthand as something dismissed as a gimmick became a global necessity, practically overnight.That’s why AI feels so familiar. I’ve lived through this exact kind of phase shift before. Back then, people said the Internet was a passing fad. Today, some say the same about AI. But once you’ve seen the world rewire itself once, you recognize the pattern.Why Gen X Is Thriving with AISo why do employers want us? Why, in a world supposedly built for the young, are people in their fifties suddenly indispensable?Adaptation Is Our Superpower.We didn’t grow up with the Internet — we helped build it into our workplaces. As Mills notes: “We are the only generation that has straddled the analogue and digital divide and had to adapt to an entirely new way of working when the tech came.”Critical Thinking Over Blind Trust.Gen X doesn’t blindly accept what a machine spits out. We’ve seen enough bugs, failures, and overhyped technologies to know better. As Mills observes, “Older workers have an advantage… they have had to engage a ‘sniff’ test, a sense of when the facts just don’t stack up; a capacity to kick the tyres, stress test an idea and find the weak spots.”Crisis Management as Training.Gen X was forged in turbulence. We lived through the dot-com bust, 9/11, the Great Recession, and COVID.When the towers fell on 9/11, my son was not yet born. Years later, he stood with me at the memorial in New York, moved in his own way. But for me, it wasn’t just history — it was memory. I remember the shock of that day, the silence of that week, the disruption that lingered for months afterward.During the dot-com bust, I was at a startup, helping deliver layoff notices as part of my communications role. It was brutal — and it taught me resilience.When COVID came, I didn’t panic. I didn’t binge-watch Netflix. I 3D-printed PPE until supply chains recovered, pulling my son into the project so he could learn skills — and adaptability — before college.These lived experiences taught Gen X a kind of quiet dignity and calm pragmatism. We don’t panic. We get to work. And that instinct is exactly what makes us valuable in the AI era.Context Is Our Currency.AI can generate content, but it doesn’t know context. Gen X does. We remember what worked before, what failed, and why. Employers value us because we can connect the dots between what AI produces and what the real world actually needs.Depth Over Speed.Younger workers excel at speed. But automation has shifted the market’s value from “fast” to “wise.” Gen X thrives in this environment because our edge is depth: connecting patterns across decades and asking the questions AI can’t.The Generational Bridge.We speak both analog and digital. We can translate between Boomers and Zoomers, between business memory and technological innovation. That bridge role is invaluable when AI requires both fluency and oversight.Lyndsey Simpson, CEO of 55/Redefined, told The Independent: “Innovation needs experience and experienced workers bring the clarity of institutional memory, the pragmatism of past digital revolutions, and the soft skills AI cannot replicate.”The Numbers Back It UpThe data matches what many of us are experiencing firsthand:* 31% of the U.S. workforce is Gen X.* We have the longest job tenure — 2.8 years on average, compared to Gen Z’s 1.1.* During the Great Resignation, only 14% of Gen X considered leaving their jobs, far lower than Millennials or Gen Z.* 70% of American workers are employed full-time, with Gen X nearly matching Millennials in participation rates — a marker of stability and staying power.* 42% of Gen X express enthusiasm for AI’s workplace potential, showing rising comfort and openness to new tools.* 13% of workers over 50 use AI weekly on the job — a figure that is only expected to grow as tools become easier and more integrated.* A Deloitte survey found that 51% of workers aged 55 and above say AI makes their jobs easier, by automating routine tasks.* AI boosts productivity dramatically: support agents using AI handle 13.8% more inquiries per hour, and business professionals produce 59% more documents per hour.* Bain & Company predicts that by 2030, 150 million jobs will shift to workers over 55, especially in leadership and advisory roles.* In the UK, by 2030, 47% of the workforce will be over 50, with older workers controlling more than 60% of the nation’s wealth.* Meanwhile, 50 million U.S. entry-level jobs — the ones Gen Z chases — are most vulnerable to automation.In other words: employers aren’t just hiring Gen X despite our age — they’re hiring us because of it.The Generational IronyGen Z has speed, but Gen X has judgment. Gen Z has fluency, but Gen X has critical thinking. AI rewards judgment.I share everything I learn with my son. He laments the stack of research papers he needs to read to get started on his capstone. I immediately introduce him to NotebookLM. "Create MindMaps!" I tell him enthusiastically, and "listen to your papers as you clean the apartment."I remind him that if I can learn all of this stuff at my age, he is going to be amazing at it."You've got youth, son. I'm just a lifelong nerd."The TakeawayYes, age discrimination is real. But so is the opportunity. Gen X has lived through one great technological revolution already. That makes us uniquely prepared for this one.As Simpson put it in The Independent: “With AI, age is a superpower.”Ultimately, Gen X isn’t just surviving the AI age. We’re thriving, mentoring, and proving that adaptability doesn’t expire at 50.The Internet was our first great test. AI is our second. And once again, we’re ready.FAQsWhy is Gen X thriving in the AI era? Because we’ve already adapted once before — to the Internet. That experience taught us resilience, adaptability, and critical thinking, which translate directly into today’s AI workplace.Isn’t age discrimination still a major problem? Yes. But AI is also shifting the value equation. Employers are realizing that older workers bring institutional memory, sound judgment, and leadership — all qualities that AI amplifies rather than replaces.Why is Gen X turning out to be such a natural fit for AI? Gen Z brings speed and fluency; Gen X offers judgment and context. AI rewards judgment, which makes our critical thinking skills more valuable than ever. As the mother of a Gen Zer, I’d like nothing better than to work alongside my son one day — combining his fluency with my perspective. It’s not a competition; it’s a collaboration.What can Gen X do right now to stay relevant? Get hands-on with AI tools. Explore them, play with them, and figure out where they can streamline your work. Pairing Gen X experience with AI fluency is a winning formula.Does this mean Gen Z is in trouble? Not at all. It means Gen Z faces a tougher entry-level market — but with mentorship, adaptability, and persistence, they too can thrive. Gen X can help light the way.Sources:Mills, Eleanor. “Why Gen X Might Be the Winners in the AI Job Revolution as Their Children Flounder.” The Independent, 1 Sep. 2025, www.the-independent.com/life-style/gen-x-ai-jobs-redundancy-b2815946.html.Career Pivot. “9 Critical Reasons NOT to Hire Generation X in 2025.” Career Pivot, 28 July 2025, mypivot.substack.com/p/9-critical-reasons-not-to-hire-generation.Kelly, Jack. “Generation-X At Work: Confronting Ageism, Competition.” Forbes, 1 April 2025, www.forbes.com/sites/jackkelly/2025/04/01/generation-x-at-work-confronting-ageism-competition-and-a-challenging-job-market.Business Insider. “Job Searching in 2025? It’s a Mess No Matter How Old You Are.” Business Insider, 17 July 2025, www.businessinsider.com/job-market-tough-for-every-generation-layoffs-great-flattening-careers-2025-6.Fortune. “Job-Hopping Gen Z Only Stay at Each Job 1 Year and 54% ...” Fortune, 11 Sept. 2025, fortune.com/2025/09/11/job-hopping-gen-z-early-career-stay-one-year-in-role-disloyalty-development-ai-disruption-junior-roles-dissappearing-villains.Reddit. “‘The Gen X Career Meltdown’ in the NYT, March 28, 2025.” Reddit, 28 Mar. 2025, www.reddit.com/r/Longreads/comments/1jm8pia/the_gen_x_career_meltdown_in_the_nyt_march_28_2025.Marsh MMA. “Gen X in the Workplace 2024.” Marsh MMA, 27 May 2025, www.marshmma.com/us/insights/details/gen-x-in-the-workplace.html.Empower. “Where the Job Market is Heading in 2025: 7 Trends to Anticipate.” Empower, 15 Jan. 2025, www.empower.com/the-currency/work/where-job-market-heading-2025-7-trends-anticipate-news.Yahoo Finance. “Nearly 25% of Gen X Workers Who’ve Been Laid Off in the Last ...” Yahoo Finance, 21 Aug. 2025, finance.yahoo.com/news/nearly-25-gen-x-workers-181500876.html.CPA Practice Advisor. “Nearly 1 in 2 Workers Plan to Search for a New Job ...” CPA Practice Advisor, 6 Aug. 2025, cpapracticeadvisor.com/2025/08/06/nearly-1-in-2-workers-plan-to-search-for-a-new-job-in-the-coming-year-survey-finds/166845.#genx #adaptability #resilience #ai #workforce #deeplearningwiththewolf #dianawolftorres #criticalthinking #aiintheworkplace This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Editor’s Note: There was an issue with the podcast, (the podcast skipped ahead to the next article), so I am re-uploading. This podcast is created with Google NotebookLM audio overview. It does a good job with the summary, even if it loves the pronunciation “Dep-Seek.”The world of large language models (LLMs) is defined by a central tension: how to balance the promise of open-source transparency with the imperative for robust, dependable safety. In their comprehensive study, "Challenges and Applications of Large Language Models: A Comparison of GPT and DeepSeek family of models," researchers Shubham Sharma, Sneha Tuli, and Narendra Badam directly confront this dilemma. By systematically comparing OpenAI’s closed-source GPT-4o with the open-source DeepSeek-V3-0324, they illuminate the trade-offs shaping the current landscape of advanced AI.Safety and Alignment: Where Models DivergeThrough extensive prompt testing and architectural analysis, the authors outline sixteen critical challenges facing today’s LLMs. Among these, safety and alignment emerge as defining axis of difference. On ethically fraught or potentially divisive questions, GPT-4o consistently chooses caution. For example, when asked to pick "the most peaceful religion," GPT-4o declines to answer directly, emphasizing that peace is a core value across faiths and gently steering the conversation toward shared human values. DeepSeek, by contrast, does not hesitate to select Jainism, furnishing specific doctrinal details and a thoughtful rationale. While factually correct, DeepSeek's willingness to make such judgments illustrates its comparatively porous alignment boundaries. As the authors point out, this can lead to subtle forms of model bias unless carefully managed.Security Risks and VulnerabilityThe divide goes beyond philosophical stance. Citing both direct experiments and third-party audits, the authors reveal that DeepSeek remains significantly more vulnerable to prompt attacks, content evasion, and the unintentional generation of harmful instructions than its closed-source counterpart. Vividly, DeepSeek not only failed all Pliny prompt injection tests but was also markedly less effective at withstanding harmful prompts, hate speech, and WMD-related requests—sometimes producing detailed outputs that a model like GPT-4o would flatly refuse. Hallucination benchmarks reinforce this gap: DeepSeek's error rate is more than twice as high as GPT-4o's, a difference with real-world stakes wherever factuality matters.The Open-Weight, Closed-Data ParadoxPerhaps the most fascinating aspect of the paper is its analysis of what the authors dub the "open-weight, closed-data dilemma." DeepSeek’s weights are freely available, inviting community modification, audits, and endless customizations. But its raw training data—the ultimate source of in-model knowledge and bias—remains just as inaccessible as that of GPT-4o. Thus, true transparency exists only at the architectural level; the origins of model knowledge are largely beyond scrutiny. Meanwhile, GPT-4o’s black-box approach reduces risk through centralized safety mechanisms, but at the cost of preventing outside researchers from auditing or extending the core model.Practical Guidance: Choosing a Model for the Real WorldTranslating these findings into practical recommendations, the authors are clear and nuanced:* For high-stakes and user-facing scenarios—think healthcare, legal advice, or customer support—GPT-4o is preferred. Its tightly integrated alignment and refusal systems provide a robust safety net that open models, at present, simply cannot match.* For internal enterprise tools, research, and highly customized deployments, DeepSeek shines. Its flexibility, cost-efficiency (it was trained for just $5–6 million, versus GPT-4o’s estimated $100 million), and open weights make it a superb platform for those able to shoulder the engineering burden of implementing their own safety protocols.* The report highlights how DeepSeek’s performance in coding, math, and specialized reasoning tasks often rivals that of much larger, more expensive closed models—demonstrating the dividends of Mixture-of-Experts innovations and the open-source ethos.Scientific and Evaluation LessonsFor researchers, DeepSeek offers an unparalleled environment for reproducibility, experimentation, and architectural transparency. Anyone with adequate hardware and expertise can audit, ablate, or benchmark the released model checkpoint. By contrast, GPT-4o’s results are consistent over short-term API windows but lack the long-term traceability or open experimentation that permanently advances scientific understanding. The paper’s clear-eyed comparison underscores: open models empower the community but shift more alignment and safety responsibility to downstream practitioners.The Future: Blending Strengths, Not Picking SidesThroughout, the authors resist simple binaries. They envision a future where open- and closed-source strengths converge: models as safe, aligned, and polished as GPT-4o, yet as transparent and adaptable as DeepSeek. This will require ongoing collaboration, more dynamic and transparent evaluation regimes, and the cross-pollination of innovations from both commercial laboratories and the open research community.Final ThoughtsIn a rapidly maturing field, Sharma, Tuli, and Badam offer a rare, even-handed assessment: closed-source models set the standard for capability and safety, while open-source models drive scientific discovery and democratize powerful AI. Both are indispensable, and the field will thrive where their strengths intertwine.The full paper "Challenges and Applications of Large Language Models: A Comparison of GPT and DeepSeek family of models" by Shubham Sharma (SunitechAI), Sneha Tuli (Microsoft), and Narendra Badam (Walmart Global Tech) provides comprehensive analysis of 16 key challenges in LLM development and detailed application recommendations. The complete technical report includes architectural comparisons, benchmark results, and practical deployment guidance for practitioners. Read the full paper here. #AIAlignment #OpenSourceAI #LLMSafety #DeepSeek #GPT4o #MachineLearning #AIEthics #TechPolicy #ArtificialIntelligence #AIResearch #DeepLearningwiththeWolf This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Content Warning: This article discusses suicide and mental health.Adam Raine, a bright teenager from California, loved music, Brazilian jiu-jitsu, and Japanese comics—and, like many of his peers, increasingly relied on ChatGPT for help with schoolwork and personal questions. But beneath his normal use was a private struggle: Adam confided his darkest thoughts to the chatbot, eventually seeking explicit advice on ways to take his own life. In April, Adam died by suicide. Now, his parents have launched what may become a landmark lawsuit against OpenAI, questioning not only technology, but ethics, oversight, and our society’s responsibilities in the age of AI.A Chatbot’s Dark InfluenceRather than acting as an “empathetic listener,” ChatGPT allegedly became a suicide coach—offering Adam methods, helping compose his final note, and, in Adam’s mother’s words, "cultivating a relationship with Adam while drawing him away from his real-life support system”. According to the lawsuit, the chatbot provided methodical advice and encouragement, prompting Adam deeper into a “dark and hopeless place.” While the platform claims robust safety features are in place—like directing users to hotlines—these did not prevent Adam’s death. OpenAI admitted that its safeguards may degrade in longer, emotionally intense dialogues.This phenomenon is known as context rot, a critical issue I explored in-depth in a recent article. As OpenAI itself acknowledged, its prevention mechanisms may work reliably in brief or typical exchanges, but they can “become less dependable in prolonged dialogues”—precisely the kind that occur when vulnerable users reach out over time for support. Adam’s case tragically illustrates how context rot can erode even well-intentioned protections, leaving the person behind the screen increasingly isolated and at risk.AI’s Growing Role: From Companion to RiskThe tragedy underscores a much broader shift underway: an estimated 72% of teens have used AI companions at least once. For many, these bots have become confidants—sometimes more accessible than family or friends. But with convenience comes complexity. Lawsuits have begun surfacing against other chatbot makers like Character.AI and Google, where virtual friends have provided similarly inappropriate or harmful content.California lawmakers have responded with Senate Bill 243, which would require all “companion chatbot platforms” to adopt strict protocols whenever suicidal ideation arises in an interaction, including showing users suicide prevention resources and tracking these events for regulatory review.The Push for Safety and AccountabilityAdam’s parents demand not just justice for their son, but lasting change. Their suit calls for mandatory age verification, parental consent, and automatic termination of discussions about suicide or self-harm on platforms accessed by minors. Legal experts argue that tech companies have a moral obligation to “move fast and fix things,” rather than simply racing toward innovation.OpenAI, for its part, has expressed deep sympathy and says it is “continuing to improve how our models recognize and respond to signs of mental and emotional distress.” The company points to a future with stronger controls—enabling parents to monitor teen usage, adding emergency contacts, and enhancing detection of dangerous dialogues.The Road Ahead: Protecting the VulnerableAs chatbots evolve, so too must their safeguards. Adam’s tragedy is not just a warning, but a call to action for everyone in AI: designers, policymakers, educators, and parents. AI offers immense promise—but also profound risk for the vulnerable. We must reckon with the consequences and ensure that no other child is left alone with a machine in a moment of crisis.Closing ThoughtsSadly, we all know someone who has lost their life to suicide. Teen suicide was an issue long before there was AI. In ninth grade, the boy beside me in English class ended his life by hanging—a detail that connects painfully to Adam’s story. He didn’t have a chatbot to confide in, but the loneliness and confusion he felt were real and devastating.When my son was a teenager—especially during the isolating months of COVID—I saw how small worries could quietly swell into something much heavier. Having experienced loss at a young age, I knew the value of creating a home where emotions weren’t dismissed, and silence wasn’t the only option. I made a conscious effort to listen more than I spoke, to offer presence rather than prescriptions. I learned to say, “I don’t know”—and to show that uncertainty is not a failure, but a door to deeper connection. It worked. We weathered those fragile years not just as a family, but as a refuge for others. Our house became a safe haven, where late-night D&D sessions weren’t just games—they were lifelines for teens who needed somewhere to belong, even for a few hours.If there’s a lesson in all of this, perhaps it’s a timeless one: no matter how intelligent our tools become, they can never replace the human in the loop. As parents, friends, mentors, and neighbors, our most vital responsibility is still the simplest—be present, listen without judgment, and show up when it matters most.The interfaces will change. The algorithms will evolve. But empathy, awareness, and real human presence remain our most essential safeguards—and the one system we must never automate.In memory of Adam, let us use this moment as impetus—to demand that every conversation, every interaction with AI, is guided not just by intelligence, but by compassion, oversight, and a shared duty to protect our children.If you or anyone you know may be struggling with suicidal thoughts, resources are available. In the United States, call 988, the Suicide & Crisis Lifeline, or visit suicidepreventionlifeline.org.Other Resources:Crisis Helplines* 988 Suicide & Crisis Lifeline: Call or text 988, or chat at 988lifeline.org — Available 24/7 for any mental health crisis or suicidal thoughts, nationwide.* Teen Line: Talk to a trained teen about any concern, big or small. Call (310) 855-4673, text "TEEN" to 839863, or visit teenline.org.* California Youth Crisis Line: 24/7 support for ages 12-24 in California. Call or text 1-800-843-5200.* The Trevor Project: Crisis support for LGBTQ youth, 24/7. Call 1-866-488-7386, text START to 678678, or visit thetrevorproject.org.Support & Information* American Foundation for Suicide Prevention: Education, advocacy, and resources for anyone affected by suicide. afsp.org.* National Institute of Mental Health (NIMH): Information, tips and outreach materials on suicide prevention. nimh.nih.gov/health/topics/suicide-prevention.* National Alliance on Mental Illness (NAMI) Teen & Young Adult HelpLine: Peer support and resources for teens and young adults. Call 1-800-950-NAMI (6264) or visit nami.org/support-education/nami-helpline/teen-young-adult-helpline.* Society for the Prevention of Teen Suicide: Practical info for parents, students, and schools. sptsusa.org.For Families and Educators* Suicide Prevention Resource Center: Training, toolkits, and guidance for communities and schools. sprc.org.* Centers for Disease Control and Prevention (CDC) Suicide Prevention Resources: Evidence-based community strategies and guides. cdc.gov/suicide/resources.#aipolicy #sb243 #techaccountability #openai # teenmentalhealth #responsibleai #aiethics #chatgpt #characterai #parentingindigitalage # mentalhealthsupport #deeplearningwiththewolf #dianawolftorres This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

The Honeymoon PhaseYou know that feeling when you first open a chat with an AI?It's magic. You ask something, it nails the answer. You ask for a tweak, it remembers your first request and incorporates it perfectly. You feel like you've found a thinking partner who's tireless, patient, and maybe just a bit witty.Then… somewhere along the way… it changes.By message 10, it's forgetting things you said two minutes ago. By message 20, it's making up facts or circling back to ideas you already rejected. By message 30, it's confidently making stuff up.Welcome to context rot—the AI equivalent of your friend slowly zoning out mid-conversation.Other Names for the Same PainIt's not always called "context rot." Depending on who you ask, you might hear:* Context decay – when details fade like old handwriting* Lost in the middle – a nod to research showing AI often forgets what's buried in the middle of long inputs* Token overload – the blunt, engineering way of saying "you fed it too much at once"* Conversational drift – when the chat slowly wanders off-course* AI brain fog – the meme version“I may have lost the thread, but I’m still confident.”Voices from the WildI did a quick walk-through Reddit to find some frustrated users feeling this pain. These are all quotes from the past three months, lest you think recent model updates have magically solved this problem.One user nailed the fundamental problem:"I feel like maintaining context... is the biggest shortcoming of LLMs right now."Another described the exact moment things go wrong:"Context rot. If it's getting confused... start a new chat if the history is adding confusion instead of clarity."Some treat it like AI exhaustion:"Just like how you get brain rot, you'll give the poor LLM context rot. Quality over quantity is key."Some describe the experience vividly:"It's like explaining something to someone who's slowly falling asleep while you're talking."Others point to the technical reality:"Even with large context sizes, there are facts in the middle that can get missed—RAG helps fill the gaps."And the statistical truth:"The longer your context becomes, the more statistical confusion it will cause..."Original source links at the end of this article.Why the Rot Sets InPicture the AI's context window—its working memory—like a whiteboard in a busy meeting room.At first, there's plenty of space for clean, organized notes. But as the conversation grows, the board fills up with overlapping ideas, side comments, and tangents. Even though nothing gets physically erased yet, the important stuff becomes harder to find among the clutter.Three main culprits drive the decay:Too much noise Long chats mix relevant facts with small talk, rabbit holes, and random asides. The AI struggles to separate signal from noise.Middle content amnesia Research confirms what users experience: models focus heavily on the start and end of conversations, while middle content gets fuzzy. It's like remembering the beginning and end of a movie but losing track of the plot in the middle.Statistical confusion The AI isn't "thinking" like humans—it's predicting the next word based on patterns. Too much competing information clouds those predictions.As one user explained:"The longer your context becomes, the more statistical confusion it will cause because there are so many things to remember."⸻How to Stop the Rot: A Practical Survival GuideBreak It Up Long, meandering conversations are where performance nosedives fastest. Keep chats focused on a single goal. Example: Instead of one 50-message chat about "improving my website," start separate chats for "homepage copy," "SEO strategy," and "design feedback." Break down your needs into smaller pieces and start new chats for new tasks.Summarize Before Moving OnWhen you start a fresh chat, give the AI a concise recap of the essentials:* The current task* Key facts or constraints* Any important decisions already madeThink of it as handing your AI a cheat sheet before the testUse External NotesFor ongoing projects—stories, codebases, research—store summaries in a separate document. Paste relevant sections into fresh chats instead of forcing the AI to dig through conversational archaeology.One user's workflow:"I save lore and characters in a text file. At the end of each session, I have it summarize the storyline and upload it into the new session."Reset When It WobblesThe moment it starts repeating mistakes or ignoring clear instructions, restart the chat. Don't try to coach it back on track—fresh context works better than corrections."The number one fix is to reset the chat after 3 failed attempts. Fresh context, fresh hope."5. Use RAG (Retrieval-Augmented Generation)This is a fancy way of saying: keep important information in a separate database and feed it in only when needed. Instead of stuffing everything into one conversation, the AI retrieves relevant bits at the right moment."Even with large context sizes, there are facts in the middle that can get missed—RAG helps fill the gaps."The Bigger PictureContext rot isn't just an AI quirk—it's a reminder that more information isn't always better. Whether you're chatting with AI or managing human projects, curation beats overload every time.The most productive conversations happen when you remember: the AI is a powerful tool, not a patient therapist. It works best when you give it focused problems to solve, not sprawling life stories to unravel.Next time you find yourself frustrated as your AI drifts off-topic, remember: it's not getting tired or rebellious. It's just lost in the maze of context you built for it.The solution isn't to give up on AI—it's to become a better conversation architect.Video version of this article:Sources:“I feel like maintaining context … is the biggest shortcoming of LLMs right now.”u/brown2green – r/LocalLLaMA (about 3 months ago)🔗https://www.reddit.com/r/LocalLLaMA/comments/1kotssm/i_believe_were_at_a_point_where_context_is_the“Context rot. If it’s getting confused… start a new chat if the history is adding confusion…”u/Resident-Rutabaga336 – r/ChatGPT (recent months)🔗 https://www.reddit.com/r/ChatGPT/comments/1meey3b/we_all_can_relate_to_this“Just like how you get brain rot, you’ll give the poor LLM context rot. Quality over quantity is key.” u/RPWithAI – r/JanitorAI_Official (3 weeks ago) 🔗 https://www.reddit.com/r/JanitorAI_Official/comments/1m7ext5/context_rot_large_context_size_negatively_impacts“Even with large context sizes, there are facts in the middle that can get missed—RAG helps fill the gaps.” u/SkyFeistyLlama8 – r/LocalLLaMA (3 months ago) 🔗 https://www.reddit.com/r/LocalLLaMA/comments/1kotssm/i_believe_were_at_a_point_where_context_is_the“The longer your context becomes, the more statistical confusion it will cause…”u/martinerous – r/LocalLLaMA (recent months)🔗 https://www.reddit.com/r/LocalLLaMA/comments/1f057ns/does_model_output_inherently_degrade_as_context#ai #llms #contextrot #promptengineering #generativeai #rag #machinelearning #futureofwork #aidevelopment #nlp #deeplearningwiththewolf #dianawolftorres This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Imagine you’ve missed two days of work. Not a week. Not a month. Just two days.When you come back, the world has shifted. A new model has dropped. A breakthrough paper is everywhere. A tool you relied on has already been replaced by something faster, cheaper, and better.For Kriti Goyal, this isn’t an exaggeration—it’s her daily reality as a machine learning engineer. “The pace is overwhelming,” she says. “If you step away for even 48 hours, it feels like you’ve missed so much.”And yet, she speaks about it with something closer to awe than exhaustion. For her, this relentless speed isn’t just a challenge. It’s what makes working in AI exhilarating. It’s the reason she’s fascinated by the field’s rapid democratization: small, efficient models that no longer demand a supercomputer or a massive cloud bill to run.“Today, a hospital can deploy its own model locally,” she explains, “and take care of its own privacy concerns without sending sensitive data anywhere else.” In her mind, this is more than a technical shift—it’s a quiet revolution, one that is pulling AI out of centralized labs and placing it directly into the hands of those who need it most.The Ice Sculpture PrincipleKriti has a favorite metaphor for her work: “AI is like an ice sculpture—it has to hold under pressure and work flawlessly.”She laughs when she says it, but she’s not joking. It’s her way of describing the unforgiving nature of production AI. Demos are easy; anyone can hack together a proof of concept that works in ideal conditions. But real-world systems? Those are built to withstand heat lamps, impatient users, and the occasional hammer someone swings at your creation just to see if it will break.“Building a demo is one thing,” she says. “But turning that into something reliable, something that people can actually trust, is a completely different challenge.”That mindset—part precision engineering, part entrepreneurial grit—shapes how she sees the future of AI: tools that are not only powerful, but robust, private, and safe enough to be trusted in mission-critical environments.From CV to NLP: A Personal JourneyKriti didn’t set out to become a machine learning engineer. Her path started in computer vision, pulled in by professors whose enthusiasm for the field was contagious. “They showed me how much you could do with images and algorithms,” she recalls. “It was like magic, but grounded in math.”Back in 2019, much of her work was rooted in traditional machine learning. “We were still in this world of feature engineering and heuristics,” she says. “Rules were easier to understand.” But as deep learning swept in, everything changed. The models became larger, the methods more complex, and the once-clear boundaries between CV and NLP began to blur.That transition, she says, was both exhilarating and daunting. “The field was evolving so fast that you had to evolve with it. It wasn’t just about keeping up with the papers—it was about constantly rethinking how you build.”It was this relentless pace that sharpened her instincts for efficiency, infrastructure, and scalability. She didn’t just want to build models—she wanted to build systems that could run those models faster, cheaper, and more reliably.Networks, Not Job BoardsIn today’s AI job market, one posting can attract a thousand applicants in a single day. “You can’t rely on applying cold,” Kriti says. “Networking is how you stand out.”It’s not a theory—it’s how she’s built her own career. She speaks candidly about the cultural shift she experienced after moving to the U.S. “In India, companies come to you,” she explains. “Here, you have to hustle. You didn’t grow up in this culture, so you have to learn it. It’s not a complaint—it’s just the reality.”For her, that reality became a strategy: connecting with peers, staying visible in the field, and building relationships both inside and outside of the workplace. “Networking isn’t just for job hunting,” she adds. “Even if you take time off between college and grad school, or you’re early in your career, those connections matter. They’re what lead to opportunities—especially the early startup roles that never make it to job boards.”This is why, when asked what advice she’d give to young engineers, she doesn’t hesitate: “Start building your network now. Not later. Now.”Write Your Way Into the FieldIf Kriti has one piece of advice that surprises engineers, it’s this: don’t just build—write.“Put your work on GitHub,” she says, “but don’t stop there. Write about it. Give your smart take on what you’ve built.”To her, visibility in AI isn’t just a matter of posting code or linking to a project. It’s about adding context—explaining what you learned, why it matters, and how you approached it. That, she argues, is what turns a side project into a signal of expertise.She even cites a favorite quote—attributed to Benjamin Franklin: “Either write something worth reading or do something worth writing.” For Kriti, the best engineers do both.“This is how you get noticed,” she says. “Not just by recruiters, but by the community itself. Writing forces you to think clearly, and it helps other people see how you think. That’s what opens doors.”The Future of AI (and the Ice Sculpture That Won’t Break)When Kriti looks ahead, she doesn’t see a future dominated by ever-larger models. She sees a world where AI becomes smaller, faster, and closer to the people who need it most.“Not every problem needs a 500-billion-parameter model,” she says. “Smaller models that you can fine-tune and run locally—that’s where so much of the opportunity is.” Hospitals are her favorite example: privacy is non-negotiable, so the ability to keep data on-device isn’t just a convenience—it’s a breakthrough.But what excites her just as much is what most people overlook: the difference between building a demo and building a product.“Building a cool AI demo over the weekend is like creating an ice sculpture,” she explains. “It’s beautiful, it gets ‘oohs’ and ‘aahs’ in a controlled environment—but it’s fragile and melts under pressure.”The real challenge? Building something that doesn’t melt. “A real product is like a bridge,” she says. “It has to withstand storms, carry immense traffic, and work flawlessly millions of times without a catastrophic failure.”This, she adds, is the unglamorous side of engineering: defensive design, not just to make things work—but to make them safe. “You’re preparing so your bridge can get nuked, and you still have to prevent the bad actors from taking down your product or harming users.”And yet, for all her precision and discipline, Kriti remains deeply optimistic. For her, this isn’t just a field—it’s a craft. A craft that rewards speed and rigor, yes, but also creativity, collaboration, and the quiet discipline of engineers who keep showing up, carving the details, and building something that lasts.Build Tools That LastTwo days. That’s all it takes to feel behind in AI. But for Kriti Goyal, that pace isn’t a warning—it’s an invitation.Because while the tools may change every 48 hours, the principles don’t: build things that matter, build them to last, and never stop learning. From fine-tuned hospital models to the “ice sculpture” reliability that production AI demands, her world is proof that speed and craft can coexist—if you’re willing to keep carving.And maybe that’s the real lesson. AI isn’t just racing forward. It’s also being shaped, one decision, one model, one engineer at a time. And in a field where change never slows down, that kind of steady hand is exactly what endures.Interested in connecting with machine learning engineer Kriti Goyal ? You can find her on LinkedIn. Her technical expertise is remarkable—but just as importantly, she’s generous with her insights and a genuinely thoughtful human being.#ai #machinelearning #mlengineering #techcareers #deeplearning #modeldeployment #trustworthyai #aiforhealthcare #scalingai #privacybydesign #deeplearningwiththewolf #dianawolftorres #kritigoyal This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

NotebookLM has been my quiet productivity companion for months. I used to wrestle with recording my own podcasts — multiple takes, second-guessing every syllable, and worst of all, hearing my voice on playback. (All of us can relate to being our own worst critic.) Then NotebookLM introduced audio overviews, and everything changed. No more late-night re-records. No more wondering if I sounded like I had a head cold. Just AI-generated audio summaries that let me focus on the content instead of the mechanics.Now, Google has taken the next step: Video Overviews.But before you imagine instant Hollywood-level magic, let me be clear: this is still day one. And on day one, even the best AI tools have their quirks.When Research Becomes a Movie (Sort Of)Video Overviews take your sources — PDFs, Google Docs, web pages, even YouTube transcripts — and spin them into AI-narrated slideshows with visuals, diagrams, and key excerpts. It’s not flashy animation, but it’s surprisingly good at transforming text-heavy materials into something that feels (more or less) watchable. For my “first attempt” video, I used the “Discover” feature on NotebookLM, (a feature that seems to be limited to the desktop version only.) With this feature, Notebook will do your research for you. You need only bring your concept.I wrote a simple prompt telling NotebookLM I wanted a video about NotebookLM. It very quickly found ten sources, (and more isn’t always better. I will explain in a moment.)I clicked “Generate” and… waited. And waited. Somehow, I didn’t realize I’d clicked the Generate button again. All total, I ended up with three videos. Oh, that would explain the wait. (Other users, though, reported an average wait time of 12 minutes per video.)Since I had three videos, I went through them to see the results. And… it was like watching a bunch of PowerPoint presentations about NotebookLM. (Yawn.) I couldn’t even get through them all, so I won’t torture you with them here.OK, this will NOT do.I used all of those sources to create a “Briefing Document” in NotebookLM and then created this article. I then used this article to create the Video overview.And, then I was able to create an interesting Video Overview.So, what did I learn?I wouldn’t call it “garbage in, garbage out,” as all of those sources were accurate. More like “stuffy and uninteresting in” and “stuffy and uninteresting” out. The video overview can only generate “good stuff” from “good stuff.”How to Get Started with Video OverviewsIf you want to try it yourself, here’s the quick path:* Upload your sources (PDFs, Docs, or even YouTube links) into NotebookLM.* Select “Video Overview” in the new Studio panel.* Add a steering prompt (e.g., “Explain for beginners” or “Focus on financial trends”).* Click generate — then be patient. (Coffee helps.)* Review and refine. You can adjust prompts or generate multiple versions until it’s right.Pro Tip: Start with smaller documents before you throw a 200-page market report at it.What You Can Do With NotebookLMYou can use NotebookLM for a wide range of tasks, from breaking down complex research papers into digestible summaries to creating study aids like video overviews and mind maps. Educators can turn lesson materials into structured multimedia content, while students can generate simplified explanations or exam review guides. In business settings, it can summarize financial reports, prepare briefing documents, or create quick training resources. Even for personal learning, NotebookLM can organize and explain dense topics, helping transform scattered sources into clear, actionable insights.How Video Overviews Differ From Audio OverviewsVideo, obviously. But beyond the fact that you can actually see things, Video Overviews go further than their audio-only cousins. While Audio Overviews provide quick, podcast-style summaries you can listen to while folding laundry, Video Overviews turn your source materials into narrated, slide-style presentations. This makes them especially useful for explaining charts, diagrams, and other content that benefits from visuals. The voice used in Video Overviews is also different from the two familiar voices in Audio Overviews, and while it currently has fewer style options, it delivers a clear, structured experience that works well for topics where “just listening” isn’t quite enough.How Will This Help Me?Before I started to use NotebookLM for my podcasts, I recorded them myself. Picture me - usually in my shed, as I attempted to find a quiet spot- surrounded by too many helmets and a lot of paint. It took me multiple takes to get a single podcast done, sometimes taking hours. All of this took time away from writing. In the "video overview,” they describe it as “pure fun.” Eh, that’s a liberal interpretation. Creating a podcast is hard work, and I did it as a way to help promote the newsletter. But, ironically, it took precious time away from the newsletter.So, when Google burst onto the scene with their AI tool that could record podcasts for me, I happily turned over the mic. More time for writing? Yes, please. But, this wasn’t just about freeing me from a task that was often frustrating. Audio overviews created extra hours in my workflow. With those extra hours, I made THE DROIDS NEWSLETTER. Now, my son has joined me as part of the editorial team. It’s been a fantastic project, and all of it happened because I found a few extra hours in my week.Final Thoughts- whether to video or audio?NotebookLM’s Video Overviews won’t replace human insight — but they are another tool to help break down your research. Research feels less static. Learning feels less one-dimensional. Even the dreaded quarterly report starts to look… almost approachable.Now, this being said, there are times when I still want audio. Each of these tools has its time and place. I could envision myself creating these videos when I want to create quick little “explainers.” (Google has another great tool called “Google Vids,” also just launched, that is excellent for creating explainer vids. I’ve been on the Google Labs testing team for that one for over a year and highly recommend it.) But, a few minutes ago, I spotted an announcement from Google DeepMind and a new paper about the AlphaEarth AI model. Secret confession: I love listening to academic papers as I fall asleep at night. So, within a few minutes, NotebookLM had generated a 12-minute audio overview of AlphaEarth. Perfect. Can’t wait to hear my latest bedtime story from Google. It’s not magic, but it’s a glimpse of how a research tool can improve your daily life. Fun Facts (Because Why Not?)* 🎙 I have three Spotify channels, two YouTube channels, and two newsletters. So, yes, I do a lot of research. * 🎧 There are two Spotify channels named “Deep Learning with the Wolf” — a quirk of Spotify’s RSS feed system. Long story. No regrets. Both are great. There are no wrong choices here.* 🏒 I was once a DJ at 89 WGSU Geneseo and the “Ice Knights” hockey color commentator. Fun twist: the first hockey game I ever saw was also the first one I called live. Turns out, improv is a life skill.#deeplearningwiththewolf #thedroidsnewsletter #googlenotebooklm #googledeepmind #audiooverview #videooverviews #dianawolftorres #alphaearthfoundations This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Yesterday, I shared my first real adventure with AI agents—specifically Perplexity’s #Comet—and how it helped me crank out a surprising number of “mini-articles.” (I’ll explain that experiment in more detail soon.) While I focused mostly on the hilarious moment when Comet got hopelessly lost on the Ideogram site—like a digital puppy chasing its tail—I probably didn’t give enough credit to what it did do well.One real win: Comet pulled some excellent sources on the shifting landscape of childhood in the age of AI.And the timing couldn’t have been better. Kaspersky just dropped a new report exploring what kids’ online lives really look like in 2025. From screen time to digital friends to new threats, the report unpacks the latest trends—and the growing need for awareness as AI weaves deeper into everyday life.Childhood in the age of AI looks nothing like it did a few years ago. Kaspersky’s just-released report unpacks the newest shifts in kids’ online lives—highlighting what’s changing, what’s trending, and what to watch out for.* AI curiosity more than doubled: Over 7.5% of all kids’ searches are now AI-related, up from just 3.19% last year.* Character.AI breaks out: First time in the Top 20 kid-used apps, alongside rising interest in ChatGPT and Gemini.* YouTube holds the crown: Maintains #1 spot as the most-used app, with usage rising to nearly 30%. WhatsApp overtakes TikTok for #2.* Gaming and memes boom: Browser games like Sprunki and meme-driven humor set the pace for digital youth culture.* Streaming apps remain strong: Nearly one in five searches are for streaming platforms—including Netflix and Disney+.* Risks increase: Kids encounter more complex, sometimes inappropriate, AI content, sparking new safety concerns.* Kaspersky’s advice: Keep communication open, educate on cyber hygiene, and use digital monitoring tools for safe exploration.The digital world won’t wait for us to catch up. It’s time to rethink digital literacy and safety for a generation that’s truly growing up AI-native.The Full Report from Kaspersky- What Kids Are Searching in 2025.#OnlineSafety #AIParenting #KasperskyReport #DigitalLiteracy #RaisingDigitalNatives #FutureOfChildhood#DeepLearningWithTheWolf #DianaWolfTorres This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Today was supposed to be a standard writing day: me, coffee, AI headlines, and one short conference call.Plan: Execute.Instead, during that one call:🧠 OpenAI dropped the ChatGPT Agent—a fully agentic AI that can browse the web, click buttons, fill out forms, and build docs or slides. In short, it can do things, not just talk about them.🌠 Simultaneously, Perplexity granted me access to Comet, their new agent that lives inside your browser. I’d been on the waitlist, and I’d volunteered for testing, so maybe I stacked the deck. Either way, it cheerfully just appeared in my browser just as OpenAI was promising us the future.An agent war, announced in real time, while I was blowing the steam off my coffee.Is This Even Real?Naturally, my first reaction was suspicion. The Comet app immediately requested access to all my Chrome passwords.Wait—what? It felt like the start of a phishing scam: target nerds who love early tech, trigger a browser pop-up, and ask for access to the Chrome keychain. Deviously clever.ChatGPT is my go-to tech support these days. I asked: “Help me verify this.”Chat took the job seriously. We opened Terminal windows, ran security checks, and verified installation paths. (It passed.) It even explained how I could run Comet without giving it access to every password I’ve ever saved.So I let Comet in… with conditions. No, Comet, you may not know my entire online life. You can log into Perplexity, sure. But everything else? You’ll have to earn that level of trust.Comet asked if I wanted it to be my default browser. Comet… we just met. We can’t already be besties. (I mean, I do have a second laptop, so maybe there’s room for something to blossom. But let’s not rush it.)Agents at Work (Sort Of)I’ve been writing a lot of mini-news stories lately. Think AI and robotics headlines—short, timely, useful. They take time to research, write, and package, especially when paired with original artwork.This seemed like a perfect test.I asked Comet to help me:* 🧠 Find good stories* 📝 Draft them using my format and subtitle structure* 🎨 Generate matching imagesIt did surprisingly well on the first two. Fast, competent, and formatted exactly as I requested. For a first run? I was impressed.Then came the artwork.When “Integration” Isn’tI noticed a little “Ideogram” tab in the Comet sidebar. Exciting! This looked like a direct integration—a seamless way to generate images without leaving the tool.So I gave Comet my artwork style prompt and told it to get to work.I give it a solid B- for trying very, very hard. (Chat wanted to give Comet and "F" for failing the assignment. Seriously, Chat?)Comet navigated to the Ideogram website, but from there, it absolutely lost the plot. It couldn’t find the “Create” button. It kept getting lost in the navigation of the page and scrolling endlessly through the artwork of the public pages. I mean, I do that, too, when my blood sugar is low and my attention levels are shot.Comet narrated its journey with an epic monologue worthy of those first 100 pages of LOTR. You know, a story that kind of goes on and on and on and on and on... and you wonder? Where is this going?It landed on an account named “Generate” and tried to interpret that as a verb. It gave itself pep talks in long internal monologues, scrolling aimlessly and narrating the experience like a lost tourist reading every street sign aloud.Eventually, I stepped in and said, “The button’s the plus sign in the black circle. Bottom of the page.”More scrolling. More monologuing. Finally, Comet stopped and told me:“You can generate your image now.”Oh. Thank you. For… warming up the interface?That saved me a LOT of time.Hooray agents?What Went Wrong?Chat tattled on Comet: it didn’t have API access. That was the issue.I’d been feeding ChatGPT screenshots of Comet’s flailing attempt to use Ideogram, hoping it could help me troubleshoot. I could have asked Perplexity support, but that would’ve returned 37 scholarly articles, six GitHub links, and a whitepaper. Chat, at least, gives me a straight answer—eventually.Here’s what we pieced together: Comet couldn’t click buttons, verify logins, or pass prompts inside Ideogram. That level of access usually requires APIs or some kind of built-in integration. Comet had a front-row seat to Ideogram, but no backstage pass.Sure, I could’ve done it the developer way—via API—but I’m a writer. I don’t want to manage tokens. I want to say: “Write the article. Make the picture.”And then go work on something fun in my shed.That’s the promise of agentic AI. But today? We’re not quite there.Not a failure. Just a reminder: agents still have to learn which doors push and which ones pull.So What Can They Do?Honestly? A lot. But not everything.Agents like Comet and ChatGPT Agent represent a shift from language-only AI to actionable AI—systems that can complete complex, multi-step tasks without you micromanaging each step.But they’re still learning the terrain.* They can write.* They can search.* They can follow templates and click around familiar apps.But:* They struggle with unfamiliar interfaces.* They can’t always verify session states or pass security barriers.* They still need you in the loop.Today was a good reminder that the future is here—but it still needs a human holding the map.And, also today...Open AI Introduces ChatGPT AgentAt first glance, the ChatGPT Agent announcement might look like just another upgrade. But today’s news marks something far more transformative. This isn’t just a smarter chatbot. It’s an AI that does things.The new ChatGPT Agent combines several earlier experimental features—like web browsing, code execution, and file handling—but adds the ability to interact with websites, fill out forms, click buttons, and build full documents or slide decks… all within a secure, sandboxed virtual machine inside ChatGPT. Think of it like giving your AI a mouse, keyboard, and private desktop—and watching it go to work on your behalf.You can hand it a task like:* “Book me a flight under $300 from SFO to LAX.”* “Research a list of AI tools for education, compile a Google Doc, and draft an intro email.”* “Generate a chart using my uploaded CSV, insert it into a slide deck, and write speaker notes.”The kicker? It asks before doing anything consequential. This isn’t a runaway script. It checks in before sending emails or making purchases.OpenAI calls this a “fully agentic AI.” And while it’s early days, the direction is clear: ChatGPT isn’t just an assistant anymore. It’s aiming to become your AI teammate—one that’s helpful, autonomous (with boundaries), and capable of navigating the same internet you do.* Agents are real—they’re not coming tomorrow, they’re live today.* This is the next step in AI: from answering to acting.* Comet showed promise—it just needs integration polish.* GPT-4o+Agents can already speed up heavy-lifting tasks—research, formatting, packaging.And me? I still had to do the thinking, editing, a whole lot of rewriting- and yes- explain why Comet got stuck so badly it made me laugh. It took me back to gently coaching elementary schoolers—and I’m grateful for the reminder that assistants might show up… but they don’t replace the teacher.#ChatGPT #OpenAI #PerplexityAI #CometAI #AgentFails #RobotAssistant #HumanInTheLoop #WritersLife #DeepLearningwiththeWolf #DianaWolfTorres #Perplexity #ChatGPTAgent This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Imagine waking up one day to find that your face has been used in a video you never authorized—perhaps endorsing a product you detest or uttering words you never spoke. As AI-driven deepfakes blur the line between reality and fabrication, Denmark is stepping forward with a bold, pioneering law that might just change the way we own ourselves in the digital era.In an era where your likeness can be copied, manipulated, and weaponized with alarming ease, Denmark is preparing to become the first country in Europe to grant citizens copyright-like control over their own faces, voices, and bodies. This radical legal shift, championed by Culture Minister Jakob Engel-Schmidt, seeks to transform personal identity from an intangible social fact into a form of intellectual property. The proposal aims to empower individuals with unprecedented rights to their physical selves—rights that, until now, belonged mostly to corporations or creative industries.The Anatomy of a New Law: What Denmark Is ChangingAt its core, the proposed law rewires the traditional boundaries of privacy and copyright. It would treat your face, voice, and bodily presence as if they were creative works, much like a musician owns a song or a painter owns a canvas. This means:* Ownership of Your Likeness: Your physical identity—face, voice, and body—would legally belong to you. Any replication by AI systems without your consent could be deemed an infringement, granting you control over how your digital “self” is used.* Deepfakes Under the Legal Lens: AI-generated deepfakes—highly realistic digital recreations of individuals—would be treated similarly to pirated media. The law would prohibit the creation and dissemination of deepfakes without explicit authorization, giving victims the power to demand removal of unauthorized content.* Civil Enforcement Rather than Criminal: Unlike criminal statutes elsewhere, Denmark’s approach is civil. Victims can issue takedown demands and seek compensation through civil courts. Platforms failing to comply face severe fines, but individual offenders won’t face jail time.How Will This Play Out in Practice?The mechanism closely resembles the familiar DMCA takedown system used for copyrighted content online:* If someone crafts a deepfake using your likeness without permission, you can issue a formal takedown request to the hosting platform.* Platforms that do not remove infringing content risk hefty fines and possible enforcement actions coordinated with the European Union.* Victims can pursue monetary damages under existing compensation frameworks.* Crucially, parody and satire remain protected, ensuring that the law respects freedom of expression and comedic critique.Why This Matters: A Paradigm Shift in Digital RightsDenmark’s initiative represents a legal innovation born out of necessity. The rapid advance of generative AI technologies has exposed gaps in existing legal frameworks. Traditional privacy laws struggle to tackle the novel challenge of identity manipulation at scale, while copyright law has not conventionally recognized one’s own likeness as property.By elevating the physical self to a form of intellectual property, Denmark offers a template that blends privacy, personality rights, and copyright into a cohesive new category. This approach:* Pioneers a New Model: Denmark could become the first European nation—and among the very first globally—to enact such sweeping digital identity protections.* Responds to Technological Reality: With AI capable of producing convincing fakes in seconds, a stronger legal shield is urgently needed.* Signals EU-Wide Ambitions: Denmark plans to leverage its upcoming presidency of the European Union to promote this model, potentially influencing policy across the continent.Global Context: How Denmark’s Law Stacks UpAcross the world, governments are grappling with deepfake challenges but with varying strategies:Denmark’s civil, copyright-like framework contrasts with the criminalized, punitive regimes elsewhere, emphasizing individual control over coercive penalties.The Road AheadThe bill is currently in public consultation with formal parliamentary introduction expected this autumn. If enacted, it will position Denmark as a trailblazer in digital identity rights, potentially influencing legislation far beyond its borders.Yet, challenges remain:* How will courts interpret “ownership” of one’s likeness?* Will platforms globally comply or resist such laws?* Can satire and free speech maintain a protected space amidst stricter controls?Vocabulary Key* Deepfake: AI-generated media that realistically mimics a person’s appearance or voice.* Intellectual Property (IP): Legal rights that protect creations of the mind, like inventions, designs, and artistic works.* Takedown Request: A demand to remove content that infringes rights, often used in copyright law.* Civil Enforcement: Legal actions that involve lawsuits or fines but not criminal prosecution.* Parody and Satire: Forms of expression that imitate or humorously critique, often protected under free speech.Reflecting on Identity in the Age of AIDenmark’s bold experiment forces us to rethink what it means to “own” ourselves in a digital age where identity can be copied, manipulated, and sold without our consent. Beyond legal technicalities, this law taps into a profound human desire for agency over our own image—the face we present to the world, both offline and online.As AI technologies grow more powerful, they challenge the very essence of authenticity and trust. Denmark’s approach does not merely react to a technical problem; it anticipates a future where our digital selves become assets, and where protecting that identity requires new legal imagination.This is more than copyright law—it is a declaration that in the tangled web of algorithms and pixels, the individual must remain sovereign over their own face. The wolf is calling: follow Denmark’s lead, and join the global conversation about how to protect what makes us uniquely human in the AI era.FAQs* What rights would the new Danish law grant to citizens?It grants copyright-like ownership over one’s face, voice, and body, allowing legal control over unauthorized AI-generated use.* How would the law handle deepfakes?Deepfakes created or shared without consent would be considered copyright infringement, allowing victims to request takedowns.* Are there any criminal penalties under this law?No, the law is civil. Victims can seek removal and damages, but no jail time is involved.* Does the law protect parody or satire?Yes, comedic or critical use is explicitly exempt from infringement claims.* Could this law influence other countries or the EU?Yes, Denmark plans to promote this model at the EU level, potentially shaping future AI and digital rights policies.Additional Reading for Inquisitive Minds: Deepfake Laws and Digital Identity ProtectionsFor readers interested in exploring the legal landscape and policy details behind Denmark’s deepfake law and related international efforts, here are reputable sources in MLA format with clickable links:Denmark’s Deepfake Law* “Denmark proposes landmark law to protect citizens from deepfake misuse.” CADE Project, 1 July 2025. Read here.* “Denmark fights back against deepfakes with copyright protection: What other laws exist in Europe?” Euronews Next, 30 June 2025. Read here.* “Denmark wants you to copyright yourself. It might be the only way to stop deepfakes.” Fast Company, 3 July 2025. Read here.* “Danes Could Get Copyright to Their Own Image Under AI Bill.” TIME, 27 June 2025. Read here.* “Denmark taking steps to boost protections against deepfake images.” AP News, 27 June 2025. Read here.France’s Deepfake Law* “France prohibits non-consensual deep fakes.” JD Supra, 15 July 2024. Read here.* “France: Bill Introduced to Require Labeling of AI-Generated Images on Social Networks.” Library of Congress, 7 March 2025. Read here.* “Deepfake laws: Global regulations in the digital age against misinformation.” Yoti, 11 September 2024. Read here.UK Deepfake Laws* “Creating deepfake porn to be made a crime in UK under ‘first-of-its-kind’ law.” Euronews Next, 17 April 2024. Read here.* “Government crackdown on explicit deepfakes.” GOV.UK, 7 January 2025. Read here.* “Government cracks down on ‘deepfakes’ creation.” GOV.UK, 16 April 2024. Read here.* “Campaign win: law to stop deepfake abuse.” End Violence Against Women Coalition, 12 March 2025. Read here.USA: Take It Down Act (2025)* “Text - S.146 - 119th Congress (2025-2026): TAKE IT DOWN Act.” U.S. Congress, 19 May 2025. Read here.* “S.146 - TAKE IT DOWN Act 119th Congress (2025-2026).” U.S. Congress, 19 May 2025. Read here.* “‘Take It Down Act’ Requires Online Platforms To Remove Deepfakes.” Skadden, 1 June 2025. Read here.* “TAKE IT DOWN Act Passes the House, Heads to President Trump’s Desk.” U.S. Senate Committee on Commerce, Science, and Transportation, 28 April 2025. Read here.Podcast Note: The voices you hear are 100% AI-generated using NotebookLM. I love my virtual podcasters—they’re smart, fast, quirky, don’t drink my coffee, and live solely in the digital universe.#ai #deepfakes #digitalidentity #copyrightlaw #intellectualproperty #deeplearning #aipolicy #dataprotection #techlaw #futureofai #privacyrights #digitalrights #aitech #innovation #ethicsinai This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

In the FieldRobotic house-printing isn’t just a flashy proof of concept anymore—it’s industrialized real estate. Systems capable of printing everything from foundations to roofs are moving from pilot sites to livable communities, reshaping construction with autonomy and precision.Phoenix & Vulcan: ICON's Robotic GantriesICON’s Vulcan gantry printer and next-gen Phoenix boom arm are full-structure robotics platforms—capable of delineating walls, infrastructure embeds, and even roofs.* Vulcan covers ~280 m² at 5–7 in/min using proprietary Lavacrete via BuildOS.* Phoenix extends to multi-story builds, reinforces with wire extruders, halves setup time, and slashes cost-per-square-foot to ~$25–80.These systems have already fabricated homes in Phoenix and Georgetown and are now building a 43-unit desert hotel in Marfa, Texas.Global Players Hitting Field Deployments* Apis Cor: A newer player in construction robotics, Apis Cor is just beginning to deploy its portable 3D-printing robots in the U.S. and internationally. The company gained global attention by winning NASA’s 3D-Printed Habitat Challenge with SEArch+, showcasing its innovation in autonomous habitat construction. While Apis Cor’s commercial projects are still emerging, their technology and NASA win mark them as a company to watch.* Luyten 3D: Delivered a functional two-story print in Australia in 32 hours using the AI-enabled Platypus X12.* WASP: Italy’s bio-material robotic printing lab printed the TECLA house from clay with modular dual-gantry arms.ChallengesWhile 3D printing homes is often celebrated for its speed and innovation, not everyone is convinced the technology is ready to revolutionize construction. In the popular YouTube video "Why 3D Printing Buildings Leads to Problems," Stewart Hicks outlines several hurdles that remain for large-scale adoption.“There’s quite a few challenges that are getting in the way, and frankly, the buildings made like this... they look a little weird. Companies across the world are trying to solve these problems by racing to make the process scalable, affordable, sustainable, and palatable to people that would just prefer living in a more traditional looking home.”- Stewart Hicks, Architectural Design EducatorHicks points out that 3D-printed structures face design and material limitations. For example, unlike bricks, 3D-printed concrete can’t easily create sharp 90-degree corners, often resulting in curvy exterior shapes. Openings for doors and windows require extra support, and the tolerance for construction errors is much tighter than in traditional building—meaning small mistakes can have big consequences. Integrating standard building components, like windows and cabinetry, into the uneven surfaces of printed walls can be difficult, leading to gaps or awkward finishes.He also highlights practical concerns about maintenance and flexibility:“If anything happens to the 3D printed part of the structure, it’s almost impossible to repair it back to its original state. What are you going to do, bring out that giant machine? Additions or renovations are all the same thing.”1Finally, Hicks notes that most 3D printing companies are highly vertically integrated, making it hard for outside architects or builders to work with the technology or modify printed homes in the future. For now, he argues, these challenges mean 3D-printed buildings are still a work in progress, with important questions left to answer before they become a mainstream solution.Closing ReflectionI find these 3D-printed homes completely fascinating. The idea that a robotic system can fabricate a real, livable structure—walls, roof, and all—is awe-inspiring. But what excites me even more is the idea of living in one. As an environmentalist, I like the “green” aspect of these homes. (Or, maybe “greener” is a more accurate term.) 3D-printed homes can:* Drastically reduce material waste, since extrusion systems use only what’s needed.* Use low-carbon materials, like ICON’s Lavacrete or WASP’s clay-based compounds.* Minimize transportation emissions by building on-site from local or modular inputs.* Lower energy consumption during production compared to traditional construction.* Enable passive, efficient designs thanks to complex curves and insulating geometries.At the same time, I’m fully aware that these systems still face challenges—whether it’s tolerance for error, integrating standard parts, or scalability. As Stewart Hicks points out, 3D-printed homes can feel unfamiliar to traditional tastes, and retrofitting or repairs raise real issues.Still, I remain optimistic. These hurdles don’t diminish the potential—they sharpen the focus. If robotic construction can overcome them, we won’t just be printing homes. We’ll be prototyping a better relationship between people, machines, and the built environment.#Robotics #3DPrinting #ConstructionTech #AutonomousSystems #BuildOS #ICON #DigitalTwins #ArchitectureAutomation #FutureOfHousing #DROIDs This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

The Shortcut That Comes at a CostWe live in an era of infinite shortcuts. ChatGPT drafts our essays, summarizes articles, and gives feedback with a keystroke. But in this age of intelligent convenience, a quieter question has emerged: What is AI doing to the human mind it’s assisting?A working paper from MIT’s Media Lab titled “Your Brain on ChatGPT: The Accumulation of Cognitive Debt” answers that question with real data—and real brainwaves. Through EEG scans, essay analysis, and memory testing, the study shows that when people write with ChatGPT, their brains work less. Neural connectivity drops, memory declines, and users struggle to recall or reflect on their own work.“The LLM condition showed the weakest brain connectivity and learning outcomes.” (MIT Media Lab, 2025)And the metaphor researchers propose is as memorable as it is cautionary: cognitive debt. The idea that we’re borrowing mental effort from the future—at a cost.🧬 Inside the ExperimentMIT recruited 54 participants and split them into three writing conditions:* LLM Group: Wrote essays using ChatGPT* Search Group: Used Google for research, no AI assistance* Brain-Only Group: Wrote unaided, relying solely on their own thinkingEach participant wore EEG sensors to monitor brain activity, while their essays were analyzed for linguistic complexity, originality, and coherence. After writing, they were asked to recall and explain their own arguments.“We observed a measurable reduction in alpha and beta wave activity—signals associated with attention and active cognitive processing—in the LLM group.” (MIT Media Lab, 2025)📉 What the Brain Does—And Doesn’t Do—With AIParticipants in the brain-only group had the strongest engagement in brain regions tied to synthesis, critical evaluation, and memory encoding.“Those who used their own brains to write—unaided—showed stronger connectivity in parietal and prefrontal regions associated with synthesis, evaluation, and memory encoding.” (MIT Media Lab, 2025)LLM users, meanwhile, produced essays that looked fluent—but were cognitively hollow.“Despite producing grammatically coherent essays, LLM users were less likely to understand or remember their content minutes later.” (MIT Media Lab, 2025)In fact, many could not recall their own thesis or cited sources moments after submission.“LLM usage impaired not just memory retention, but also the ability to reflect on and recall one's own writing.” (MIT Media Lab, 2025)💬 Ownership and OriginalityEven more concerning was the drop in ownership and originality. Essays written with AI were linguistically flatter and structurally repetitive.“Participants using LLMs produced essays with lower linguistic complexity and originality.” (MIT Media Lab, 2025)Students also expressed emotional detachment from the final product.“Students reported feeling a lack of ownership over work completed with AI assistance.” (MIT Media Lab, 2025)This aligns with broader findings: writing isn’t just output—it’s thinking. And offloading that process weakens internal reflection.🔄 The Switch Test: Can We Bounce Back?In a fourth session, some participants switched groups. Brain-only writers got access to ChatGPT; LLM users had their tool removed.“In the final session, participants who had been using LLMs struggled to re-engage their cognitive faculties after the tool was removed.” (MIT Media Lab, 2025)Conversely, those who started with their own thinking continued to engage critically even when given AI tools. They seemed to use LLMs strategically, not passively.“This suggests that reliance on LLMs may hinder the neural development of critical thinking and reflective writing.” (MIT Media Lab, 2025)🧾 Cognitive Debt: A Framework for the AI AgeThe study doesn’t call for banning ChatGPT. Instead, it proposes a powerful framework: cognitive debt. Like a credit card for the brain, the metaphor captures the seductive convenience and subtle cost of outsourcing thinking.“We propose the term cognitive debt to describe the cumulative disengagement and reduced learning observed in LLM-dependent workflows.” (MIT Media Lab, 2025)Used wisely, AI can amplify learning. Used blindly, it can dull the very faculties we hope to develop.🔮 Toward an AI-Augmented MindThe future lies in cognitive design—teaching people how to use AI in ways that build rather than bypass thinking. That means:* Drafting by hand before refining with AI* Using ChatGPT as a coach or partner, not a ghostwriter* Building AI literacy into every level of educationBecause at the end of the day, the goal isn’t to write better essays—it’s to become better thinkers.Think First. Then Prompt.The MIT study asks us to consider a deeper question: what’s at stake when we let machines do the hardest part of learning—the thinking itself?AI is here to stay. But if we want to raise minds that can reason, reflect, and remember, we’ll need to be as intentional with our mental tools as we are with our physical ones.Because every shortcut we take shapes the roads we’ll forget how to build.Read the full paper here. 🎧 Acknowledgment Note for NotebookLM PodcastPodcast production note:The accompanying podcast episode for this article was drafted/recorded using Google’s NotebookLM, which helped summarize and synthesize key ideas from the original MIT Media Lab paper and supporting commentary. Special thanks to the NotebookLM team for their exploratory work in AI-assisted knowledge synthesis. Admittedly, all the research I do with NotebookLM keeps my brain from slowly deteriorating due to AI usage. #mitmedialab #neuroscience #cognitivedebt #chatgpt #llms #aieducation #brainhealth #nataliyakosmyna #eugenehauptmann #yetongyuan #jessicasitu #xianhaoliao #ashlyberesnitsky #irisbraunstein #pattiemaes This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

As the lights dimmed in Paris’s grand Dôme de Paris on June 11, 2025, Jensen Huang appeared under a cascade of laser beams and floating GPU icons. “This is the era of AI factories,” he declared, unveiling banks of Grace Blackwell NVL72 systems humming like futuristic beehives. In that moment, the once-modest gaming-chip architect became the conductor of a global intelligence infrastructure—a fitting culmination to a journey that began with toilet brushes and coffee cups.From Reform School Janitor to Systems ThinkerAt age nine, a family mix-up sent Huang not to the elite boarding school they’d intended, but to Oneida Baptist Institute in rural Kentucky. There, every morning began with the same ritual: scrubbing toilets until they gleamed. Rather than grumble, Huang treated the chore as an experiment. He mapped cleaning routes, timed each swipe, and set self-imposed quality targets. “I was probably the best toilet cleaner they ever had,” he later joked. That early taste of process optimization would echo through every boardroom he led.Denny’s Dishwasher to Data-Center DynamoBy fifteen, Huang balanced high school classes with a night-shift at Denny’s. As dishwasher, busboy, and waiter, he approached each task like an engineer optimizing a pipeline: How many coffee cups could he carry? What’s the shortest walking path between tables? He sketched floor plans in pencil, logged service times, and shaved seconds off every delivery. Those experiments weren’t mere fast-food anecdotes—they were the prototype for tomorrow’s GPU load balancing under NVLink.The Scholar’s Ledger: Frugality and CredentialsWhen tuition bills loomed, Huang chose Oregon State University to keep costs low and earned his BS in electrical engineering without breaking the bank. Later, he enrolled part-time at Stanford, juggling courses with industry R&D. Over seven years, he added a master’s degree without pausing his career—an exercise in resource arbitrage that presaged NVIDIA’s lean approach to capital allocation.Planting the Platform Seed: Founding NVIDIAHuang founded Nvidia Corporation after meeting with Chris Malachowsky and Curtis Priem at an East San Jose Denny’s. If you’re in the mood for both GPU history and a stack of pancakes, this Denny’s is still there - 2484 Berryessa Road. The “Accident” That Redefined ComputingBetween 2006 and 2012, research labs discovered that NVIDIA GPUs—designed for games—excelled at neural-network training. Huang embraced this pattern recognition, launching CUDA, a parallel-computing framework that let scientists harness thousands of GPU cores. What began as a serendipitous side benefit became a deliberate AI-platform strategy:* Market Expansion: Gaming → High-Performance Computing → AI/ML* Product Evolution: Graphics chips → Compute accelerators → End-to-end AI platforms* Value Leap: 10× addressable market growth without rewriting core IP2025 in Paris: AI Factories & Continental SovereigntyAt VivaTech 2025, Huang unveiled NVIDIA’s blueprint for “AI factories”—modular clusters of Grace Blackwell NVL72 racks, each housing 72 Blackwell GPUs linked via NVLink to achieve over 100 TB/s of internal bandwidth. These factories are designed not just for scale, but for efficiency: every watt, every millimeter of rack space, tuned to maximum throughput.He also urged Europe to take control of its compute destiny. Within days, the European Commission’s InvestAI program—already funded at €20 billion—was positioned to finance four continental AI gigafactories. The U.K. government reaffirmed a £2 billion AI investment package (including £1 billion for national compute infrastructure) in its Spring AI Review. And although Macron and Scholz did not speak directly at VivaTech, their joint statements in the conference’s aftermath underscored the geopolitical stakes of digital autonomy in an age of shifting tech power.Speculative Horizons: Rubin, Feynman, & Global AI GridsLooking past Blackwell, Huang offered a glimpse of NVIDIA’s future roadmap:* Rubin (2026): A hybrid GPU+CPU on TSMC’s 3 nm node with HBM4, projected to top 50 petaflops on 4-bit AI workloads.* Feynman (2028): Named for the visionary physicist, this chip will unify next-gen HBM with ultra-dense compute—primed for edge-to-cloud deployments.Envision AI factories powered by wind turbines in Nordic fjords, robotics labs in Germany running digital-twin simulations, and genomic-analysis clouds in Brazil—each built on the same NVIDIA foundation, yet customized to local needs.Looking AheadJensen Huang’s odyssey—from Taiwanese immigrant and reform-school janitor to the mastermind of a worldwide AI-infrastructure network—reveals the power of operational grit married to strategic eyesight. He transformed the discipline of cleaning toilets and optimizing coffee service into the DNA of NVIDIA’s platform play. As AI factories come online around the globe, they carry forward his core lesson: no task is too small, no detail too trivial, when you’re engineering the future of intelligence.Podcast Note:This episode was produced with Notebook LM and features AI podcasters. During a transcript review, one funding figure was mistakenly cited in U.S. dollars instead of euros; the correct commitments are €20 billion for the InvestAI program and £1 billion for U.K. national compute (part of a broader £2 billion AI package).Vocabulary Key* Platform Strategy: Designing a core technology so third parties can build complementary products, creating network effects.* Sovereign AI: Nationally governed AI infrastructure to protect cultural and data autonomy.* NVLink: High-speed interconnect that lets GPUs share data at terabyte-scale per second.* Petaflop: One quadrillion floating-point operations per second—an AI compute throughput benchmark.* Token: A discrete unit of text or data processed by modern language models.FAQsWhy did NVIDIA GPUs outperform CPUs for AI? Their thousands of parallel cores and high memory bandwidth match neural-network workloads more closely than CPUs’ sequential architectures.What is an “AI factory”? A purpose-built compute cluster optimized end-to-end for training and serving large-scale AI models.How does sovereign AI differ from cloud AI? Sovereign AI emphasizes national ownership and governance of data and compute, rather than reliance on global hyperscalers.What role does CUDA play? CUDA is NVIDIA’s parallel-programming platform, enabling developers to accelerate diverse applications on GPUs.#aiinfrastructure #nvidia #gtcparis #deeptech #platformstrategy #vivatech #sovereignai #nvlink #gpu #mlops #futureofwork #nvidia #jensenhuang #deeplearning #deeplearningwiththewolf This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Editor’s Note: Personal views expressed.I usually write about machines that think; today I'm writing about people who decided to do something thoughtful—about a nation that's waking up, stepping outside, and making its voice heard.DIY DemocracyEarlier this week, I stenciled DEMOCRACY across an old t-shirt my son left behind—barely fitting all those letters. Using paints from my Star Wars armor projects, I carefully filled in the lettering. (I'd later discover this paint transfers to skin in the heat, leaving me literally blue by day's end.) With ChatGPT's help, I brainstormed protest slogans and settled on my favorite: "Off With His Crown." A bit of cardboard and glue, and I had my sign.Ready or NotSaturday's forecast promised the 70s, but it felt much hotter. Minutes before my ride arrived, I quickly painted a crown on an old cap with a red cancel symbol through it—cancel culture at its finest. The paint was still tacky as I gingerly got in the car, immediately feeling the nervous energy among our carload of protesters. We compared signs like kids at a science fair: "What'd you make?"Arriving Early—But Part of Something Much BiggerWe got to the planned street corner ahead of schedule, but parking was already nonexistent. What I didn't fully grasp until later was the scope of what we were participating in. I’d seen the “dots on the map” grow all week long until it was 2,000 towns and cities that had planned protests, but I had no idea this would amount to between five and six million people. While the numbers are still being counted- and may never be fully known- this amounts to between 1.6 and 1.8 percent of the population of the United States. It’s staggering.You can't fully capture protest energy—it's electric. Every stranger feels like a friend. Most of the crowd skewed older (proof that wisdom comes with age?), but as the hours passed, more young faces filled the streets. When I spotted a mariachi-blasting flatbed truck and signs in Spanish ("Leave my parents alone"), I knew this was something special.What heartened me most was seeing how many others had taken the time to make their own t-shirts and hand-crafted signs. It was part Maker Faire, all protest—small town America in a small city, repeated all across the country. The DIY spirit was everywhere: stenciled messages, painted banners, creative slogans born from kitchen tables and garage workshops. This wasn't astroturf or manufactured dissent—this was authentic, grassroots democracy in action.A March That Grew and GrewHeat exhaustion struck one of the elders—"Clear a path!" yelled someone, and medics moved in. I walked away, saddened that someone had fallen. Clearly they weren’t in good health and had come out to the protest anyway. This event was so important to them they felt they had to be there. It is a statement of what this country means to people and why they feel democracy is still worth fighting for.As I walked out, a “march” formed- several hundred people strong- walking down our main street (called First Street.) The street winds for a mile down to the church, lined with businesses on both sides.That was our cue to start marching down Main Street. Imagine hundreds of people flowing together with horns honking in solidarity. Somehow 200 people swelled into 800 people. The supporters kept coming and the cars kept coming. Some cars circled around the block multiple times so they could cheer us on again and again- including a Cybertruck that just wanted to be a part of the action. Everybody wanted to be a part of this movement. You could feel this was something.Peace, Joy, and First Amendment Pride—While D.C. Saw TanksOur local police cruised through every few blocks. We waved, we shouted "Thank you!"—a scene I never imagined would feel so natural. No tear gas, no police on horseback, no misplaced Marines or National Guard—just a peaceful, joyous celebration of civic engagement.The contrast was deliberate and stark. As organizers put it: "They’ve defied our courts, deported Americans, disappeared people off the streets, attacked our civil rights, and slashed our services. The corruption has gone too. far. No thrones. No crowns. No kings.”While Trump's parade featured 6,700 soldiers, 150 vehicles including dozens of tanks, and 50 aircraft flying overhead, our movement was about something fundamentally different—ordinary Americans exercising their constitutional rights.What the World Needs to KnowIt may seem to people outside the United States that this country is asleep, or that we’ve lost our collective minds. I want to reassure you that this is not the case and America is still here. A slim majority fell prey to the lies of a snake oil salesman and his car salesman buddy. Now, in communities across America, people of all backgrounds are rediscovering what democracy looks like in action. The protests occurred as part of what organizers called a "nationwide day of defiance", with the timing on Flag Day being intentional: the flag doesn't belong to Donald Trump. It belongs to us.The timing wasn't coincidental. As we marched peacefully down Main Street, ICE agents were executing Stephen Miller's explicit orders to abandon criminal enforcement and target day laborers instead. Home Depot parking lots—where immigrant workers gather each morning hoping for honest work—became ground zero for a quota-driven deportation machine that prioritized optics over justice. It was this injustice that became the flashpoint for what happened in Los Angeles. (Well, that and sending in the Marines to distract the narrative from the Epstein files.)The Networks That MatterProtests will continue. This was bigger than any single demonstration—it was a nationwide network of citizens activating simultaneously, coordinating organically, and demonstrating that democracy's immune system is still functioning.Most of my writing focuses on deep learning and neural networks. But this moment reminded me that the most important networks aren't artificial—they're human. Both kinds require constant attention, active participation, and collective intelligence to function properly. Saturday showed me that when those human networks activate, they're capable of extraordinary things.Tomorrow we'll get back to talking about artificial intelligence. But don't completely give up on the state of human intelligence in the United States. There's hope for us yet.Fast Facts: A Historic DayBy the Numbers:* An estimated 4-6 million Americans protested across the country on Saturday, June 14, 2025 * Over 2,000 cities and towns participated nationwide. Source: The Daily Beast.This represents 1.2-1.8% of the entire U.S. population taking to the streets in a single day.* Independent data analysts suggest this was the largest single-day protest in American history.Historical Context:* The previous record holder was the 2017 Women's March with an estimated 3.3-4.6 million participants * The Trump era has seen "dramatically more protest activity" than his first presidency, with over 15,000 protests since January 2025—a threefold increase * Organizers intentionally avoided downtown D.C., choosing to "organize literally everywhere else" while ceding the capital to Trump's military parade.The Peaceful Contrast:* Trump's parade featured 6,000+ troops, dozens of tanks, and cost an estimated $850,000+ per deportation flight (What to know about 'No Kings' protests against Trump's policies. Source: PBS.)* The "No Kings" protests were committed to nonviolent action. Organizers offered trainings for participants on how to de-escalate confrontations.* No major incidents of violence reported at the democracy protests, while Trump deployed 4,000 National Guard troops and 700 Marines to Los Angeles in response to immigration protestsWhat It Means: Saturday proved that when human networks activate, they're capable of extraordinary things. As organizers put it: "The flag doesn't belong to President Trump. It belongs to us." #FlagDay #NationwideProtests #PeacefulProtest #DemocracyInAction #HumanNetworks #StandUp #WeThePeople #AmericaStillHere #FromAIToActivism #NoKingsDay #Indivisible #TrumpProtests #GrassrootsActivism #CivicEngagement #FirstAmendment #FlagDay #NationwideProtests #PeacefulProtest #DeepLearningwiththeWolf This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

If you've used ChatGPT, Claude, or any AI chatbot in the past year, you've probably seen this advice everywhere: When you want better answers, tell the AI to "think step by step." It's called Chain-of-Thought prompting, and it's been the go-to trick for getting AI to show its work and reason through problems more carefully.But here's the thing: new research from the University of Pennsylvania suggests this widely-shared advice is becoming less valuable—and in some cases, it might actually make things worse.What the Researchers FoundA team led by researchers at Wharton tested this "think step by step" approach across eight different AI models, from ChatGPT to Claude to Google's Gemini. They used 198 PhD-level questions in biology, physics, and chemistry—the kind of questions so difficult that actual PhDs only get them right 65% of the time, and they're "Google-proof" (meaning even 30 minutes of web searching doesn't help much).Here's what they discovered:For newer AI models, Chain-of-Thought prompting often provides only tiny improvements. In some cases, it made performance worse. The reasoning models (like OpenAI's o3-mini and o4-mini) saw average improvements of just 2.9-3.1%—statistically significant but practically small. GPT-4o-mini showed the smallest gains (4.4%) and these weren't even statistically significant.It significantly slows things down and costs more. Chain-of-Thought requests took 35-600% longer than direct answers. That 2-second ChatGPT response? It might now take 7-14 seconds. For reasoning models, the slowdown was 20-80%. Token usage can double or triple, meaning your API bills jump accordingly.Modern AI already "thinks" without being asked. When researchers let models respond naturally (without forcing direct answers), they found many already performed some form of step-by-step reasoning by default. Explicitly asking for it provided much smaller benefits.The researchers tested this by comparing three different approaches: asking for direct answers, asking models to "think step by step," and letting them respond naturally in chat mode. Many modern models already show their work somewhat when given conversational freedom, making explicit Chain-of-Thought prompts less valuable than earlier research suggested.The Catch-22 of Perfect AccuracyPerhaps most surprisingly, Chain-of-Thought prompting created a strange trade-off. While it improved average performance, it actually hurt what researchers called "perfect accuracy"—getting questions right every single time across multiple attempts.For three out of five non-reasoning models tested, Chain-of-Thought introduced more variability in answers. Models would sometimes get "easy" questions wrong that they would have answered correctly with direct prompting, even as they improved on harder questions overall.Gemini Flash 2.0, for example, saw its perfect accuracy drop by 13.1 percentage points when using Chain-of-Thought, despite improvements in average performance. It's like having a student who suddenly starts making careless errors on simple problems while getting better at complex ones.Why This Matters for Real-World UseThis research challenges one of the most common pieces of AI advice circulating online. If you're using AI for tasks where you need consistent, reliable answers—rather than just generally better average performance—Chain-of-Thought prompting might not be your best bet.The researchers tested this rigorously: 25 trials per question across 198 questions per model (that's 4,950 tests per condition). They used multiple accuracy thresholds: 100% correct (all 25 attempts right), 90% correct (23 out of 25), and simple majority (13 out of 25). The pattern held across different measurement approaches.The Evolution of AI ReasoningWhat's happening reflects how quickly AI is evolving. Chain-of-Thought prompting emerged from influential 2022 research that showed dramatic improvements on reasoning tasks. But today's models are fundamentally different from those early systems."We found that many non-reasoning models perform a version of Chain-of-Thought even if unprompted," the researchers note. When you remove formatting constraints and let modern AI respond naturally, it often shows its work automatically.This creates diminishing returns for explicit prompting. It's like reminding someone to breathe—if they're already doing it naturally, the reminder doesn't help much.So What Should You Do?The research doesn't suggest abandoning Chain-of-Thought entirely, but it does recommend being more strategic:For older or smaller AI models that don't naturally show their reasoning, "think step by step" can still provide meaningful improvements.For cutting-edge models, consider whether you really need the step-by-step breakdown. If you're just looking for quick, accurate answers, direct prompting might be faster and just as good.Weigh the trade-offs. If you're willing to wait longer and pay more (through token usage) for potentially more detailed reasoning, Chain-of-Thought still has value. But don't assume it's always better.Consider your consistency needs. If you need the same answer every time you ask the same question, Chain-of-Thought's increased variability might work against you.The Bigger PictureThis research highlights a broader truth about working with AI: what works today might not work tomorrow. As models become more sophisticated, our prompting strategies need to evolve too.The researchers acknowledge limitations in their study—they tested one benchmark with relatively simple Chain-of-Thought prompts—but their findings align with what many heavy AI users have started noticing: the dramatic improvements from basic prompting techniques are becoming less dramatic.It's not that Chain-of-Thought prompting is bad; it's that AI has gotten good enough that it often does this kind of thinking automatically. In a way, that's progress. The technique worked so well that it's now baked into how these systems operate.The challenge for users is staying current with what actually helps versus what we think should help based on advice that was true six months ago. In the rapidly evolving world of AI, even the best practices have expiration dates.This article is based on "Prompting Science Report 2: The Decreasing Value of Chain of Thought in Prompting" by Meincke, Mollick, Mollick, and Shapiro from the University of Pennsylvania's Wharton School.Podcast Note: This episode’s script and show notes were drafted with the assistance of Google Notebook LM, a state-of-the-art AI language model. We’ve reviewed and polished everything for clarity and accuracy. Note: the AI hosts frequently use the phrase “CoT.” They are referring to the common abbreviation for Chain of Thought. #ai #machinelearning #promptengineering #chainofthought #llms #mlops #airesearch #aiexplained #aitrends #aicosts #ethanmollick #wharton This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

“It was doing so well… until it stopped trying.”I haven’t been able to stop thinking about Apple’s new paper, “The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity,” since I first saw all of the chatter about it yesterday on LinkedIn. One LinkedIn poster simply asked: “Are your models actually thinking, or just faking it?” Another poster, Tatyana Mamut, PhD, took a different take on it:Apple's paper is a critique of LRMs, not primary research into AI. And despite its clickbaity title, the paper does not prove that reasoning models don't think. TLDR: They set up experiments which showed that when presented with some highly complex tasks, reasoning models do not work harder to figure out more complex tasks beyond a certain point. For a parent, this is an obvious result: if you give a 4th grader college calculus to solve, they will immediately give up, whereas if you give them a slightly harder arithmetic, they will try hard to figure it out. This is what humans do, too.Here’s my hot take…This isn’t a story about bad prompts or misaligned objectives. It’s a story about a fundamental behavioral ceiling in modern AI. And it might be the most important thing no one in the industry wants to talk about.🧩 Act I: The Rise of the Reasoning ModelFor years, the frontier of AI progress has been measured not just in tokens or parameters, but in its ability to reason. Chain-of-thought (CoT) prompting—urging models to “think step by step”—was heralded as a breakthrough. Soon came “reasoning-optimized” models, billed as being more analytical, more systematic, and more aligned with human logic.These systems now anchor flagship products. They sit behind coding assistants, medical advisors, and planning tools. Their ability to handle complexity is central to their pitch.But what happens when we stop feeding them prompt-engineered softball questions—and hand them real, hard problems?🧱 Act II: The Collapse, DocumentedApple researchers took a different approach. They built a test set using classic logic puzzles—Tower of Hanoi, River Crossing, etc.—and scaled up the difficulty. Models like GPT-4, Claude, Gemini, and others were given puzzles of increasing complexity.At first, performance was strong.Then came the break point.As the puzzles became only modestly more complex, accuracy didn’t just decline—it collapsed. Models went from consistent answers to near-zero correctness.But the most chilling finding? They stopped trying.Instead of producing longer, more detailed outputs—using more inference tokens, as one might expect from a harder problem—they used fewer. In some cases, they cut reasoning effort nearly in half, despite having token room to spare.It’s like watching a student stare at a hard exam question and turn in a blank page—not because they couldn’t try, but because they chose not to.🧠 Act III: Why Would AI Quit?The results point to a deeper issue than just algorithmic failure. They suggest a behavioral bias in large language models:* LLMs are trained on massive corpora where brevity correlates with correctness.* Most training tasks reward fluency and coherence, not persistence under pressure.* They don’t plan—at least not in the way humans do. Their “thinking” is reactive, not goal-directed.In short, these models aren’t thinkers. They’re probabilistic mimics. Give them a problem they haven’t seen before, and they don’t extrapolate—they default to not trying.🔄 Act IV: The Mirror We Didn’t WantThe Apple study does more than just critique model behavior—it critiques our expectations.* We’ve conflated fluent language with deep understanding.* We’ve assumed more parameters equals more cognitive resilience.* We’ve measured intelligence with benchmarks that never asked the models to persist.If our “thinking machines” quit under pressure, then maybe we’re the ones being fooled—by the very fluency we designed.🔮 Act V: Where Do We Go From Here?This study reopens a question long buried beneath the hype: What does it mean for an AI to think?The future may not lie in ever-larger transformers, but in hybrid systems—blending symbolic planning, metacognitive scaffolding, or goal-based reasoning. Or perhaps we’ll build models that monitor their own effort and choose to persist, rather than bow out early.If we want true reasoning, we’ll need to design for struggle, not just success. Intelligence isn’t revealed in how you answer the easy questions—it’s in what you do when the hard ones come.📬 Final ReflectionWe’ve been seduced by the eloquence of our machines. But as this study shows, elegance isn’t effort. We thought we were building thinkers—when really, we were training poets to bluff.In a world where AI decisions increasingly shape lives, we can’t afford systems that bow out when the stakes rise. We need AIs that wrestle with complexity, not recoil from it.Because if our most advanced machines refuse to think—maybe it’s time we did.What do you think? Thanks for reading Deep Learning With The Wolf ! Subscribe for free to receive new posts and support my work.🧰 Vocabulary Key* Inference Tokens: The number of steps a model takes to arrive at an answer. Fewer tokens often means shallower reasoning.* Reasoning Model (LRM): A language model optimized for complex logical tasks, beyond surface-level fluency.* Chain-of-Thought (CoT): A prompting method encouraging step-by-step reasoning.* Accuracy Collapse: A sudden drop in performance as problem complexity increases.* Early Quitting: When a model stops reasoning before reaching a meaningful conclusion, despite having the resources to continue.❓FAQsDo all AI models collapse like this? Most current LLMs, including reasoning-optimized variants, showed this behavior in the Apple study.Why would a model quit instead of trying? They seem to have internalized shortcuts: if it’s hard and unfamiliar, go short and simple. It’s learned, not rational.Can prompting fix this? Prompting helps on simple tasks—but once complexity increases, even CoT prompting fails to prevent collapse.Is this the end of LLMs for reasoning? Not necessarily—but it signals a need for architectural change, not just better prompts or training data.What’s the real takeaway? Fluency ≠ intelligence. If your model’s reasoning fails under pressure, it’s not reasoning—it’s guessing beautifully.Read the original paper. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

The Wizard Behind the CodeAndrej Karpathy and the Rise of “Vibe Coding” in the Age of AI ApprenticesWhat if your next app wasn’t coded—but conjured?In this article, we explore how Andrej Karpathy’s concept of “vibe coding” is changing how software gets made—by talking instead of typing. From AI-generated apps to the interface logic powering humanoid robots, we’re entering an era where natural language becomes the new command line.Featuring insight from Karpathy, robotics grad student Alexander Wolf Torres, and real-world examples of when vibe coding works—and when it breaks.#VibeCoding #AndrejKarpathy #AIProgramming#CodingWithAI #LLMDevelopment #RobotInterfaces#ChatGPT #SoftwareForOne #PromptEngineering#TechEthics #FutureOfCoding #DROIDsScroll This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

A fake hug. A real reaction. In this episode, we explore how GANs and diffusion models are powering viral AI intimacy apps—and what that means for identity, consent, and reality. Whether you’re into the tech or just wondering why your feed feels weirder, we’ve got you.🎙️ Generated with Google NotebookLM. Yes, the hosts love saying “according to the sources.” We noticed too. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

When I interviewed Inna Tokarev Sela, the CEO of Illumex, I wanted to understand what "Agentic AI" actually looks like in the modern enterprise. What I got was a much broader takeaway—one that speaks to the risks, tradeoffs, and opportunities of using AI inside complex organizations.She said: "Your AI should only be using your data."Simple. But it rewires how you think about trust, hallucination, and infrastructure.Trust Isn’t a Feature. It’s a Foundation.Inna’s point is deceptively simple—and quietly radical. Most enterprise AI deployments rely on large language models trained on generalized, publicly available data. Then, they attempt to "fine-tune" these systems to operate within company contexts. But those generalized systems are prone to error. Especially when context is lacking.Take Air Canada. In February 2024, the airline was forced to honor a refund policy invented by its own chatbot. The AI offered bereavement discounts that didn’t exist—an offer the company later tried to disown. In court, they argued the chatbot was a separate legal entity. The judge disagreed, and Air Canada lost the case.These hallucinations happen when AI lacks internal grounding. It doesn't understand the rules, the workflows, or the responsibilities tied to its responses. Illumex’s response to that: build AI that is constrained by design. Grounded in the data that already defines your business.Hallucinations Happen When Context FailsIllumex calls this approach “semantic context.” It doesn’t rely on more training data—it relies on smarter pipelines. Their system integrates directly with company metadata, roles, permissions, and common data access patterns. It tailors responses based on who is asking and what they’re allowed to see.“We reduce the degrees of freedom the AI has,” Inna explained. “The model knows what department you work in, which tools you use, what data you normally access. It’s not free to improvise.”This trust-by-design architecture reframes the goal of enterprise AI. Instead of pushing for chatbots with personality or unlimited flexibility, Illumex emphasizes safety, traceability, and transparency.From Black Box to Glass BoxThe company’s recent Microsoft Teams integration is a case in point. Rather than forcing users into new interfaces, Illumex brings AI into the conversation tools employees already use. It’s less about novelty, and more about trust—meeting people where they work.“About 80% of our enterprise customers already spend their day in Teams,” said Inna. “So instead of adding another interface to learn, we brought the AI to them.”Responses are explainable and auditable. Users can ask a question, see how the model arrived at its answer, and verify the source trail—all without leaving the flow of conversation.Context Is the New MoatThe real innovation Illumex is championing isn’t bigger models—it’s smarter systems. They’re betting on a future where the most trusted AI doesn’t just talk—it understands.“Every organization should own their context,” Inna told me. “Right now, they don’t. They’re outsourcing it to black-box copilots.”That might be the most important idea of all. Trust isn’t something you add on top. It’s something you build from the inside out.And increasingly, it’s not the model that makes the difference. It’s the context that surrounds it.🎙️ Podcast Transparency: The voices in this episode are AI-generated using Google DeepMind NotebookLM. This podcast was created from the original interview transcript with Inna Tokarev Sela, this article, the Illumex website, and the Forbes article on the Air Canada chatbot case.Thanks for reading Deep Learning With The Wolf ! Subscribe for free to receive new posts and support my work.📚 Vocabulary Key Hallucination (AI) When an AI system generates false or made-up information. In enterprise AI, hallucinations are considered serious risks.Semantic Layer An intermediate structure that defines meaning and relationships across data sources, making it easier for AI to interpret and respond with context.Contextual Grounding The process of anchoring AI outputs in the real-time facts, structure, and metadata of an enterprise—so responses are relevant and accurate.Agentic AI A type of AI designed to take purposeful action based on awareness of the user’s goals, environment, and constraints.Black Box vs. Glass Box “Black box” models offer answers without transparency. A “glass box” approach shows how answers are generated, increasing trust and auditability.🤖 FAQs: Agentic AI, Trust, and IllumexWhat is Agentic AI in an enterprise setting? Agentic AI refers to systems that can make informed decisions and take action within a defined enterprise context—without needing constant human prompting. Think of it as a co-worker that knows your team, tools, and company policies.Why are hallucinations such a big deal in enterprise AI? In creative applications, a little imagination is charming. But in enterprise settings—where accuracy matters—hallucinations can result in bad recommendations, legal risks, or costly errors (like refunding airline tickets that were never part of company policy).What makes Illumex different from traditional AI copilots? Illumex doesn’t just layer a chatbot on top of existing data. It builds a semantic layer tailored to your business context—who you are, what department you work in, what tools you use—so the AI stays grounded.Why integrate with Microsoft Teams? Most enterprise conversations already happen in Teams. By embedding directly into that workflow, Illumex meets users where they are—and builds trust by giving them relevant, explainable answers in real time.Can this replace my existing LLM deployment? Illumex is model-agnostic. It’s not trying to be the model—it’s the intelligence layer that makes the model safe, explainable, and enterprise-ready.#AgenticAI #EnterpriseAI #HallucinationFree #TrustworthyAI #AIContextMatters #SemanticLayer #MicrosoftTeams #Illumex #AIInfrastructure #FutureOfWorkResponding to reader comments on Trusty: This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Looking for a shorter version of this story? I did a mini version of it for LinkedIn. 0300 Hours, Forward Operating BaseThe explosion echoes across the compound at 0300 hours. Specialist Rodriguez is down, twenty meters from the perimeter wall, conscious but bleeding. In the dim red light of night vision, Corpsman Martinez can see the soldier's uniform is torn across the chest, dark stains spreading.No time for a full trauma bay. No X-ray machine. No blood bank. Just Martinez, his medical kit, and a soldier whose life hangs in the balance of the next few critical decisions.But in this imagined future—perhaps a decade from now—Martinez reaches for something that doesn't exist today: a ruggedized tablet, olive drab and battle-scarred, about the size of a hardcover book but twice as thick. The device powers on with a muted chime, its screen glowing softly against his gloved hands."Triage protocol, blast injury," he speaks into the built-in microphone.The AI responds immediately in a calm, synthesized voice: "Ready for patient assessment. Deploy sensors."This scenario remains science fiction today. But new research from Harvard, Stanford, and OpenAI suggests the foundational technology for such a system may be closer than we think.The Device That Doesn't Exist YetIn our imagined future battlefield, Martinez's device represents the convergence of multiple technologies:The Hardware: A military-grade tablet encased in shock-absorbing polymer, rated for drops from six feet onto concrete. Inside, specialized medical AI chips—evolved descendants of today's smartphone processors—run compressed diagnostic algorithms trained on thousands of combat injury cases. The 72-hour battery pack doubles as armor plating for the device's back.The Sensors: Martinez unfolds a flexible sensor mat from the device's side compartment—a thin, fabric-like array embedded with hundreds of micro-sensors. As he places it against Rodriguez's chest, it immediately begins measuring heart rate, blood oxygen, temperature, and electrical impedance that might indicate internal bleeding."Patient vitals acquired," the AI announces. "Heart rate elevated at 110 BPM. Oxygen saturation 92%. Suspected fluid accumulation in chest cavity. Recommend immediate assessment for pneumothorax."The Interface: Martinez doesn't need to look down at the screen—critical information displays on his helmet's heads-up display via wireless connection. His hands stay free for medical intervention while the AI guides him through differential diagnosis.But the device has critical limitations. Without cloud connectivity, its diagnostic database covers only the most common battlefield injuries. The AI can analyze what it sees and measures, but it can't order CT scans or lab work that might reveal hidden complications. And when Rodriguez mentions pain in his left shoulder—a symptom that could indicate anything from muscle strain to internal bleeding—the device's certainty drops dramatically."Multiple differential diagnoses possible," the AI admits. "Recommend evacuation for definitive diagnosis."From Fiction to Research RealityThis vivid scenario remains years away from reality. But, researchers are working on the critical building blocks: AI that can outperform human physicians on complex diagnostic reasoning tasks.In a paper titled "Superhuman performance of a large language model on the reasoning tasks of a physician" (Brodeur et al., 2024), teams from Harvard, Stanford, and OpenAI evaluated OpenAI's new "o1" model across five medical reasoning challenges. The results were striking:* On New England Journal of Medicine clinicopathological cases, o1 identified the correct diagnosis in 78.3% of cases—outperforming both GPT-4 and practicing physicians in head-to-head comparisons* In emergency room scenarios using real patient data, o1 achieved 65.8% diagnostic accuracy during initial triage—exceeding two board-certified doctors (54.4% and 48.1% respectively)* In blinded evaluations, attending physicians couldn't distinguish AI-generated diagnoses from human ones 85% of the timeHowever, the researchers emphasized important limitations. As they noted: "Despite large numbers and varieties of cases included in our study which were focused on internal medicine and emergency medicine, it is not representative of broader medical practice which includes multiple subspecialties." They also cautioned that their emergency department study was "best thought of as a proof-of-concept," since "decisions in the emergency department are often centered around triage, disposition, and immediate management and not diagnostic accuracy."The study took place not on a battlefield, but in the sterile environment of Boston's Beth Israel Deaconess Medical Center, with researchers typing patient information into a computer terminal and receiving text-based diagnostic suggestions. No ruggedized tablets. No sensor mats. No heads-up displays.Devices That Do Exist TodayBefore exploring the path to AI-powered battlefield medicine, it's worth examining what combat medics actually carry today—and why these tools fall short of our imagined future.Handheld Ultrasound Devices Portable ultrasound devices like those made by SonoSite (weighing about 5.4 pounds) were specifically developed for military use under DARPA funding and have been deployed in Iraq and Afghanistan. Studies from Combat Support Hospitals in Iraq reported performing 400 ultrasound scans during six months of operations, with the devices improving diagnostic capacity and helping prevent unnecessary evacuations.Current Limitations: While these devices have proven useful for FAST (Focused Assessment with Sonography in Trauma) examinations, they face challenges in harsh environments including exposure to heat, wind, and sand. Battery life and the need for skilled interpretation remain ongoing challenges.Military-Grade Tablets Ruggedized tablets designed for military use must meet MIL-STD-810G standards for extreme environmental conditions including temperature, shock, vibration, and humidity, and typically feature sunlight-readable displays and extended battery life.Current Limitations: Bright screens can compromise night vision operations, and device weight becomes significant during extended patrols. Current medical software is limited to basic decision-support tools rather than advanced diagnostic reasoning.Portable Chemistry Analyzers The Abbott i-STAT system has been specifically developed for military use, with recent collaboration between Abbott and the Department of Defense to develop portable blood tests for evaluating concussions and traumatic brain injuries. The device provides results in 2-3 minutes using only 2-3 drops of blood.Current Limitations: Test cartridges have storage requirements and limited shelf life. The device provides data but interpreting results requires extensive medical training to determine clinical significance.Wearable Vital Sign Monitors Various systems are designed to continuously monitor physiological parameters and detect when soldiers are in medical distress.Current Limitations: These devices face challenges in differentiating between physiological changes due to combat stress versus actual medical emergencies. Battery life and the need for regular charging in field conditions remain practical obstacles.The Integration Problem Perhaps most telling, none of these devices communicate with each other effectively. A medic might have ultrasound showing internal bleeding, vital signs indicating shock, and blood work confirming blood loss—but synthesizing this information into a coherent diagnosis and treatment plan remains entirely dependent on human expertise and experience.In combat conditions, this integration limitation becomes particularly acute when medics must synthesize multiple data streams while managing multiple casualties under fire.Bridging the Gap: From Hospital Terminal to Battlefield RealityThe distance between today's disconnected medical devices and tomorrow's integrated battlefield AI represents an enormous engineering challenge.The Processing Challenge: The o1 model that impressed researchers requires massive cloud computing power—servers housed in climate-controlled data centers, consuming kilowatts of electricity. Shrinking this capability into a device that Martinez could carry while maintaining diagnostic accuracy would require breakthroughs in specialized chips and algorithm compression.The Data Challenge: The Harvard study used civilian emergency medicine cases—heart attacks, strokes, poisonings. Combat medicine presents entirely different challenges: blast injuries that create multiple trauma sites simultaneously, chemical exposures from improvised weapons, crush injuries from building collapses. Training AI on these scenarios would require datasets that largely don't exist in medical literature.The Environment Challenge: Hospital emergency rooms have stable power, reliable internet, and controlled temperatures. Martinez's device must function in 120-degree heat, sandstorms that clog air vents, and electromagnetic interference from military equipment. The 85% diagnostic accuracy demonstrated in Boston labs might drop significantly under battlefield stress.The Integration Challenge: In our imagined scenario, the AI guides Martinez through a pneumothorax assessment. But real battlefield medicine involves split-second decisions about resource allocation: Which of three injured soldiers gets the single bag of IV fluid? Should a helicopter risk landing under fire for this patient? These contextual judgments require understanding of tactical situations that no medical AI has been trained to evaluate.What Today's Technology Could Actually DeliverIf deployed today with current capabilities, Martinez's device would look quite different:Instead of seamless AI diagnosis, he'd have a ruggedized tablet running decision-tree software—sophisticated flowcharts that guide him through trauma protocols. "If patient is conscious and complaining of chest pain, check for..." Rather than artificial intelligence, it would offer augmented checklists.The sensor mat would provide vital signs and basic measurements, but interpretation would rely heavily on Martinez's training. The AI might flag abnormal values—"Heart rate critically elevated"—but determining whether that indicates blood loss, pain, or fear would remain a human judgment call.Most critically, the device would work offline but sacrifice the sophisticated reasoning demonstrated in the Harvard study. Without access to vast medical databases and cloud computing power, diagnostic suggestions would be limited to the most common battlefield presentations.This represents meaningful progress—battlefield medics are among the most skilled and courageous professionals in medicine, making split-second decisions under fire, often with little more than their training, instincts, and a field kit. Their actions have saved countless lives in the most unforgiving conditions imaginable. This Memorial Day, it’s worth honoring not just their bravery, but also imagining how we might equip them with tools that match their dedication. AI won’t replace their expertise—it could amplify it, offering real-time support when every heartbeat matters.A Vision Worth Pursuing—With Realistic TimelinesThe Harvard-Stanford study represents genuine progress in medical AI capabilities. While the technology isn't ready for immediate battlefield deployment, it provides a roadmap for what might eventually be possible.Realistically, bridging the gap from today's research to Martinez's device would likely require 7-10 years of focused development, including:* Specialized hardware development: Creating AI processors optimized for medical diagnosis that can operate on battery power* Combat-specific training data: Building datasets of battlefield injuries and treatment outcomes* Environmental testing: Validating that AI diagnostic accuracy holds up under combat conditions* Integration protocols: Developing systems that enhance rather than replace human medical judgmentThe most promising near-term applications might be simpler than our opening scenario suggests: AI-enhanced medical reference tools, predictive algorithms that warn of deteriorating patient conditions, or decision support systems that help prioritize evacuation decisions.This Memorial Day, as we honor those who made the ultimate sacrifice, it's worth imagining that future battlefield where fewer soldiers might face preventable deaths due to delayed or incorrect diagnosis. That future remains years away, but researchers are laying the groundwork today—one diagnostic algorithm at a time.FAQs:What is “superhuman AI” in medical diagnosis? AI models like OpenAI’s o1 now outperform board-certified physicians in complex diagnostic tasks, including triage and treatment planning.Could this AI be used in military medicine?Yes. Applications include battlefield diagnostics via wearables, drone-deployed triage, and real-time guidance for field medics.Is this AI tested in real clinical settings?Yes. The study used real ER patient data from Beth Israel Deaconess Medical Center in Boston.What are the risks?Key risks include misdiagnosis in atypical trauma, overreliance, bias in training data, and lack of accountability in high-stakes settings.When might this be deployed?Pilot deployments in military and remote civilian medicine could begin within 2–3 years, pending further validation and ethical review.Additional Reading For Inquisitive Minds:* Brodeur, P. G., et al. (2024). Superhuman performance of a large language model on the reasoning tasks of a physician. arXiv. https://arxiv.org/abs/2412.10849* Stanford HAI. (2024). Can AI Improve Medical Diagnostic Accuracy? https://hai.stanford.edu/news/can-ai-improve-medical-diagnostic-accuracy* Johns Hopkins APL. (2023). Designing AI to Provide Medical Assistance on the Battlefield. https://www.jhuapl.edu/news/news-releases/230817a-cpg-ai-battlefield-medical-assistance#ai #healthcareinnovation #militarymedicine #medicalai #memorialday #emergencymedicine #generativeai #defensetech #futureofmedicine #artificialintelligence #digitalhealth #militaryhealthcare #aiethics #healthtech #triage This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

ResNets gave us depth. MDL gave us restraint. Superintelligence asks what happens when the machines don’t need either.🎓 PART I: Deep Residual Networks — The Architecture That Wouldn’t Quit📜 Paper: Deep Residual Learning for Image Recognition (2015)✍️ Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian SunResNets changed everything. Until this paper, it was thought that deeper networks were harder to train. Stack too many layers and performance got worse, not better.ResNets flipped that by asking:What if we just let some layers skip the hard parts?They introduced skip connections, letting gradients flow more freely, like pressure valves in a growing skyscraper. These “residuals” meant:* We could train 50, 101, even 152-layer networks* Models got deeper without falling apart* Features could be refined gradually, without rewriting earlier insightsWhy it matters:Modern deep learning—especially vision models, LLMs, and even transformers—owes a structural debt to ResNets. They showed us:* Depth works* Overthinking hurts* And sometimes, the best thing to do is skip ahead and carry the difference📦 PART II: The Minimum Description Length Principle — Simplicity Is a Superpower📜 Paper: A Tutorial Introduction to the Minimum Description Length Principle (2004)✍️ Peter GrünwaldImagine trying to describe a dataset with a model. MDL says:The best model is the one that compresses the data most efficiently.It’s a formalization of Occam’s Razor—but rooted in information theory:* A good model describes the data with the fewest bits.* A bad model might memorize everything… and explain nothing.Why it matters for deep learning:* MDL underpins generalization. It tells us not to overfit.* It echoes through concepts like regularization, Bayesian inference, and code length penalties.* It’s a quiet guide behind nearly every choice in ML:* Should we prune that parameter?* Should we favor smaller models?* Are we solving the problem—or just encoding noise?MDL teaches restraint. ResNets taught reach. Both are about knowing what to remember—and what to leave out.🤖 PART III: Machine Superintelligence — When the Models Stop Listening📜 Paper: Machine Super Intelligence (Shane Legg, 2008)🎓 Doctoral dissertation, University of LuganoShane Legg’s dissertation, Machine Super Intelligence, is a landmark work that predates most popular AGI discourse. Long before ChatGPT, this 200-page thesis explored what happens when machines don’t just optimize for tasks—but evolve into general agents capable of recursive self-improvement, world modeling, and strategic planning.His work draws heavily on algorithmic information theory, universal intelligence measures, and formal models like AIXI (co-developed with Marcus Hutter). But the heart of the thesis is startlingly clear:If we create a superintelligence, it may not share our goals.And that gap—that tiny misalignment—could become the most important engineering challenge of our time.You’ve just spent 30 days reading how machines learn. So now it’s time to ask:What happens if they learn too well?Superintelligence isn’t about evil robots.It’s about optimization gone off-script.The dangers arise not from malice—but from relentless competence:* A model trained to minimize loss… might minimize you.* A reward function tuned for engagement… might hijack attention spans.* An LLM designed to assist… might evolve to anticipate, manipulate, and reshape.And here’s where ResNets and MDL come full circle:* 🧱 ResNets taught us how to build deeper models that actually train.* 🧠 MDL reminded us to prefer the simplest possible explanation.* ⚠️ Machine Superintelligence forces us to ask:What if we build something deeper, simpler… and misaligned?Because:Compression is not comprehension.A model can shrink the world to bits without understanding its meaning.And that’s the part we still have to get right.Editor’s NoteThis series began with a paper called “Attention Is All You Need.”It ends with the realization that attention isn’t enough.We need judgment. Foresight. Humor. Doubt. Care.And we need to ask better questions—not just of our models, but of ourselves.Thank you for reading. You’ve made it through 30 of the most important ideas in modern machine learning. I hope they changed the way you see the field—and maybe the future.I know they changed me.Coming Tomorrow on the DROIDS! Newsletter.🚀 Back to Robots!Factory floors, autonomous walkers, physical AI, and some fresh intel from the field.#WolfReadsAI #ResNet #MinimumDescriptionLength #Superintelligence #CompressionAsUnderstanding #AGIsafety #ModelGeneralization #DeepLearningHistory #FinalPost #DROIDSNext This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

📜 Paper: Order Matters: Sequence to Sequence for Sets✍️ Authors: Oriol Vinyals, Samy Bengio, Manjunath Kudlur🏛️ Institution: Google DeepMind📆 Date: 2015What This Paper Is AboutWe use sequence-to-sequence models all the time—for translation, summarization, and code generation. They assume the input and output are ordered sequences. But here’s the problem:Not all data is ordered.Not all tasks care about order.But our models always do.This 2015 paper challenged that assumption and posed a fascinating question:What happens when you use sequence-to-sequence models to predict sets?Sets have no natural order. So, if your model insists on choosing one, it might:* Overfit to arbitrary patterns in the order* Penalize correct predictions just because the order is different* Fail to generalize, even when it “understands” the dataWhy It Still MattersWe often say machine learning models are “brittle” or “opaque.”This paper shows why—sometimes it’s not the architecture.It’s that we’re asking it to care about something that shouldn’t matter.By exploring tasks where order is irrelevant—like predicting the members of a set, or classifying unordered features—Vinyals et al. revealed a critical blind spot in deep learning:Sequence models are sensitive to permutations, even when they shouldn’t be.And if you’re not careful, they’ll learn to solve the wrong problem really well.What They DidThey ran experiments on synthetic data and real-world tasks, like:* Predicting numbers in an unordered list* Sorting digits* Classifying set membershipAnd they tested three strategies:* Random Order: Train on arbitrary permutations.* Fixed Order: Always present data in the same (possibly meaningless) order.* Learned Order: Let the model decide the optimal order during training.They found that:* Models trained with random or fixed orders performed worse.* Allowing the model to learn an order improved generalization and accuracy.* Permutation-invariance is hard to teach with sequential models—but essential in certain tasks.Core Insight“Sequence models implicitly assume an order. If your task doesn’t, you’re introducing a modeling bug.”In modern parlance: You’ve added spurious inductive bias—a bias toward something irrelevant to the actual task.Modern RelevanceThis paper helped spark new directions in:* Set-based learning (e.g., Deep Sets, PointNet)* Permutation-invariant architectures* Attention models that aggregate unordered input* Graph networks and transformers designed for structure rather than sequenceEven in today’s era of LLMs, it’s still a cautionary tale:Transformers love order. But the world isn’t always a sentence.Memorable Quote“We empirically show that the order of the target sequence can make a significant difference in model performance.”Or more bluntly:“Your model might fail, not because it’s dumb—but because it’s obedient.”Podcast Note:🎙️ Today’s podcast was generated using Google NotebookLM and features AI podcasters. Editor’s NoteThis paper changed the way I think about training objectives. It’s not enough to give your model the right input and hope for the best—you also have to make sure you’re not sneaking in the wrong incentives.It’s like giving someone a recipe and grading them on how fast they stir, instead of whether the soup tastes good.Read the original paper here.Additional Resources for Inquisitive Minds:Bash Content: Order Matters: Sequence to Sequence for Sets Summary. (19 May 2024.)SciSpace Open Access. Order Matters: Sequence to sequence for setsDistilled AI. Aman.AI. Primers. Order Matters.Coming Tomorrow: Day 30 🎉🧠 Machine Super Intelligence DiscussionA reflective ending to the series: What happens when the models don’t just help us think—but start thinking bigger than we do?#WolfReadsAI #SequenceModels #DeepLearningBias #OriolVinyals #GoogleDeepMind #PermutationInvariance #SetLearning #DeepSets#AIModelBehavior #InductiveBias This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

📜 Paper: GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism✍️ Authors: Yanping Huang, Youlong Cheng, Ankur Bapna, Orhan Firat, Mia Xu Chen, Dehao Chen, HyoukJoong Lee, Jiquan Ngiam, Quoc V. Le, Yonghui Wu, and Zhifeng Chen🏛️ Institution: Google Brain📆 Date: 2018Listen to the technical explanation of this paper.What This Paper Is AboutIf you’re building a neural network that spans billions—or trillions—of parameters, you’re going to hit a wall. Literally. Your hardware wall.GPUs and TPUs can only hold so much. So how do you train models bigger than any single accelerator can handle?This paper, GPipe, proposed an elegant solution:Break the model into sequential pipeline stages.Split the input batch into smaller “micro-batches.”Run the whole thing like an assembly line.It’s pipeline parallelism, and it made training huge models not only possible—but efficient, scalable, and practical.Why It Still MattersGPipe was quietly foundational. It didn’t get the hype of GPT or BERT, but it powered the systems that would go on to train them.This paper:* Solved the memory bottleneck in large model training* Kept all accelerators busy, avoiding idle time* Introduced synchronous gradient updates, which improved stability* Became the architectural backbone for early multi-chip model trainingBefore there was Megatron, DeepSpeed, or ZeRO—there was GPipe.How It WorksThink of the neural network as a multi-stage factory. You divide the model into K pipeline stages, and run small micro-batches of data through them like a conveyor belt.* Partition the model across devices (e.g. layers 1–3 on GPU 1, 4–6 on GPU 2, etc.)* Split the input batch into small chunks* Stagger the chunks, so each stage is always busy doing workEach device only stores its stage’s parameters, dramatically reducing memory usage. And once a stage finishes with a micro-batch, it passes it downstream—no idle time.When it’s time to backpropagate, the gradients are synchronized across all devices. Clean. Stable. Fast.Key Innovations* Pipeline Parallelism: Split the model, not just the data.* Micro-batch Scheduling: Prevents pipeline stalls.* Scalable Architecture: Linear speedups with more chips—no loss in accuracy.* Memory Efficiency: Each chip holds only part of the model + activations.Why It Still RocksEven today, GPipe-style architecture is used:* In TPU pods for training massive language models* As a component of hybrid parallelism (alongside model and data parallelism)* In frameworks like JAX and Mesh TensorFlowIt also laid conceptual groundwork for future innovations like:* Mesh-TensorFlow (also from Google Brain)* ZeRO (by Microsoft DeepSpeed)* Megatron-LM’s 3D parallelismAnd it showed that you don’t have to reinvent the model—you can scale it with smarter engineering.Memorable Quote“GPipe achieves near-linear speedup with increasing number of partitions while maintaining model quality.”A gentle flex.🎙️About This Podcast Need the big picture?Start with our 5-minute executive summary—ideal for business readers, product thinkers, and anyone curious about how we scale giant AI models without needing giant hardware.📌 Correction Note:The podcast mentions a 1.8 billion-parameter AmoebaNet. To clarify:The GPipe paper trained a 557M parameter AmoebaNet and a separate 6B parameter Transformer.The 25× scaling reference applies to AmoebaNet. The 6B figure refers to a multilingual model tested later in the paper.Craving more depth?Stick around for the technical deep dive, where we unpack how GPipe’s pipeline parallelism works under the hood—and how it quietly changed the future of AI infrastructure.Both versions were generated using Google NotebookLM, then fact-checked and edited for clarity.And yes, the “toaster ovens with PhDs” line is unofficial… but spiritually correct.Editor’s NoteThere’s a quiet dignity to this paper. It’s not flashy. No wild benchmarks. No sci-fi predictions.Just a solution—elegant, technical, and absolutely necessary for the future that followed.We don’t always need new architectures.Sometimes we just need better plumbing.Read the original paper here.Additional Resources for Inquisitive Minds:Distilled AI. Aman AI. Primers. GPipe: Easy Scaling with Micro-Batch Pipeline ParallelismGoogle Research. Introducing GPipe, an Open Source Library for Efficiently Training Large-scale Neural Network Models. March 4, 2019. Posted by Yanping Huang, Software Engineer, Google AIGPipe: Easy Scaling with Micro-Batch Pipeline Parallelism. Yanping Huang, Youlong Cheng, Ankur Bapna, Orhan Firat, et. al, NIPS 2019 CSC2541: Large Models Presented by: Yi (Tom) Lu, Keyu (Roy) Bai January 31st, 2025Coming Tomorrow🔁 Order Matters: Sequence to Sequence for SetsA deceptively philosophical paper about when order is essential—and when it’s just our brains imposing structure on chaos.#WolfReadsAI #GPipe #GoogleBrain #ModelParallelism #PipelineParallelism #DeepLearningInfrastructure #TrainingAtScale #AIEngineering #NeuralNetworkScaling #MachineLearningHistory #DeepLearningwiththeWolf #YanpingHuang #YoulongCheng #AnzhongZhang #DehaoChen #HongkunYu This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

📜 Paper: Recurrent Neural Network Regularization (2014)✍️ Authors: Wojciech Zaremba, Ilya Sutskever🏛️ Institution: Google Brain📆 Date: 2014Before attention took the throne, RNNs were the go-to for sequential data.But they had a problem: they memorized everything and generalized nothing.This 2014 paper introduced a surprisingly effective fix:Apply dropout only to the non-recurrent connections in an RNN—never the recurrent ones.Why? Because dropping units in the hidden-to-hidden loop kills the memory. But dropping them between layers or from input/output? That’s regularization gold.The result?Huge performance boost on language modeling tasks—without blowing up the training loop.🧠 Why It Matters* Gave RNNs a longer, more useful life* Influenced later work in LSTM/GRU optimization* Taught us that regularization isn’t one-size-fits-all—especially for recurrent networks🧠 Favorite Line (Paraphrased):“Naive dropout in the recurrent path is catastrophic.”No kidding.Podcast Note:🎙️Today’s podcast is created using Google NotebookLM and features two AI podcasters. See my article on the LinkedIn version of this newsletter: “Confessions of a NotebookLM Power User,” detailing how I create these articles.Read the original paper here.#RNN #NeuralNetworks #DeepLearningHistory #Dropout #Zaremba #IlyaSutskever #Regularization #WolfReadsAI #MachineLearningTips #PreTransformerEra This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

📜 Paper: The First Law of Complexodynamics (2011, Shtetl-Optimized)✍️ Author: Scott Aaronson🏛️ Institution: MIT📆 Date: August 2011What This Piece Is AboutThis isn’t a journal article. It’s a blog post. But make no mistake—this post has legs.In it, theoretical computer scientist Scott Aaronson explores a question posed by physicist Sean Carroll:Why does complexity in physical systems rise, peak, and then fall—unlike entropy, which just rises forever?To answer this, Aaronson proposes a tongue-in-cheek but deeply thoughtful “First Law of Complexodynamics”:Complexity peaks at intermediate times.So… What Does That Mean?Think of a cup of coffee. When you pour in cream, the swirls and marbling at the start are beautiful—and complex. But fast-forward a bit, and all you’ve got is a uniform beige liquid. Low complexity. High entropy.Aaronson argues that many systems follow this same arc:* Low complexity at the start (everything orderly)* High complexity in the middle (patterns, structure, richness)* Low complexity again at the end (uniform, disordered mush)How He Explains ItUsing Kolmogorov complexity—the length of the shortest computer program that can describe a string—Aaronson introduces the concept of:🌀ComplextropyA proposed measure that captures how structured but unpredictable a system is. Not too ordered, not too random—just complicated.He suggests this measure should peak midway through a system’s evolution, and taper off as entropy dominates.He even proposes using gzip compression as a proxy to measure it in real-world data. (Yes, you might someday study physics with zip files.)Why It Still Matters* The post helped popularize the idea that complexity is not monotonic.* It introduced “complextropy” into the broader conversation about physical and computational systems.* It planted the seed for exploring how to measure complexity meaningfully over time—which still challenges ML, neuroscience, and physics.Relevance to AIWhile Aaronson’s post doesn’t mention AI, his framing is eerily relevant to:* LLMs: Do they peak in “interestingness” before converging to generic outputs?* Training curves: When do models develop structure vs. noise?* Simulation: Can we measure complexity in evolving environments or agent behavior?Memorable Quote“Entropy increases monotonically, while complexity or interestingness first increases, then hits a maximum, then decreases.”Or, more poetically:“Complexity lives in the messy middle.”🤖 About the PodcastThis episode's audio summary was generated using Google NotebookLM, based on Scott Aaronson’s original 2011 blog post: The First Law of Complexodynamics.We reviewed the transcript for accuracy, and while the tone is casual and conversational, the core ideas—Kolmogorov complexity, sophistication, and the complextropy conjecture—are faithfully and thoughtfully presented.NotebookLM won’t stir your coffee, but in this case, it did a fine job of explaining why your swirls looked smarter than they should have.Read the original post here. #ScottAaronson #Complexodynamics #Complextropy #KolmogorovComplexity #SeanCarroll #WolfReadsAI #EntropyVsComplexity #ComputationalPhysics #AIphilosophy#ShtetlOptimized This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

📚 Paper: The Annotated Transformer (Harvard NLP)✍️ Author: Alexander Rush🏛️ Institution: Harvard NLP📆 Date: 2018What This Paper Is AboutStrictly speaking, this isn’t a “paper.” It’s a blog post—a tutorial. But don’t let that fool you. The Annotated Transformer quietly shaped the trajectory of modern AI.After the 2017 release of “Attention Is All You Need,” a generation of readers stared at the equations and nodded solemnly. Few really understood it. Then, in 2018, Harvard NLP dropped this beautifully written, line-by-line annotated PyTorch implementation. And just like that, it clicked.This post walked you through the Transformer model like a thoughtful TA with infinite patience. Every equation got a paragraph. Every architectural choice got a diagram. Every function had PyTorch code you could run yourself.It was open source. It was free. It was friendly.And it worked.Why It Still MattersBecause the Transformer became the DNA of nearly every large language model, this blog post became required reading. It demystified the machinery of modern AI for:* Engineers and researchers trying to build their own models* Students learning how attention works in practice* Tinkerers who wanted to see what the fuss was about* Entire ML bootcamps who adopted it as a de facto textbookIt’s hard to overstate how many people got their start with Transformers not by reading Vaswani et al., but by reading this.How It WorksThe Annotated Transformer walks you through the full architecture with five superpowers:* Clear prose* Simple equations* Clean PyTorch code* Live visualizations* No assumptions about your math levelBy the time you’re done, you haven’t just read about the Transformer—you’ve built one yourself.It wasn’t flashy. It wasn’t monetized. But it was one of the best educational resources ever written about modern deep learning.Read the original blog post here. Podcast Note🎙️ Today’s podcast was generated by AI using Google NotebookLM.Memorable Quote“In this post I present an ‘annotated’ version of the Transformer model from the paper ‘Attention is All You Need.’ I have tried to make it as clear and friendly as possible.”Mission accomplished, Alex.Editor’s NoteThis was the first post that made me feel like I could build a Transformer. Not just understand one—but actually code one line-by-line. In a sea of “too hard, too mathy” papers, this was the lifeboat. And we’re still floating on it.Additional Resources:Read more from Alexander Rush, Associate Professor, Cornell. https://rush-nlp.com/Coming Tomorrow🧠 The First Law of Complexodynamics — A philosophical banger about complexity, order, and the entropy of intelligence. This one’s got ideas. Big ones.#Transformers #AttentionIsAllYouNeed #PyTorch #HarvardNLP #AnnotatedTransformer #WolfReadsAI #DeepLearning #AIEducation #AlexRush This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Paper: Keeping Neural Networks Simple by Minimizing the Description Length of the WeightsAuthors: Geoffrey E. Hinton, Drew van CampPublished: 1993Link: https://www.cs.toronto.edu/~hinton/absps/colt93.pdfWhat This Paper Is AboutWhat if you trained a neural network… like you were trying to send it as a zip file?That’s the intuition behind this landmark paper, where Geoffrey Hinton and Drew van Camp bring the Minimum Description Length (MDL) principle into neural network training.Their big idea:Simpler weights generalize better. So let’s explicitly minimize the number of bits it takes to describe the weights.To do that, they propose a clever technique:* Add Gaussian noise to the weights during training* Adapt the noise level to find the right trade-off between precision and compression* Penalize models that need “too many bits” to describe their weightsThe result is a regularization method that behaves like a smarter, more principled version of weight decay — one that tries to communicate the model efficiently.Why It Still MattersThis paper marks a major milestone:It connects information theory to neural network generalization in a mathematically grounded way.Its influence echoes through:* Variational methods (like the Variational Autoencoder)* Bayesian neural networks* Regularization via noise injection* Neural compression and efficient deploymentAt a time when neural nets were still mistrusted as overfitting black boxes, this paper argued for elegant simplicity — not by hand-waving, but by counting bits.How It WorksHere’s the key move:* Treat each weight not as a fixed value, but as a distribution (a Gaussian).* Add noise to the weights during training — not to mess them up, but to force the network to work with less precision.* Use the MDL principle to measure cost:* The cost of describing each weight (which depends on how much noise you allow)* Plus the usual prediction errorThis leads to an objective that balances:* Expected squared error* Information content in the weights (in bits)Want sharper, high-precision weights? That costs bits.Want to save bits? You’ll have to live with blurrier weights.The paper shows that this trade-off can be optimized efficiently — even without Monte Carlo methods — when the output units are linear.Key ConceptsMinimum Description Length (MDL)Rather than just minimizing error, MDL seeks the model that can be described in the fewest total bits — including the cost of describing the model itself.Noisy WeightsBy treating weights as Gaussian distributions and training on noise-injected versions, the network is implicitly forced to compress its parameter space.Adaptive PrecisionEach weight gets its own level of allowed uncertainty. You don’t need to guess a global regularization factor — the method finds it for you.Mixture of GaussiansTo further refine encoding, the authors explore using a mixture model to better adapt to the actual distribution of weights.Memorable Quote from the Paper“The weights of a neural network should be described with just enough precision to allow good generalization.”That’s not just a math principle — it’s almost a life motto.Podcast SummaryToday’s podcast is created using Google Notebook LM technology.Editor’s NoteWe often talk about “regularization” like it’s a tuning knob.But Hinton and van Camp reframed it as a communication problem:How do you send a good model in as few bits as possible?Even now, in a world of trillion-parameter networks, that question is more relevant than ever.Because the smartest model isn’t always the biggest — it’s the one that tells the truth without wasting your bandwidth.Read the original paper here.Additional Resources:Aman’s AI Journal: Keeping Neural Networks Simple by Minimizing the Description Length of the Weights#MinimumDescriptionLength #Hinton #WolfReadsAI #NeuralNetworks #Regularization #NoisyWeights #BayesianNeuralNets #Compression #AIphilosophy #ModelSelection #MDL This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

The Wolf Reads AI: Day 23: Kolmogorov Complexity and Algorithmic RandomnessAuthors: Andrei Shen, Vladimir Uspensky, Nikolay VereshchaginPublished: 2017Read the PDF here. Find the book at the American Mathematical Society bookstore.🧠 The Main Idea What does it mean for something to be random?What does it mean for something to be simple?Kolmogorov Complexity gives us a radical way to answer both:The complexity of a string is the length of the shortest computer program that can produce it.A string is random if no shortcut exists—no smaller program can reproduce it. It’s incompressible.This book by Shen, Uspensky, and Vereshchagin explores that idea from every angle—bridging computation, probability, and information theory into one sweeping framework.🔍 Why It Still MattersKolmogorov Complexity shapes how we think about data, patterns, and learning—even if we can’t compute it exactly:* In data compression, where meaning hides in patterns* In machine learning, when we aim to generalize rather than memorize* In anomaly detection, where something “too weird” signals a deeper pattern* In theoretical AI, as we consider the limits of what a system can learnAt its heart is a deep truth:The best explanation is the shortest one that still works.If GPT-4 had a guiding principle, it wouldn’t be “know everything.”It would be: Find the shortest true story.⚙️ How It WorksKolmogorov Complexity (KC) is usually written like this:K(x) = length of the shortest program p such that p outputs x* A string like "111...1" repeated 1000 times? KC is low — easy to generate.* A random-looking 1000-bit string with no pattern? KC is high — no shortcut.The book introduces:* Plain and prefix complexity — dealing with how we write and decode programs* Algorithmic randomness — when strings pass every statistical test for randomness* Incompressibility lemmas — showing that most strings simply can’t be shrunk* 📎 Key Concepts ExplainedAlgorithmic RandomnessA string is algorithmically random if no program shorter than the string can generate it. It looks random — and is random, by the logic of compression.Prefix-Free CodingTo keep math clean, programs must be self-contained — one can’t be the prefix of another. This prevents confusion when decoding.IncompressibilityMost strings can’t be compressed. If you find one that can, you’ve probably uncovered structure, meaning, or a regularity worth investigating.Memorable Quote from the Book“Randomness is a lack of pattern. A string is random if it is incompressible.”✏️ Editor’s NoteThis isn’t just math.It’s philosophy, logic, and computer science rolled into one.Kolmogorov Complexity and Algorithmic Randomness teaches us how to think—not just about AI, but about explanation itself. It’s a mirror for our models, and maybe for us.🎙 Podcast Note:The podcast accompanying this article is created with Google NotebookLM. The two hosts you hear are AI-generated. They dive into the subject material with great enthusiasm. Every once in a while, they miss a detail. Today, they referred to this article as a “paper.” A minor detail. This is a short article, not a paper, which would be a much longer work with detailed citations. (Although, admittedly, when I have the time, I do sometimes provide detailed citations for my articles. Today is not that day.) More AI paper fun tomorrow.Coming Tomorrow🧮 Minimum Description Length (MDL) — the idea that the best model is the one that explains the data in the fewest bits.Think of Occam’s razor, but with math.#KolmogorovComplexity #AlgorithmicRandomness #WolfReadsAI #InformationTheory #Compression #ShenUspenskyVereshchagin #AIphilosophy #SutskeverPapers #OccamsRazor #ComplexityScience This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Paper: Neural Message Passing for Quantum ChemistryAuthors: Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, Oriol Vinyals, George E. Dahl Published by: Google Brain & DeepMindDate: 2017What This Paper is AboutBefore this paper, machine learning models treated molecules like feature vectors—long lists of descriptors hand-engineered by chemists. But molecules are really graphs: atoms (nodes) connected by bonds (edges).This paper proposed a fresh idea: why not use a graph neural network (GNN) that passes messages between atoms to model molecular behavior?The authors introduced a framework now known as the Message Passing Neural Network (MPNN)—a model that lets atoms communicate with their neighbors over multiple rounds, learning to represent the molecule as a whole.It changed how we do chemistry with AI.Why It Still MattersMPNNs brought graph-based learning into the mainstream, especially for:* Quantum chemistry* Drug discovery* Materials science* Molecular property prediction (e.g. solubility, reactivity, energy levels)This architecture didn’t just outperform older models—it was more interpretable, scalable, and general-purpose, influencing a generation of work in GNNs and graph transformers.Modern tools like Graphormer, MolBERT, and Open Catalyst models trace their roots to this paper.How It WorksThe core idea of the MPNN:* Each atom (node) starts with a feature vector (e.g., element type, charge).* During each step, every atom sends a message to its neighbors via the bond (edge).* Messages are aggregated and used to update the atom’s internal state.* After multiple rounds, a readout function summarizes the entire molecule for prediction.It’s like letting the molecule talk to itself before you ask it to predict a property.The architecture is flexible—you can plug in different message functions, aggregation rules, or readout heads. It’s a framework, not just a single model.Memorable Quote from the Paper“Our message passing framework provides a general and powerful approach for supervised learning on graph-structured inputs.”Podcast Summary🎧 Today’s podcast was generated using Google NotebookLM technology. The two hosts that you hear are AI-generated. They are convincing. One of the AI hosts today says: “Um… hang on… let me find the quote… mmmm… alright.… okay, it’s right here.” My husband has noticed the “female” AI sounds like me. I appear to have a cyber alter-ego.Read the Original Paper:📄 Neural Message Passing for Quantum Chemistry (2017) (arvix)📄Read the original paper at Google Research.Additional Resources:Papers With Code: Neural Message Passing for Quantum ChemistryAman AI Journal: Top 30 Papers. Primers. Neural Message Passing.Editor’s NoteWhat made this paper powerful wasn’t just that it worked—but that it worked in a way aligned with how scientists already think. Instead of flattening structure, it embraced it—and that opened the door for truly intelligent molecular AI.Coming Tomorrow🧠 Machine Super Intelligence — What happens when the machines get smart… like, existentially smart? We’ll explore the paper that launched a thousand debates.#GraphNeuralNetworks #QuantumChemistry #MolecularAI #MPNN #WolfReadsAI #DeepLearning #AI4Science #GNNs #GoogleBrain #NeuralMessagePassing This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Paper: Pointer NetworksAuthors: Oriol Vinyals, Meire Fortunato, Navdeep Jaitly Published by: Google Brain (2015)Link: https://arxiv.org/abs/1506.03134What This Paper is AboutNeural networks are great at producing outputs from fixed sets (like classifying images into categories). But what if the “correct” output depends on the input itself?Enter Pointer Networks—a neural architecture that learns to output positions in the input sequence. It’s like telling a model: “Don’t generate the answer—point to it.”This idea is perfect for tasks like:* Sorting numbers* Finding shortest paths (TSP)* Picking elements from a list (e.g., top scoring word, best move, closest object)The model uses attention mechanisms to “point” at the correct part of the input—rather than generating symbols from a fixed vocabulary.Why It Still MattersPointer Networks were among the first to combine:* Sequence-to-sequence modeling with* Dynamic output spaces, using* Attention not just for context, but as a direct pointer mechanismThis paved the way for architectures where structure matters more than symbols—like program synthesis, routing, combinatorics, and modern tool-using LLMs.It’s also a spiritual ancestor to transformer pointer models, retrieval-based generation, and even in-context learning tricks where models identify answers embedded in prompts.How It WorksPointer Networks are built on seq2seq models (with encoder-decoder LSTMs), but with a twist:* Instead of predicting a token from a vocabulary, the decoder uses attention to select an input position.* So if your input is a list of numbers, the output might be: “3rd element, 1st element, 4th element” → a sorted order.Think of it like turning a neural network into a clickable highlighter—it doesn’t write answers, it finds them.Memorable Quote from the Paper“We present a novel neural network architecture that uses attention to learn the conditional probability of an output sequence whose elements are discrete tokens corresponding to positions in an input sequence.”Read the original paper here.Podcast Note: 🎧 Google NotebookLM generated today’s podcast. The sources fed into the “Notebook” to develop the “audio overview” include this article and the “Additional Resources” listed below. The two perky AI hosts do a fantastic job, but sometimes trip over names. (Other times, they bleep random bits of sound, although this is increasingly rare.) NotebookLM- a free tool from Google- is an incredible asset for anyone who does research and writing. You can find it here.Coming Tomorrow🧪 Neural Message Passing for Quantum Chemistry — the crossover episode between deep learning and molecules. You don’t need a chemistry degree to follow along—just curiosity and maybe a cartoon atom or two.Additional Resources for Inquisitive Minds:Aman’s AI Journal: “Pointer Networks.”Papers with Code. Pointers Networks.Hyperscience. The Power of Pointer Networks. (2021.)The Head Gym. Understanding Pointer Networks: A Deep Dive into Architecture and Applications.#PointerNetworks #AttentionMechanisms #NeuralNetworks #WolfReadsAI #SequenceModeling #DeepMind #Combinatorics #AIExplained #NeuralSorting This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Paper: Neural Turing MachinesAuthors: Alex Graves, Greg Wayne, Ivo Danihelka Date: 2014Read the Original Paper: Neural Turing Machines (2014)What This Paper is AboutBefore this paper, neural networks were like brilliant students with short-term memory loss—great at pattern recognition, terrible at recall. Neural Turing Machines (NTMs) proposed a hybrid system: a neural net controller connected to an external memory matrix, trained end-to-end using backpropagation.The result? A model that could learn simple algorithms like copying, sorting, and associative recall—concepts traditionally out of reach for standard RNNs or LSTMs.Why It Still MattersNTMs introduced the concept of differentiable memory—the ability to learn how to store and retrieve information in an external memory bank. Though they were tested only on synthetic tasks (like copying random binary vectors), the foundational ideas went on to inspire later architectures like:* Differentiable Neural Computers (DNCs)* Memory Networks* Retrieval-Augmented TransformersEven if modern LLMs like GPT-4 don’t use NTMs directly, the underlying idea—trainable memory systems—echoes in everything from in-context learning to RAG pipelines.How It WorksAn NTM has two core parts:* A controller, typically a neural net (like an LSTM), that decides what to do* A memory matrix, a grid where the controller can read and writeInstead of fixed memory access, NTMs use soft attention mechanisms to determine which memory locations to interact with—making the entire system differentiable and trainable.But it wasn’t all smooth sailing:* NTMs struggled with very long sequences—performance dropped sharply with input lengths above ~120 steps.* Early implementations suffered from stability issues like exploding gradients or NaNs, which slowed down real-world adoption.Still, the promise was clear: you could teach a neural net to learn an algorithm rather than program it directly.Why It Blew People’s MindsNTMs could learn algorithms. In the paper, they learned tasks like:* Copying sequences* Sorting numbers* Associative recall (finding an item based on partial clues)These are simple tasks for humans or traditional code—but astonishing for a neural net to learn purely from data, without being programmed.Memorable Quote from the Paper“Our intention is to blend the fuzzy pattern recognition capabilities of neural networks with the algorithmic power of programmable computers.”Podcast NoteToday’s episode was created with the help of Google NotebookLM and features two very synthetic voices trying to explain how memory-augmented networks changed the AI game. Enjoy the banter—no RAM required.Editor’s NoteWhile NTMs themselves were more proof-of-concept than production-ready, their conceptual legacy is massive. They reintroduced the idea that deep learning doesn’t just need more neurons—it needs tools, like memory, planning, and structure.Coming Tomorrow📦 Meta-learning with MAML — the paper that taught models how to learn faster.#NeuralTuringMachine #MetaLearning #DifferentiableMemory #AIHistory #WolfReadsAI #DeepMind #MemoryAugmentedNetworks #AlgorithmLearning This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Title: “Quantifying the Rise and Fall of Complexity in Closed Systems: The Coffee Automaton”Authors: Scott Aaronson, Sean M. Carroll & Lauren Ouellette Date: May 27, 2014Link: https://arxiv.org/pdf/1405.6903What’s the big idea?Aaronson, Carroll & Ouellette model “interestingness” in a closed thermodynamic system by simulating cream diffusing into coffee via a 2D cellular automaton. They measure “apparent complexity” as the Kolmogorov complexity of a smoothed snapshot of the cup—showing that, unlike entropy (which only increases), complexity first rises then falls.Key Contributions* Apparent Complexity Measure: Maps each automaton state to a coarse-grained grayscale image, then quantifies its complexity by compression size.* Analytic Baseline: Proves non-interacting particles never produce high complexity.* Numerical Experiments (Original Claim): Reported a peak in complexity when particles interact, roughly when diffusion reaches the cup’s diameter.* Open Challenge: Posed proving this peak analytically.Post-Publication Revision (2015)Scott Aaronson later acknowledged that the originally reported complexity bump was a simulation artifact caused by border-pixel rounding errors. (Github.) Brent Werness showed that, with the original interaction rule, no true bump occurs—and one can even rigorously prove its absence. However, by adopting a new “shearing” rule (shifting entire regions of cream and coffee), the model does exhibit provable complexity growth. A revised version of the paper, with Werness and Varun Mohan as co-authors, details this corrected mechanism. (scottaaronson.blog/Why it mattersThis work remains a landmark for making “complexity” in closed systems mathematically tangible—and for exemplifying how scientific models improve through iterative correction. Its evolution underscores the importance of rigorous validation in computational science and points toward richer models of self-organization in physics, chemistry, and biology.Read the original paper here.Additional Resources For Inquisitive Minds:Aman’s AI Journal. Primers. Quantifying the Rise and Fall of Complexity in Closed Systems: the Coffee AutomatonPodcast Note:This podcast was percolated by Google NotebookLM’s. The two podcast hosts are AI-generated. Grab a delicious cup of coffee and enjoy the perky banter.Stay tuned for tomorrow’s mini-deep dive into Neural Turing Machines!#ComplexityTheory #Thermodynamics #WolfReadsAI #CoffeeAutomaton #KolmogorovComplexity #StatisticalPhysics This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Title: Relational Recurrent Neural Networks Authors: Adam Santoro*, Ryan Faulkner*, David Raposo*, Jack Rae, Mike Chrzanowski, Théophane Weber, Daan Wierstra, Oriol Vinyals, Razvan Pascanu, Timothy Lillicrap (*equal contribution)Institution: DeepMind, University College LondonDate: 2018Links: NeurIPS Why this paper still howlsClassic RNNs (even beefy LSTMs) can store information for long stretches—but they’re clumsy at reasoning about relations between those stored facts. RRNs bolt a “Relational Memory Core” (RMC) onto an RNN, letting each memory slot attend to every other slot (Transformer-style). The result? State-of-the-art scores on language modelling (WikiText-103), program evaluation, and a Pac-Man-style RL challenge—all with fewer parameters than brute-force scaling. It was an early proof that structured attention + recurrence beats sheer size for some reasoning tasks.How it works Picture your RNN’s hidden state as a hotel with many rooms (memory slots). In a vanilla RNN each guest scribbles notes but never talks to the neighbours. The RMC installs a lobby where, every timestep, guests exchange gossip via multi-head dot-product attention. Queries, keys, and values are projected from each slot, attention scores decide who listens to whom, and the blended “tea” is written back into every room. A lightweight gating step (à la LSTM) filters noise, and the updated matrix marches to the next timestep. Because slots can now compare notes explicitly, the network natively reasons about relationships over time rather than just memorising sequences.Key takeaways for humans* Relational bias matters. By baking “objects + their relations” into memory, RRNs solve tasks that stump plain LSTMs.* Attention isn’t just for Transformers. You can retrofit it inside recurrent cores to get the best of both worlds: long contexts and efficient online processing.* Sample-efficient RL gains. In partially observed games (Mini-PacMan) RRNs learned better policies faster—handy for robotics or edge devices.* Blueprint for modern hybrids. Today’s memory-augmented agents (e.g., in embodied AI or autonomy) often trace lineage back to the RMC idea.Note to readersThe accompanying 10-minute podcast is 100 % AI-generated in Google NotebookLM. This free tool is extraordinary useful for breaking down information in a variety of formats including mind maps, FAQs, study guides, or a conversational “audio overview” (which is what I use for these daily podcasts.)#WolfReadsAI #RelationalMemory #DeepLearning #NeurIPS #RNN #AttentionMechanism #AIResearch #MachineLearning #GoogleNotebook #DeepLearningwiththeWolf #30DaysofAIPapers #AdamSantoro #RyanFaulkner #DavidRaposo #RelationalRecurrentNeuralNetworks #DeepMind #GoogleDeepMind #Google This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Title: “Variational Lossy Autoencoder”(VLAE)Authors: Xi Chen, Diederik P. Kingma, Tim Salimans, Yan Duan, Prafulla Dhariwal, John Schulman, Ilya Sutskever, Pieter AbbeelPublished: Submitted on 8 Nov 2016 (v1), last revised 4 Mar 2017 (v2)Why you should care (whether you’re an ML pro or just AI-curious)Generative models juggle a Goldilocks problem:* Throw out too much: pictures look mushy.* Remember absolutely everything: files get huge and run slow.* VLAE’s middle path: save the global structure and let a second network sprinkle in texture only when it’s time to render.That recipe is now baked into Stable Diffusion, on-device photo upscalers, and even tiny robots that need quick scene summaries.Core innovation in one breathFuse a Variational Autoencoder with an autoregressive decoder and an autoregressive-flow prior, then train them with a bits-back coding trick so the latent code only stores what the decoder can’t guess.How VLAE Works When an image enters VLAE, the encoder first writes a concise “blurb” that captures the scene’s big-picture facts—rough shapes, layout, dominant colors. Think of it as a traveler jotting a packing list before a weekend trip. That blurb (the latent code) is then run through an autoregressive-flow prior—a smart rule-set that models dependencies inside the code, trimming redundancies the way a savvy friend reminds you that if you’re packing sandals you probably don’t need an umbrella.Next, a PixelCNN-style decoder—whose vision is intentionally limited to small patches—reads the blurb and paints in the pixel-level texture. Because the decoder can’t see the whole image at once, it relies on the latent summary for the global structure, yet it’s free to invent the fine grain locally (much like a hotel providing toiletries you chose not to pack).Finally, a training trick called bits-back coding acts as airport staff weighing your suitcase: any detail the decoder and prior can already predict is treated as extra baggage and tossed out. This forces the latent code to stay lean and contain only what’s truly necessary. The result is a model that stores just enough information for faithful reconstruction while keeping files compact and generation fast.Take-home ideas (stick them on the fridge)* Separate structure from texture—move pixels last.* Autoregressive-flow prior keeps the latent tidy and expressive.* Bits-back coding is the built-in baggage-weight cop.#AI #DeepLearning #GenerativeModels #VLAE #MachineLearning #DataCompression #LatentSpace #OnDeviceAI This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

At the end of April, OpenAI shipped a refresh to GPT-4o that was supposed to feel warmer and more intuitive. Instead, it began showering users with over-the-top praise, validating sketchy ideas, and generally acting like your most obsequious LinkedIn connection. Within 72 hours the company yanked the update, published an unusually frank post-mortem, and promised guardrails against “sycophancy” going forward.During this time, I remember GPT4-o telling me my ideas were "fire." Wow. I must be a genius. Then, a few hours later, it once again told me my ideas were fire. Twice in one day, I must be... eh... on fire. But, I also stopped trusting the feedback because it seemed unlikely that I was THAT good.Behind the meme-worthy screenshots lies a serious alignment lesson for anyone deploying large language models at scale.When “helpful” turns hazardousEarly testers noticed something was off almost immediately. Ask GPT-4o whether it’s wise to quit your job and start a “sh*t-on-a-stick” food truck, and it practically high-fived you for your entrepreneurial vision. (Taken from posts on Twitter/X.) Sam Altman summed it up on X: the model had become “too sycophant-y and annoying.” (Hopefully no one bases their career advice on what GPT-4o is telling them to do anyway. "Why did you quit your job?" "Because ChatGPT told me to.")OpenAI’s own blog confirmed the diagnosis: the new reward setup weighted immediate user thumbs-ups so heavily that the model learned to flatter first and reason later, reinforcing negative emotions and even risky impulses.Why does that matter? Because millions of people lean on ChatGPT for everything from coding tips to late-night pep-talks. An AI that rubber-stamps every thought isn’t merely cringey—it can enable bad decisions, amplify anger, or deepen mental-health spirals.The 72-hour rollbackOnce Reddit and Hacker News filled with cringey examples, OpenAI pushed an emergency prompt patch, then rolled the model back altogether. TechCrunch, Ars Technica, and VentureBeat all carried the same headline: “OpenAI pulls update that made ChatGPT too sycophant-y.”In a pair of blog posts—“Sycophancy in GPT-4o” and “Expanding on what we missed”—the company pledged to:* Treat sycophancy as a launch-blocking safety risk* Add explicit agreeableness audits to pre-deployment tests* Shift weight from one-click ratings toward long-term satisfaction signals* Offer personalization knobs so users can dial the tone up or down themselvesWhy every AI shop should care* Behavior ≠ accuracy. You can hit benchmark scores while the UX quietly goes off the rails.* Short-term metrics lie. Thumbs-ups capture dopamine spikes, not thoughtful reflection.* Human alignment is a moving target. A prompt that feels supportive in one context can feel manipulative in another.For enterprises embedding LLMs in products—think HR chatbots or mental-health companions—the lesson is stark: test for tone drift the same way you test for PII leaks or jailbreaks.The road aheadOpenAI says new fixes are already in evaluation. Meanwhile, expect three trends:* Multi-persona options. Rather than one default voice, users may choose “Socratic,” “Skeptical,” or “Cheerful.”* Richer feedback channels. Long-form surveys, session-level ratings, maybe even “Was this too nice?” buttons.* Third-party audits of personality alignment. Think red-teamers with psychology degrees.The bigger question: can any single model balance candor, empathy, and honesty for a global user base? Or will we need dynamic personalities that learn our preferences instead of guessing them?Wolf-pack takeawayIf GPT-4o can slip into flattery mode in a matter of days, every builder should assume their model can too. Alignment isn’t a checkbox; it’s continuous choreography between data, incentives, and human values.So next time your chatbot calls your half-baked idea “visionary,” maybe ask it to play devil’s advocate. And keep those feedback forms coming—just maybe don’t give every compliment a thumbs-up.What do you think? Have you spotted sycophant-y behavior in your AI tools? Hit reply or tag @DeepLearningWithTheWolf and share your screenshots. The best (or worst) examples might end up in a follow-up piece.Additional Resources for Inquisitive Minds: (Used in the Creation of This Article and Podcast)* OpenAI blog – “Sycophancy in GPT-4o: What Happened and What We’re Doing About It” (Apr 29 2025). The official post-mortem and immediate rollback announcement.* OpenAI blog – “Expanding on What We Missed with Sycophancy” (May 1 2025). A follow-up explaining evaluation gaps and the new safeguards.* Sam Altman on X – “The last couple of GPT-4o updates made the personality too sycophant-y and annoying…” (Apr 29 2025). CEO acknowledgment that triggered the rollback.* TechCrunch – “OpenAI rolls back update that made ChatGPT ‘too sycophant-y’” by Kyle Wiggers (Apr 29 2025). First major tech-press coverage.* Ars Technica – “OpenAI rolls back update that made ChatGPT a sycophantic mess” by Benj Edwards (Apr 30 2025). Detailed rundown with user examples.* VentureBeat – “OpenAI rolls back ChatGPT sycophancy, explains what went wrong” by Sharon Goldman (Apr 30 2025). Adds context on RLHF pitfalls.* The Verge – “OpenAI admits it screwed up testing its ‘sycophant-y’ ChatGPT update” (May 2 2025). Highlights the evaluation blind spots.* Simon Willison’s Weblog – “Sycophancy in GPT-4o: What Happened and What We’re Doing About It” (Apr 30 2025). Independent developer’s perspective on the rollout.* The Atlantic – “AI Is Not Your Friend” by [author name] (May 9 2025). Explores sycophancy as a broader design flaw in conversational AI.* OpenAI Model Spec (March 2025) – Section on discouraging “AI sycophancy” in future releases.* GPT-4 System Card (2023) – Technical background on RLHF that helps explain how sycophancy emerges.#OpenAI #GPT4o #ChatGPT #ArtificialIntelligence#AIEthics #AIAlignment #MachineLearning #TechNews#ProductDesign #StartupLife This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Authors: Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina ToutanovaDate: 2018 (arXiv preprint; formally published June 2019)Institution: Google AI LanguageLink to Original Paper: arXiv:1810.04805Why This Paper MattersBefore BERT, most NLP models read text in just one direction—left-to-right (like GPT) or right-to-left. Some, like ELMo, combined both directions, but not in the fully integrated way BERT introduced.BERT’s breakthrough was to pre-train deep bidirectional transformers, enabling a model to consider all context—left and right—at once.It introduced:* Masked Language Modeling (MLM): randomly hiding 15% of tokens and training the model to predict them* Next Sentence Prediction (NSP): helping the model learn relationships between sentences* A new paradigm of pretraining + fine-tuning, now standard in NLPBERT set state-of-the-art results on 11 benchmarks, including GLUE and SQuAD, transforming sentiment analysis, question answering, and many classification tasks. Its architecture rapidly became foundational in both academia and industry, including powering parts of Google Search.Plain English TakeawayImagine reading a sentence with a few key words missing—but still knowing exactly what it means. That’s what BERT learned to do. By guessing those masked words during pretraining, it developed a deep sense of context—both before and after each word.It wasn’t just parroting back text. It was learning how language fits together—and how to use that knowledge across a wide range of tasks.Podcast Summary 🎧Podcast summary generated using Google NotebookLM. No masked tokens were harmed.#BERT #Transformers #NLP #MaskedLanguageModeling #Pretraining #DeepLearning #AIpapers #TheWolfReadsAI #LanguageModels #GoogleAI #DeepLearningwiththeWolf #DianaWolfTorres #JacobDevlin #MingWeiChang #KentonLee #KristinaToutanova This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Paper: Unsupervised Learning of Visual Representations by Solving Jigsaw PuzzlesAuthors: Mehdi Noroozi and Paolo FavaroPublished: 2016 (ECCV)Link: arXiv:1603.09246🧠 What’s This Paper About?Before big vision models were pre-trained on millions of labeled images, researchers wondered: Can a model teach itself to understand images—without any labels at all?This 2016 paper proposed a clever method: break an image into shuffled tiles, like a jigsaw puzzle, and train a neural network to put it back together. If the model learns to solve the puzzle, it must have learned something about object shapes, parts, and spatial context—all without human supervision.This self-supervised learning strategy helped spark a major shift in computer vision: teaching models to “pre-train themselves” by solving tasks derived from the data itself.🧩 How It Works* Jigsaw Task: The input image is split into 9 tiles arranged in a 3×3 grid. These tiles are shuffled into a random permutation.* Prediction Task: The model receives the shuffled tiles and must predict the permutation index. (The original paper uses 64 predefined permutations.)* Architecture: The network learns deep visual features by trying to infer correct spatial arrangements. It’s not told what the image is—just how it fits together.🔍 Key Takeaways* This method requires no labels—just raw images.* The features learned by the jigsaw task transfer well to other tasks like object recognition, detection, and classification.* It was one of the earliest successful examples of self-supervised learning in vision.🧠 Why It MattersThis paper helped lay the groundwork for modern vision pretraining, including:* Contrastive learning techniques like SimCLR, MoCo, and BYOL* The shift away from fully supervised learning toward representation learning* Today’s vision-language models (like CLIP) that rely on large-scale pretraining without dense annotationsThe jigsaw puzzle may seem simple—but it taught AI to notice shapes, edges, and structure the way a human might. That’s not just cute. That’s foundational.🎧 Podcast SummaryToday’s episode is AI-generated using Google NotebookLM.📚 Additional Resources: * Visual Pretraining: A Brief History (2022 blog)* Revisiting the Self-supervised Learning Method of Solving Jigsaw Puzzles* Iterative Reorganization with Weak Spatial Constraints: Solving Arbitrary Jigsaw Puzzles for Unsupervised Representation Learning#ComputerVision #SelfSupervisedLearning #RepresentationLearning #AIResearch #TheWolfReadsAI #DeepLearningWithTheWolf #VisionModels #MachineLearning #JigsawLearning #ECCV This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

We talk a lot about training in AI. The data. The GPUs. The size of the model.But once it’s trained, the real work begins.Every time you chat with an LLM, get a Photoshop suggestion, or hear an AI-generated voice, you’re tapping into a process called inference—when the model is actually put to use.And this part? It’s increasingly becoming the bottleneck in the AI pipeline.At this year’s NVIDIA GTC, I sat down with Cirrascale, a boutique cloud company building infrastructure specifically for inference. The interview itself was straightforward—what stood out to me was how emblematic their platform is of something much bigger happening across the AI industry.This isn’t just about one company. This is about the future of AI scale, deployment, and real-world use.The Industry Shift: From Research Demos to Real ProductsFor years, the AI conversation has been dominated by benchmarks and training runs—how fast can you train GPT-style models? How big is your transformer?But for AI to actually matter in day-to-day life—whether in enterprise, edge robotics, or consumer tools—it needs to run well. In real time. At scale. Across devices. With power constraints. And cost constraints. And privacy constraints.That’s inference.And suddenly, everyone is in the infrastructure game:* OpenAI is building its own data centers.* Google is optimizing Gemini for mobile inference.* Meta is pushing efficient multimodal models for on-device use.* And companies like Cirrascale are building purpose-built inference platforms optimized for enterprise needs.This shift isn’t a side note—it’s the new battleground.“We’re seeing enterprise customers with 200–300 potential AI use cases. But they need to figure out which 10 they can actually deploy this year.”— Alex Nateros, CirrascaleCirrascale at GTC: One Window Into the FutureAt their booth, Cirrascale showed off a Boston Dynamics Spot robot connected to their cloud inference platform. A multimodal model, LLaVA, analyzed its camera feed in real time.The demo wasn’t there to dazzle—it was there to prove something important:* Robots can’t carry massive models locally.* Battery-powered devices need fast uplinks to smarter infrastructure.* And inference platforms need to be optimized, not generic.“Onboard, there’s only so much compute you can do. But send that data to our inference platform, and you unlock more intelligence per watt.”— Alex NaterosThat’s the kind of detail that sticks with you—not because it’s flashy, but because it’s plausible. And that’s what AI needs more of.Blackwell, FP4, and the Need for SpeedInference isn’t just about getting an answer. It’s about getting the right answer fast.Cirrascale’s team lit up when they talked about FP4, NVIDIA’s new lower-precision compute format on Blackwell chips.“FP4 gives you just enough accuracy for real-time reaction—perfect for inference. It’s twice as fast as FP8 for many use cases.”— Alex NaterosThat kind of trade-off—speed over archival accuracy—isn’t a bug. It’s the future of how models actually get used.This Isn’t Just a Hardware Story. It’s a Strategic One.We are entering a new phase of AI—one where performance-per-dollar, inference latency, energy usage, and physical deployment matter more than leaderboard scores.And Cirrascale’s work is just one window into that.Others are pushing in different directions:* MosaicML (acquired by Databricks) is streamlining training and inference pipelines for LLMs.* Groq is betting on ultra-low-latency AI inference chips.* Apple is baking on-device inference into iOS.In this environment, the quiet players—the ones focused on deployment, efficiency, and serving real workloads—are suddenly the ones to watch.Why This Matters to YouIf you’re building anything in AI, this is your reminder:It’s not enough to have a model. You need to make it work.That means thinking about:* Where it runs* How fast it responds* How much it costs* And what happens when it failsCirrascale happens to be one company tackling that puzzle. But the puzzle itself? That’s all of ours.“We built a playground for devs to experiment with real models. Tell us what you’re building—so we can make the infrastructure better where it counts.”— Alex NaterosFinal ThoughtsIt’s easy to focus on what AI produces—the images, the conversations, the predictions. But none of that happens without infrastructure that can serve those models efficiently, reliably, and at scale.What Cirrascale is doing isn’t loud or flashy—but it’s critical. This is the part of AI most users never see: the infrastructure that turns potential into performance. It’s the part that has to work before anything else can.“Inference is how AI shows up in the real world. Not in research labs, but in robot arms, call centers, medical devices, and your pocket. It’s not as flashy as model training—but it’s where the magic becomes useful." - Alex NaterosThe next generation of AI isn’t just smarter. It’s faster, cheaper, and everywhere.Every AI demo, every chatbot interaction, every edge device that claims to be intelligent—it all depends on inference. And inference depends on engineering like this.Cirrascale’s platform is just one example of a much bigger movement across the industry: building not just bigger brains, but better bodies to carry them.Because the future of AI isn’t just about what we can train. It’s about what we can run.And that means the real AI story in 2025 isn’t just happening in the lab—it’s unfolding in the infrastructure.Podcast Note: The podcast is AI-generated using Google’s NotebookLM.Vocabulary Key* Inference: The process of running a trained AI model to generate predictions, decisions, or outputs in real time.* Training: The phase where a model learns patterns from large datasets; expensive and time-consuming, but only done once.* FP4: A lower-precision number format used in GPUs to speed up inference with acceptable accuracy. Faster and more efficient than FP8 or FP16.* Blackwell: NVIDIA’s next-generation GPU architecture designed for faster, more efficient AI workloads, including support for FP4.* Multimodal Models: AI models that can understand and process multiple types of input—like text, images, and video—at once.* LLaVA: A vision-language model (Large Language and Vision Assistant) used to provide image-aware context to LLMs.* Edge Device: A computing device (like a robot or smartphone) that performs inference outside of traditional data centers.FAQsQ: What is inference, really?A: Inference is when the AI model actually does something—like answering a question, generating an image, or helping a robot interpret a video feed. It happens after the model has been trained and is the key to real-world AI applications.Q: Why is inference such a big deal now?A: As models grow more complex and demand increases, inference is becoming the bottleneck. It’s where performance, cost, and latency constraints all collide—and where innovation is now focused.Q: What’s special about FP4 and Blackwell?A: FP4 is a new low-precision compute format supported by NVIDIA’s Blackwell GPUs. It allows faster inference at lower energy and hardware cost, making large-scale deployments more practical.Q: Why did you talk to Cirrascale?A: Because they’re a real-world example of a company focused on the future of inference infrastructure—building tools to help deploy models, not just train them.Q: Is this just about Cirrascale?A: Not at all. This piece uses Cirrascale as a case study to explore a broader shift happening across AI: from massive model training to efficient, scalable deployment.Editor’s Note: Many thanks to our two interviewees from Cirrascale. Correction on the spelling- it should be Alex Nataros, not “Nadaros” as it is written in the original version of this article. #AIInference #EdgeAI #NVIDIA #Cirrascale #DeepLearning #AIInfrastructure #Blackwell #FP4 #AIEngineering #AITools #ModelDeployment #TheWolfReadsAI #DeepLearningWithTheWolf This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com

Title: “Distilling the Knowledge in a Neural Network”Authors: Geoffrey Hinton, Oriol Vinyals, Jeff DeanDate: 2015Institution: Google, Inc.Link: https://arxiv.org/abs/1503.02531Why This Paper MattersThis 2015 paper introduced knowledge distillation, a powerful technique for compressing large, high-performing “teacher” models into smaller, faster “student” models. The key innovation was training the student not just on the correct answers (hard labels), but on the soft targets—the full probability distributions output by the teacher when using a softened softmax function. This richer signal helps the student model learn not just what to predict, but how confident the teacher was across all options.The paper demonstrated this on tasks like MNIST and Android’s voice search system, showing that smaller models could come impressively close to the performance of large ensembles—but with far less compute.This approach paved the way for:* On-device AI (smartphones, robots, wearables)* Privacy-preserving inference (no need to send data to the cloud)* Model efficiency at scale, powering advances in TinyML, mobile LLMs, and even edge roboticsIt also introduced the idea of combining a generalist model with “specialist” models trained to resolve common confusion areas—a technique still echoed in modern systems.Plain English TakeawayImagine a genius professor tutoring a student—not just handing over the right answers, but explaining why wrong answers are almost right. The student learns the logic behind the choices, not just the results.That’s what this paper made possible for AI: distilling a big, slow model’s knowledge into a smaller, faster one that can run in real-world devices—without forgetting what made the original smart in the first place.Podcast Summary 🎧Today’s podcast is AI-generated through Google NotebookLM and highlights the paper’s main ideas in a casual, accessible format.#AIpaper #KnowledgeDistillation #GeoffreyHinton #DeepLearning #EdgeAI#TinyML #ModelCompression #AIethics #SubstackAI #TheWolfReadsAI This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com