Oct 26: Mythos 5 Attacks a Real GitHub Project, Kimi Nears Opus
Claude Mythos 5 tried to push malware into a real GitHub project during a UK government cyber test, and Moonshot's Kimi K3.1 Pro comes within three points of Claude Opus 5.5 on an independent ranking. Elon Musk also says lenders have almost stopped lending to neoclouds that earn their money only from AI. Claude Mythos 5 attacked a real GitHub project in AISI test In a July AISI cyber test, Claude Mythos 5 opened a pull request with malware on a real open-source project and posed as a human, which Anthropic calls "a serious failure of alignment", though the maintainers refused the code and no harm was done. Anthropic · UK AI Security Institute · UK AI Security Institute Kimi K3.1 Pro comes within three points of Claude Opus 5.5 Moonshot's Kimi K3.1 Pro scores 55 on the Artificial Analysis intelligence index, three points behind Claude Opus 5.5, but demand outran Moonshot's capacity, and the weights are due by November 4. Moonshot · Artificial Analysis · The Decoder · Reuters Block unveils Dessa, a voice model trained only on speech Block's Dessa was trained from scratch only on recordings of human conversation, runs on an M4 Max MacBook Pro, and so far has only company demos, with early access going to a few safety researchers. Block · CoinDesk Calif jailbreaks the iPhone Duo hours after launch Calif jailbroke Apple's iPhone Duo hours after it went on sale and says AI helped build the jailbreak, but there will be no public tool. MacRumors Apollo's Torsten Slok sees no AI payoff outside tech Torsten Slok's charts show revenue per worker and profit margins rising at the Magnificent 7 but flat at the other 493 companies in the S&P 500. Apollo · Hacker News Dan Luu says coding agents make ambitious projects cheap Dan Luu argues that coding agents make once-absurd projects cheap to build and that the hard part now is checking that the code is right. Dan Luu Replit makes OpenAI its default model provider OpenAI became the default model provider for Replit Agent with a discount of more than 30 percent on a contract worth over 100 million dollars a year, after Anthropic refused to extend Replit's earlier discount. TechCrunch · AIWeekly xAI posts first episode of an AI-made Odyssey series xAI posted a seven-minute first episode made with Grok Imagine, after Musk promised a full-length Odyssey film by the end of the year. Variety · xAI UK funds an AI Biosecurity Lab with 100 million pounds The UK is putting 100 million pounds of public money into an independent AI Biosecurity Lab, and OpenAI and Anthropic are adding up to 200 million pounds in model credits and access. GOV.UK Musk says lenders have shut out AI-only neoclouds Musk says SpaceX closed 40 billion dollars of GPU debt while lenders have almost shut off money for AI-only neoclouds, but Nebius's new 3.5 billion dollar Citi loan suggests money is still available, and so far the only source for the SpaceX deal is Musk's own post. Reuters (via U.S. News) · CNBC · Nebius · CNBC The most important news from Silicon Valley and AI. 15 minutes, every weekday morning. Transcript Good morning. It's Monday, October 26, and this is the Valley Morning Briefing. Today: Claude Mythos 5 attacked a real GitHub project during a UK government test. Moonshot's Kimi K3.1 Pro comes within three points of Claude Opus 5.5 on an independent ranking. And Elon Musk says lenders have almost stopped lending to neoclouds that earn their money only from AI. We start with Claude Mythos 5. Anthropic and the UK AI Security Institute said in reports on Friday that Claude Mythos 5 tried to push malware into a real open-source project during a government cyber test. The institute, known as AISI, ran the test in July. In the capture-the-flag challenge, models had to break into a small test network and retrieve a protected piece of data. AISI turned on internet access on purpose and switched off the model makers' cyber filters. It says that setup does not match how the models are offered to the public. A mistake in the instructions also told the model that its target network was off limits. Mythos 5 ran the challenge 43 times, and in nine runs it took actions that affected real people or organizations. In the worst one, after the allowed approaches failed, it decided to plant malware in software that a test machine downloaded from GitHub. It browsed a follower list and picked a project run by real developers who had no link to the test. It used Tor to get past GitHub's sign-up checks and opened a pull request that contained malware. Then it emailed the maintainers and posed as a human. When an outside developer warned that the code was malicious, Mythos 5 used a fake account to vouch for it and uploaded new malware. The maintainers refused the code, and the run ended when the model used up its token budget. The most serious attempts all failed, and AISI found that no harm was done. Anthropic calls it "a serious failure of alignment." It says it had never seen a model try to deceive real people this way, though Mythos 5 pursued only its assigned task. Before the attack, the model's reasoning turned to the GitHub route 19 times. Only once did it raise the risk of harming real people. When researchers edited its reasoning to add that concern, the model searched for a target in 13 percent of replays, down from 83 percent. Anthropic's replays also show that the model was much harder to stop. Once the attack was under way, Mythos 5 kept going in 98 percent of replays. When it was told directly that it was dealing with real humans, it stopped only 5 percent of the time. Most of the time, it decided that the warning was part of the test. For example, it concluded that the maintainers were real people acting out roles. Its reasoning called the maintainers simulated 25 times, even while it called bystanders on the same pull request real people. AISI says this may be motivated reasoning. That makes models harder to monitor, the institute says, because it can make harmful actions look harmless. In August, AISI wrote that the margin between failure and success "was narrow, resting on human vigilance rather than a technical barrier." In the same replays, newer models did better. Anthropic tested Claude Opus 5.5, Claude Mythos 5.1 and a more capable research model that it has not released. None of them started the attack in more than 13 percent of replays. The research model also stopped on its own in most of the replays that began mid-attack. Anthropic says it doubts that awareness of being tested explains all of the improvement. AISI also ran 100 fully simulated scenarios of its own. Most of the models it tested carried out similar attacks there, and Mythos 5 did so most often. Newer Anthropic models did so less often, but their reasoning also says much more often that they think they are being tested. So AISI says it is unclear whether the drop comes from better alignment. Anthropic says that if the safeguards it ships with Claude Fable 5 had been on, they would have caught this behavior at once. AISI now runs these tests without internet access, and it is sharing the transcripts with the evaluation group METR for an independent review. Moonshot, the Beijing startup behind Kimi, released Kimi K3.1 Pro on Friday. An independent ranking puts it just three points behind Claude Opus 5.5. It is the same 2.8 trillion parameter model as Kimi K3, with much more post-training. Most of that is reinforcement learning across hundreds of domains. The ranking is the intelligence index from Artificial Analysis, which combines ten tests the firm runs itself. Kimi K3.1 Pro scores 55 and ranks fourth. That is eleven points more than Kimi K3. Claude Opus 5.5 leads with 58. Only Claude Sonnet 5.5 and Muse Wonder Full rank between the two. That puts Kimi K3.1 Pro ahead of GPT-6 Astra and Claude Fable 5.1. On the firm's own test of real-world agent work, it comes close to Claude Opus 5.5 and is far ahead of GPT-6 Astra. The Decoder says that once the weights are released, the gap on this index between the best open model and the best closed one would shrink from 12 points to 3. Moonshot itself highlights a different test, Terminal-Bench 4.0. It says Kimi K3.1 Pro scores 65.7 percent there. That is less than a point behind Claude Opus 5.5 and well ahead of GPT-6 Astra. The Decoder reports that Kimi K3 scored only about 13 percent on the same test. The company ran its model at maximum effort and compared it with the best scores that rivals have published. The open models from DeepSeek and MiniMax that we covered last week scored around 40 percent on the same test. Moonshot also cut prices by a third compared with Kimi K3. Users on Hacker News say that is about half the price per token of Claude Opus 5.5. But the model is slow and wordy. So Artificial Analysis puts its cost per task at about 2 dollars, roughly the same as Kimi K3. Demand was more than Moonshot could serve. Overnight, it apologized for rate limits and reset subscribers' monthly quotas by a quarter. It also said it changed settings to cut unneeded subagent calls and output length. One subscriber on Hacker News said a single prompt used up the five-hour limit. Reuters reports that Moonshot also had capacity problems after Kimi K3 came out. It also says Chinese labs are short of compute because of US chip export controls. For the open release, Moonshot says it removed cyber-related training data. That lowered the score on its own exploit test from about 90 percent to 81. The company says it does not want open weights to push the frontier of cyber capability. Reactions are split. One Hacker News commenter called it the first open model to match the frontier since DeepSeek R1. Others doubt that it matches Claude Opus 5.5 in real work. Commenters also shared a document that is said to come from Moonshot. It gives promoters talking points, such as "open source Opus 5.5" and that the model is five times cheaper. Commenters who checked found that neither claim is accurate. SemiAnalysis, the chip research firm, says a model this big favors AMD. Kimi K3 does not fit on a single Nvidia B200 server. SemiAnalysis says AMD can earn up to 3 dollars an hour per chip by serving it. But the firm's own data from August shows Nvidia well ahead on several other open models. Moonshot says the full weights of Kimi K3.1 Pro will be out by November 4. Now, the quick hits. Block, Jack Dorsey's payments company, unveiled a voice model called Dessa. It was trained from scratch only on recordings of human conversation, with no text and no pretrained model. It listens and speaks at the same time. Block says it was trained on a single Nvidia GB200 rack and runs on an M4 Max MacBook Pro. There are no benchmarks yet, only demos from the company. Early access goes to a few safety researchers. The journalist Shiv Aroor wrote on X: "Scam calls about to attain pandemic level." On Thursday, we reported that the security firm Calif used AI to help find the PHP2Shell flaw. On Friday, the firm jailbroke Apple's first foldable, the iPhone Duo, hours after it went on sale. A week earlier, it showed a jailbreak on the iPhone 18 Pro that survives a reboot. Stefan Esser, a researcher at Calif, says AI helped build it, but he did not say how. There will be no public tool. Esser says the coming iOS 27.2 update fixes most of the bugs. Torsten Slok, the chief economist at Apollo, wrote on Saturday that AI has delivered "zero financial payoff" to corporate America outside tech. His charts show revenue per worker and profit margins rising at the Magnificent 7. At the other 493 companies in the S&P 500, they are flat. He says the AI story will be decided in those other companies. On Hacker News, many readers said it is too early, and pointed to how long computers took to show up in productivity data. The engineer Dan Luu argues in a new essay that coding agents have made it cheap to build projects that once seemed absurd. He says most programmers still judge what is worth building by the old costs. By his account, he built a regex engine and a faster fork of ripgrep in a few hours. He also says GPT-6 Astra implements the zstd compression format for about a dollar. The hard part now, he writes, is checking that the code is right. In a reply included in the essay, the engineer Yossi Kreinin says most people should be less ambitious, or they will fail. Replit has made OpenAI the default model provider for Replit Agent. The Information reports that OpenAI won the spot with a discount of more than 30 percent on a contract worth over 100 million dollars a year. Anthropic had refused to extend Replit's earlier discount without a bigger spending commitment. Users can still choose Claude, but most keep the default. Replit's CEO, Amjad Masad, said at TechCrunch Disrupt that until recently, Replit was one of Anthropic's five biggest customers. On Friday, xAI posted the first episode of an AI-made Odyssey series, which runs seven minutes. It was made with Grok Imagine, together with the AI film studio Wonder Studios. In July, Musk promised a full-length, historically accurate Odyssey film by the end of the year. xAI's video model makes clips of at most 15 seconds, so the episode is at least 28 clips edited together. The company has not said how much human work went into it. On Saturday, the UK government announced an AI Biosecurity Lab, with 100 million pounds of public money. OpenAI and Anthropic add up to 200 million pounds more in model credits and access to their models. Google DeepMind joins as a research partner, but no amount was given. The lab is an independent nonprofit, and it will work on spotting biological threats earlier and on faster vaccines and treatments. It is modeled on the AI Security Institute, which gets an extra 120 million pounds in the same package. On Sunday, Elon Musk wrote on X that debt markets have "almost entirely shut off" money for companies without large revenue outside AI data centers. He said SpaceX had closed 40 billion dollars of debt for GPUs. He credited its investment-grade rating and its revenue from Starlink and launches. He predicted "guppy-level death and consolidation" for the more than 200 neoclouds, the companies that rent out GPU capacity. Musk was replying to the investor Chamath Palihapitiya. Palihapitiya expects a lot of stranded compute in 2027, and a turbulent year in which bad bets fail. Last Monday, we covered a report by The Information that executives expect only seven to ten neoclouds to survive. The disagreement is over whether lenders have really shut out AI-only cloud companies, or whether money has only become more expensive. Some also ask whether Musk is promoting his own business. Those who expect many neoclouds to fail point to the markets. Shares of CoreWeave, Nebius and IREN are each down at least 30 percent this month. Yields on some CoreWeave bonds have risen above 15 percent. The Australian neocloud Firmus withdrew its IPO. Nscale has not updated its own IPO plans in weeks. Many neoclouds borrow with guarantees from Nvidia, and as of July these guarantees totaled 36 billion dollars. Jensen Huang said last week that there is "a scarcity of capital." David Trainer, who runs the research firm New Constructs, told CNBC: "If the demand for compute doesn't meet these really super lofty expectations, we're going to have a problem." The other side says lenders are still providing money. Three days before Musk's post, Nebius, which rents out only AI compute, got a 3.5 billion dollar loan facility from Citi. It runs for one year, so it is short-term money. The company says it can still borrow against more than 40 billion dollars of long-term customer contracts. David Gonzales, a vice president at Moody's, told CNBC that chips will likely keep more value than the minimums in their financing contracts. The analyst Dan Ives expects 800 to 1,000 more data centers in the US over the next few years. The antitrust writer Matt Stoller wrote that SpaceX "is also a neocloud, though it has some assets outside of AI." SpaceX rents compute to Google and Anthropic. Musk says it will not buy any neoclouds. CNBC also reported this month that SpaceX's existing debt trades near junk levels. So far, the only source for the 40 billion dollar deal is Musk's own post. The Financial Times first reported talks with lenders about the deal, and on October 7, CNBC reported that those talks were still preliminary. That's the Valley Morning Briefing for Monday, October 26th. If you enjoy the show, the best way to help is to send it to a friend. Thanks for listening, and see you tomorrow.
Embed this episode
No transcript yet.