The Web Gets New Rules for AI Crawlers

Cloudflare’s new defaults split AI crawlers by search, agent use and model training, shifting control over access into web infrastructure. Microsoft publishes a draft behaviour code for future MAI models, while Anthropic connects Claude to financial-adviser systems. South Korea broadens its espionage law, and five exploited flaws put enterprise-management systems on urgent patch lists. We also look at durable Pydantic AI agents on AWS Lambda, Nvidia’s forthcoming 84 GB workstation GPU, and who can actually use Siri AI as iOS 27 rolls out. Full transcript: https://www.owenonthenet.com/podcast/2026-09-15/ Sources: https://blog.cloudflare.com/content-independence-day-ai-options https://www.cloudflare.com/press/press-releases/2026/cloudflare-allows-the-agentic-internet-to-flourish-with-a-simple-philosophy-your-content-your-rules https://microsoft.ai/news/mai-code-of-conduct https://claude.com/blog/claude-for-financial-advisors https://addepar.com/blog/bringing-addepar-portfolio-intelligence-to-claude https://www.apple.com/os/ios https://www.apple.com/newsroom/2026/09/apple-advances-health-and-fitness-capabilities-using-apple-intelligence https://www.macrumors.com/2026/09/14/apple-releases-ios-27 https://www.law.go.kr/LSW/lsRvsDocListP.do?chrClsCd=010202&lsId=001692&lsRvsGubun=all https://currently.att.yahoo.com/att/south-koreas-expanded-espionage-law-000452173.html https://thehackernews.com/2026/09/cisa-adds-5-actively-exploited.html?m=1 https://www.connectwise.com/company/trust/advisories https://cert.pl/en/posts/2026/09/vulnerabilities-in-mikrotik-routeros-actively-exploited https://docs.jfrog.com/releases/docs/jfrog-security-advisories https://pydantic.dev/articles/harness-aws-lambda https://www.nvidia.com/en-eu/products/workstations/professional-desktop-gpus/rtx-pro-5500 https://www.tomshardware.com/pc-components/gpus/gaming-takes-a-backseat-as-nvidia-overhauls-the-rtx-5090-for-maximum-ai-margins-rtx-pro-5500-delivers-2-6x-vram-at-matching-specs