302: It’s So Hot, Even Windows is Hotpatching

Welcome to episode 302 of The Cloud Pod – where the forecast is always cloudy! This week Justin and Ryan are on hand to bring you all the latest in Cloud (and AI news.) We’ve got hotpatching, Project Greenland, and a rollback of GPT-4.o, which sort of makes us sad – and our egos are definitely less stroked. Plus Saas, containers, and outposts – all of this and more. Thanks for joining us in the cloud!  Titles we almost went with this week: The Cloud Pod was never accused of being sycophantic 2nd Gen outposts!?! I didn’t even know anyone was using Gen 1 AWS Outposts 2nd Gen… not with AI (GASP) If you’re doing SaaS wrong, Google & AWS have your back this week with new Features  Patching, so hot right now Larger container sizes for Azure….  You don’t say AWS Green reporting detects hotspots… surprisingly close to Maryland….. Visual pipeline for Opensearch… I want to like this… but I just can’t A big thanks to this week’s sponsor: We’re sponsorless! Want to get your brand, company, or service in front of a very enthusiastic group of cloud news seekers? You’ve come to the right place! Send us an email or hit us up on our Slack channel for more info.  General News  01:37 Sharing new DORA research for gen AI in software development The DORA team at Google has released a new report, “Impact of Generative AI In Software Development.” The report is based on data and developer interviews, and the report aims to move beyond hype to offer a proper perspective on AI’s impact on individuals, teams and organizations.  Click on the link in our show notes to access the full report. However, Google has highlighted a few key points in the blog post. AI is Real – A staggering 89% of organizations are prioritizing the integration of AI into their applications, and 76% of technologists are already using AI in some part of their daily work.  Productivity gains confirmed: Developers using Gen AI report significant increases in flow, productivity, and job satisfaction.  For instance, a 25% increase in AI adoption is associated with a 2.1% increase in individual productivity. Organization benefits are tangible: Beyond individual gains, Dora found strong correlations between AI adoption and improvements in crucial organizational metrics. A 25% increase in AI adoption is associated with increases in document quality, code quality, code review speeds and approval speeds.  If you are looking to utilize AI in your development organization, they provide five practical approaches for both leaders and practitioners. Have transparent communications Empower developers with learning and experimentation Establish clear policies Rethink performance metrics Embrace fast feedback loops 045:06 Ryan – “Those are really good approaches, but really difficult to implement in practice. You know, in my day job, watching the company struggle to get a handle on AI from all the different angles you need to, from data protection, legal liability – just operationally – it’s very hard. So I think having a mature program where you’re rolling that out with intent and being very specific with your AI tasks I think will go a long way with a lot of companies.”   AI Is Going Great – Or How ML Makes Its Money  08... Chapters (00:00:00) - The Cloud Pod(00:01:51) - A New Report on AI in Software Development(00:02:57) - How to Use AI in the Development Organization(00:08:37) - A Code Team's Journey(00:09:04) - How OpenAI Is Making Money With AI(00:12:13) - ChatGPT: The Chatbot's Syncophantic(00:14:38) - Cloudflare: DDoS Attacks reached 1 TB per second(00:18:22) - Cloudflare: Best DDoS Protection for $30 a month(00:20:09) - Amazon's US East 1 Availability Zone Announcement(00:25:41) - AWS AppSync Events(00:30:23) - EKS Cluster Node Monitoring and Auto-Repair(00:34:11) - Amazon Bedrock: Prompt Optimization (General Availability)(00:36:50) - Amazon Q Business Integrations for Microsoft Word and Outlook(00:39:05) - Amazon Serverless Reservations: New Discount for Analytics(00:42:25) - Amazon OpenSearch Injection Pipelines(00:44:50) - Amazon Announces Second Generation AWS Outpost Racks(00:48:09) - Amazon Cloudfront SaaS Manager: Multi-Termite Webs(00:52:34) - Amazon VPC Endpoints: 10 years too late(00:54:06) - SaaS Runtime: Fully Managed by Google Cloud(01:01:04) - On the Cloud: The IMS Blueprint(01:03:44) - Google Cloud Database and LangChain Integrations now support Go Java and(01:04:22) - OpenAI Unveils GPT Image 1 at Microsoft(01:06:16) - How to Stop restarting your Windows Servers for Patching(01:06:44) - Microsoft Hot Patching for Windows Server 25(01:13:27) - Let it go.(01:13:42) - Azure Confidential VMs(01:16:43) - Azure: Large Container Sizes for ACI(01:19:14) - DigitalOcean Launches Managed Caching for Valky(01:20:28) - How Amazon Rescued Its GPU Crunch(01:22:15) - Amazon's GPU Priority Process(01:24:01) - NVIDIA GPUs, Storage, and Collaboration(01:24:46) - Efficiency and confidentiality in the R&D environment(01:26:31) - Amazon's GPU Orchestration System(01:31:34) - Week in the Cloud: Longest Episode Yet