#577: My Dream "home lab"

Join me for an exclusive, behind-the-scenes tour of Cisco's purpose-built $20 million AI data center lab in San Jose. AI is revolutionizing the tech industry, but running massive 10,000 GPU clusters can cost up to $175 million a year—and a mere 5% network bottleneck can flush $8 million down the drain. In this video, we break down the hardware, software, and networking topologies required to build, secure, and scale massive AI data centers.I sit down with Cisco engineers to explore scale-up domains with NVIDIA H200 and AMD MI350X servers, scale-out rail-optimized topologies, and the massive Cisco Silicon One G300 ASIC delivering 102.4 Terabits per second with innovative liquid cooling. We also dive into the Ethernet vs. InfiniBand debate for scaling to 100,000 GPUs, the power of Linear Pluggable Optics (LPO) to reduce power draw, and how Cisco used AI to safely refactor 500,000 lines of legacy code. Whether you are buildingan AI network today or upgrading your engineering skills for the future, this is video can help you learn.Big thanks to Cisco for sponsoring my trip to Cisco Data Center and Operational Control Center in San Jose.// Will Eatherton SOCIAL // LinkedIn: / willeatherton Newsroom: https://newsroom.cisco.com/c/r/newsro...// Rakesh Kumar SOCIAL //LinkedIn: / rakesh-kumar-78559b // Richard Licon SOCIAL //LinkedIn: / rlicon75 // Ram Gandikota //LinkedIn: / ramgandikota // Faraz Taifehesmatian SOCIAL //LinkedIn: / faraztaifeh // YouTube video REFERENCE // • The 100Tbps AI Switch: Inside the Beast / David's SOCIAL //Discord: discord.com/invite/usKSyzbTwitter: www.twitter.com/davidbombalInstagram: www.instagram.com/davidbombalLinkedIn: www.linkedin.com/in/davidbombalFacebook: www.facebook.com/davidbombal.coTikTok: tiktok.com/@davidbombalYouTube: / @davidbombalSpotify: open.spotify.com/show/3f6k6gE...SoundCloud: / davidbombalApple Podcast: podcasts.apple.com/us/podcast...// MY STUFF // https://www.amazon.com/shop/davidbombal // SPONSORS // Interested in sponsoring my videos? Reach out to my team here: [email protected]// MENU //0:00 - The power of AI data centers0:51 - Cost and challenges of AI data centers02:35 - How to connect GPUs in an AI cluster05:23 - The future of data centers08:45 - NeoCloud infrastructure in Australia10:28 - The right components matter16:32 - Testing to avoid failures21:43 - Ethernet vs InfiniBand23:27 - Cisco security services26:14 - Future of speeds in the data center27:23 - ConclusionPlease note that links listed may be affiliate links and provide me with a small percentage/kickback should you use them to purchase any of the items listed or recommended. Thank you for supporting me and this channel! Disclaimer: This video is for educational purposes only.#ai #network #datacenter