MLPerf 3 Upsets the AI Apple Cart | Gestalt IT Rundown: June 28, 2023

Training 3.0 benchmark results show performance gains of up to 1.54x compared to six months ago and 33-49x improvement over the first round, driving innovation and energy efficiency in the industry. Intel's Habana Gaudi2 ML training engine competes with Nvidia's offerings, boasting better performance than A100 and lower pricing than H100. Nvidia, on the other hand, unveils their NeMo model with half a trillion parameters and expands the MLPerf Training suite to include GPT-3 and a new Recommendation engine. Their collaboration with CoreWeave showcases the superior performance of the H100, providing a 3.6x speed increase for GPT-3 compared to Intel Xeon and Gaudi2. Nvidia is also developing foundation models for their DGX cloud, collaborating with major players in the industry, and Intel is widely rumored to be developing its own Gaudi2-as-a-Service offering. Then there's the Tiny 1.1 inferencing benchmark, which saw over 150 results and performance improvements up to 1000x. Time Stamps: 0:00 - Welcome to the Rundown 0:48 - What Red Hat is doing with CentOS 3:36 - Moving Windows to the cloud for consumers 6:31 - IBM acquires Apptio 8:51 - Cisco set to acquire SamKnows 12:04 - Databricks Acquires MosaicML 15:37 - Cato Networks introduces AI tracker for malware command and control 18:39 - MLPerf 3 Upsets the AI Apple Cart 32:10 - The Weeks Ahead 33:40 - Thanks for Watching Follow our Hosts on Social Media Tom Hollingsworth: https://www.twitter.com/NetworkingNerd Stephen Foskett: https://www.twitter.com/SFoskett Tim Bertino: https://www.twitter.com/TimBertino Follow Gestalt IT Website: https://www.GestaltIT.com/ Twitter: https://www.twitter.com/GestaltIT LinkedIn: https://www.linkedin.com/company/Gestalt-IT #Rundown, #MLPerf, #CentOS, #RHEL, @RedHat, #Cloud, @Microsoft, @Windows, @IBM, @Apptio, #NetworkMonitoring, @Cisco, @SamKnows, @Databricks, @MosaicML, @CatoNetworks, #AI, @MLCommons, #MLPerf3,