650: SparseGPT: Remove 100 Billion Parameters but Retain 100% Accuracy
SparseGPT is a noteworthy one-shot pruning technique that can halve the size of large language models like GPT-3 without adversely affecting accuracy. In this episode, Jon Krohn provides an overview of this development and explains its commercial and environmental implications.Additional materials: www.superdatascience.com/650Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.
An episode of the Super Data Science: ML & AI Podcast with Jon Krohn podcast, hosted by Jon Krohn, titled "650: SparseGPT: Remove 100 Billion Parameters but Retain 100% Accuracy" was published on February 3, 2023 and runs 7 minutes.
February 3, 2023 ·7m · Super Data Science: ML & AI Podcast with Jon Krohn
Summary
SparseGPT is a noteworthy one-shot pruning technique that can halve the size of large language models like GPT-3 without adversely affecting accuracy. In this episode, Jon Krohn provides an overview of this development and explains its commercial and environmental implications. Additional materials: www.superdatascience.com/650 Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.
Episode Description
Similar Episodes
Mar 10, 2026 ·43m
Feb 17, 2026 ·57m