A guide to AI model collapse
Episode 6 of the Critical AI podcast, hosted by Handy AI, titled "A guide to AI model collapse" was published on October 23, 2024 and runs 11 minutes.
October 23, 2024 ·11m · Critical AI
Summary
Model collapse guts AI's intelligence as it feeds on its own output. Training on AI-generated junk reduces models to echo chambers, detached from reality. Culprits are statistical approximation errors, functional expressivity limits, and flawed learning procedures. We can fix this mess with rigorous data curation, model distillation, and human oversight.Read more on the Handy AI Substack newsletter. Hosted on Acast. See acast.com/privacy for more information.
Episode Description
Model collapse guts AI's intelligence as it feeds on its own output. Training on AI-generated junk reduces models to echo chambers, detached from reality. Culprits are statistical approximation errors, functional expressivity limits, and flawed learning procedures. We can fix this mess with rigorous data curation, model distillation, and human oversight.
Read more on the Handy AI Substack newsletter.
Hosted on Acast. See acast.com/privacy for more information.