559: GPT-3 for Natural Language Processing

Natural language processing expert and PhD student Melanie Subbiah sits down with Jon Krohn to discuss GPT-3, its strengths and weaknesses, and the future of NLP.

An episode of the Super Data Science: ML & AI Podcast with Jon Krohn podcast, hosted by Jon Krohn, titled "559: GPT-3 for Natural Language Processing" was published on March 22, 2022 and runs 88 minutes.

March 22, 2022 ·88m · Super Data Science: ML & AI Podcast with Jon Krohn

Summary

Natural language processing expert and PhD student Melanie Subbiah sits down with Jon Krohn to discuss GPT-3, its strengths and weaknesses, and the future of NLP. In this episode you will learn: What is GPT-3? [6:24] The strengths and weaknesses of GPT-3 [14:38] What is autoregression? [18:03] GPT-3's new fine-tuning abilities [20:02] Bias issues with GPT-3 [22:47] The future of natural language processing models [27:54] How Melanie ended up working at OpenAI [38:13] Melanie’s self-study process [42:19] Melanie's work on OpenAI API [45:45] How to address the climate change and bias issues that cloud discussions of large natural language models [49:40] Why Melanie chose to do a PhD at Columbia University [1:01:17] The machine learning tools Melanie’s most excited about [1:08:09] Additional materials: www.superdatascience.com/559

Episode Description