Clément Delangue — The Power of the Open Source Community

Clem explains the virtuous cycles behind the creation and success of Hugging Face, and shares his thoughts on where NLP is heading.---Clément Delangue is co-founder and CEO of Hugging Face, the AI community building the future. Hugging Face started as an open source NLP library and has quickly grown into a commercial product used by over 5,000 companies.Connect with Clem:📍 Twitter: https://twitter.com/ClementDelangue📍 LinkedIn: https://www.linkedin.com/in/clementdelangue/---🌟 Transcript: http://wandb.me/gd-clement-delangue 🌟⏳ Timestamps:0:00 Sneak peek and intro0:56 What is Hugging Face? 4:15 The success of Hugging Face Transformers7:53 Open source and virtuous cycles10:37 Working with both TensorFlow and PyTorch13:20 The "Write With Transformer" project14:36 Transfer learning in NLP16:43 BERT and DistilBERT22:33 GPT26:32 The power of the open source community29:40 Current applications of NLP35:15 The Turing Test and conversational AI41:19 Why speech is an upcoming field within NLP43:44 The human challenges of machine learningLinks Discussed:📍 Write With Transformer, Hugging Face Transformer's text generation demo: https://transformer.huggingface.co/📍 "Attention Is All You Need" (Vaswani et al., 2017): https://arxiv.org/abs/1706.03762📍 EleutherAI and GPT-Neo: https://github.com/EleutherAI/gpt-neo]📍 Rasa, open source conversational AI: https://rasa.com/📍 Roblox article on BERT: https://blog.roblox.com/2020/05/scaled-bert-serve-1-billion-daily-requests-cpus/---Get our podcast on these platforms:👉 Apple Podcasts: http://wandb.me/apple-podcasts​​👉 Spotify: http://wandb.me/spotify​👉 Google Podcasts: http://wandb.me/google-podcasts​​👉 YouTube: http://wandb.me/youtube​​👉 Soundcloud: http://wandb.me/soundcloud​Join our community of ML practitioners where we host AMAs, share interesting projects and meet other people working in Deep Learning:http://wandb.me/slack​​Check out Fully Connected, which features curated machine learning reports by researchers exploring deep learning techniques, Kagglers showcasing winning models, industry leaders sharing best practices, and more:https://wandb.ai/fully-connected