Lewis Tunstall: Hugging Face, SetFit and Reinforcement Learning | Learning from Machine Learning #6

This episode features Lewis Tunstall, machine learning engineer at Hugging Face and author of the best selling book Natural Language Processing with Transformers. He currently focuses on one of the hottest topic in NLP right now reinforcement learning from human feedback (RLHF). Lewis holds a PhD in quantum physics and his research has taken him around the world and into some of the most impactful projects including the Large Hadron Collider, the world's largest and most powerful particle accelerator. Lewis shares his unique story from Quantum Physicist to Data Scientist to Machine Learning Engineer. Resources to learn more about Lewis Tunstallhttps://www.linkedin.com/in/lewis-tunstall/https://github.com/lewtunReferences from the Episodehttps://www.fast.ai/https://jeremy.fast.ai/SetFit - https://arxiv.org/abs/2209.11055Proximal Policy OptimizationInstructGPTRAFT BenchmarkBidirectional Language Models are Also Few-Shot LearnersNils Reimers - Sentence TransformersJay Alammar - Illustrated TransformerAnnotated TransformerMoshe Wasserblat, Intel, NLP, Research ManagerLeandro von Werra, Co-Author of NLP with Transformers, Hugging Face ResearcherLLMSys - https://lmsys.org/LoRA - Low-Rank Adaptation of Large Language ModelsResources to learn more about Learning from Machine Learninghttps://www.linkedin.com/company/learning-from-machine-learninghttps://mindfulmachines.substack.com/https://www.linkedin.com/in/sethplevine/https://medium.com/@levine.seth.p