PaLM 2 details leaked 🤐 // Apple's Speech Cloning 🗣️ // Contextual Pre-Training 📖

Apple's AI-Driven Accessibility Updates and Google's PaLM 2. We also delve into the world of efficient audio generation with SoundStorm and explore the potential of active retrieval augmented generation. Finally, we discuss the importance of in-context learning in NLP and how Pre-Training to Learn in Context can enhance language models' abilities. Contact: [email protected] Timestamps: 00:34 Introduction 01:45 Apple's AI-Driven Accessibility Updates Include Text-to-Speech That Can Mimic Your Voice 03:10 PaLM 2 Details Leaked: it uses 5x the data the original PaLM trained on 05:32 Numbers every LLM Developer should know 06:48 Fake sponsor 08:38 SoundStorm: Efficient Parallel Audio Generation 09:58 Active Retrieval Augmented Generation 11:30 Pre-Training to Learn in Context 13:26 Outro