Investments Pay Off for MSFT 💰 // Apple's Language Models 🍎 // Improved Language Search 🔎

Microsoft's investment in AI is paying off, with a 17% jump in revenue and a 20% increase in profit for the first three months of the year. Apple has released eight small AI language models aimed at on-device use, using a "layer-wise scaling strategy" to improve performance and transparency. Multi-Head Mixture-of-Experts is a new approach to address issues with Sparse Mixtures of Experts, outperforming existing models on three different tasks. Stream of Search (SoS) is a new technique for teaching language models to search, resulting in improved search accuracy and the ability to solve previously unsolved problems. Contact:  [email protected] Timestamps: 00:34 Introduction 01:28 Microsoft Reports Rising Revenues as A.I. Investments Bear Fruit 03:14 Apple releases eight small AI language models aimed at on-device use 05:00 Fake sponsor 07:01 Multi-Head Mixture-of-Experts 08:43 Achieving >97% on GSM8K: Deeply Understanding the Problems Makes LLMs Perfect Reasoners 10:30 Stream of Search (SoS): Learning to Search in Language 12:31 Outro