Cohere's Command R+ 🔝 // JetMoE-8B cost-effective model 💸 // Think-and-Execute framework for algorithmic reasoning 🤖

Command R+ is a new language model designed for enterprise-grade workloads that outperforms similar models in the scalable market category and offers multilingual coverage in 10 key languages to support global business operations. JetMoE-8B is a new model that was trained with less than $0.1 million cost and outperformed LLaMA2-7B from Meta AI, who has multi-billion-dollar training resources. Mixture-of-Depths is a new method proposed for transformer-based language models that dynamically allocates compute to specific positions in a sequence, optimizing the allocation along the sequence for different layers across the model depth. Think-and-Execute is a new framework that aims to improve algorithmic reasoning in large language models by decomposing the reasoning process into two steps: discovering task-level logic that is shared across all instances for solving a given task and expressing it with pseudocode, and simulating the generated pseudocode to execute the code.  Contact:  [email protected] Timestamps: 00:34 Introduction 01:42 Introducing Command R+: A Scalable LLM Built for Business 03:38 JetMoE: Reaching LLaMA2 Performance with 0.1M Dollars 05:08 AI & the Web: Understanding and managing the impact of Machine Learning models on the Web 06:37 Fake sponsor 08:44 Do language models plan ahead for future tokens? 10:04 Mixture-of-Depths: Dynamically allocating compute in transformer-based language models 11:33 Language Models as Compilers: Simulating Pseudocode Execution Improves Algorithmic Reasoning in Language Models 13:40 Outro