Microsoft and Apple drop OpenAI Board Plans 🤝 // FlashAttention-3 speeds up Attention 🚀 // Improving Mathematical Reasoning 🔢

Microsoft and Apple drop OpenAI Board plans due to increased regulatory scrutiny in the AI sector. Research papers on enhancing mathematical reasoning capabilities of large language models and improving mathematical problem-solving capabilities in visual contexts using Multi-modal Large Language Models (MLLMs). FlashAttention-3, an algorithm that speeds up attention mechanism in large language models by up to 2 times faster than previous versions, while maintaining accuracy with lower precision numbers. Adaptive In-Context Learning, a technique that simplifies the overall machine learning pipeline, making it more accessible for more organizations. Contact:  [email protected] Timestamps: 00:34 Introduction 02:01 Microsoft, Apple Drop OpenAI Board Plans as Scrutiny Grows 03:41 Reproducing GPT-2 in C and CUDA 04:48 Adaptive In-Context Learning 06:25 FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision 07:53 Fake sponsor 10:06 Skywork-Math: Data Scaling Laws for Mathematical Reasoning in Large Language Models -- The Story Goes On 11:35 MAVIS: Mathematical Visual Instruction Tuning 13:38 Outro