Foxconn & Nvidia AI Factories 🚗 // Open Source LLMs 🔓 // BitNet 1-bit Transformers 🔄

Foxconn and Nvidia are collaborating to build "AI factories" that will accelerate the development of self-driving cars and other autonomous machines. Yann Lecun, an AI legend, shares his thoughts on the potential of open-source Language Learning Models (LLMs) and how they could revolutionize AI research. The Instant Domino Effect is a new device that allows users to set up impressive chain reactions of falling dominoes in seconds. Exciting research papers are discussed, including Llemma, an open language model for mathematics; BitNet, a scalable 1-bit Transformer architecture for large language models; and VeRA, a vector-based random matrix adaptation method for reducing trainable parameters. Contact:  [email protected] Timestamps: 00:34 Introduction 02:15 Foxconn and Nvidia are building ‘AI factories’ to accelerate self-driving cars 04:54 Yann Lecunn on Open Source LLMs 06:43 ChatGPT Voice System Prompt 08:46 Fake sponsor 11:38 Llemma: An Open Language Model For Mathematics 13:51 BitNet: Scaling 1-bit Transformers for Large Language Models 15:20 VeRA: Vector-based Random Matrix Adaptation 17:32 Outro