Wix's AI Journey 🚀 // SEC's AI Risks Warning ⚠️ // NaViT Vision Transformer 🔭

A comprehensive look at Wix's AI journey, from its current AI-powered features to its ambitious future plans. It also delves into the SEC's warning about AI's potential risks to financial stability, including its use in financial fraud and conflicts of interest. The episode also features a deep dive into three intriguing research papers, exploring the NaViT Vision Transformer, the Retentive Network as a potential successor to Transformers, and a theory on Adam Instability in large-scale machine learning. Lastly, the episode includes a segment on Random Reads, where potential inaccuracies in the "gzip beats BERT" paper are discussed. Contact:  [email protected] Timestamps: 00:34 Introduction 02:14 To our users, my thoughts on AI: past, present and future 03:46 SEC warns AI risks financial stability 05:32 Bad numbers in the "gzip beats BERT" paper? 06:57 Fake sponsor 09:02 Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution 10:45 Retentive Network: A Successor to Transformer for Large Language Models 12:29 A Theory on Adam Instability in Large-Scale Machine Learning 14:29 Outro