AI On An Exponential? Data, Mamba, and More

From the crazy potential of data quality, the dramatic possibilities of new architectures like Mamba (summarised here in around 5 minutes!), hybrid architectures, prompt optimisation and more. And regardless of all of that, photo-realism is coming to video. I'll also explore a 100 year old prediction, on this 2024 New Year in AI... https://www.patreon.com/AIExplainedFan Tweet: https://twitter.com/DrJimFan/status/1741499431474934165Mamba: https://arxiv.org/abs/2312.00752Mamba Tri Dao Interview: https://www.youtube.com/watch?v=OFFHiJzPpCQ&t=1902sAlbert Gu: https://twitter.com/_albertgu/status/1731727682814050570AI Improvement Paper: https://arxiv.org/abs/2312.07413Mistral Interview: https://www.youtube.com/watch?v=NhASk7rZsmULukasz Kaiser on Inference Time Compute: https://www.youtube.com/watch?v=Vrvc2rPuXTEW.A.L.T Video: https://twitter.com/DrJimFan/status/1740788207967736047 https://aicountdown.com/AI Explained Orca: https://www.youtube.com/watch?v=Dt_UNg7MchgLet’s Verify: https://www.youtube.com/watch?v=hZTZYffRsKIQ-Star: https://www.youtube.com/watch?v=ARf0WyFau0A&t=721s1923 Cartoon: https://www.linkedin.com/posts/svpino_a-1923-cartoon-that-predicts-generative-ai-activity-7023655761272524800-GRsy/Quadratic Complexity: https://medium.com/intel-tech/how-to-apply-transformers-to-time-series-models-spacetimeformer-e452f2825d2eStriped Hyena: https://www.together.ai/blog/stripedhyena-7bIllustrated Transformer: https://jalammar.github.io/illustrated-transformer/Language Models as Optimizers: https://arxiv.org/abs/2309.03409https://www.etched.com/W.A.L.T https://www.tomsguide.com/news/walt-is-a-new-ai-video-tool-that-creates-photorealistic-clips-from-a-single-image-you-have-to-see-it-to-believe-itS4: https://hazyresearch.stanford.edu/blog/2022-01-14-s4-1https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/