[ML News] DeepMind builds Gopher | Google builds GLaM | Suicide capsule uses AI to check access

#mlnews #gopher #glam Your updates on everything going on in the Machine Learning world. Sponsor: Weights & Biases https://wandb.me/yannic OUTLINE: 0:00 - Intro & Overview 0:20 - Sponsor: Weights & Biases 3:05 - DeepMind releases 3 papers on large language models 11:45 - Hugging Face Blog: Training CodeParrot from scratch 14:25 - Paper: Pre-Training vision systems with noise 15:45 - DeepMind advances Quantum Mechanics 16:45 - GoogleAI trains GLaM: 1 Trillion Parameters Mixture of Experts Model 18:45 - Colin Raffel calls for building ML models like we build Open-Source software 22:05 - A rebuke of the hype around DeepMind's math paper 24:45 - Helpful Things 32:25 - Suicide Capsule plans AI to assess your mental state before use 35:15 - Synthesia raises 50M to develop AI avatars Weights & Biases Embedding Projector https://twitter.com/_ScottCondron/sta... https://docs.wandb.ai/ref/app/feature... https://wandb.ai/timssweeney/toy_data... DeepMind releases 3 papers on large language models https://deepmind.com/blog/article/lan... https://arxiv.org/pdf/2112.04426.pdf https://kstatic.googleusercontent.com... https://arxiv.org/pdf/2112.04359.pdf https://deepmind.com/research/publica... Hugging Face Blog: Training CodeParrot from scratch https://huggingface.co/blog/codeparro... Paper: Pre-Training vision systems with noise https://mbaradad.github.io/learning_w... DeepMind advances Quantum Mechanics https://deepmind.com/blog/article/Sim... https://storage.googleapis.com/deepmi... https://github.com/deepmind/deepmind-... GoogleAI trains GLaM: 1 Trillion Parameters Mixture of Experts Model https://ai.googleblog.com/2021/12/mor... Colin Raffel calls for building ML models like we build Open-Source software https://colinraffel.com/blog/a-call-t... A rebuke of the hype around DeepMind's math paper https://arxiv.org/abs/2112.04324?s=09 Helpful Things https://twitter.com/huggingface/statu... https://docs.cohere.ai/prompt-enginee... https://github.blog/2021-12-08-improv... https://huggingface.co/blog/data-meas... https://huggingface.co/spaces/hugging... https://blogs.microsoft.com/ai-for-bu... https://techcommunity.microsoft.com/t... https://github.com/minitorch/minitorc... https://minitorch.github.io/ https://pandastutor.com/ https://pandastutor.com/vis.html https://github.com/IAmPara0x/yuno https://colab.research.google.com/dri... https://www.reddit.com/r/MachineLearn... https://www.drivendata.org/competitio... https://www.reddit.com/r/MachineLearn... https://www.uttt.ai/ https://arxiv.org/abs/2112.02721?utm_... https://arxiv.org/pdf/2112.02721.pdf https://github.com/GEM-benchmark/NL-A... https://www.reddit.com/r/MachineLearn... Suicide Capsule plans AI to assess your mental state before use https://www.swissinfo.ch/eng/sci-tech... Synthesia raises 50M to develop AI avatars https://techcrunch.com/2021/12/08/syn... https://www.synthesia.io/ Links: TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick YouTube: https://www.youtube.com/c/yannickilcher Twitter: https://twitter.com/ykilcher Discord: https://discord.gg/4H8xxDF SubscribeStar: https://www.subscribestar.com/yannick... Patreon: https://www.patreon.com/yannickilcher Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq