#48 - Attention is all you need. Understanding Transformers.

An episode of the Life with AI podcast, hosted by Filipe Lauar, titled "#48 - Attention is all you need. Understanding Transformers." was published on April 28, 2022 and runs 16 minutes.

April 28, 2022 ·16m · Life with AI

Summary

Hey guys, in this episode I finally explain the Transformers network architecture! The paper Attention is all you need proposed the Transformer network and it was groundbreaking for firstly NLP field and now for all the Deep Learning fields. In the episode I explain the attention, the self-attention and the multi-head attention mechanisms for both Transformers encoder and Decoder, and also the positional encoding. Go listen to this episode because it's probably my best technical episode!  Original paper: https://arxiv.org/pdf/1706.03762.pdf  Self-attention GitHub code: https://github.com/filipelauar/projects/blob/main/self_attention.ipynb  Youtube video explaining the architecture: https://www.youtube.com/watch?v=TQQlZhbC5ps  Nice blog post with code 1: http://peterbloem.nl/blog/transformers  Nice blog post with code 2: https://nlp.seas.harvard.edu/2018/04/03/attention.html  Instagram: https://www.instagram.com/podcast.lifewithai/  Linkedin: https://www.linkedin.com/company/life-with-ai

Episode Description