#73- Transformers.

An episode of the Life with AI podcast, hosted by Filipe Lauar, titled "#73- Transformers." was published on November 30, 2023 and runs 23 minutes.

November 30, 2023 ·23m · Life with AI

0:00 / 0:00

Summary

Hey guys, in this episode I explain most of what I know about Transformers. I talk about the architecture, the attention formula, encoder, decoder, self-supervised learning, positional encoding, tokenization, inductive bias, Vision-Transformers, receptive fields... It was the most technical episode I've recorded so far, and I hope you like it! By the way, it worth listening to this episode with the Transformers paper. Paper Transformers: ⁠https://arxiv.org/pdf/1706.03762.pdf⁠ Link of OpenAI explaining Next Token Prediction: https://www.linkedin.com/posts/zainhas_the-most-clearest-and-crisp-explanation-ugcPost-7132561633280692224-63AX?utm_source=share&utm_medium=member_desktop Instagram: https://www.instagram.com/podcast.lifewithai/ Linkedin: https://www.linkedin.com/company/life-with-ai

Episode Description

Hey guys, in this episode I explain most of what I know about Transformers. I talk about the architecture, the attention formula, encoder, decoder, self-supervised learning, positional encoding, tokenization, inductive bias, Vision-Transformers, receptive fields...

It was the most technical episode I've recorded so far, and I hope you like it! By the way, it worth listening to this episode with the Transformers paper.

Paper Transformers: ⁠https://arxiv.org/pdf/1706.03762.pdf⁠

Link of OpenAI explaining Next Token Prediction: https://www.linkedin.com/posts/zainhas_the-most-clearest-and-crisp-explanation-ugcPost-7132561633280692224-63AX?utm_source=share&utm_medium=member_desktop

Instagram: https://www.instagram.com/podcast.lifewithai/

Linkedin: https://www.linkedin.com/company/life-with-ai

Share this episode

Similar Episodes

New Season, Same God

Jan 15, 2025 ·15m

Standing On Business

Jan 15, 2025 ·18m

I’m Tired Of This Ship”

Dec 8, 2023 ·20m

Episode 26 - community energy & shared ownership

Oct 25, 2023 ·18m

Somebody or Nobody

Oct 21, 2023 ·19m

It’s My Mentality

Sep 16, 2023 ·18m

Similar Podcasts

Life with Rev. Q Quinton Steverson Daily conversations filled with inspirations, insightful thought and in depth prospectives aimed to motivate and challenge you in this journey called life. Ireland Creates with Aisling O' Rourke Aisling O' Rourke Ireland Creates with Aisling O' Rourke is a podcast about Ireland's storytellers. The story behind storytelling. In each episode, Aisling speaks with a different creative about their life, creative practice and what storytelling means to them. Ireland Creates has featured Writers, Photographers, Musicians and Filmmakers to name just a few. If you would like to get involved please check out www.irelandcreates.com or email Aisling on [email protected] Leanne Wood Podcast Leanne Wood With more than twenty five years experience as a political activist on the Welsh left in various roles, including the leadership of Plaid Cymru and Member of the Senedd for the Rhondda, I am now seeking to contribute to political life with a podcast.This new platform aims to give voice to those people and issues we don’t hear enough from or about in the mainstream media. Our politics needs a different conversation. I hope that this podcast will help with that. Confession Session With Life Coach Francis Camia FRANCIS CAMIA This podcast focuses on life's confessions and discussions that will hopefully make an impact to everyone and lead to a better transformation of themselves. We will be talking about purpose, relationships and anything under the sun. It also aims to shed some hope and positivity to all the listeners. On a personal note, you may also send a message or if you want to have a personal catch up or a collaboration. Let's talk!

URL copied to clipboard!