Skip to content
What is a Transformer? episode artwork

Jun 24, 2024 6 min

What is a Transformer?

from Generative AI 101 Hosted by Emily Laird

In this episode, we discover the fascinating world of Transformers. Imagine it's the early days of AI, with RNNs and LSTMs doing the heavy lifting, but struggling with long-range dependencies like forgetful grandparents. Enter the Transformer model—a revolutionary architecture introduced in 2017 by Google’s "Attention is All You Need" paper. Transformers handle long-range dependencies and process data in parallel, making them incredibly efficient. We'll break down their key components like self-attention, positional encoding, and multi-head attention, showing how they transformed the AI landscape. Tune in to discover why Transformers are the shiny new sports car of AI models. Connect with Emily Laird on LinkedIn

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

What is a Transformer?

0:00 6:28

No transcript yet.

Requests help us decide what to transcribe next.

Share this episode

Similar podcasts

CISO Perspectives (public) N2K Networks This season on CISO Perspectives, host Kim Jones explores some of the challenges of leading through uncertainty. We explore the complexity of the changing nature of regulation and working with the federal government, the evolution of privacy and fraud, and how emerging technologies like AI and quantum computing are changing cyber. When you don’t know what questions to ask, you’re afraid to ask, or don’t know who to ask, CISO Perspectives provides the foundation for learning in this brave new world.

Frequently asked questions

How long is this episode of Generative AI 101?

This episode is 6 minutes long.

When was this Generative AI 101 episode published?

This episode was published on June 24, 2024.

Can I download this Generative AI 101 episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.