PodParley PodParley
PodParley
#131: FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness episode artwork

EPISODE · Apr 23, 2024 · 30 MIN

#131: FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

from Misreading Chat · host Hajime Morrita

CUDA で書かれた PyTorch 用カーネルに森田が玉砕しました。

What this episode covers

CUDA で書かれた PyTorch 用カーネルに森田が玉砕しました。

NOW PLAYING

#131: FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

0:00 30:40

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Share this episode

Similar Episodes

S3 EP1: The Mystery of GurryBurg and Herbert Jones

Mar 31, 2026 ·18m

S2 EP4: Candyhub, it's the place to be. And John Redwoods!

Mar 21, 2025 ·3m

Episode 9: From the Mailroom

Mar 13, 2025 ·16m

Episode 8: From the Principal's Office

Dec 16, 2024 ·20m

S2 EP3: Jesters, Birthdays, and a Fight!

Nov 17, 2024 ·3m

S2 EP2: Dark Allegations in the Dale Glenn Community

Oct 25, 2024 ·5m

Similar Podcasts

The Health Odyssey: Navigating Tomorrow's Medicine Podcast Welcome to 'The Health Odyssey: Navigating Tomorrow's Medicine,' where we embark on an adventurous journey through the ever-evolving world of healthcare. Each episode is like a treasure map, guiding you through the rich tapestry of ancient healing arts mixed with futuristic tech wizardry. We’ll chat about the wild west of health data privacy, the corporate giants reshaping our care, and the mind-bending potential of psychedelics for mental wellness. Think of us as your trusty sidekicks, unraveling the mysteries of modern medicine while keeping it real and relatable. Let’s dive into the stories, the science, and the soul of healthcare, paving the way for a healthier tomorrow. Healing & Storytelling iamshaerka Life can be hard but thank the Lord we don’t have to go at it with our strength alone. Life with Christ is my trials, tribulations, and testimonies in the race of faith with Christ Jesus. The goal is to get closer to Jesus with bible and life chat. So, let’s talk it out, walk it out and get right with our Lord and Savior of the world. No one is asking you to be perfect, just to try for the Lord. He loved us first, even when we were sinners so it's easy to love Him back. Let’s do life with Christ together! API Intersection Stoplight Building a successful API requires more than just coding. It starts with collaborative design, focuses on creating a great developer experience, and ends with getting your company on board, maintaining consistency, and maximizing your API’s profitability.In the API Intersection, you’ll learn from experienced API practitioners who transformed their organizations, and get tangible advice to build quality APIs with collaborative API-first design.Jason Harmon brings over a decade of industry-recognized REST API experience to discuss topics around API design, governance, identity/auth versioning, and more.They’ll answer listener questions, and discuss best practices on API design (definition, modeling, grammar), Governance (multi-team design, reviewing new API’s), Platform Transformation (culture, internal education, versioning) and more.They’ll also chat with experienced API practitioners from a wide array of industries to draw out practical takeaways and insights you can use.H From the Break Room Quill Do you want to hear awesome work tips but also take a brain break? Do you want to hear from professionals just like you but also experts in other fields too? What if you could do it while getting to know your office supplier a little better, peeking behind the curtain a bit?At Quill, we’re all about helping you in your worklife. That’s why we’ve created From the Break Room, a podcast where we sit down with colleagues and customers to chat about the things that matter to you (and have a little fun).So grab your coffee, or whatever you like to drink, and hang out with us for a few minutes.

Frequently Asked Questions

How long is this episode of Misreading Chat?

This episode is 30 minutes long.

When was this Misreading Chat episode published?

This episode was published on April 23, 2024.

What is this episode about?

CUDA で書かれた PyTorch 用カーネルに森田が玉砕しました。

Can I download this Misreading Chat episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!