12: GPUs - Can I, Should I, and How?

It's Wolf's turn this episode, and this one required research!GPUs obviously do tons of work. You see it every time you play a graphics intensive game. You know how crypto-miners are using them. You’ve heard AI companies using them for model building. You’ve got this hardware in your machine! Can you use it? Should you use it? Where even to start?GPUs can help if your problems, data, systems, languages, and architecture align. GPU-based solutions won’t help everyone … but when they do help, oh boy do they really help.TakeawaysPlatform recommendations:NVIDIA: Richest ecosystem, start here if you have choiceAMD: Improving rapidly, good for PyTorch workflowsApple Silicon: Excellent for unified memory workloadsLanguage recommendations:Python for quickest winsRust/C++ for maximum controlJavaScript for web applicationsLinksDave Farley explains what's wrong with Vibe coding https://youtu.be/1A6uPztchXk?si=mzEg4mpbTIjaihnPHow do graphics cards work https://youtu.be/h9Z4oGN89MU?si=JRrumRPfYU6a0A02 Hosts:Jim McQuillan can be reached at [email protected] can be reached at [email protected] us on Mastodon: @[email protected] you have feedback for us, please send it to [email protected] our webpage at http://RuntimeArguments.fmTheme music:Dawn by nuer self, from the album Digital Sky