RTFM HPC - E01 - What happens on train buttom push
from RTFM: High-Performance Computing Edition
Hey! I'd love to hear your thoughts, send me a voice note. Someone hits the "Train" button… and somewhere behind the scenes, hundreds or thousands of GPUs are supposed to start processing a new #AI model. But what actually happens between that click and a new model showing up a week later? In this first episode of RTFM: High-Performance Computing Edition, we walk through what's really going on under the hood of an AI training job on a real #HPC cluster: resource management, regular storage and parallel file systems, why #RDMA exists, and why #GPU utilization can quietly drop to 10-20% if your network and storage aren't pulling their weight. This is a #HPC101 level overview, future episodes will dig into each piece (job scheduling internals, parallel file systems, #RDMA, #InfiniBand, and more) in much more depth. More info about HPC in the book https://a.co/d/b03YNBn #HPC #Supercomputing #SLURM #AI #DeepLearning #Linux #SysAdmin #DataCenter #HPC101 #supercomputer #supercomputers #lustre
Embed this episode
No transcript yet.