Skip to content
A Deep Dive on Supporting Multi-Instance GPUs in Containers and Kubernetes - Kevin Klues, NVIDIA episode artwork

Jul 12, 2021 31 min

A Deep Dive on Supporting Multi-Instance GPUs in Containers and Kubernetes - Kevin Klues, NVIDIA

from CNCAST Hosted by judson feedlyn

This episode aired on Youtube in the CNCF official Channel on mai 14, 2021 This video is based on the youtube video with the same title, it is licensed under Creative Commons Attribution license (reuse allowed) as stated in youtube the July 13th, 2021 A Deep Dive on Supporting Multi-Instance GPUs in Containers and Kubernetes - Kevin Klues, NVIDIA MIG (short for Multi-Instance GPU) is a mode of operation in the newest generation of NVIDIA Ampere GPUs. It allows one to partition a GPU into a set of "MIG Devices", each of which appears to the software consuming it as a mini-GPU, with a fixed partition of memory and compute resources. In this talk, we take a deep dive into the details of how we built support for MIG in containers and Kubernetes. You will learn how MIG is made available to containers, what challenges we faced building MIG support for Kubernetes, and how you can use it today. Everything we built is 100% open-source and part of the NVIDIA container toolkit stack and NVIDIA k8s-device-plugin. This talk will conclude with a discussion on best practices around how to distribute MIG devices throughout a Kubernetes cluster, including how to handle the lifecycle of MIG devices on a node.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

A Deep Dive on Supporting Multi-Instance GPUs in Containers and Kubernetes - Kevin Klues, NVIDIA

0:00 31:54

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of CNCAST?

This episode is 31 minutes long.

When was this CNCAST episode published?

This episode was published on July 12, 2021.

Can I download this CNCAST episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.