NVIDIA and Google have teamed up to bring the new Multi-Instance GPU feature, launched with the NVIDIA A100, to GKE. We speak to Kevin Klues from NVIDIA and Pradeep Venkatachalam from Google Cloud on how and why people use GPUs, optimising instance shapes for machine learning, and why less is often more.

Do you have something cool to share? Some questions? Let us know:

Chatter of the week

News of the week

Links from the interview

Episode 92, with Pramod Ramarao
Dogecoin
Training and inference
12 things that prove Doom will run on literally anything
“It runs Doom” subreddit
CUDA
vGPUs
Multi-Instance GPUs
GKE now supports multi-instance GPUs
7 core MacBook Air GPUs
A100 GPU
16 A100 GPUs on a Google Cloud VM
Running GPUs on GKE
- Node taints for scheduling
NVIDIA Container Toolkit
GCP NVIDIA GPU device plugin
Kubernetes NVIDIA device plugin
GTC 2021 talks:
- A Deep Dive on Supporting Multi-Instance GPUs in Containers and Kubernetes by Kevin and Pradeep
- Gain Competitive Advantage using ML Ops: Kubeflow and NVIDIA Merlin and Google Cloud by Andrew Stein and Maulin Patel (Google) and Davide Onofrio (NVIDIA)
Kevin’s KubeCon talk and slides
Kevin Klues on Twitter

Multi-Instance GPUs, with Kevin Klues and Pradeep Venkatachalam

Kubernetes Podcast from Google

Multi-Instance GPUs, with Kevin Klues and Pradeep Venkatachalam