This article will explore the use of GPUs in Kubernetes, outline the key metrics you should be tracking, and detail the process of setting up the tools required to schedule and monitor your GPU resources ... To keep track of GPU utilization and ensure GPU resources are not overprovisioned, we can leverage another piece of NVIDIA software to provide usage metrics ... The state of NVIDIA GPU metrics and monitoring in Kubernetes is rapidly changing and often not well documented, both in an official capacity as well as on other common troubleshooting channels (GitHub, Stack Overflow).