The NVIDIA Container Toolkit allows users to build and run GPU accelerated Docker containers. The toolkit includes a container runtime library and utilities to automatically configure containers to leverage NVIDIA GPUs. Make sure you have installed the NVIDIA driver and Docker engine for your Linux distribution Note that you do not need to install the CUDA Toolkit on the host system, but the NVIDIA driver needs to be installed. The NVIDIA Container Toolkit supports different container engines in the ecosystem - Docker, LXC, Podman etc. Follow the User Guide for running GPU containers with these engines. The architecture of the NVIDIA Container Toolkit allows for different container engines in the ecosystem - Docker, LXC, Podman to be supported easily. The NVIDIA Container Toolkit provides different options for enumerating GPUs and the capabilities that are supported for CUDA containers.

Features

  • The NVIDIA Container Toolkit is architected so that it can be targeted to support any container runtime in the ecosystem
  • You can register the NVIDIA runtime as a custom runtime to Docker
  • Enumerate GPUs and control which GPUs are visible to the container
  • Control which features of the driver are visible to the container using capabilities
  • Control the behavior of the runtime using constraints
  • Users can control the behavior of the NVIDIA container runtime using environment variables

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow NVIDIA Container Toolkit

NVIDIA Container Toolkit Web Site

Other Useful Business Software
Forever Free Full-Stack Observability | Grafana Cloud Icon
Forever Free Full-Stack Observability | Grafana Cloud

Our generous forever free tier includes the full platform, including the AI Assistant, for 3 users with 10k metrics, 50GB logs, and 50GB traces.

Built on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
Create free account
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of NVIDIA Container Toolkit!

Additional Project Details

Operating Systems

Linux

Registered

2021-04-30