Q: You need to run a Docker container with access to GPU. How?
Install NVIDIA Container Toolkit on the host. Run with --gpus all or --gpus '"device=0"'. In Docker Compose: deploy: resources: reservati...
#Docker #Docker #L3 #Containers #Linux
🎙️ Candidate Opening & Architectural Context
""In an interview, I explain how we diagnosed container runtime failures without guessing. When addressing this question, I walk the interviewer through our production incident runbook: isolating the blast radius, checking diagnostic logs and metrics, and applying a safe fix.""
Advertisement
🛠️ Production Runbook & Step-by-Step Resolution
1️⃣
Production Solution & Architecture
Install NVIDIA Container Toolkit on the host. Run with --gpus all or --gpus '"device=0"'. In Docker Compose: deploy: resources: reservations: devices:. The container can then use CUDA APIs. Verify: docker run --gpus all nvidia/cuda:11.0-base nvidia-smi.
💡 The Senior SRE Gold Nugget (Key Architectural Takeaway)
"Pro-Tip: Install NVIDIA Container Toolkit on the host. Run with --gpus all or --gpus '"device=0"'. In Docker Compose: deploy: resources: re."
⚡ 60-Second Elevator Pitch Talking Points
- Immediate Triage: Install NVIDIA Container Toolkit on the host. Run with --gpus all or --gpus '"device=0"'. In Do
- Run targeted verification commands before modifying configuration.
- Automate permanent guardrails (CI check, alerts, IaC policy) to prevent recurrence.
Advertisement