I am running Ubuntu (not using WSL) and trying to run the Hailo AI Suite, which requires an NVIDIA GPU. However, when launching a container, I encounter the following error:
ERROR:
(HTTP code 500) server error - could not select device driver “” with capabilities: [[gpu]]
Computer Installed libraries
Ubuntu
jerico@jerico-MS-7D76:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 22.04.5 LTS
Release: 22.04
Codename: jammy
Nvidia
jerico@jerico-MS-7D76:~$ nvidia-smi
Wed Mar 5 13:16:44 2025
±----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.120 Driver Version: 550.120 CUDA Version: 12.4 |
|-----------------------------------------±-----------------------±---------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA GeForce RTX 4070 … Off | 00000000:01:00.0 Off | N/A |
| 0% 33C P8 5W / 285W | 10MiB / 16376MiB | 0% Default |
| | | N/A |
±----------------------------------------±-----------------------±---------------------+
±----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 1347 G /usr/lib/xorg/Xorg 4MiB |
±----------------------------------------------------------------------------------------+
Nvidia Toolkit
jerico@jerico-MS-7D76:~$ apt show nvidia-container-toolkit
Package: nvidia-container-toolkit
Version: 1.17.4-1
Priority: optional
Section: utils
Maintainer: NVIDIA CORPORATION cudatools@nvidia.com
Installed-Size: 4,156 kB
Depends: nvidia-container-toolkit-base (= 1.17.4-1), libnvidia-container-tools (>= 1.17.4-1), libnvidia-container-tools (<< 2.0.0)
Breaks: nvidia-container-runtime (<= 3.5.0-1), nvidia-container-runtime-hook
Replaces: nvidia-container-runtime (<= 3.5.0-1), nvidia-container-runtime-hook
Homepage: GitHub - NVIDIA/nvidia-container-toolkit: Build and run containers leveraging NVIDIA GPUs
Download-Size: 1,188 kB
APT-Manual-Installed: no
APT-Sources: https://nvidia.github.io/libnvidia-container/stable/deb/amd64 Packages
Description: NVIDIA Container toolkit
Provides tools and utilities to enable GPU support in containers.
N: There are 45 additional records. Please use the ‘-a’ switch to see them.
Things I have done:
sudo nvidia-ctk runtime configure --runtime=docker
sudo systemctl restart docker
Runtime configure file:
{
“runtimes”: {
“nvidia”: {
“args”: ,
“path”: “nvidia-container-runtime”
}
}
}
jerico@jerico-MS-7D76:~$ docker info | grep -i runtime
WARNING: daemon is not using the default seccomp profile
Runtimes: io.containerd.runc.v2 runc
Default Runtime: runc
After Docker:
jerico@jerico-MS-7D76:~$ docker info | grep -i runtime
WARNING: daemon is not using the default seccomp profile
Runtimes: io.containerd.runc.v2 nvidia runc
Default Runtime: runc