Failing to compile onnx to hef

General
, ,
18

@Erez could you let me know which Ubuntu and DFC versions are you using.
Make sure that you followed the commands in the Hailo AI SW Suite User Guide exactly in the order they are written, without missing anything. It is extremely important that the nvidia-docker2 and a driver version >= 525.0 are installed before running the docker for the first time.

I replicated the main steps on an Ubuntu 22 machine, please check them and and look for possible mismatches.

  • First, I added my user to the docker group, logged out and logged back in.

    sudo usermod -aG docker ${USER}

  • Then, I looked for the driver version outside on my machine. The version is already greater than 525.0, so I sticked with it (despite 525.0 offers better compatibility, according to CUDA documentation)

    driver
    driver826×235 27.8 KB

  • Installed nvidia-docker2, as per instructions:

    nvidia_docker2 add key
    nvidia_docker2 add key1407×691 164 KB

    nvidia_docker2 install
    nvidia_docker2 install1187×702 150 KB

    nvidia_docker2 restart docker

  • I ran the hailo_ai_sw_suite_docker_run.sh script to install the Hailo Docker:

    hailo_docker
    hailo_docker1519×1084 211 KB

    As you can see, the –gpus all argument was used in the container creation. This argument will be used ONLY if the GPU was successfully detected. In more details, the docker run scripts checks for the output of the following commands:

    lspci | grep "VGA compatible controller: NVIDIA"
dpkg -l | grep 'nvidia-docker\|nvidia-container-toolkit'

    Please check if these commands give a non-empty output when you run them outside the docker, and also create a new container to verify the arguments passed to the docker run command.