I have gpu-server with 2 A100 80gb on board. CUDA 12.2 CUDNN 9.4 gpu-drivers 535 and i still get warnings:
[warning] Reducing optimization level to 0 (the accuracy won’t be optimized and compression won’t be used) because there’s no available GPU
I’ve the same issue in this thread
I’m still struggling to find a solution…
There are several comments by Hailo. You can try it as well.
FYI.
Hi @rprok2002,
Welcome to the Hailo Community!
Could you let me know if you are using the docker container or the self-extractable installation of the suite?
I suggest the Docker, since it already contains the right CUDA dependencies (CUDA 11.8, CUDNN 8.9) and you don’t have to modify your existing environment. The driver version should be >= 525.0 (i.e. your version should be fine).
Please check the installation instructions in the Hailo AI SW Suite User Guide
I also created a post in another thread to go over the main installation steps and the expected output.