GPU A100 not detected

I have gpu-server with 2 A100 80gb on board. CUDA 12.2 CUDNN 9.4 gpu-drivers 535 and i still get warnings:
[warning] Reducing optimization level to 0 (the accuracy won’t be optimized and compression won’t be used) because there’s no available GPU

I’ve the same issue in this thread

I’m still struggling to find a solution…
There are several comments by Hailo. You can try it as well.

FYI.

Hi @rprok2002,

Welcome to the Hailo Community!

Could you let me know if you are using the docker container or the self-extractable installation of the suite?

I suggest the Docker, since it already contains the right CUDA dependencies (CUDA 11.8, CUDNN 8.9) and you don’t have to modify your existing environment. The driver version should be >= 525.0 (i.e. your version should be fine).
Please check the installation instructions in the Hailo AI SW Suite User Guide

I also created a post in another thread to go over the main installation steps and the expected output.