Hi,
I have a similar problem. I’m having problems with these warning messages:
[warning] Reducing optimization level to 0 (the accuracy won’t be optimized and compression won’t be used) because there’s no available GPU
[warning] Running model optimization with zero level of optimization is not recommended for production use and might lead to suboptimal accuracy results
I have installed nvidia drivers and cuda 11.8, although when I run nvidia-smi, it says it couldn’t detect any cuda, but it is installed. There is a problem with installing older versions of cuda and it always defaults to cuda 12.2, which is not supported. Here is a thread: discussion.
I installed the latest Nvidia drivers and cuda 11.8 with their runfile and only cuda selected link to cuda 11.8.
BTW, I’m running the code in a docker container created with the image in the hailo_model_zoo github repo.
Do you have any ideas on how to fix it?