Hello,
I just wanted to reported some issues with the latest DFC (3.32) /HailoModelZoo (:
(hailo_4.22_dfc_3.32_py_3.10.6) wodzu@wodzu-Legion-Pro-7-16IRX8H:~/Development/hailo_model_zoo$ hailomz compile --hw-arch hailo8l --ckpt yolov5m_vehicles.onnx --calib-path /home/wodzu/Development/CalibFiles/ --yaml /home/wodzu/Development/hailo_model_zoo/hailo_model_zoo/cfg/networks/yolov5m_vehicles.yaml
[info] No GPU chosen, Selected GPU 0
WARNING: All log messages before absl::InitializeLog() is called are written to STDERR
E0000 00:00:1753722594.356106 51131 cuda_dnn.cc:8310] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
E0000 00:00:1753722594.358436 51131 cuda_blas.cc:1418] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
[info] First time Hailo Dataflow Compiler is being used. Checking system requirements... (this might take a few seconds)
[Warning] GPU driver version should be or higher, found 535.
[Warning] CUDNN version should be 9 or higher, found 8.9.
Component Requirement Found
========== ========== ========== ==========
OS Ubuntu Ubuntu Required
Release 20.04 22.04 Required
Package python3-tk V Required
Package graphviz V Required
Package libgraphviz-dev V Required
Package python3.10-dev V Required
RAM(GB) 16 63 Required
RAM(GB) 32 63 Recommended
CPU-Arch x86_64 x86_64 Required
CPU-flag avx V Required
GPU-Driver 560 535 Recommended
CUDA 12.5 Recommended
CUDNN 9 8.9 Recommended
Var:CC unset unset Required
Var:CXX unset unset Required
Var:LD unset unset Required
Var:AS unset unset Required
Var:AR unset unset Required
Var:LN unset unset Required
Var:DUMP unset unset Required
Var:CPY unset unset Required
In file included from /home/wodzu/.pyenv/versions/3.10.6/envs/hailo_4.22_dfc_3.32_py_3.10.6/lib/python3.10/site-packages/numpy/core/include/numpy/ndarraytypes.h:1929,
from /home/wodzu/.pyenv/versions/3.10.6/envs/hailo_4.22_dfc_3.32_py_3.10.6/lib/python3.10/site-packages/numpy/core/include/numpy/ndarrayobject.h:12,
from /home/wodzu/.pyenv/versions/3.10.6/envs/hailo_4.22_dfc_3.32_py_3.10.6/lib/python3.10/site-packages/numpy/core/include/numpy/arrayobject.h:5,
from /home/wodzu/.pyxbld/temp.linux-x86_64-cpython-310/home/wodzu/Development/hailo_model_zoo/hailo_model_zoo/core/postprocessing/cython_utils/cython_nms.c:1142:
/home/wodzu/.pyenv/versions/3.10.6/envs/hailo_4.22_dfc_3.32_py_3.10.6/lib/python3.10/site-packages/numpy/core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: #warning "Using deprecated NumPy API, disable it with " "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-Wcpp]
17 | #warning "Using deprecated NumPy API, disable it with " \
| ^~~~~~~
<Hailo Model Zoo INFO> Start run for network yolov5m_vehicles ...
<Hailo Model Zoo INFO> Initializing the hailo8l runner...
[info] Translation started on ONNX model yolov5m_vehicles
[info] Restored ONNX model yolov5m_vehicles (completion time: 00:00:00.23)
[info] Extracted ONNXRuntime meta-data for Hailo model (completion time: 00:00:01.16)
[info] Simplified ONNX model for a parsing retry attempt (completion time: 00:00:02.89)
[info] According to recommendations, retrying parsing with end node names: ['/model.24/Sigmoid', '/model.24/Sigmoid_1', '/model.24/Sigmoid_2'].
[info] Translation started on ONNX model yolov5m_vehicles
[info] Restored ONNX model yolov5m_vehicles (completion time: 00:00:00.15)
[info] Extracted ONNXRuntime meta-data for Hailo model (completion time: 00:00:00.98)
[info] NMS structure of yolov5 (or equivalent architecture) was detected.
[info] Start nodes mapped from original model: 'images': 'yolov5m_vehicles/input_layer1'.
[info] End nodes mapped from original model: '/model.24/Sigmoid', '/model.24/Sigmoid_1', '/model.24/Sigmoid_2'.
[info] Translation completed on ONNX model yolov5m_vehicles (completion time: 00:00:02.21)
[info] Translation started on ONNX model yolov5m_vehicles
[info] Restored ONNX model yolov5m_vehicles (completion time: 00:00:00.15)
[info] Extracted ONNXRuntime meta-data for Hailo model (completion time: 00:00:00.93)
[info] NMS structure of yolov5 (or equivalent architecture) was detected.
[info] Start nodes mapped from original model: 'images': 'yolov5m_vehicles/input_layer1'.
[info] End nodes mapped from original model: '/model.24/Transpose', '/model.24/Transpose_1', '/model.24/Transpose_2'.
[info] Translation completed on ONNX model yolov5m_vehicles (completion time: 00:00:01.96)
[info] Appending model script commands to yolov5m_vehicles from string
[info] Added nms postprocess command to model script.
[info] Saved HAR to: /home/wodzu/Development/hailo_model_zoo/yolov5m_vehicles.har
<Hailo Model Zoo INFO> Preparing calibration data...
[info] Loading model script commands to yolov5m_vehicles from /home/wodzu/Development/hailo_model_zoo/hailo_model_zoo/cfg/alls/generic/yolov5m_vehicles.alls
[info] Found model with 3 input channels, using real RGB images for calibration instead of sampling random data.
[info] Starting Model Optimization
W0000 00:00:1753722613.251656 51131 gpu_device.cc:2344] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...
W0000 00:00:1753722613.297727 51131 gpu_device.cc:2344] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...
[warning] Reducing optimization level to 0 (the accuracy won't be optimized and compression won't be used) because there's less data than the recommended amount (1024), and there's no available GPU
[warning] Running model optimization with zero level of optimization is not recommended for production use and might lead to suboptimal accuracy results
[info] Model received quantization params from the hn
[info] MatmulDecompose skipped
[info] Starting Mixed Precision
[info] Model Optimization Algorithm Mixed Precision is done (completion time is 00:00:00.55)
[info] LayerNorm Decomposition skipped
[info] Starting Statistics Collector
[info] Using dataset with 64 entries for calibration
Calibration: 0%| | 0/64 [00:00<?, ?entries/s]/home/wodzu/.pyenv/versions/3.10.6/envs/hailo_4.22_dfc_3.32_py_3.10.6/lib/python3.10/site-packages/keras/src/layers/activations/leaky_relu.py:41: UserWarning: Argument `alpha` is deprecated. Use `negative_slope` instead.
warnings.warn(
E0000 00:00:1753722630.131184 51131 meta_optimizer.cc:966] remapper failed: INVALID_ARGUMENT: Mutation::Apply error: fanout 'yolov5m_vehicles_1/conv59_1/act_op_1/Mean' exist for missing node 'yolov5m_vehicles_1/conv59_1/bias_add_op_1/add'.
Calibration: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 64/64 [00:23<00:00, 2.73entries/s]
[info] Model Optimization Algorithm Statistics Collector is done (completion time is 00:00:24.33)
[info] Starting Fix zp_comp Encoding
[info] Model Optimization Algorithm Fix zp_comp Encoding is done (completion time is 00:00:00.00)
[info] Matmul Equalization skipped
[info] Starting MatmulDecomposeFix
[info] Model Optimization Algorithm MatmulDecomposeFix is done (completion time is 00:00:00.00)
[info] Finetune encoding skipped
[info] Bias Correction skipped
[info] Adaround skipped
[info] Starting Quantization-Aware Fine-Tuning
[warning] Dataset is larger than expected size. Increasing the algorithm dataset size might improve the results
-
Please take a look at the “Checking system requirements.” table, it is incorrectly formatted. Honestly I don’t know what is going on there.
-
[warning] Dataset is larger than expected size. Increasing the algorithm dataset size might improve the results
If the dataset is larger than expected size than how increasing it might improve the results? 
Regs,
Chuck