hailo compiler Mapping Failed

General
1

Hi,

I tried to convert .pt model into .hef to be able to run on rpi5, but got this error (see below). I installed newest DFC, and lates model zoo, I was able to parse .onnx moder to .har with this command :
hailo parser onnx license_plate_detector.onnx --start-node-names images --end-node-names output0 --hw-arch hailo8l

and then when I am trying to hailo compiler license_plate_detector_optimized.har --hw-arch hailo8l I got this(for better understanding full output) :

(new_hailo_env) dima-ubuntu@Dima:~/hailo_model_zoo$ hailo compiler license_plate_detector_optimized.har --hw-arch hailo8l
[info] Current Time: 20:23:35, 09/11/24
[info] CPU: Architecture: x86_64, Model: AMD Ryzen 9 7950X3D 16-Core Processor, Number Of Cores: 32, Utilization: 8.8%
[info] Memory: Total: 63GB, Available: 17GB
[info] System info: OS: Linux, Kernel: 4.4.0-22621-Microsoft
[info] Hailo DFC Version: 3.28.0
[info] HailoRT Version: Not Installed
[info] PCIe: No Hailo PCIe device was found
[info] Running `hailo compiler license_plate_detector_optimized.har --hw-arch hailo8l`
[info] Compiling network
[info] To achieve optimal performance, set the compiler_optimization_level to "max" by adding performance_param(compiler_optimization_level=max) to the model script. Note that this may increase compilation time.
[info] Loading network parameters
[info] Starting Hailo allocation and compilation flow
[error] Mapping Failed (allocation time: 8s)
No successful assignment for: format_conversion1, concat17, feature_splitter9, shortcut_softmax1, reduce_max_softmax1, ew_sub_softmax1, reduce_sum_softmax1, ew_mult_softmax1, conv64

[error] Failed to produce compiled graph
[error] BackendAllocatorException: Compilation failed: No successful assignment for: format_conversion1, concat17, feature_splitter9, shortcut_softmax1, reduce_max_softmax1, ew_sub_softmax1, reduce_sum_softmax1, ew_mult_softmax1, conv64
2

Hey @DimaR,

The Deep Flow Compiler (DFC) error you’re seeing indicates resource allocation failures for operations like format_conversion1, concat17, and feature_splitter9. This suggests resource or compatibility issues in your graph.

The “Mapping Failed (allocation time: 8s)” error implies the Hailo device lacks sufficient resources (memory or computational units) for some operations.

Potential solutions:

  1. Reduce model complexity:

    • Decrease model size or split into sub-models
    • Optimize layers (use efficient layers, reduce layer sizes)
    • Use lower precision (e.g., INT8 quantization)

  2. Address unsupported operations:

    • Check Hailo SDK/DFC docs for supported operations
    • Replace unsupported ops with alternatives
    • Consider fusing multiple operations

  3. Try compiling without performance mode first, then retry with it enabled