Hello, I am trying to convert a modified Conv-TasNet model to HEF. When I tried compiling without any training and 0-ed out data, I was able to compile an HEF file without any errors. However, after training, I am able to get the quantized HAR file but not the HEF file.
The error I got was BackendAllocatorException: Compilation failed: Negative Mantiassa is not supported in current hw arch during the compilation stage.
What would be the reason for this error? Thank you for your help.
The error BackendAllocatorException: Compilation failed: Negative Mantissa is not supported in current hw arch occurs when the Hailo compiler encounters numerical representations, such as extremely small or invalid floating-point values, that result in negative mantissas which the hardware cannot process. This is typically caused by improper quantization, unsupported operations in the model, or configuration mismatches between the model and the hardware capabilities. To resolve this, ensure proper quantization with representative calibration data, verify that all operations and layer configurations in the model are supported by the Hailo hardware.
Additionally, simplify or debug the model iteratively to isolate the problematic layer, and analyze the quantization parameters (e.g., qp_scale and qp_zp) using the Hailo Profiler to ensure they align with the hardware’s supported numerical range.