Error while optimization for custom dataset

[kewalrc19]

Is there any steps i am missing for optimization:

1. I have pretrained ONNX model.
2. Using hailo zoo for model optimization and compilation.
3. Calibration dataset is coco dataset, as i don’t see documentation for using custom data set.
4. I have done batch normalization while training.

Getting below error after optimization.

hailo_model_optimization.acceleras.utils.acceleras_exceptions.NegativeSlopeExponentNonFixable: Quantization failed in layer yolov8n_seg/conv45 due to unsupported required slope. Desired shift is 10.0, but op has only 8 data bits. This error raises when the data or weight range are not balanced. Mostly happens when using random calibration-set/weights, the calibration-set is not normalized properly or batch-normalization was not used during training.

[Omer]

Hi @kewalrc19,
Please refer to my response here:

facing issue for onnx to hec for custom trained model.

Hello Team, I am drilling through all the possible steps needed for converting my custom onnx model to hec file for running it on Halio AI chip on raspi5. I have trained this model on YOLOv8_seg using using dataset of 4320x4320 resolution which was my requirement for higher precision. I need to run this on raspi5 with higher processing time for this i am trying Hailo Ai chip. For conversion I had tried Dataflow compiler steps but it was not been helpfull. Now i am trying the compilation usi…