Facing issue for onnx to hef for custom trained model

Hi @kewalrc19,
The Negative Slop error is usually caused from one (or more) of the following:

  1. The model was not trained properly (model did not converge).
  2. The model was not trained with Batch Normalization and thus the outputs from the activations “explode”, meaning the values range of the output is wider than what can be represented in 8 bits.
  3. The calibration process was done with a calibration set that is not representable subset of the training dataset (64 images).

Did you apply all the above?
BTW - a 4320x4320 input resolution is vey big. Even if you are able to compile the model, the performance, especially on the Raspie5 will not be very good. With the standard yolov8_seg model (640x640) it runs with the app here:

around 30 FPS. please take that into considerations.

Regards,