Model not working after conversion to hef

Hello,
I’m having issues after converting yolo v8s to hef.
When I test pt file using ultralytics predict, everything works perfectly, but after conversion, I want to use the file in frigate, but only rarely something shows up.

At the beginning, it was working fine with smaller dataset. It was not too good due to small dataset, but seemed to be 1:1 compared to ultralytics predict. I did not change anything in config. alls and nms json configs are unchanged from default.

imgsz 640
model yolov8s
dataset size 2028

model.train(data = "dataset_custom.yaml", imgsz = 640, batch = 8, epochs = 300, workers = 0, device = 0)

epoch 300 (after last run Best results observed at epoch 63)

hailomz compile yolov8s --ckpt=best.onnx --hw-arch hailo8l --calib-path train/images --classes 1 --performance

I’m kind of at a loss at this point, any idea what could be wrong?