Performance difference between PyTorch (.pt) and compiled Hailo (.hef) models

General Discussion
2

Hi @ALEXFER

There could be a couple of reasons for the behavior you are seeing.

  1. In your inference script, you could be passing BGR image arrays instead of RGB.
  2. During compilation, you might have not used calibration images from your use case.

One way to find the root cause is to find the mAP of the hef file on your validation set and compare it with the mAP of the pytorch checkpoint. You can also try compiling using our cloud compiler that allows you to upload some calibration images: Early Access to DeGirum Cloud Compiler