Slow hailomz compile

General
1

I’ve a custom yolov8n based model with 1280x1280 images

I’m running the following command line:
hailomz compile yolov8n --ckpt /local/shared_with_docker/best.onnx --hw-arch hailo8 --calib-path /local/shared_with_docker/datasets/images/hailo/ --classes 2 --performance

the calibration directory has 100 images (I had 500 before but i got an error that my GPU got exhausted).

it’s running for 5 hours already and I think that it will take two hours more.
What Can I do about it?

What is your recommendation about the amount of images?

2

You used the performance flag. In performance mode the compiler will try as hard as it can to find a solution with the highest performance. This will require significant longer time to complete. See Hailo Dataflow Compiler User Guide and Model Zoo User Guide.

The recommended number of images depend on the optimization level used. You can read more about it in the Hailo Dataflow Compiler User Guide.

3

Thanks for the reply

In addition, when I’m using the trying to use my new hef file I’m getting the following warning:
[HailoRT] [warning] Desc page size value (2048) is not optimal for performance.

What should I do about it? I

4

Any idea what should I do?

5

Any idea what should I do?

6

Are you using the batch-size parameter? This message is sometimes displayed when the batch-size is set high when running a model with large input size.