Hello Hailo team,
Please review my questions related to Hailo-8.
We’re working to find reason why Hailo benchmark score was different from real score on our hardwares.
Our HW configuration
- System 1 with Intel i3 CPU with Hailo-8
- System 2 with Intel i7 CPU with Hailo-8
We tested Hailo’s reference hef model from model zoo.
we use same model with hailo benchmark reference.
- resnet-50 v1
- vit base
- YOLOv5m
- YOLOv8m
- YOLOv11m
we got similar scores with resnet-50 v1 model…within 1% gap.
but YOLO model were lower over 20% gap.
our system works PCIe Gen3 x4 Lane well…
we used several drivers and other Ubuntu OS version…but same results.
we used same batch size…8.
Below is result.
Could you guide me for idea ??
yolov8m reference score is 139 but our score was 108.63. 22% lower
yolov11m 102 71.85. 29% lower
vit_base 107 97.44. 9% lower
I hope to get your advice ASAP…
thanks