YOLOv8n real performance didn't expected from Hailo Model Zoo documentation

General Discussion
1

I am experiencing a significant performance gap between my local test results and the Hailo Model Zoo documentation for YOLOv8n on Hailo-8L.

According to the Hailo Model Zoo v2.13 docs, the expected performance is:

  • Batch=1: 182 FPS

  • Batch=8: 464 FPS

However, using the pre-compiled .hef file linked in the documentation, my results are:

  • Batch=1: 61.9 FPS

  • Batch=8: 121.4 FPS

Environment:

  • Hardware: Raspberry Pi 5 (8GB)

  • AI Accelerator: Hailo-8L (M.2 Key M via PCIe)

  • OS: Raspberry Pi OS (64-bit)

  • Software: HailoRT v4.19.0, Hailo Model Zoo v2.13

2

Hi,

Please have a look here: Official FPS benchmark on HAILO 8 using raspberry pi 5.

The Model Zoo numbers are raw chip throughput, not application-level FPS. The performance numbers in the Hailo Model Zoo documentation are not directly comparable to what you’ll see on a Raspberry Pi 5.

Thanks,