Raspberry pi 5 with Hailo-8L expected performance

General
, ,
1

The table below presents the performance benchmark results for the popular AI models and tasks such as object detection, face detection, and more on the raspberry pi 5 and Hailo-8L with batch size 8.

Network Rpi5 Performance Input resolution
yolov5s_personface 150.21 640x640x3
yolov6n 354.07 640x640x3
yolov8s 127.85 640x640x3
Yolov8s_pose 123.43 640x640x3
yolox_s_leaky 110.26 640x640x3
Yolov5n_seg 103.57 640x640x3
ssd_mobilenet_v2 145.42 300x300x3
efficientnet_edgetpu_l 97.48 300x300x3
efficientnet_edgetpu_m 242.92 240x240x3
efficientnet_edgetpu_s 373.96 224x224x3
Resnet_v1_50 257.56 224x224x3
clip_resnet_50 127.85 224x224x3

The results show the RPi5 and Hailo-8L offers excellent performance that should be more than sufficient for deploying these types of AI applications.
The frame rates are high enough to support real-time processing for most common use cases like security camers, smart home devices, robotics, etc. And these popular models are very efficient, so you still have headroom to run additional software on the Pi alongside them.

Please keep in mind that the performance results may vary depending on the software version being used.

The results presented here were generated using PCIe Gen 3 technology.

It’s worth noting that the difference in performance between the Hailo-8L with Raspberry Pi 5 and the Explorer model is due to the fact that the Raspberry Pi 5 and Hailo-8L are connected using a single-lane PCIe interface.

5 Likes
5

Thanks for publishing these results – I have built a couple modules using the Pimoroni Base Duo in order to pair the Hailo AI module with an NVMe drive, and one of the trade-offs regarding the NVMe drive is that the speed is supposedly halved due to sharing the PCIe bus with two devices. I am assuming that this means it could also reduce the Hailo module’s performance, but it would be interesting to run some tests to determine real world performance. Using your baseline numbers could be interesting. Do you have instructions for how to run this benchmark?

6

Hey @matt,

The results you see have been tested by running the following command:

hailortcli run {hef} --batch-size 8

If you want to explore more options for measurements, you can run the following command to see the available options:

hailortcli run -h

This will show you all the different options you can use when running the hailortcli run command, such as measuring latency and other performance metrics.

Please let me know if you have any other questions.

Best regards,