yolov8m FPS lower than Model Zoo on UGen300 (Hailo-10H)

General Discussion
1

Hi, I tested yolov8m on Asus UGen300 (Hailo-10H via USB 3.1) using the hailortcli benchmark tool, but the FPS is significantly lower than the Model Zoo reference.

Command: hailortcli benchmark yolov8m.hef --power-mode ultra_performance

Result: 39.67 FPS

image
image858×330 45.9 KB

Model Zoo reference: 49.9 FPS

image
image736×166 6.14 KB

Is this gap due to USB 3.1 vs PCIe Gen3 x4 bandwidth?

Also, on Hailo-8, hailortcli run can be used to monitor in/out bandwidth. On UGen300 (Hailo-10H), this command doesn’t seem to work — is this a hardware limitation of the USB interface, or am I using it incorrectly?

2

Hi @Hans_Weber,

Do you have 3A port?
Can you please run hailortcli fw-control identify and share the result?

Thanks,
Michael.