Continuing the discussion from Getting Started with RPI5-Hailo8L:
I noticed that in the official example video the demo runs at about 150 FPS, but when I run the same example on the same hardware, I only get around 30 FPS on average.
What could be causing this difference, and how can I improve the performance on my setup?
Thanks
Hi @Eden_Ben_Meshi , is PCIe gen2 enabled? If not you need to do it.
Perhaps you meant gen3 ?
Gen2 is the default mode for RPi5 PCIe.
$ grep -i pci /boot/firmware/config.txt
dtoverlay=pciex1-compat-pi5,no-mip,mmio-hi
dtparam=pciex1
dtparam=pciex1_gen=3
The first line is an addition that may be necessary, I had the same problem as described here Problems After Integrating NVMe with Seeed R2000 - #7 by Rocky_Crag - Raspberry Pi - Seeed Studio Forum with mine (Seeed reComputer with dual M2 gen3 pcie switch hat).
Other issue you can run into, is driver/firmware mismatch when the app using the TPU is dockerized.
It is the case with frigate NVR, RPiOS hailo driver is behind, you have to uninstall the packages and manually install hailo8 driver (& firmware) with the script from frigate’s doc.
@PiKaBZH yes, sorry for mistake… you are correct
also wanted to call out the fact that if you are using a pcie splitter such as the Raft from SunFounder that you will slow down your Hailo8L by splitting the bandwidth to it with the other device (such as an nvme HDD)