Unfortunately need help getting Hailo runtime installed (Pi5 Ubuntu)...

General
, , , ,
1

Stuck at installing HailoRT. Getting:

Unpacking hailort-pcie-driver (4.21.0) over (4.21.0) ...
Setting up hailort-pcie-driver (4.21.0) ...
WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
build-essential/oracular,now 12.10ubuntu1 arm64 [installed,automatic]
Do you wish to use DKMS? [Y/n]: Y
**Failed. Exited with status 2. See /var/log/hailort-pcie-driver.deb.log**
**dpkg: error processing package hailort-pcie-driver (--install):**
** installed hailort-pcie-driver package post-installation script subprocess returned error exit status 2**
**Errors were encountered while processing:**
** hailort-pcie-driver**

######### Fri May 16 00:07:53 PDT 2025 #########
/share/opt/hailo/linux/pcie /
make[1]: *** /lib/modules/6.11.0-1012-raspi//build: No such file or directory.  Stop.
make: *** [Makefile:106: clean] Error 2
Failed. Exited with status 2. See /var/log/hailort-pcie-driver.deb.log
Failed at 42
   39	}
   40	
   41	function compile_and_install_pcie_driver_with_dkms() {
   42	    make clean &>> $LOG
   43	    make install_dkms &>> $LOG || {
   44	        echo "Failed to install PCIe driver to the DKMS tree. Trying to install PCIe driver without DKMS"
   45	        compile_and_install_pcie_driver_without_dkms

Setup:

  • Raspberry Pi 5
  • Ubuntu 24.10 (GNU/Linux 6.11.0-1012-raspi aarch64)
  • Hailo-8L AI Accelerator Kit
  • USB webcam
  • Pi camera module v2.1
  • Frigate running in Docker container
  • (Home Assistant w/ Frigate Proxy add-on running on another box)
  • (Plan on running Double Take and CodeProject.AI in Docker containers too once get HailoRT working)

Steps:

  1. Flash 32GB microSD with Ubuntu desktop
  2. apt install v4l-utils
  3. apt install ffmpeg
  4. Install Docker / Docker Compose
  5. Set up Frigate container
    docker-compose.yml includes:
    image: ghcr.io/blakeblackshear/frigate:stable-h8l
    - /dev/hailo0:/dev/hailo0
    config.yml includes:
    detectors:
    hailo8l:
    type: hailo8l
    device: /dev/hailo0
    # device: PCIe # not sure if this should be /dev/hailo0 or PCIe
  6. Tried to follow https://hailo.ai/developer-zone/documentation/hailort-v4-21-0/?sp_referrer=install/install.html#ubuntu-installer-requirements
  7. From https://hailo.ai/developer-zone/sw-downloads/ got hailort-pcie-driver_4.21.0_all.deb and hailort_4.21.0_arm64.deb (also got hailort-4.21.0-cp311-cp311-linux_aarch64.whl but get same error with this in place)
  8. sudo dpkg --install hailort-pcie-driver_4.21.0_all.deb
  9. Y at DKMS prompt
  10. Get error detailed at top of post…
  11. Reboot and see in Frigate logs:
  • Did not detect hwaccel, using a GPU for accelerated video decoding is highly recommended
  • Failed to initialize Hailo device: Unsupported device type: /dev/hailo0
  • usb_cam has a bandwidth of 10345.35 MB/hr which exceeds the expected maximum. This typically indicates an issue with the cameras recordings.

Chat-GPT gives different varied answers every time queried; web search returns mostly steps for Pi running Raspberry Pi OS and not Ubuntu OS. hailo.ai documentation seems well thought out and comprehensive, but assumes a little more dev skill than I have and deals with multiple scenarios on each set of instructions. From my reading it seems I don’t need a container running Hailo stuff as - “For integrating Hailo with Frigate, it’s sufficient to have the PCIe driver installed on the host and pass the device to the Frigate container.”

Do I need to do something at the Pi firmware level?

Some other way to run hailort-pcie-driver_4.21.0_all.deb?

When / how is hailort_4.21.0_arm64.deb even used? (Should I be using hailort_4.21.0_arm64.deb or hailort-4.21.0-cp311-cp311-linux_aarch64.whl?)

Any clear clean steps for me to take to get HailoRT installed and working?

2

Hey @Zake_S,

Welcome to the Hailo Community!

This looks like it could be a kernel-related issue. Here are a few things to try:

  1. Try downgrading your kernel — some versions have known compatibility issues.
  2. Install the Hailo driver on the host, not inside the Docker container. Then pass it through using /dev/hailo0.
  3. Test without using DKMS answer N.

Give these steps a shot and let me know how it goes! Happy to help further if needed.

3

Thanks for feedback!

  1. Not sure what downgrading kernel involves - perhaps better to just re-image with Raspberry Pi OS.
  2. I’m am installing on host, just have Frigate in a container.
  3. What would this test show? Wouldn’t I still need to use DKMS to get full functionality anyway?

What I’ve done since:
Followed steps from Hacker’s guide to the Raspberry Pi AI kit on Ubuntu | Ubuntu.

Got error: [HailoRT] [error] CHECK failed - Driver version (4.21.0) is different from library version (4.20.0)

4

Hey @Zake_S ,

For kernel downgrade to 6.6:

sudo apt update
# Check available versions (optional)
apt list -a raspberrypi-kernel raspberrypi-bootloader
# Downgrade to 6.6.74
sudo apt install --reinstall \
  raspberrypi-bootloader=1:6.6.74-1+rpt1 \
  raspberrypi-kernel=1:6.6.74-1+rpt1
# Hold packages to prevent auto-upgrade
sudo apt-mark hold raspberrypi-bootloader raspberrypi-kernel
sudo reboot

We’re working on updating Pi support to 4.21 soon. For now, stick with hailo-all on Pi since it’s optimized and more stable. Frigate container uses 4.20, so hailo-all + 4.20 frigate docker should work fine (I wrote the hailo8l integration).

You don’t need DKMS - we maintain the hailo-all package and Pi drivers directly, and DKMS sometimes causes issues.

My recommendation:

  1. Ensure kernel 6.6 (most stable for Hailo)
  2. Purge all existing Hailo packages
  3. Install hailo-all
  4. Set up Frigate using my guide: Hailo official integration with Frigate
1 Like