Is this happening? I bought a few of the 10H modules and plugged them into an Asus Hyper Gen4 quad M.2 chassis, and plugged that into a bifurcated 16x16 PCIe slot on a machine running Ubuntu 26 (resolute) and an AMD Radeon RX 9060 XT GPU with AMD’s drivers at pcie link speed 32GT/s x16.
I can run models with the CPU memory, and with the GPU. I can’t seem to get the Hailo devices to do work.
I could not get any of the precompiled .deb files for either versions 5.3.0 or 5.4.0 to install/work with the system. I have been able to compile some of the 5.3.0 sources in a virtual python 3.14 environment, and the compiled 5.3.0 drivers and compiled hailortcli utility are working.
$ sudo hailortcli scan
Hailo Devices:
[-] Device: pci/0000:05:00.0
[-] Device: pci/0000:04:00.0
[-] Device: pci/0000:01:00.0
[-] Device: pci/0000:03:00.0
Using ‘fw-control identify’ I can see the four with
Control Protocol Version: 2
Firmware Version: 5.3.0 (release,app)
Logger Version: 0
Device Architecture: HAILO10H
on each device. It sure does look like everything is working. So how do I get them to do work?
I can’t seem to get Ollama or ComfyUI (both also compiled from source) or the AppImage version of ComfyUI.
I think there’s a link between Hailo drivers and linux that I’m missing.
I’m developing some real-time TV watching utilities to get rid of car insurance commercials. Fortunately, the fate of the world does not depend on my success, but I could use a clue to save some time and aargh!-ravation trying to get this motor hand-crank started.
What libraries / code do I need to get my lovely Hailo’s watching TV for me?
What am I missing in Ubuntu 26.04.1 LTS to link up Ollama and Hailo 10H, or ComfyUI?