Proxmox 9 and hailo 8

General
1

I bought an expensive Hailo 8 to use with Frigate. Normally running with LCX/docker and coral TPU’s,

Per docs I setup a Ubuntu 24.0x VM and tried to get it working but keeps crashing my system:

Hardware:

  • Hailo-8 AI Processor (1e60:2864)

  • PCIe slot location (59:00.0)

  • minisforum MS-01

  • Software:

  • Proxmox VE 9.0.10

  • Kernel 6.14.11-2-pve

  • QEMU/KVM version (qemu-system-x86_64 --version)

Issue:

  • Immediate Proxmox host crash when starting VM with Hailo-8 passthrough

  • Occurs even with conservative settings and advanced kernel parameters

  • VM uses Q35 machine type (required for PCIe passthrough)

Tested Configurations:

  • VFIO binding: :white_check_mark: Working

  • IOMMU isolation: :white_check_mark: Working (Group 19, isolated)

  • Kernel parameters tried: intel_iommu=on iommu=pt vfio_iommu_type1.allow_unsafe_interrupts=1 pcie_acs_override=downstream,multifunction kvm.ignore_msrs=1

  • Passthrough settings: 59:00.0,pcie=1,x-vga=0,rombar=0

Hope there will be a solution for this soon.

2

Maybe the following two posts in the forum will be able to help.

Hailo Community - Proxmox → Ubuntu VM PCIe Passthrough for Hailo-8 / Hailo-8L

Hailo Community - Halio and Proxmox

3

I have faced this issue too.

Env:

  • Hailo-8 M.2
  • Minisforum MS-01
  • Proxmox VE 9.0.10
4

I have managed to work it by setting the Hailo-8 reset method to null.

#!/bin/bash
lspci -D | grep -E "Co-processor: Device 1e60:2864 \(rev 01\)|Hailo" | awk '{print $1}' | while read -r device; do
    echo | sudo tee /sys/bus/pci/devices/$device/reset_method
done

Here is the proper manual Enabling Virtual Machine to access Hailo-8 devices

5

With the help of AI and endless testing and trying I got it to work. Many things needs to be checked and set and yes the post whee Klaus is pointing to also give some ideas. Thanks for that!

Not a prosumer friendly product at the moment but it seems to work ok. Fraction faster than the Coral in the same maching. Needs more power/heat, more expensive, so the jury is still out if it is worth it. :slight_smile: