Bug Report: hailo-gen-ai-model-zoo 5.3.0 Uninstallable on Raspberry Pi with Hailo-10H
Summary
The hailo-gen-ai-model-zoo_5.3.0_arm64.deb package cannot be properly installed on Raspberry Pi 5 with Hailo-10H due to incorrect package dependencies. The .deb requires the generic hailort package (intended for Hailo-8L), but Hailo-10H requires the architecture-specific h10-hailort package.
Result: hailo-ollama binary crashes at runtime with missing shared library error.
System Configuration
Hardware
- Device: Raspberry Pi 5
- Accelerator: Hailo-10H AI Kit
- OS: Debian 13 (Trixie)
Software Stack
- Kernel: ARMv8 (ARM 64-bit)
- Python: 3.13.5
- Installation Date: May 1, 2026
Installed Hailo Packages
hailo-gen-ai-model-zoo 5.3.0 (arm64)
h10-hailort 5.2.0-1 (arm64) [installed per Hailo-10H requirements]
hailo-tappas-core 5.2.0 (arm64)
python3-h10-hailort 5.2.0-1 (arm64)
rpicam-apps-hailo-postprocess 1.11.1-1 (arm64)
hailo-apps Installation
hailo-apps 26.3.0
hailort (Python binding) 5.2.0
hailo-tappas-core (Python) 5.1.0
Steps to Reproduce
Step 1: Prepare System
# Start with clean Hailo-10H installation
sudo apt update
sudo apt upgrade
# Install Hailo-10H required packages (following official guide)
sudo apt install h10-hailort python3-h10-hailort
Step 2: Attempt Standard Installation (README Method)
# Download hailo-gen-ai-model-zoo from Developer Zone
wget https://hailo.ai/developer-zone/hailo_gen_ai_model_zoo_5.3.0_arm64.deb
# Install via apt (as per README)
sudo apt install ./hailo_gen_ai_model_zoo_5.3.0_arm64.deb
Result: APT attempts to downgrade h10-hailort to generic hailort 4.23.0, causing conflicts.
Error Messages
Error 1: APT Dependency Conflict
Installiere:
hailo-gen-ai-model-zoo
Installiere Abhängigkeiten:
hailort (4.23.0) ← WRONG VERSION FOR H10!
ENTFERNE:
h10-hailort hailo-h10-all python3-h10-hailort
ERROR: Pakete müssen entfernt werden, aber Entfernen ist abgeschaltet.
Error 2: dpkg Installation Failure
$ sudo dpkg -i hailo_gen_ai_model_zoo_5.3.0_arm64.deb
dpkg: Abhängigkeitsprobleme verhindern Konfiguration von hailo-gen-ai-model-zoo:
hailo-gen-ai-model-zoo hängt ab von hailort; aber:
Paket hailort ist nicht installiert.
dpkg: Fehler beim Bearbeiten des Paketes hailo-gen-ai-model-zoo (--install):
Abhängigkeitsprobleme - verbleibt unkonfiguriert
Error 3: Runtime Library Missing
$ hailo-ollama --help
hailo-ollama: error while loading shared libraries: libhailort.so.5.3.0:
cannot open shared object file: No such file or directory
Root Cause Analysis
Problem 1: Incorrect Package Dependency
The .deb file declares:
Depends: hailort
Expected for Hailo-10H:
Depends: h10-hailort (>= 5.2.0)
Issue: The generic hailort package (v4.23.0) is for Hailo-8L and contains libhailort.so.4.23.0, but the hailo-ollama binary is compiled for libhailort.so.5.3.0 (Hailo-10H).
Problem 2: Version Mismatch
hailo-gen-ai-model-zoo 5.3.0
↓ Requires (Incorrect)
hailort (generic) → 4.23.0 for Hailo-8L
↓ But hailo-ollama binary needs
libhailort.so.5.3.0 (Hailo-10H specific)
Problem 3: No Architecture Detection
The package doesn’t adapt dependencies based on detected hardware. Should detect h10-hailort and require it accordingly.
Failed Workaround Attempts
Attempt 1: Force Dependencies
sudo dpkg --force-all -i hailo_gen_ai_model_zoo_5.3.0_arm64.deb
# Result: Installs but binary still crashes (missing libhailort.so.5.3.0)
Attempt 2: Manual hailort Installation
sudo apt install hailort=5.2.0
# Result: Causes conflicts, APT removes h10-hailort instead
Expected Behavior
After installation:
$ hailo-ollama
Listening on http://0.0.0.0:8000
Should work with h10-hailort installed and libraries available:
$ ldd /usr/bin/hailo-ollama | grep hailort
libhailort.so.5.3.0 => /usr/lib/libhailort.so.5.3.0
Impact
Cannot use hailo-ollamaCLI tool on Hailo-10H- Cannot follow official README installation instructions
- Blocks integration with Open WebUI
Workaround exists: Use hailo-appsvenv instead
Workaround (Until Fix)
Use the bundled GenAI apps from hailo-apps instead of system package:
# Activate hailo-apps venv
source ~/hailo-apps/venv_hailo_apps/bin/activate
# Run LLM server (has correct dependencies)
python -m hailo_apps.python.gen_ai_apps.simple_llm_chat.simple_llm_chat --mode server --port 8000
# In another terminal: Run Open WebUI
docker run -d --network host \
-v open-webui:/app/backend/data \
--name open-webui \
ghcr.io/open-webui/open-webui:main
Result: Both services work correctly without package conflicts.
Requested Fix
Option A (Recommended): Update .deb package
- Change
Depends: hailorttoDepends: h10-hailort (>= 5.2.0) - Add hardware detection to select correct dependency
- Rebuild and publish corrected version
Option B (Alternative): Provide separate package
hailo-gen-ai-model-zoo-h10_5.3.0_arm64.deb(for Hailo-10H, requires h10-hailort)hailo-gen-ai-model-zoo-8l_5.3.0_arm64.deb(for Hailo-8L, requires hailort)
Option C (Documentation): Update README
- Document the dependency issue
- Provide manual installation workarounds
- Link to venv-based alternative
Additional Information
- Package Date: April 4, 2026
- Build Date: Published to Raspberry Pi repository (trixie/main)
- Affected Versions:
hailo-gen-ai-model-zoo 5.3.0(at minimum) - Hardware: Hailo-10H (possibly also other H-series devices)
Files Affected
.debfile:hailo-gen-ai-model-zoo_5.3.0_arm64.deb- Binary:
/usr/bin/hailo-ollama - Documentation:
hailo_apps/python/gen_ai_apps/hailo_ollama/README.md
Reproducibility
Always reproducible on Raspberry Pi 5 + Hailo-10H with Debian 13
Contact Information
- User: PromiseYouDE
- Hardware: Hailo-10H on Raspberry Pi 5
- Use Case: Robotics AI integration (Vision + LLM)
**Thank you for your attention to this issue. Happy to provide additional logs or testing if needed.
**
(The installation attempts were assisted by AI, specifically the LLM Claude Haiku 4.5 via Copilot (github.com).
