Hailo8 M2 + OrangePi Max Frigate issues

General
1

Hi Team!
Im trying to run Frigate on OrangepiMax with Hailo8.
Driver version is 4.19 (the newest does not works with Frigate).
Its Debian Linux 6.1.43-rockchip-rk3588 on aarch64
All drivers works but when i start frigate it comes to errors:
Please take a look.

2025-04-04 19:02:46.468384891 [INFO] Preparing Frigate...
2025-04-04 19:02:46.802748832 [INFO] Starting Frigate...
2025-04-04 19:02:52.513214540 [2025-04-04 19:02:52] frigate.util.config INFO : Checking if frigate config needs migration...
2025-04-04 19:02:52.600737514 [2025-04-04 19:02:52] frigate.util.config INFO : frigate config does not need migration...
2025-04-04 19:02:53.840983115 [2025-04-04 19:02:53] frigate.util.services WARNING : Did not detect hwaccel, using a GPU for accelerated video decoding is highly recommended
2025-04-04 19:02:53.939960924 [2025-04-04 19:02:53] frigate.app INFO : Starting Frigate (0.15.0-cea210d)
2025-04-04 19:02:53.952334165 [2025-04-04 19:02:53] peewee_migrate.logs INFO : Starting migrations
2025-04-04 19:02:53.952954825 [2025-04-04 19:02:53] peewee_migrate.logs INFO : There is nothing to migrate
2025-04-04 19:02:55.070973201 [2025-04-04 19:02:55] frigate.app INFO : Recording process started: 440
2025-04-04 19:02:55.071437530 [2025-04-04 19:02:55] frigate.app INFO : Review process started: 444
2025-04-04 19:02:55.075827357 [2025-04-04 19:02:55] frigate.app INFO : go2rtc process pid: 95
2025-04-04 19:02:55.123767216 [2025-04-04 19:02:55] detector.hailo8l INFO : Starting detection process: 456
2025-04-04 19:02:55.129706944 [2025-04-04 19:02:55] frigate.detectors.plugins.hailo8l INFO : Initializing Hailo device as PCIe
2025-04-04 19:02:55.455907514 [2025-04-04 19:02:55] frigate.app INFO : Embedding process started: 458
2025-04-04 19:02:55.472326420 [2025-04-04 19:02:55] frigate.detectors.plugins.hailo8l INFO : A model file already exists at /config/model_cache/h8l_cache/ssd_mobilenet_v1.hef not downloading one.
2025-04-04 19:02:55.535923652 [HailoRT] [warning] HEF was compiled for Hailo8L device, while the device itself is Hailo8. This will result in lower performance.
2025-04-04 19:02:55.536446313 [HailoRT] [warning] HEF was compiled for Hailo8L device, while the device itself is Hailo8. This will result in lower performance.
2025-04-04 19:02:55.536555104 [2025-04-04 19:02:55] frigate.app INFO : Output process started: 478
2025-04-04 19:02:55.536808851 [2025-04-04 19:02:55] frigate.app INFO : Camera processor started for cam_parking_enterance: 493
2025-04-04 19:02:55.536978307 [2025-04-04 19:02:55] frigate.app INFO : Camera processor started for cam_parking_facade: 495
2025-04-04 19:02:55.537126764 [2025-04-04 19:02:55] frigate.app INFO : Camera processor started for cam_veranda: 496
2025-04-04 19:02:55.537266763 [2025-04-04 19:02:55] frigate.app INFO : Camera processor started for cam_domushka: 503
2025-04-04 19:02:55.537398303 [2025-04-04 19:02:55] frigate.app INFO : Capture process started for cam_parking_enterance: 510
2025-04-04 19:02:55.537528385 [2025-04-04 19:02:55] frigate.app INFO : Capture process started for cam_parking_facade: 541
2025-04-04 19:02:55.537657008 [2025-04-04 19:02:55] frigate.app INFO : Capture process started for cam_veranda: 544
2025-04-04 19:02:55.537790007 [2025-04-04 19:02:55] frigate.app INFO : Capture process started for cam_domushka: 550
2025-04-04 19:02:55.555086821 [2025-04-04 19:02:55] frigate.detectors.plugins.hailo8l INFO : Hailo device initialized successfully
2025-04-04 19:02:55.583674221 [2025-04-04 19:02:55] frigate.audio_manager INFO : Audio processor started (pid: 553)
2025-04-04 19:02:55.796861300 [2025-04-04 19:02:55] frigate.api.fastapi_app INFO : Starting FastAPI app
2025-04-04 19:02:56.133777713 [2025-04-04 19:02:56] frigate.api.fastapi_app INFO : FastAPI started
2025-04-04 19:03:19.974010416 [HailoRT] [error] CHECK failed - Out of order enqueue for queued stream buffer pool
2025-04-04 19:03:19.974232955 [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INTERNAL_FAILURE(8)
2025-04-04 19:03:19.974272913 [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INTERNAL_FAILURE(8) - Failed read from stream (device: 0000:01:00.0)
2025-04-04 19:03:19.974304996 [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INTERNAL_FAILURE(8) - HwReadEl12ssd_mobilenet_v1/nms1 (D2H) failed with status=HAILO_INTERNAL_FAILURE(8)
2025-04-04 19:03:19.974365662 [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INTERNAL_FAILURE(8)
2025-04-04 19:03:19.974400370 [HailoRT] [error] Queue element PullQEl_hw_read12ssd_mobilenet_v1/nms1 run in thread function failed! status = HAILO_INTERNAL_FAILURE(8)
2025-04-04 19:03:19.974911948 [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INTERNAL_FAILURE(8) - Shutdown event was signaled in dequeue of queue element PullQEl_hw_read12ssd_mobilenet_v1/nms1 because thread has failed with status=HAILO_INTERNAL_FAILURE(8)!
2025-04-04 19:03:19.974986614 [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INTERNAL_FAILURE(8)
2025-04-04 19:03:19.974991280 [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_INTERNAL_FAILURE(8)
2025-04-04 19:03:19.974995655 [HailoRT] [error] Queue element UserBuffQEl12ssd_mobilenet_v1/nms1 run in thread function failed! status = HAILO_INTERNAL_FAILURE(8)
2025-04-04 19:03:19.975151404 [HailoRT] [error] Failed waiting for threads with status HAILO_INTERNAL_FAILURE(8)
2025-04-04 19:03:19.979940810 [2025-04-04 19:03:19] frigate.detectors.plugins.hailo8l ERROR : [detect_raw] HailoRTException during inference: libhailort failed with error: 8 (HAILO_INTERNAL_FAILURE)
2

Hey @Alexander_Pavlikov,

Check out our guide on running Frigate with 4.20 and our official integration. It runs faster and supports more networks: Hailo official integration with Frigate

If you run into any problems after trying it, just let me know here or on the integration page.

3

Hey Omria!
Thanks a lot!
I tried to use this docker with 4.20 version and everything works well!
In case if you still have some time to dedicate to this issue i would ask you for 2 thinks if possible:

  • would be good if this docker could be synchronized with latest drivers version (4.21 for example :innocent:)
  • and this is related to my specific config, but probably it would be also helpful for others: i use Hailo in OrangePI Max rk3588. Hailo can be used for decoding but for encoding ffmpeg can use Rockchip so=processor. If you can include into docker version of ffmpeg compiled with rk chip support, i can probably use this by giving options in Frigate to manage ffmpeg use hardware acceleration for encoding.