RPI 5 Example not working

czion · August 19, 2024, 3:59pm

I have the M.2 hat for the pi 5 with a Hailo 8 on it and I am trying to use the examples from GitHub - hailo-ai/hailo-rpi5-examples. If I run it with input resources it works fine, but trying to run it with a camera causes problems. Just running detection.py from the virtual environment with no arguments gives me the following output

hailomuxer name=hmux v4l2src device=/dev/video0 name=src_0 ! video/x-raw, width=640, height=480, framerate=30/1 ! queue name=queue_scale max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoscale n-threads=2 ! queue name=queue_src_convert max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 name=src_convert qos=false ! video/x-raw, format=RGB, width=640, height=640, pixel-aspect-ratio=1/1 ! tee name=t ! queue name=bypass_queue max-size-buffers=20 max-size-bytes=0 max-size-time=0 ! hmux.sink_0 t. ! queue name=queue_hailonet max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 ! hailonet hef-path=/home/cmc/hailo-rpi5-examples/basic_pipelines/../resources/yolov6n.hef batch-size=2 nms-score-threshold=0.3 nms-iou-threshold=0.45 output-format-type=HAILO_FORMAT_TYPE_FLOAT32 force-writable=true ! queue name=queue_hailofilter max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hailofilter so-path=/home/cmc/hailo-rpi5-examples/basic_pipelines/../resources/libyolo_hailortpp_post.so  qos=false ! queue name=queue_hmuc max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hmux.sink_1 hmux. ! queue name=queue_hailo_python max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! queue name=queue_user_callback max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! identity name=identity_callback ! queue name=queue_hailooverlay max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hailooverlay ! queue name=queue_videoconvert max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 qos=false ! queue name=queue_hailo_display max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! fpsdisplaysink video-sink=xvimagesink name=hailo_display sync=false text-overlay=False signal-fps-measurements=true 
Error: gst-resource-error-quark: Failed to allocate required memory. (13), ../sys/v4l2/gstv4l2src.c(976): gst_v4l2src_decide_allocation (): /GstPipeline:pipeline0/GstV4l2Src:src_0:
Buffer pool activation failed

Running it with my custom model’s .hef file gives me

hailomuxer name=hmux v4l2src device=/dev/video0 name=src_0 ! video/x-raw, width=640, height=480, framerate=30/1 ! queue name=queue_scale max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoscale n-threads=2 ! queue name=queue_src_convert max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 name=src_convert qos=false ! video/x-raw, format=RGB, width=640, height=640, pixel-aspect-ratio=1/1 ! tee name=t ! queue name=bypass_queue max-size-buffers=20 max-size-bytes=0 max-size-time=0 ! hmux.sink_0 t. ! queue name=queue_hailonet max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 ! hailonet hef-path=hailo_090.hef batch-size=2 nms-score-threshold=0.3 nms-iou-threshold=0.45 output-format-type=HAILO_FORMAT_TYPE_FLOAT32 force-writable=true ! queue name=queue_hailofilter max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hailofilter so-path=/home/cmc/hailo-rpi5-examples/basic_pipelines/../resources/libyolo_hailortpp_post.so  qos=false ! queue name=queue_hmuc max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hmux.sink_1 hmux. ! queue name=queue_hailo_python max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! queue name=queue_user_callback max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! identity name=identity_callback ! queue name=queue_hailooverlay max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hailooverlay ! queue name=queue_videoconvert max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 qos=false ! queue name=queue_hailo_display max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! fpsdisplaysink video-sink=xvimagesink name=hailo_display sync=false text-overlay=False signal-fps-measurements=true 
gst_parse_error: could not link videoconvert0 to hailonet0 (3)
hailomuxer name=hmux v4l2src device=/dev/video0 name=src_0 ! video/x-raw, width=640, height=480, framerate=30/1 ! queue name=queue_scale max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoscale n-threads=2 ! queue name=queue_src_convert max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 name=src_convert qos=false ! video/x-raw, format=RGB, width=640, height=640, pixel-aspect-ratio=1/1 ! tee name=t ! queue name=bypass_queue max-size-buffers=20 max-size-bytes=0 max-size-time=0 ! hmux.sink_0 t. ! queue name=queue_hailonet max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 ! hailonet hef-path=hailo_090.hef batch-size=2 nms-score-threshold=0.3 nms-iou-threshold=0.45 output-format-type=HAILO_FORMAT_TYPE_FLOAT32 force-writable=true ! queue name=queue_hailofilter max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hailofilter so-path=/home/cmc/hailo-rpi5-examples/basic_pipelines/../resources/libyolo_hailortpp_post.so  qos=false ! queue name=queue_hmuc max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hmux.sink_1 hmux. ! queue name=queue_hailo_python max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! queue name=queue_user_callback max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! identity name=identity_callback ! queue name=queue_hailooverlay max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hailooverlay ! queue name=queue_videoconvert max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 qos=false ! queue name=queue_hailo_display max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! fpsdisplaysink video-sink=xvimagesink name=hailo_display sync=false text-overlay=False signal-fps-measurements=true

Output of dmesg | grep hailo

[    3.736720] hailo: Init module. driver version 4.17.0
[    3.738906] hailo 0000:01:00.0: Probing on: 1e60:2864...
[    3.738915] hailo 0000:01:00.0: Probing: Allocate memory for device extension, 11600
[    3.738933] hailo 0000:01:00.0: enabling device (0000 -> 0002)
[    3.738940] hailo 0000:01:00.0: Probing: Device enabled
[    3.738960] hailo 0000:01:00.0: Probing: mapped bar 0 - 000000005c218efe 16384
[    3.738966] hailo 0000:01:00.0: Probing: mapped bar 2 - 000000006e1c092f 4096
[    3.738971] hailo 0000:01:00.0: Probing: mapped bar 4 - 000000005e3a15ca 16384
[    3.745732] hailo 0000:01:00.0: Probing: Force setting max_desc_page_size to 4096 (recommended value is 16384)
[    3.745748] hailo 0000:01:00.0: Probing: Enabled 64 bit dma
[    3.745751] hailo 0000:01:00.0: Probing: Using userspace allocated vdma buffers
[    3.745757] hailo 0000:01:00.0: Disabling ASPM L0s 
[    3.745761] hailo 0000:01:00.0: Successfully disabled ASPM L0s 
[    3.943270] hailo 0000:01:00.0: Firmware was loaded successfully
[    4.019130] hailo 0000:01:00.0: Probing: Added board 1e60-2864, /dev/hailo0

Output of hailortcli fw-control identify

Executing on device: 0000:01:00.0
Identifying board
Control Protocol Version: 2
Firmware Version: 4.17.0 (release,app,extended context switch buffer)
Logger Version: 0
Board Name: Hailo-8
Device Architecture: HAILO8L
Serial Number: HLDDLBB241901953
Part Number: HM21LB1C2LAE
Product Name: HAILO-8L AI ACC M.2 B+M KEY MODULE EXT TMP

I already checked to make sure the hailort service was running with sudo systemctl status hailort.service but I still restarted it anyway and rebooted the pi, and that didn’t fix it.

j.mya.pitz · August 19, 2024, 11:16pm

I’m having a similar issue. More or less lifted the gstreamer query from the hailo-rpi5 repo into Rust and having the same issue linking the videoconvert step to the hailonet:

failed to parse pipeline from description: Error { domain: gst_parse_error, code: 3, message: "could not link videoconvert0 to hailonet0" }

Nadav · August 20, 2024, 4:24pm

Which camera is it? USB, RTSP or Picam?

USB should be the easiest, at least as a checking step. Can you also share the exact command that you execute to get that error?

czion · August 20, 2024, 6:29pm

Typing this command results in the first error
python basic_pipelines/detection.py

Typing this command results in the second error
python basic_pipelines/detection.py --hef-path hailo_090.hef

The camera is plugged directly into the pi’s camera port, and it works to pipe video into the yolo example with
rpicam-hello -t 0 --post-process-file hailo_yolov6_inference.json --lores-width 640 --lores-height 640

giladn · August 20, 2024, 7:32pm

For RPi camera use ‘–input rpi’
Use the “–help” flag for more details

czion · August 20, 2024, 8:10pm

Using a USB camera fixed the first problem, but the custom model is still giving the same error
gst_parse_error: could not link videoconvert0 to hailonet0

Nadav · August 21, 2024, 5:34am

Can you check if your camera is capable of outputing VGA (640x480) @30FPS?
You can check that with this command:
gst-device-monitor-1.0
It would give a long output, listing all the available resolutions for each connected camera, but ideally you would see something like that:

czion · August 21, 2024, 5:50pm

It lists raw video at 640 by 480 but it doesn’t specify anything else
video/x-raw, format=YUY2, width=640, height=480

czion · August 21, 2024, 10:06pm

Fixing the resolution to match the model fixed that error. Now I’m just dealing with the script since the model isn’t one for detection. I’m trying to adapt the script to work with mine but so far, no success.

Nadav · August 22, 2024, 4:57am

so you’ve switched to a different task? If this the case, need to verify that you have the post processing function.

czion · August 22, 2024, 4:56pm

I was able to get it working with my model after I made a bare-bones post-processing .so file, but it’s running really slowly and with about a 4 second latency

M_S · August 25, 2024, 1:02am

@czion please post your solution!

victor · August 30, 2024, 12:14pm

“could not link videoconvert0 to hailonet0”

how did you solve this issue?

czion · August 30, 2024, 1:59pm

@victor, what solved that problem for me was making sure the script’s resolution matched the resolution my model was expecting. There is a default resolution in the given script, if your model uses some other resolution, it will give that error. @M_S I can’t post my exact code, but if you have questions about the solution I’d be happy to answer them!

victor · August 30, 2024, 2:58pm

this solved the problem:
self.batch_size = 2
self.network_width = 416
self.network_height = 416
self.network_format = “RGB”
nms_score_threshold = 0.3
nms_iou_threshold = 0.45

victor · August 30, 2024, 5:18pm

now the nms post processing is not working…

Topic		Replies	Views
For those who want use your own yolo model with pi5 Community Projects raspberry-pi	12	310	September 13, 2024
Python inference for Raspberry Pi 5 General raspberry-pi	8	709	August 24, 2024
Does python package 'hailo_platform' support on raspberry pi 5? General raspberry-pi , python , hailo8	3	447	August 12, 2024
Cant seem to get my hailo 8 to do any of the rpicams Ai models General raspberry-pi	12	91	September 4, 2024
I have update HailoRT and Tapps， but can not run General raspberry-pi	5	80	August 28, 2024

RPI 5 Example not working

Related Topics