[gtstreamer pipeline construction issues : xvimagesink closed]

Dear community members,

I always appreciate your help with my project. Many contributors’ comments have been instrumental in solving the problems I’ve encountered.

Unfortunately, I am now facing new errors that I am unable to resolve.

Here is the message:

===================================
Pipe lines

hailomuxer name=hmux v4l2src device=/dev/video0 name=src_0 ! video/x-raw, width=640, height=480, framerate=30/1 ! queue name=queue_scale max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoscale n-threads=2 ! queue name=queue_src_convert max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 name=src_convert qos=false ! video/x-raw, format=RGB, width=640, height=640, pixel-aspect-ratio=1/1 ! tee name=t ! queue name=bypass_queue max-size-buffers=20 max-size-bytes=0 max-size-time=0 ! hmux.sink_0 tee name=d !queue name=queue_hailonet_D max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 ! hailonet hef-path=/home/jskang/hailo-rpi5-examples/basic_pipelines/…/resources/yolov6n.hef batch-size=2 nms-score-threshold=0.3 nms-iou-threshold=0.45 output-format-type=HAILO_FORMAT_TYPE_FLOAT32 force-writable=true multi-process-service=true device-count=1 vdevice-key=1 ! queue name=queue_hailofilter_d max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hailofilter so-path=/home/jskang/hailo-rpi5-examples/basic_pipelines/…/resources/libyolo_hailortpp_post.so qos=false ! tee name=s !queue name=queue_hailonet_S max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 ! hailonet hef-path=/home/jskang/hailo-rpi5-examples/basic_pipelines/…/resources/yolov5n_seg_h8l_mz.hef batch-size=2 force-writable=true multi-process-service=true device-count=1 vdevice-key=1 ! queue name=queue_hailofilter_s max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hailofilter function-name=yolov5seg so-path=/usr/lib/aarch64-linux-gnu/hailo/tappas//post-process/libyolov5seg_post.so qos=false ! tee name=p !queue name=queue_hailonet_P max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 ! hailonet hef-path=/home/jskang/hailo-rpi5-examples/basic_pipelines/…/resources/yolov5n_seg_h8l_mz.hef batch-size=2 force-writable=true multi-process-service=true device-count=1 vdevice-key=1 ! queue name=queue_hailofilter_p max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hailofilter function-name=yolov5seg so-path=/usr/lib/aarch64-linux-gnu/hailo/tappas//post-process/libyolov5seg_post.so qos=false ! queue name=queue_hmuc max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hmux.sink_1 hmux. ! queue name=queue_hailo_python max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! queue name=queue_user_callback max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! identity name=identity_callback ! queue name=queue_hailooverlay max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hailooverlay ! queue name=queue_videoconvert max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 qos=false ! queue name=queue_hailo_display max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! fpsdisplaysink video-sink=xvimagesink name=hailo_display sync=false text-overlay=False signal-fps-measurements=true

Error occurs
QoS message received from src_0
[HailoRT] [error] CHECK_GRPC_STATUS failed with error code: 4.
[HailoRT] [warning] Make sure HailoRT service is enabled and active!
[HailoRT] [error] Lost communication with the service…
[HailoRT] [error] CHECK_GRPC_STATUS failed with error code: 4.
[HailoRT] [warning] Make sure HailoRT service is enabled and active!
[HailoRT] [error] Lost communication with the service…
[HailoRT] [error] CHECK_GRPC_STATUS failed with error code: 4.
[HailoRT] [warning] Make sure HailoRT service is enabled and active!
[HailoRT] [error] Lost communication with the service…

===================================

I tried to handle one image input in parallel with three functions (object detection, pose detection, and segmentation), and I attempted to merge the results into a single image output.

I think these errors are occurring due to a synchronization problem coming from the three branches, but I couldn’t find any documents related to this issue.

If you have any recommendations or comments for solving these issues, please let me know.

Thank you for reading.

Have a great day!

Jusung Kang

Hey @happistday

Is the HailoRT services enables ?
Can you enable it and rerun this .

if not then this is like you said a synchronization issue , to fix it you have to make the pipeline wait for the other pipelines and then merge them.

Best regards

Thank you for your comments.

Unfortunately, I checked that RT services are ongoing, and they are still running now.

As you said, I agree with your comments that we have to synchronize the pipeline for parallel working.

I am still doing trial and error for studying.

After I get some corrected results, I will reply again to this tag.

Thank you.