Hello,
This pipeline works with detection.mp4, but not when I modify it to use a raspberry pi camera.
The example below (latest attempt to make it work) uses the suggestions here
How should I modify it to make it work? Or how would I know what to modify to make it work?
gst-launch-1.0 -v libcamerasrc ! capsfilter caps=video/x-raw,format=RGB,width=640,height=480,framerate=5/1 ! queue max-size-buffers=20 max-size-bytes=0 max-size-time=0 ! videoscale n-threads=2 ! queue max-size-buffers=20 max-size-bytes=0 max-size-time=0 ! hailonet hef-path=yolov5m_wo_spp_60p.hef device_id=0000:01:00.0 batch-size=1 output-format-type=HAILO_FORMAT_TYPE_FLOAT32 nms-score-threshold=0.3 nms-iou-threshold=0.45 output-format-type=HAILO_FORMAT_TYPE_FLOAT32 ! queue max-size-buffers=20 max-size-bytes=0 max-size-time=0 ! hailofilter function-name=yolov5 so-path=/home/pparrot/robotic/resources/libyolo_hailortpp_postprocess.so qos=false ! queue max-size-buffers=20 max-size-bytes=0 max-size-time=0 ! hailooverlay ! queue max-size-buffers=5 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 ! fpsdisplaysink video-sink=ximagesink name=hailo_display sync=false text-overlay=true
gst-launch-1.0 -v libcamerasrc ! capsfilter caps=video/x-raw,format=RGB,width=640,height=480,framerate=5/1 ! queue max-size-buffers=20 max-size-bytes=0 max-size-time=0 ! videoscale n-threads=2 ! queue max-size-buffers=20 max-size-bytes=0 max-size-time=0 ! hailonet hef-path=yolov5m_wo_spp_60p.hef device_id=0000:01:00.0 batch-size=1 output-format-type=HAILO_FORMAT_TYPE_FLOAT32 nms-score-threshold=0.3 nms-iou-threshold=0.45 output-format-type=HAILO_FORMAT_TYPE_FLOAT32 ! queue max-size-buffers=20 max-size-bytes=0 max-size-time=0 ! hailofilter function-name=yolov5 so-path=/home/pparrot/robotic/resources/libyolo_hailortpp_postprocess.so qos=false ! queue max-size-buffers=20 max-size-bytes=0 max-size-time=0 ! hailooverlay ! queue max-size-buffers=5 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 ! fpsdisplaysink video-sink=ximagesink name=hailo_display sync=false text-overlay=true
Setting pipeline to PAUSED ...
[14:36:25.111078056] [6461] INFO Camera camera_manager.cpp:327 libcamera v0.4.0+50-83cb8101
[14:36:25.118749597] [6472] INFO RPI pisp.cpp:720 libpisp version v1.1.0 e7974a156008 27-01-2025 (21:50:51)
[14:36:25.127887365] [6472] INFO RPI pisp.cpp:1179 Registered camera /base/axi/pcie@120000/rp1/i2c@88000/ov5647@36 to CFE device /dev/media0 and ISP device /dev/media2 using PiSP variant BCM2712_C0
Pipeline is live and does not need PREROLL ...
/GstPipeline:pipeline0/GstFPSDisplaySink:hailo_display/GstXImageSink:ximagesink0: sync = false
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
[14:36:25.130545576] [6480] INFO Camera camera.cpp:1202 configuring streams: (0) 640x480-BGR888
[14:36:25.130666632] [6472] INFO RPI pisp.cpp:1484 Sensor: /base/axi/pcie@120000/rp1/i2c@88000/ov5647@36 - Selected sensor format: 640x480-SGBRG10_1X10 - Selected CFE format: 640x480-PC1g
New clock: GstSystemClock
/GstPipeline:pipeline0/GstLibcameraSrc:libcamerasrc0.GstLibcameraPad:src: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)480, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)480, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1
/GstPipeline:pipeline0/GstQueue:queue0.GstPad:sink: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)480, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)480, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1
/GstPipeline:pipeline0/GstQueue:queue0.GstPad:src: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)480, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1
/GstPipeline:pipeline0/GstVideoScale:videoscale0.GstPad:src: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstQueue:queue1.GstPad:sink: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstQueue:queue1.GstPad:src: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstHailoNet:hailonet0.GstPad:sink: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstVideoScale:videoscale0.GstPad:sink: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)480, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1
/GstPipeline:pipeline0/GstHailoNet:hailonet0.GstPad:src: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstQueue:queue2.GstPad:sink: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstQueue:queue2.GstPad:src: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstHailofilter:hailofilter0.GstPad:src: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstQueue:queue3.GstPad:sink: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstHailofilter:hailofilter0.GstPad:sink: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstQueue:queue3.GstPad:src: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstHailoOverlay:hailooverlay0.GstPad:src: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstQueue:queue4.GstPad:sink: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstHailoOverlay:hailooverlay0.GstPad:sink: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
/GstPipeline:pipeline0/GstQueue:queue4.GstPad:src: caps = video/x-raw, format=(string)RGB, width=(int)640, height=(int)640, colorimetry=(string)1:1:5:1, framerate=(fraction)5/1, pixel-aspect-ratio=(fraction)4/3
HailoNet Error: gst_pad_push failed with status = -4
^Chandling interrupt.
Interrupt: Stopping pipeline ...
Execution ended after 0:00:08.161472341
Setting pipeline to NULL ...
Freeing pipeline ...
Thank you!