Hello!
I am trying to implement Hailo Tiling as outlined here. My current pipeline, however, splits (or at least appears to split) the video unevenly in the vertical axis (see image below).
The pipeline that produces this output is as follows:
gst-launch-1.0 hailomuxer name=hmux v4l2src device=/dev/video0 ! video/x-raw, format=NV12, width=1920, height=1080 ! videocrop top=50 bottom=50 ! video/x-raw, format=NV12, width=1920, height=980 ! tee name=t ! queue name=bypass_queue leaky=no max-size-buffers=20 max-size-bytes=0 max-size-time=0 ! hmux.sink_0 t. ! queue name=queue_hailonet leaky=no max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! videoconvert n-threads=3 ! video/x-raw,format=RGB ! hailotilecropper internal-offset=false name=cropper tiles-along-x-axis=2 tiles-along-y-axis=2 overlap-x-axis=0 overlap-y-axis=0 hailotileaggregator flatten-detections=false iou-threshold=0.7 name=agg cropper.src_0 ! queue leaky=downstream max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! agg.sink_0 cropper.src_1 ! video/x-raw,width=960,height=490 ! videoscale add-borders=false ! hailonet hef-path=../model.hef batch-size=2 nms-score-threshold=0.7 nms-iou-threshold=0.7 output-format-type=HAILO_FORMAT_TYPE_FLOAT32 force-writable=true ! video/x-raw,width=640,height=640 ! agg.sink_1 agg.src ! queue name=queue_hmux leaky=no max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hmux.sink_1 hmux.src ! queue name=queue_hailooverlay leaky=no max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! hailooverlay ! queue name=queue_hailo_display leaky=no max-size-buffers=3 max-size-bytes=0 max-size-time=0 ! fpsdisplaysink video-sink=xvimagesink name=hailo_display sync=false text-overlay=false signal-fps-measurements=true
As you can see, I’ve added some caps filters to be able to debug what’s going on in here, and it suggests that the hailotilecropper element divides each frame into subframes of size 960x490 without any issues, which are subsequently resized into 640x640 for processing by the hailonet. It appears to me that the issue stems from hailotileaggregator, but I have been unable to troubleshoot it for quite a bit and figured I would ask here. I would be grateful for any kind of help/tip regarding this!
Thanks in advance!