No overlay when using hailonet and hailooverlay gstreamer plugins

General
, , ,
1

I am trying to use the hailonet gstreamer plugin on a solidrun hummingboard 8p edge running a hailo8 m.2.

I have compiled my model for the ai accelerator and can perform a hailortcli parse-hef and get:

Architecture HEF was compiled for: HAILO8
Network group name: nano_best, Single Context
    Network name: nano_best/nano_best
        VStream infos:
            Input  nano_best/input_layer1 UINT8, NHWC(640x640x3)
            Output nano_best/yolov8_nms_postprocess FLOAT32, HAILO NMS(number of classes: 2, maximum bounding boxes per class: 100, maximum frame size: 4008)
            Operation:
                Op YOLOV8
                Name: YOLOV8-Post-Process
                Score threshold: 0.010
                IoU threshold: 0.01
                Classes: 2
                Cross classes: false
                Max bboxes per class: 100
                Image height: 640
                Image width: 640

I also can run video with hailonet and hailooverlay but can not seem to get it to output the overlay to the output video and I am not sure how to debug further.

Here is my gstreamer command:

gst-launch-1.0 -v filesrc location=./resources/ir_20230212.005144.732_0044.mp4 ! qtdemux ! h264parse ! avdec_h264 ! videoconvert ! videoscale ! video/x-raw,format=RGB,width=640,height=640,framerate=15/1 ! hailonet hef-path=./resources/nano_best_yolov8n.hef ! hailooverlay ! videoconvert ! autovideosink

Does anyone see anything that I am missing?

2

Have a look at the following Hailo Tappas detection example.

GitHub - Tappas - Detection

Your pipeline does not have the hailofilter element. So, you are missing the post-processing.