In the gstreamer pipeline, you need to add a few more parameters to hailonet
hailonet hef-path=$hef_path $device_id_prop batch-size=$batch_size multi-process-service=true device-count=1 vdevice-key=1 !
Note that it requires Hailo-RT multi-process service to be running in the background. If you have installed Hailo-RT on a Ubuntu distribution, the debian installation package would have asked you if you wanted to install with Hailo-RT service. If you are installing using Yocto, please refer to: GStreamer parallel inference - #3 by lieberwirth
If you don’t want to use Hailo-RT multi-process service, there is also a way to run multiple gstreamer pipelines in parallel: you just need to add device-count=1 vdevice-key=1 to the options of hailonet and run all the gstreamer pipelines under the same gst-launch-1.0 command. Note that since these pipelines are independent from each other, there is no delimiter ‘!’ between them.