Different pipelines with multi-device

Hello community,

   I'm facing a problem with multi-devices. I have two hailo8 modules, I want to use them for different gstream pipelines. For example, I want one pipeline for license plates recognition, and another for face detection. I can start them separately with the two hailo mudules. If I setup only one hailo, run another pipeline will report lack of hailo device, so one pipeline will occupy one device.

   But can I fix the pipeline to a hailo device and the other pipeline to another hailo device?
   For example, LPR fix run on hailo 1, Face Dection fix run on hailo 2?

   I have searched the community, only find a multi_stream_detection.sh, with --device-count x, but this only share the devices, not fix.

   My upper program wants to know the running status of each device. So is there any way to fix the hailo device, not only by hailort scheduler? Thanks.

Best Regards.
   

Hi @chrysler.chen,

This might be helpful: hailo-apps/doc/user_guide/running_parallel.md at main · hailo-ai/hailo-apps · GitHub

Thanks,

Hi Michael,

Thanks for your reply, It seems the vdevice is to let two applications share the same hailo module. But I want different piplelines use their separate hailo modules.

What I’m looking for is something like:
“If multiple Hailo-8 devices are available, it’s possible to select a specific one 

\# Device id looks something like 0000:41:00.0 

hailomz eval <model_name> --target <device_id>”

Above comes from the hailo_model_zoo document.

So if we can select the device_id to do eval, I guess we can select it when we use the pipeline.

BR

Hi @chrysler.chen,

In a GStreamer pipeline, the HailoNet element supports a device-id property to select a specific Hailo device.

So you can assign different device-id values to different HailoNet elements in separate pipelines, and each pipeline will use its own dedicated Hailo module. Please see here in our developer zone: https://hailo.ai/developer-zone/documentation/hailort-v5-2-0/?sp_referrer=integration_with_frameworks%2Fgstreamer.html

Thanks,

Hi Michael,

I think the device-id of HailoNet is the solution, I will try it. Thank you very much.

BR

1 Like