Hailo onnxruntime with mulitple Hailo-8 devices

General Discussion
,
1

Hi everyone,

Does anyone know whether hailo’s onnxruntime Execution Provider support muliple Hailo devices?
From the source code here hailo_op.cc It seems default to use first device?

Best regards,
Chih-Peng

2

Hi @Chih-Peng_Chang , you are right, Hailo’s ONNX Runtime EP has no multi-device support. Is it possible for you to use the C/C++, Python API or Gstreamer hailonet for inference on Hailo ?

3

Hi @Victor_Cheng ,

no, not for now. Our application use onnxruntime with different execution provider on ctrlX platform. Switching to SDK requires more work. I will fork your onnxruntime repo and try to make it support multiple devices.

Thanks for your quick response. I will update my result if I succeed to modify execution provider.