Hello,
I have a question regarding ONNXRuntime feature to integrate hailo execution provider in onnxruntime. In the git project this feature is still in PREVIEW. Is there a plan to release it soon as an official feature?
Currently, there are no plans to further develop ONNX Runtime for Hailo devices.
ONNX Runtime relies on a blocking execution model, which limits its ability to take full advantage of Hailo’s architecture. While it can be useful for quick prototyping or basic tests, it is not recommended for production applications unless your AI performance requirements are minimal.
For best performance, we recommend using the HailoRT APIs.