Handling Input and Output for Asynchronous Inference with Hailort

I am currently working on implementing asynchronous inference using Hailort, following the examples provided in the links below:

However, I have encountered an issue as I am unable to find any examples on how to write inputs (such as images) and read the corresponding outputs during the asynchronous inference process.

Could you please provide me with a working example or guidance on how to handle image input and output properly in an asynchronous inference pipeline? It would be especially helpful if you could show how to maximize the NPU usage for optimal performance during this process.

Any additional resources or advice on input/output handling for NPU-accelerated inference would be greatly appreciated.

Thank you for your time and support.

Hey @Hyunha_Hwang ,

Welcome to the Hailo Community!

Please check out our example in here : Hailo-Application-Code-Examples/runtime/cpp/object_detection at main · hailo-ai/Hailo-Application-Code-Examples · GitHub

This has the input out and all of the api handling .