I am currently working on implementing asynchronous inference using Hailort, following the examples provided in the links below:
However, I have encountered an issue as I am unable to find any examples on how to write inputs (such as images) and read the corresponding outputs during the asynchronous inference process.
Could you please provide me with a working example or guidance on how to handle image input and output properly in an asynchronous inference pipeline? It would be especially helpful if you could show how to maximize the NPU usage for optimal performance during this process.
Any additional resources or advice on input/output handling for NPU-accelerated inference would be greatly appreciated.
Thank you for your time and support.