Query regarding hailo 10H

Hello team,

I have some of the questions where i need your help to answer:

  1. Does you hailo 10h supports CNN along with LLM’s?
  2. If CNN support is available on 10H, then can we use our custom models? Does your DFC supports it?
  3. If 10H does not support the CNN’s then , In the hailo-8l can we use custom models? What all operations are supported in DFC (In the past year when we tried on the hailo8l , some of the operations were not supported in 2024)

Hoping for your response.

Thank you for your time.

Welcome to the Hailo Community!

Yes you can run CNNs on the Hailo-10.

Yes. You can use the Hailo AI Software Suite Docker version 5.xx to convert CNN models to run on Hailo-10. The current plan is to make it available it for Community User with the next release.

The ONNX and TFLite format were not designed for accelerators like Hailo but for CPUs and GPUs. Therefore they can describe operators that are not supported on Hailo. These operators are often at the beginning and end of a network. They need to be removed in the parsing step by setting the start- and end-node-names and then reimplemented on the host.

While this requires an extra effort when porting an AI application to a Hailo based system it will provide a much more efficient and cost effective solution. The process is similar to moving an application from an x86 to an Arm-based host: instead of relying on the raw power of an x86 processor to handle tasks like video decoding, you need to leverage onboard peripherals, such as hardware video decoders, on the Arm platform.

You can find the list of supported operators in the Hailo Dataflow Compiler User Guide.