Deploying custom models for inference on RPI5-Hailo8

General Discussion
1

Hello All. I have recently started working with Hailo8. I was wondering if we can compile a custom model that is in .onnx format to be able to run on Hailo. When I used hailomz I just see popular models but I am unable to figure out a way to compile for a custom model. Can anyone help me out in figuring out how to convert custom .onnx files to .hef file to deploy in RPI+Hailo8

2

Welcome to the Hailo Community!

The Hailo AI Software Suite Docker comes with built-in tutorials. You can open them with the following command.

hailo tutorial

This will open a Jupyter Notebook server with notebooks for each step of the process.

3

Hello,

Check this thread Create hef model. This shows an example of the 3 steps to convert an .onnx model to .hef model. The 3 steps are parser, optimize and compiler. Hope that helps.