Using HailoDFC and HailoModelZoo to compile ONNX model to HEF model costs 2 hours

General
1

compile ONNX model to HEF model costs about 2 hours.
is that normal?
Is there any way to reduce time？

1 Like
2

Hi @wangzongzheng unrelated to your question. But how did you get the conversion to work? i am trying to convert superpoint model from onnx to HEF.

3

Check this thread

Are you sure that you have GPU available?
In addition, are you using Docker based solution?

I’ve compiling onnx to have without --performance for around 20-30 mins.

With the performance flag is can be up to 5 hours.

1 Like
4

succeeded in generating the .hef file. Made an inferende script in python. Now stuck at the hailort module not being recognized.

Environment Setup:

I am using pyenv to manage Python versions, with a virtual environment hailoconv set to Python 3.10.4.
The environment is activated successfully (pyenv activate hailoconv), and I have verified this by running python --version (which shows Python 3.10.4).

hailort Installation:

I installed hailort version 4.20.0 appropriate for python 3.10 using .whil file hailort-4.20.0-cp310-cp310-linux_aarch64.whl. Suitable for my system arch.

Confirmed the installation with pip show hailort, which shows that version 4.20.0 is installed in the correct path:

/home/my/.pyenv/versions/3.10.4/envs/hailoconv/lib/python3.10/site-packages.

Issue Encountered:

Despite the successful installation of hailort, when I attempt to import the module in Python (import hailort), I receive the following error:

ModuleNotFoundError: No module named 'hailort'

I verified the Python executable being used with which python, which correctly points to

/home/my/.pyenv/versions/3.10.4/envs/hailoconv/bin/python

I have tried importing the module directly in a Python session using the following:

import hailort

But it still returns the ModuleNotFoundError.

Attempts to Resolve:

I have tried deactivating and reactivating the environment (pyenv deactivate / pyenv activate hailoconv).

Reinstalled hailort by running pip uninstall hailort followed by pip install hailort.

Checked the PYTHONPATH environment variable and ensured it includes the correct path to the site-packages directory for the virtual environment.

Apologies if inapropriate to post this here!!