The Hailo Integration Tool can be used to test a system before deploying it. This will allow you to test the hardware to the limits.
If you want to test more realistic uses cases without running applications you can use the HailoRT CLI tools.
hailortcli run model.hef //for single model
hailortcli run2 set-net model.hef //for multiple models
There are many options to measure power, temperature, set framerates and batch-sizes. Use --help.
To measure power, you must use Hailo hardware equipped with a power monitoring device. This can be tested by executing the following command:
hailortcli fw-control identify --extended
You should get something like this:
...
Product Name: HAILO-8 AI ACCELERATOR M.2 M KEY MODULE
...
Device supported features: Current Monitoring, PCIE
...
Note: Current monitoring is optional and may not be available on your hardware.
CPU usage is quite independent of the Hailo-8 hardware utilization. It largely depends on the model and its usage, for example, the extent of pre- and post-processing required. Therefore, you will need to conduct tests with your specific application and the models you plan to use.
See PM.