Monitoring Hailo-8L Performance in Real-Time Applications on Raspberry Pi

General Discussion
, ,
1

Hi,

I have used the hailortcli tool to view the capabilities and performance of a model running on the Hailo-8L module connected to my Raspberry Pi. However, this only provides information in a test environment and not during a live application.

Are there any tools, libraries, or methods available that would allow me to monitor how well the Hailo-8L module is performing while the application is running? Ideally, I would like to view metrics such as inference rate, accelerator utilisation, latency, throughput, and resource usage in real time.

Thank you.

2

You can use the HailoRT CLI Monitor. I one terminal use the following command to start an htop like monitor.

hailortcli monitor

In second terminal first set the environment variable for the monitor and then start your app or command.

export HAILO_MONITOR=1
hailortcli run model.hef
3

Thanks so I have Monitor One on the terminal, and then just before I call my application
I run export HAILO_MONITOR=1, then I call my Python script?