Hi,*
*
while running the inferencing on Hailo-8, I am keep on getting the following warning message. It shows there is temeperature increase and continuous toggling of system clock between 400MHZ ←> 300MHz.*
[HailoRT] [warning] Got health monitor notification - temperature reached orange zone. sensor id=0, TS00=103.98878c, TS01=103.634674c*
[HailoRT] [warning] Got health monitor notification - System’s clock has been changed from 400000000 to 350000000
[HailoRT] [warning] Got health monitor notification - System’s clock has been changed from 350000000 to 400000000
I would like to check if there is some option to keep it fixed on lower number to avoid this toggling. From hailortcli, I didn’t find any option. Firmware version is given below
hailortcli fw-control identify
Executing on device: 0001:01:00.0
Identifying board
Control Protocol Version: 2
Firmware Version: 4.23.0 (release,app,extended context switch buffer)
Logger Version: 0
Board Name: Hailo-8
Device Architecture: HAILO8
Serial Number: 0000000000000000
Part Number: HM218B1C2L
Product Name: EAI-1200
Regards,
Subrata
Hi @user1245,
The toggling is normal thermal throttling - your chip hit ~104 °C (Orange Zone), so the firmware drops the clock to cool down, then restores it. There’s no runtime flag; you set a fixed cap via persistent firmware config.
Supported values are only 100, 200, or 400 MHz (not 350). To cap it lower:
hailortcli fw-config read --output-file config.json
Edit the system section:
{ "system": { "name": "Hailo-8", "max_neural_network_core_clock_rate": "200MHZ" } }
Then:
hailortcli fw-config write config.json
Then power-cycle the device.
Note: 104 °C means under-cooling. Capping the clock helps, but the real fix is better cooling (heatsink/airflow). Don’t disable throttling - it’s protecting the chip.
Thanks,
Thanks Michael.
I am getting the following error -
hailortcli fw-config read --output-file config.json
Executing on device: 0001:01:00.0
[HailoRT] [warning] Failed to examine user config, as it is not loaded or is not supported by the device.
[HailoRT] [error] Firmware control has failed. Major status: 0x4003003b, Minor status: 0x401a0004
[HailoRT] [error] Firmware major status: CONTROL_PROTOCOL_STATUS_USER_CONFIG_EXAMINE_FAILED
[HailoRT] [error] Firmware minor status: FIRMWARE_CONFIGS_STATUS_USER_CONFIG_NOT_LOADED
[HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_FW_CONTROL_FAILURE(18)
[HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_FW_CONTROL_FAILURE(18) - Failed to examine user config
[HailoRT CLI] [error] CHECK_SUCCESS failed with status=HAILO_FW_CONTROL_FAILURE(18) - Failed reading user config from device
Failed to execute on device: 0001:01:00.0. status= HAILO_FW_CONTROL_FAILURE(18)
root@OpenWrt:~# cat config.json
cat: can’t open ‘config.json’: No such file or directory
Regards,
Subrata
It looks like you have a Hailo-8 module from Advantech.
Changing these settings requires an EEPROM connected to the Hailo-8. The EEPROM is optional, and Advantech may have chosen not to populate it. If the EEPROM is not present, you will not be able to store or modify user configuration settings.
This warning does not necessarily mean the EEPROM is missing. It can also occur when the device supports user configuration but no user configuration has been written yet. This is typically the case on new Hailo M.2 modules from Hailo.
I would recommend attempting to write a user configuration. If the write operation succeeds, the warning should disappear afterward. If the write operation fails, contact Advantech to confirm whether the EEPROM is populated on your specific hardware.
I applied it
hailortcli fw-config write config.json
Executing on device: 0001:01:00.0
root@OpenWrt:~# cat config.json
{ “system”: { “name”: “Hailo-8”, “max_neural_network_core_clock_rate”: “200MHZ” } }
root@OpenWrt:~#
but still receving the message looks like it didn’t work although there is no error while writing.
New clock: GstSystemClock
[HailoRT] [warning] Got health monitor notification - temperature reached orange zone. sensor id=0, TS00=103.98878c, TS01=103.634674c
[HailoRT] [warning] Got health monitor notification - System’s clock has been changed from 400000000 to 350000000
[HailoRT] [warning] Got health monitor notification - System’s clock has been changed from 350000000 to 400000000