Upgrading to HailoRT 5.2.0 - step by step (Raspberry PI & Hailo Apps)

Addendum:

In /usr/local/hailo/resources/.env also change the line:
model_zoo_version=v5.1.1 → v5.2.0

Model download may fail

After the upgrade, some examples (if never started before) may fail, as the related models will not be found (while they are tried to get downloaded), as the web store is version specific.

For example, voice_assistant and simple_whisper_chat use “Whisper-Base” as model, which is only available in the storage for V5.1.1, but not for version 5.2.0.

Note: If the model files itself are really also version specific, I don’t know - they are all loaded into the same local folder. But maybe a “Whisper-Base” model for 5.1.1 cannot be loaded by HailoRT 5.2.0…

One way to get V5.1.1 models

To still download older models, you have to manipulate things:

cd hailo-apps
# if you have already an active venv: deactivate
nano /usr/local/hailo/resources/.env
# Change the line:
hailort_version=5.2.0 → 5.1.1

source start_env.sh

# hailo-download-resources --resource-name <model name> --resource-type model --group <app group as given by hailo-download-resources --list>
# e.g.
hailo-download-resources --resource-name Whisper-Base --resource-type model --group whisper_chat

deactivate

nano /usr/local/hailo/resources/.env
# Change the line:
hailort_version=5.1.1 → 5.2.0

(For the downloads the technically installed HailoRT version is irrelevant - the value from .env is used).

Alternative (for voice_assistant/simple_whisper_chat)

In this particular example, you can also just change the model for e.g. voice_assistant and simple_whisper_chat from Whisper-Base to Whisper-Small:

nano /home/pi/hailo-apps/hailo_apps/config/resources_config.yaml

# Change Whisper-Base to Whisper-Small:
whisper_chat: &whisper_chat_app
  models:
    hailo8:
      default: None
    hailo8l:
      default: None
    hailo10h:
      default:
        - name: Whisper-Small <---- here
          source: gen-ai-mz

# Voice assistant uses whisper for speech recognition and LLM for responses
voice_assistant:
  models:
    hailo8:
      default: None
    hailo8l:
      default: None
    hailo10h:
      default:
        - name: Whisper-Small <---- here
          source: gen-ai-mz
        - name: Qwen2.5-1.5B-Instruct
          source: gen-ai-mz

Regards,
HerrB92

2 Likes