Whisper Small for Hailo-10H?

I am using a Raspberry Pi AI HAT+ 2 with Hailo-10H.

I can not find a Whisper Small HEF for Hailo-10H.

Is Whisper Small supported on Hailo-10H?

Where can I get one of these?

  1. a precompiled Whisper Small .hef, or
  2. the official compilation recipe/toolchain steps for generating it?

My use case is offline speech-to-text for long WAV recordings.
I have faster-whisper Small running on the CM5 CPU but would like to get Whisper Small running on the Hailo-10H Hat.

My current stack:

HailoRT 5.1.1
Hailo-10H
Raspberry Pi CM5 / AI HAT+ 2
hailo-apps 26.03.0

Welcome to the Hailo Community!

You can find the Whisper-Small pre-compiled HEF files on GitHub in the GenAI Model Zoo.

GitHub - Gen AI Models

1 Like