Whisper Example with Hailo Acceleration!

Community Projects
1

:speaking_head: New Release: Whisper Example with Hailo Acceleration!

We’re excited to announce the release of our Whisper example – showcasing how to accelerate OpenAI’s powerful speech-to-text model on Hailo hardware.

:brain: Want to get started?
Check out the example here:
:backhand_index_pointing_right: Whisper Speech Recognition Example on GitHub

:rocket: Community Challenge: Make Whisper Work for Everyone

To celebrate this release, we’re launching a community contest!
Your mission: Integrate our Whisper acceleration into an existing third-party solution and make it accessible to the wider community.

:bullseye: Suggested Targets:

  • :white_check_mark: Integrate with the Wyoming Protocol
  • :white_check_mark: Plug into open-source voice assistant stacks
  • :white_check_mark: Contribute to Home Assistant, Rhasspy, or other community-driven tools

:puzzle_piece: What We’re Looking For:

  • :unlocked: Open-source integration (public GitHub repo)
  • :handshake: Easy to use and well-documented for the community
  • :high_voltage: Uses Hailo’s accelerated Whisper model

:trophy: Prizes & Recognition:

Top projects will be featured on our Community and promoted across our channels.
To participate, share your integration in the Community Forum as a Community Project, and don’t forget to add the Whisper tag!

:date: Submission deadline: July 1st
:sports_medal: The top 2 most-liked projects will each receive:

  • One 26 TOPS AI HAT+
  • One $100 Amazon Gift Card

Let’s make speech AI accessible for everyone — together. :speech_balloon:

Whisper community projects list

If you have a new project you’d like us to add here, please leave a comment on this topic.

If you’ve tried a project and found it useful, please mark it with a :heart:. The projects with the most likes will win the challenge.

7 Likes
3

Fantastic work. Also, thank you for keeping the community updated as you developed this solution. Looking forward to integrating with my project!

1 Like
4

This is fantastic, thanks! Is it possible to use our own fine-tuned whisper-tiny model? I am assuming there would need to be a fair amount of conversion to get it in the right shape for this pipeline?

5

Hi @Andrew_Evans we will release the compilation scripts soon. The compilation requires a feature that we added in a DFC version which is not yet supported on the Raspberry Pi.
We will keep the community updated.

6

Dear all ..that sounds exactly what I was searching for. I have the home assistant yellow with a Hailo8 (not Hailo8l) and I’m looking forward to get local whisper in realtime. I think I read somewhere here in the forum that it might be possible to ise the Hailo8l pcie for multiple applications at the same time? I’m interested in frigate and whisper. Do you think this will be possible?

7

Hi @giladn ,
First of all, great job! Thank you very much for making these complex projects accessible to the community.

The project requirements list Python 3.10 or 3.11. By default, all current images for Raspberry Pi 5 (+ai kit) use Python 3.12. Therefore, I have two questions:

  • Could you tell me which image you are using and where to download it?

  • Are you using Anaconda or something similar to have Python 3.10 on board?

Thank you very much in advance.

8

Hello,
I ran this model on PI5 HAilo8 sucessfully.

I don’t understand everything.
Is Whisper that only works in English
or is it the example.

What must be done to make it work in French?

Thanks in advance

9

Hi the model used only supports english

10

There’s just one week left to join our Whisper community contest!

Integrate our Whisper acceleration into an existing third-party solution, share your project on our community forum, and stand a chance to win fantastic prizes. LinkedIn

Got a brilliant idea but need a little extra time, resources, or expert advice? Just fill out this form, and we’ll do our best to help you out: LinkedIn

11

same question here.. i built a Home Assistant Addon with hailo whisper. so far so good but i cannot usee it in my assistant seems like it is only english?

12

Works nicely, thanks for that. As you asked for input how to proceed: Obviously next steps shall be larger models (at least “small” which has a sufficient accuracy for many use-cases) and more languages. I would prefer to see a German version (language ‘de’).