Inquiry about Hailo-8 M.2 capabilities for text and speech inference

General
1

Hello,
I am considering using the Hailo-8 M.2 for inference of text and speech in my language.
After converting them to English, it would communicate with a larger model. Would the Hailo-8 M.2 be suitable for this purpose?

Best regards,
A.H.

2

Hey @Aleksandr_Hristov,

Welcome to the Hailo Community!

If your goal is to run translation or speech-to-text on the Hailo-8 and then send that data to a larger model elsewhere (like a server or API), then yes, this will work perfectly! We’ll soon have the Whisper model available for Hailo-8, which will handle the speech recognition part nicely.

However, if you’re hoping to run the larger model directly on the Hailo-8, I’m afraid that’s not possible. For those more demanding NLP tasks, we’re bringing the Hailo-10H to market specifically designed for handling larger language models.

Let me know if you have any other questions !

3

Hello,

Thank you for your response. I’m considering two options for using the Hailo-8 with the Raspberry Pi 5:

  1. Option 1:
    AliExpress Link
    I’m not sure if this is a validated product.
  2. Option 2:
    Geekworm Link
    This option allows adding multiple Hailo-8 M.2 modules if needed.

I’m still in the research phase. I’ve had some bad experiences with IoT boards in the past, so I’m being cautious with my purchases.

Has anyone here had experience with either of these devices?

Best regards,