Is someone able to convert language model (i.e., distilBert) to hef and inference from it?
Hello junsen.yee, Have you already managed to run NLP on Hailo 8L? I’m thinking about using GPT Neo 125M on my Raspberry Pi 5 mit Hailo Board, but haven’t found a .hef-file yet. I maybe have to check if I can gave Google Colab converting something for me.
Hey all,
The language model is too large for Hailo-8L. We’re releasing Hailo-10H soon, specifically for NLP and Gen-AI. Whisper might work on Hailo-8L, but it’s still in progress with no ETA, as our focus is on Hailo-10H.
Stay tuned for updates!
1 Like
Unfortunately, I bought the Hailo-8L because it was promised to support Whisper. Please fulfill past promises before making new ones.