Hi, thanks for notifications.
Are there any plans to support Hailo conversion for models larger than Base (e.g., Small, Medium, Large)?
Hi, thanks for notifications.
Are there any plans to support Hailo conversion for models larger than Base (e.g., Small, Medium, Large)?
@hyungjun_Byun support to larger Whisper models is planned for Hailo-10H architecture, which allows faster throughput when running those models.
For Hailo-8, larger models may be supported, but of course the FPS will be limited, making them less suitable for real time applications.
You can give a look at how we converted the tiny and base model in the hailo-whisper repo. For example, you can adapt the different scripts (export, convert_whisper_encoder, …) to add support for Whisper-small