Inquiry about Hailo Conversion for Small Models

Hello Hailo Team,

I am currently working with Hailo8L and have successfully optimized the Whisper Base model using your provided repository(hailocs/hailo-whisper). I have a few questions regarding other model variants:

  1. Are there any plans to support Hailo conversion for models larger than Base (e.g., Small, Medium, Large)?
  2. For the Small model, is it acceptable to use an optimization script for the Base model to perform the conversion?

I would greatly appreciate any guidance or recommendations regarding this.

Thank you in advance for your help!

Hey @hyungjun_Byun,

We’re currently working on larger models beyond the base, so I don’t have a timeline to share yet. But we’re definitely on it!

As for the optimization script, you’re totally welcome to try it out! Just want to be upfront that we haven’t tested it with that setup, so it could go either way. Give it a shot and let me know what happens!