Hailo10 for Gemma3 LLM

General Discussion
1

Hello sir,

I want to know if Hailo-10H can support Gemma3 270M SLM model now.

and

  1. we can use general LLM model thru Hailo SDK like Hailo-8 ?

  2. where we can find LLM model list that Hailo10 support now ?

thanks

2

Converting a LLM model is much more complicated than converting a CNN. Support for LLMs will evolve over the next quarters similar to the development for Hailo-8 in the past. For now we provide a selection of LLM models for Hailo-10 and support LoRA (Low Rank Adaptation) to finetune models. You can find the currently supported models in our Gen AI Model Zoo.

GitHub - GenAI Model Zoo

1 Like
3

I’d actually also be curious what motivated the selection of LLMs, that are currently supported by Hailo10 (ie, LLama 3.2-3b and Qwen2.5-1.b) and the omission of smaller but more edge optimized models like LFM2-350m or 1.2b or Gemma3-1b. Those models run well on CPU and I’d love to see how well they work on Hailo10 in comparison. Any plans of integrating those sometime soon ?

2 Likes