hailo-ollama support for Model Explorer GenAI models

General Discussion
1

Hi, a big reason that I bought the AI+ 2 Hat was to use Hailo Ollama with all the Model Explorer GenAI Zoo models (Top Generative AI Model Examples | Hailo AI Edge), especially those showing Hailo-10H support, such as Qwen3-VL-2B-Instruct.

Disappointed to discover that Hailo Ollama actually only supports the models returned by /hailo/v1/list , which is really quite a small and dated subset.

Could you let us know when we can expect Hailo Ollama to be updated to support all the models in the GenAI Zoo pls?

Thanks

Chris

2

Hi @user9922,

Thanks for raising this. We understand the frustration and apologize for the confusion. Unfortunately, Hailo-Ollama is currently designed specifically for LLM text generation.

That said, the VLM models are fully supported on the Hailo-10H through the HailoRT Python API - you might try looking at hailo-apps/hailo_apps/python/gen_ai_apps/vlm_chat at main · hailo-ai/hailo-apps · GitHub which has working VLM chat examples that use this API directly, or hailo_model_zoo_genai/docs/USAGE.rst at main · hailo-ai/hailo_model_zoo_genai · GitHub for lower-level usage examples.

Thanks,
Michael.

3

Hi Michael, thanks for your reply.

I’m familiar with those but they’re not the same as the ease of use of Ollama.

I do hope the team will update Hailo Ollama in line with the hardware capability of the 10L in due course.

Appreciate your ongoing support.

Chris

1 Like
4

Echoing your disappointment here, big rip off given how dated these models are.

1 Like