Using Mambavision

General Discussion
1

I am using the datacompile to trying use mambavision onnx compile to hef

but i met some issue that the architecture of this model is using SSM (State Space Model)

it can’t compile this background, so i wonder if there a way can solve this problem.

Master plz help me, I already be stuck whole day long.

2

Hi @user1141,

The Hailo Dataflow Compiler currently supports a specific set of layer types.
The selective scan (S6) operation at the core of Mamba/SSM blocks is not among them, which is likely why the compilation fails during the translation stage.
You might try splitting the MambaVision ONNX model so that only the supported portions (e.g., the convolutional backbone stages) run on Hailo while the SSM blocks are handled on the host CPU.

Thanks,
Michael.

3

Hi Michael

Thanks for your help, I’ll try this solution.

And have a great day

1 Like