The gte-multilingual-bas can run on hailo8 ?
Does anyone know how to do it?
Because it uses RoPE, it will not work fully on chip for hailo (sin/cos not supported).
Hey @wen_junbo,
Welcome to the Hailo community!
Looking at the model architecture, it’s going to be challenging to run it fully on Hailo hardware in its current form. We’d likely need to modify some of the operations that aren’t currently supported and replace them with equivalent ones that work with our platform.
Let me know if you’d like to discuss which specific operations might need adjustments or if you have any other questions!