Hello everyone,
has anyone tried running text decoders on hailo8? Something around 30M parameters, is this feasible?
Hi @ma.d,
We have text encoders already part of the DFC, see this link, so while I don’t know of any project that runs text decoder on the Hailo, I think that it should be ok.
Hi @Nadav,
Thank you for your response. It’s helpful to know that a text encoder was implemented. However, since a text decoder operates in an autoregressive manner, I would expect it to be significantly slower.
You are right, but in terms of ops, hould be similar.
Please keep us posted with your progress!