Deployment of D-Fine model (SOTA Real-Time Detection)

Hi!

D-Fine is the new SOTA for real-time object detection on MS-COCO. Is this model deployable on the Hailo as well?

Best Regards

This model is also interesting due to the Apache 2.0 license. Would be great to see support for it!

Hey @stwerner,

We don’t have official support for that model in our model zoo. However, according to the model’s GitHub page, an ONNX version of the model is available.

Since an ONNX version exists, you can try converting it using our DFC or the Hailo Model Zoo. I recommend reading through the DFC documentation to understand its usage and then attempt to convert the model. If you encounter any challenges during the process, please don’t hesitate to reach out to us for assistance.

You can find the DFC documentation here: https://hailo.ai/developer-zone/documentation

Let me know if you have any further questions!

Hi @omria !

Thanks for the response. I’ve tried converting the model already, but could not get the conversion to work for the entire model. It seems like some portions of the model cannot be parsed off the bat. I’ve attached images of the onnx and profiler report where the parsing stops (the end-no-name the parser recommends). The concat node (
/model/decoder/Concat_2) is somewhere in the middle of the D-Fine (nano) onnx graph. Could you take a look at the onnx to see if this is something that the Hailo should be able to run with some modifications?


Thanks!