Deploy state-of-the-art Vit Model

General
1

As mentioned in the release note of AI SW Suite 2024-07 that many new Transformer models like ViT, DeIT are added.

I would like to know if it is possible to compile and deploy some start-of-the-art ViT monocular depth estimation models on to Hailo-8. Let’s say models like DepthAnything V2, HybridDepth, Zoedepth.

1 Like
2

Hey @ShingHin.Hung

It is feasible to compile and deploy ViT-based monocular depth estimation models on Hailo-8, using tools like the Hailo Dataflow Compiler and HailoRT. You may need to adapt post-processing stages and retrain models using Hailo’s retraining tools, but the platform’s support for transformers and depth estimation is solid.

3

How can I compile and deploy DepthAnything V2, especially how to write the ALLS script and define the end_node?

1 Like