I recommend to have a look at the following post for some generic points about this topic.
Hailo Community - My model runs slower than expected
Additionally, I recommend to have a look at the profiler in the Hailo AI Software Suite. The Profiler report will give you a detailed look into the used resources.
Once you converted your model successfully, you can use the Performance Mode of the Dataflow Compiler. The Performance Mode can be used to compile the model to the highest possible resource utilization, to maximize performance (FPS). Expect the compilation time to increase dramatically.