Hailo-8 Based 3D Collision Avoidance and Trajectory Prediction

I am working on a project involving 3D collision avoidance and trajectory analysis using an RPi 5 combined with a Hailo-8 accelerator. My specific goal is to detect and predict the trajectories of pedestrians. For the 3D depth estimation, I am considering using SC-Depth, and for trajectory prediction, I am exploring the use of LSTM (Long Short-Term Memory) networks or Transformer models. My question is: Is it feasible to implement this entire pipeline, including SC-Depth for 3D perception and LSTM/Transformer for trajectory prediction, on the Hailo platform, given its hardware and software capabilities?

Hi @johnpeng,
SCdepth is already supported on the Model-Zoo, so should be definitely possible to add more on top of that to run in parallel.

1 Like

Any LSTM sample running on HAILO-8 so far?

We’ve compiled LSTMs as part of other ops. Depending on otherfactors, and the overall pipeline, it might make more sense to run it on the cpu

1 Like