Subject: Hailo RT v5.4.0 increases model load time on Hailo 8 devices

General Discussion
,
1

Dear everyone,

I would like to ask you about the following behavior.

After updating from Hailo RT v4.3.2 to v5.4.0, we found that the startup time increased by about 500 ms.

We have confirmed that the startup time increases. The startup time increases for both Hailo 8 4G and 8G devices.

[Environment]

Hardware : Hailo 8 (4GB, 8GB)

Hailo RT : v5.4.0

OS : Windows

[Measurement method]

We define a class to handle hailo, define the following in the constructor, and measure it by doing std:: chrono:: steady_clock:: now() before and after instantiation.

model_.reset(

        new HailoInfer(

            hefPath,

            batchSize));

So we measure the time while the constructor of HailoInfer in hailo_infer.cpp is running.

It takes about 800 ms just to load the above model.

Has anyone experienced similar behavior?

H.Shimizu