Why I am getting same fps results for batch 1 and batch 8 for most of the networks? Shouldn’t batch-1 fps lower than batch-1 ideally in every case.
Welcome to the Hailo Community!
This is expected behavior. When a network fits into a single Hailo-8 context, batch-size does not matter. You can find out whether a network is compiled to a single context by running the following command.
hailortcli parse-hef model.hef
When a network is compiled to multiple contexts you can increase throughput/FPS by increasing batch-size. This is because it will reduce the context switching overhead.