is there a way to control optimization and compression levels?
What are the defaults used by hailomz?
Is there a way to disable compression?
You can control both from the allocation script, all the details are in the user guide. Generally speaking those are the commands:
model_optimization_flavor(optimization_level=4)
model_optimization_flavor(compression_level=2)
The default depends behaviour depends on the model size, and system configuration (If you have a supported GPU or not).
will model_optimization_flavor() work only with hailomz or it works with hailo compiler command too.
Hey @mohsinzb ,
Yes, this does work for both MZ and DFC!
Thanks. But when i use model_optimization_flavor() in.alls with CLI hailo compiler command, it gives parsing error. Or any of the other commands after normalization1 = normalization([127.5, 127.5, 127.5], [128.0, 128.0, 128.0]) gives me parsing error.
Hi @mohsinzb - can you share more details? The exact command, version and output you get?
Thanks for the follow-up. It started working. What i figured out is, i was using it like this in my .alls file:
normalization1 = normalization([127.5, 127.5, 127.5], [128.0, 128.0, 128.0])
performance_param(compiler_optimization_level=max, optimize_for_batch=4)
model_optimization_flavor(optimization_level=0, compression_level=0)
but when i saperated all three commands with a new line, i dident get the command parsing error. Any update if you can give on this.
Great! Exactly as you wrote, each command should be in a new line.
thanks. Are there any guideline documentation for using these config parameters for hailo parser, hailo optimize and hailo compiler commands