Thank you.
I’ve tried runner.optimize(calib_dataset_lq) without runner.load_model_script(alls)
and then i’ve encounter another problem…
error message is bellow
[info] Starting Model Optimization [warning] Reducing optimization level to 0 (the accuracy won’t be optimized and compression won’t be used) because there’s less data than the recommended amount (1024), and there’s no available GPU [warning] Running model optimization with zero level of optimization is not recommended for production use and might lead to suboptimal accuracy results [info] Model received quantization params from the hn [info] MatmulDecompose skipped [info] Starting Mixed Precision [info] Model Optimization Algorithm Mixed Precision is done (completion time is 00:00:00.35) [info] Starting LayerNorm Decomposition [info] Using dataset with 64 entries for calibration
Calibration: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 64/64 [00:19<00:00, 3.26entries/s]
[info] Model Optimization Algorithm LayerNorm Decomposition is done (completion time is 00:00:22.37) [info] Starting Statistics Collector [info] Using dataset with 64 entries for calibration
Calibration: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 64/64 [01:04<00:00, 1.00s/entries]
[info] Model Optimization Algorithm Statistics Collector is done (completion time is 00:01:05.56) [info] Starting Fix zp_comp Encoding [info] Model Optimization Algorithm Fix zp_comp Encoding is done (completion time is 00:00:00.01) [info] Starting Matmul Equalization [info] Model Optimization Algorithm Matmul Equalization is done (completion time is 00:00:00.00) [info] activation fitting started for ERNet_M3_02-2_LOL_v1/reduce_sum1/act_op [info] activation fitting started for ERNet_M3_02-2_LOL_v1/activation2/act_op [info] activation fitting started for ERNet_M3_02-2_LOL_v1/reduce_sum2/act_op [info] activation fitting started for ERNet_M3_02-2_LOL_v1/activation4/act_op
…
AccelerasUnsupportedError: layer ERNet_M3_02-2_LOL_v1/matmul1 does not support shift delta. To overcome this issue you should force larger range at the inputs of the layer using command quantization_param([layer_name], force_range_in=[range_min, range_max], force_range_index=index) current range of input 0 is [-0.075, 0.062] and input 1 is [-287933.126, 288390.782].You should increase the multiplication of these ranges by a factor of 7.172, e.g. you can apply factor of sqrt(7.172) to both inputs:
quantization_param([ERNet_M3_02-2_LOL_v1/matmul1], force_range_in=[-0.201, 0.166], force_range_index=0)
quantization_param([ERNet_M3_02-2_LOL_v1/matmul1], force_range_in=[-771101.899, 772327.529], force_range_index=1)
so i tried this link
but from hailo_sdk_client import Client is not work only work from hailo_sdk_client import ClientRunner, InferenceContext
so how can i solve it. the way of load_model_script is also occurred first problem… do i need to leave hailo tutorial notebook? …