While following this guide I get the following messages and warnings on optimization step:
[info] Starting Model Optimization
[warning] Reducing optimization level to 0 (the accuracy won’t be optimized and compression won’t be used) because there’s no available GPU
[warning] Running model optimization with zero level of optimization is not recommended for production use and might lead to suboptimal accuracy results
[info] Model received quantization params from the hn
[info] MatmulDecompose skipped
[info] Starting Mixed Precision
[info] Model Optimization Algorithm Mixed Precision is done (completion time is 00:00:00.64)
[info] LayerNorm Decomposition skipped
[info] Starting Statistics Collector
[info] Using dataset with 64 entries for calibration
Calibration: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 64/64 [00:57<00:00, 1.11entries/s]
[info] Model Optimization Algorithm Statistics Collector is done (completion time is 00:00:59.68)
[info] Starting Fix zp_comp Encoding
[info] Model Optimization Algorithm Fix zp_comp Encoding is done (completion time is 00:00:00.00)
[info] Starting Matmul Equalization
[info] Model Optimization Algorithm Matmul Equalization is done (completion time is 00:00:00.02)
[info] activation fitting started for detector/reduce_sum_sftmax1/act_op
[info] Finetune encoding skipped
[info] Bias Correction skipped
[info] Adaround skipped
[info] Starting Quantization-Aware Fine-Tuning
[info] Using dataset with 1024 entries for finetune
Epoch 1/4
1/512 […]
Can someone please explain the following:
[warning] Reducing optimization level to 0 (the accuracy won't be optimized and compression won't be used) because there's no available GPU
Why is this happening? Can it be fixed somehow? I have an Nvidia GPU with drivers/CUDA/CUDNN installed on a system.[warning] Running model optimization with zero level of optimization is not recommended for production use and might lead to suboptimal accuracy results
Similarly, is this normal or should it be fixed somehow?Using dataset with 1024 entries for finetune
I have randomly selected 1024 images from training dataset, is this enough?Epoch 1/4 1/512 [..............................]
What is going on at this step? Why 4 epochs?
Thanks!