Zero points mismatch in layer_normalization layer during model optimization

I am trying to optimize and quantize XFeat using Hailo Dataflow compiler v 3.32.0.
The optimization is successfull with optimization_level=1, but when optimization_level=2 it fails with the following error:

hailo_model_optimization.acceleras.utils.acceleras_exceptions.AccelerasNumerizationError: Input zero points to concat op xfeat/concat_layer_layer_normalization1/concat_op are not all equal.

As a fix to this I tried adding normalization and changing precision of the problematic layer_normalization1 layer.

My model script looks like this:

normalization1 = normalization([0.0, 0.0, 0.0], [255.0, 255.0, 255.0])
quantization_param(layer_normalization1, precision_mode=a16_w16)
model_optimization_flavor(optimization_level=2)

What could be done to resolve the issue?