Hi @andrea.bonvini, Currently the support for transfomers is limited, this is one of the areas that we invest a lot as a company. With that, at the moment for networks that involves transformers, the compiler is not as robust as with CNNS, with each released version you would see better support. The current vesion doesn’t fully support LN. Currently even in the model-zoo we use BN version for SegFormer. In the coming release (July) we expect to get better support for Transformers.