When Transformers is peak