it has no notion of order. Positional encodings inject position information into the token representations, breaking this permutation symmetry and allowing the model to distinguish between different orderings of the same tokens.