Why the attention mechanism lets models train faster and deeper than previous architectures

The transformer architecture, introduced in the 2017 paper "Attention Is All You Need," replaced recurrent neural networks (RNNs) with a self-attention mechanism that allows every token in a sequence to directly compare itself with every other token in a single layer.