Transformer & Self-Attention: I Built an Encoder From Scratch, Then Caught It Overfitting
This week's topic is one of the most important building blocks of modern NLP: the Transformer and the self-attention mechanism behind it. Instead of just walking through the theory, I decided to build





