Opening review spoke
How does self-attention allow a token to capture long-range dependencies like connecting a pronoun to a distant noun? — How LLMs Work | Unlomi