The math in self-attention (opens in new tab)

So, failure in TMLR. Focus now on the interest, man. Finished the embedding model discussion with Karpathy. Now, discussing the self-attetion perspective and...