Likely Math Behind Subquadratic (opens in new tab)
Subquadratic Sparse Attention (SSA): content-routed exact attention for long contexts — paper, theory, and reference implementations - jonsmirl/ssa
Read the original articleSubquadratic Sparse Attention (SSA): content-routed exact attention for long contexts — paper, theory, and reference implementations - jonsmirl/ssa
Read the original article