How Long-Context Inference Is Rewriting the Future of Transformers (opens in new tab)

Five escape routes from the quadratic tax, and what each one actually costs you in exchange