Context windows in AI: why every token is a budget decision (opens in new tab)
Some of today's most capable LLMs now support very large context windows. That doesn't mean you should fill them. Context windows have grown fast, but the underlying cost and quality tradeoffs haven't gone away. They've just gotten easier to ignore. ...
Read the original article