DEV Community

AI Coding Agents Search Like It's 2009. Provenant Cuts Tokens by 65 . (opens in new tab)

Here's what happens every time you ask an AI coding agent a question: It greps your codebase It returns 15 files It stuffs ~69,000 tokens of raw source code into your context window It answers your question using maybe 3 of those files You pay for all 69,000 tokens anyway This is BM25 keyword search on raw source code. It's the same algorithm that powered web search in 2009. And it's still the shape of most coding-agent retrieval systems: keyword search, grep, file search, context stuffing. I...

Read the original article
Sign in to keep reading the full article.

Keyboard Shortcuts

Navigation

Next / previous post
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Discover
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help