Tokenizers

🔍 Tokenizers

Lexical Analysis, Token Recognition, State Machines, Parsing Pipeline

Feeds to Scour
SubscribedAll
Scoured 43 posts in 9.9 ms

Fujo930/moss-lang: A runnable prototype of the Moss programming language and browser studio.

 💬REPL Design  Content type: Code
github.com··Hacker News

Release v1.9.0-rc.23 · kreuzberg-dev/tree-sitter-language-pack

 🌉Language Bridges  Content type: Code
github.com·

Egonex-AI/Understand-Anything: Graphs that teach > graphs that impress. Turn any code into an interactive knowledge graph you can explore, search, and ask questions about. Works with Claude Code, Codex, Cursor, Copilot, Gemini CLI, and more.

 🗂Knowledge Management  Content type: Code
github.com·
Less-relevant results

How to Set Up Codebase Indexing in Kilo Code

 🔍RAG  Content type: News  Content type: Blog
blog.kilo.ai·

zed-industries/zed glsl-v0.2.4

 ⚡Incremental Parsing  Content type: Code
github.com
·

kerbelp/metatron: Metatron is a self-hosted system that captures a codebase's real implementation decisions — preferred patterns, rejected approaches, edge cases, internal conventions — as structured priors, and serves them to coding agents over MCP (Model Context Protocol). The goal: an agent writes code like a senior engineer who already knows the codebase

 🏠Self-Hosting  Content type: Code
github.com··Hacker News

cleanmcp/clean-mcp: Reduce token usage. All local and open-source.

 📥Inlining  Content type: Code
github.com··r/mcp

Release Release Candidate v1.6.6-rc.157 · abhigyanpatwari/GitNexus

 📦Dependency Analysis  Content type: Code
github.com·

CostAffective MCP: 45.9% fewer tokens and 54.3% fewer exploration loops for AI coding agents on a 3,203-file repository

 🌳Tree-sitter  Content type: Code
github.com··r/mcp

Release v0.0.2-alpha · VxidDev/Arc

 💬REPL Design  Content type: Code
github.com··Hacker News

octoscope

 💻Terminal UIs  Content type: Code
github.com··r/commandline

zed-industries/zed v1.6.2-pre

 ⚡Incremental Parsing  Content type: Code
github.com
·

Release v1.9.0-rc.25 · kreuzberg-dev/tree-sitter-language-pack

 🌳Tree-sitter  Content type: Code
github.com·

zed-industries/zed v1.5.4

 ⚡Incremental Parsing  Content type: Code
github.com
·

zed-industries/zed v1.6.1-pre

 ⚡Incremental Parsing  Content type: Code
github.com
·

Release Release Candidate v1.6.6-rc.134 · abhigyanpatwari/GitNexus

 📦Dependency Analysis  Content type: Code
github.com·

Release Release Candidate v1.6.6-rc.150 · abhigyanpatwari/GitNexus

 📦Dependency Analysis  Content type: Code
github.com·

Release Release Candidate v1.6.6-rc.142 · abhigyanpatwari/GitNexus

 📦Dependency Analysis  Content type: Code
github.com·

Release Release Candidate v1.6.6-rc.135 · abhigyanpatwari/GitNexus

 📦Dependency Analysis  Content type: Code
github.com·

Release Release Candidate v1.6.6-rc.148 · abhigyanpatwari/GitNexus

 📦Dependency Analysis  Content type: Code
github.com·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help