🔍 Tokenizers

Lexical Analysis, Token Recognition, State Machines, Parsing Pipeline

Feeds to Scour
SubscribedAll
Scoured 4253 posts in 208.2 ms
Sieve: A Mail Filtering Language
ietf.org·1d
📚Factor
Preview
Report Post
Understanding Encoder and Decoder LLMs
magazine.sebastianraschka.com·6h·
Discuss: Hacker News
🪜Recursive Descent
Preview
Report Post
Show HN: High-Performance Domain-Agnostic Rule Engine with AI-Powered Config
ayushmaanbhav.github.io·9h·
Discuss: Hacker News
📋Tablegen
Preview
Report Post
michmech/lemmatization-lists: Machine-readable lists of lemma-token pairs in 23 languages.
github.com·1d
🔤Language Tokenizers
Preview
Report Post
LAI #106: Choosing the Right Shape for AI Systems
pub.towardsai.net
·15h
💬Prompt Engineering
Preview
Report Post
Adventures in the land of Language Servers
speakerdeck.com·2d·
Discuss: Lobsters
⚡Incremental Parsing
Preview
Report Post
Launch HN: Pulse (YC S24) – Production-grade unstructured document extraction
news.ycombinator.com·14h·
Discuss: Hacker News
⚡Incremental Parsing
Preview
Report Post
Vibe Coding Is Creating a Generation of Sorcerer’s Apprentices
russellmiller2.substack.com·11h·
Discuss: Substack
💬Interactive REPLs
Preview
Report Post
Designing the 3 layers of AI context
uxdesign.cc
·4h
💬Prompt Engineering
Preview
Report Post
GitHub - KalyanKS-NLP/LLM-Interview-Questions-and-Answers-Hub: 100+ LLM interview questions with answers.
github.com·7h·
Discuss: Hacker News
🪜Recursive Descent
Preview
Report Post
How accurate is ChatGPT for business and enterprise use
blog.pangeanic.com·1d
🎮Language Ergonomics
Preview
Report Post
Regular Expression Analyzer
xenon.stanford.edu·1d
🔤Language Tokenizers
Preview
Report Post
Some Lean Syntax for Knuckledragger
philipzucker.com·4d
💬Interactive REPLs
Preview
Report Post
GPT-5.2 Prompting Guide
cookbook.openai.com·2d
🎮Language Ergonomics
Preview
Report Post
Open Sourcing The Most Comprehensive Language Selector Component Library | Casho Lab
casholab.com·4h·
Discuss: Hacker News
🌉Language Bridges
Preview
Report Post
Introducing Bolmo: Byteifying the next generation of language models | Ai2
allenai.org·3d
📋JSON Parsing
Preview
Report Post
Writing Concisely — Center for Arts & Language
artsandlanguage.risd.edu·9h
📚Factor
Preview
Report Post
Lazar Zivanovic - transformers article
lazarzivanovicc.github.io·3d
📝Computational Linguistics
Preview
Report Post
Token-Count-Based Batching: Faster, Cheaper Embedding Inference for Queries
mongodb.com·8h·
Discuss: Hacker News
🗺️Region Inference
Preview
Report Post
My first win building with agents
olano.dev·11h·
Discuss: Lobsters
🎮Language Ergonomics
Preview
Report Post