🔍 Tokenizers

Lexical Analysis, Token Recognition, State Machines, Parsing Pipeline

Constraint Satisfaction Approaches to Wordle: Novel Heuristics and Cross-Lexicon Validation
arxiv.org·6h
🧩Constraint Solvers
Eclectic English Vocab
404wolf.com·9h
🔄Incremental Lexing
Automated Verification of Code Logic & Security Vulnerabilities via Hyperdimensional Semantic Analysis
dev.to·6h·
Discuss: DEV
🌳Pattern Match Compilation
I Made an AI Document Analyzer So You Don’t Have To (But You’ll Probably Want To)
github.com·2d·
Discuss: DEV
💬Interactive REPLs
How Much Should You Tell Your AI Agent?
raymondyxu.com·16h·
Discuss: Hacker News
💬Interactive REPLs
Teaching Models to Decide When to Retrieve: Adaptive RAG, Part 4
blog.reachsumit.com·2h·
Discuss: Hacker News
🪜Recursive Descent
Training Dynamics of Parametric and In-Context Knowledge Utilization in Language Models
arxiv.org·6h
🪜Recursive Descent
Lazy text capitalization with low latency large language models
blog.florianschulz.info·1d·
Discuss: Hacker News
🔄Incremental Lexing
Prompting Techniques for Specialised LLMs
dev.to·18h·
Discuss: DEV
🎮Language Ergonomics
Python PEP 636 – Structural Pattern Matching: Tutorial
peps.python.org·1d·
Discuss: Hacker News
💬Interactive REPLs
Writing a Dictation Application
osada.blog·15h
📚Self-Documenting Code
BULaMU-The First Luganda Large Language Model Trained from Scratch
reddit.com·1d·
Discuss: r/LocalLLaMA
🌱Minimal ML
An alternative to knowledge graphs for storing loosely structured content
fleetingswallow.com·20h·
Discuss: Hacker News
🌲Tree Rewriting
Why LLMs Hallucinate on Emojis (And 4 Tokens That Break Production AI)
dev.to·4h·
Discuss: DEV
🌊Gradual Effects
🎲 Collaborative Text Editing from Scratch in Lexical
mortenson.coffee·2h
📝Rope Editors
Java Annotated Monthly – October 2025
blog.jetbrains.com·2h
💬Smalltalk VMs
Appen Finds LLMs Struggle with Idioms and Culture in Multilingual AI Translations
slator.com·1h
⚡Tokenizer Benchmarks
Batch Processing with Spring Batch and Multiple Data Sources
dev.to·5h·
Discuss: DEV
🔧Error Recovery
Understanding the KV Cache (feat. Self-Attention)
dev.to·3h·
Discuss: DEV
🔄Subinterpreters
Token economics are serious AI business; API costs are out of control
theservitor.com·2h·
Discuss: Hacker News
🔄Subinterpreters