🔍 Tokenizers

Lexical Analysis, Token Recognition, State Machines, Parsing Pipeline

Understanding the KV Cache (feat. Self-Attention)
dev.to·6h·
Discuss: DEV
🔄Subinterpreters
Token economics are serious AI business; API costs are out of control
theservitor.com·4h·
Discuss: Hacker News
🔄Subinterpreters
Language Support for Marginalia Search
marginalia.nu·13h
🔍Text Indexing
Day 24 of My 90 Days Python Series – Word Counter Tool
github.com·2h·
Discuss: DEV
💬Interactive REPLs
How to implement unique word generation via token graph traversal with local LLMs?
reddit.com·17h·
Discuss: r/LocalLLaMA
🔍Parsing Algorithms
Mitigating Modal Imbalance in Multimodal Reasoning
arxiv.org·9h
↔️Bidirectional Typing
Fun with HyperLogLog and SIMD
vaktibabat.github.io·2d·
Discuss: Hacker News, r/rust
🔢Bit Manipulation
I Spent 6 Hours Per Blog Post Until I Built This AI Content Platform
terradium.io·1d·
Discuss: DEV
⚡Incremental Parsing
Learning to Route: A Rule-Driven Agent Framework for Hybrid-Source Retrieval-Augmented Generation
arxiv.org·9h
📋Souffle Datalog
DiffuSpec: Unlocking Diffusion Language Models for Speculative Decoding
arxiv.org·9h
🚀Tokenizer Performance
Is Odin Just a More Boring C?
dayvster.com·2h·
Discuss: Hacker News
🐹Go Internals
An experiment generating a protocol spec from natural language source with LLM
gist.github.com·2d·
Discuss: Hacker News
🌙Lua
Seriously Testing LLMs
satisfice.com·11h
🎯Finite Automata
Automated Knowledge Graph Validation and Enhancement via Adaptive Semantic Refinement
dev.to·1d·
Discuss: DEV
🧠Semantic Parsing
Reflections on Designing a Search Autocomplete System
torontostudygroup.github.io·1d·
Discuss: DEV
🌿Trie Structures
Krish Naik: Complete RAG Crash Course With Langchain In 2 Hours
dev.to·9h·
Discuss: DEV
🌊Streaming Lexers
Language, Culture, and Ideology: Personalizing Offensiveness Detection in Political Tweets with Reasoning LLMs
arxiv.org·9h
🔤Language Tokenizers
Culture, Language, and Generative Language Models
cacm.acm.org·17m
🧠Semantic Parsing
MathArena Apex: Unconquered Final-Answer Problems
matharena.ai·1d·
Discuss: Hacker News
🧩Constraint Solvers
Optimizing Long-Form Clinical Text Generation with Claim-Based Rewards
arxiv.org·9h
💬Interactive REPLs