🚀 Tokenizer Performance - abnv · Scour

The Script Tax: Measuring Tokenization-Driven Efficiency and Latency Disparities in Multilingual Language Models

arxiv.org·14h

⚡Tokenizer Benchmarks

BalatroBench Benchmarks Large Language Models Playing Balatro

balatrobench.com·8h·

Discuss: Hacker News

🏁Language Benchmarks

Lexer, Parser, Codegen

github.com·13h·

Discuss: DEV

📝Lexer Generators

SnapMLA: Efficient Long-Context MLA Decoding via Hardware-Aware FP8 Quantized Pipelining

arxiv.org·1d

⚡Tokenizer Optimization

Recursive Language Models: Stop Stuffing the Context Window

nlp.elvissaravia.com·23h

🪜Recursive Descent

The BEHILOS Benchmark: Performance Analysis of Low-Footprint CLI Search Tools

dev.to·1d·

Discuss: DEV

🏁Language Benchmarks

Show HN: We Made Nasdaq Parsing Even Faster (and More Reliable)

lunyn.com·1d·

Discuss: Hacker News

📋JSON Parsing

Building an Embedding API with Rust, Arm, and EmbeddingGemma on AWS Lambda

sobolev.substack.com·8h·

Discuss: Substack

📋JSON Parsing

N-Grams and Other Experiments

dotterrer.bearblog.dev·2d

Breaking the Tractability Barrier: A Generic Low-Level Solver for NP-Hard Instances (N=63) on Commodity 64-Bit Silicon

zenodo.org·13h·

Discuss: r/programming

🧩Constraint Solvers

TIOBE Index for February 2026: Specialized Languages Gain Ground as Python’s Lead Eases

techrepublic.com·6h

🏁Language Benchmarks

Completed Hyperparameter Transfer across Modules, Width, Depth, Batch and Duration

machinelearning.apple.com·19h

Show HN: Orangensaft – A mini Python-like language with LLM eval in lang runtime

github.com·7h·

Discuss: Hacker News

⚡Incremental Parsing

The Machine Learning Practitioner’s Guide to Speculative Decoding

machinelearningmastery.com·2d

🔍ML Language

LateOn-Code & ColGrep: LightOn unveils state-of-the-art code retrieval models and code search tooling

huggingface.co·1d·

Discuss: Hacker News

🔤Language Tokenizers

Inside CPython Lists: Contiguous Memory, Fast Indexing, Resizing. A Mental Model for Interviews

dev.to·34m·

Discuss: DEV

📦Compact Data

Presentation: Building Embedding Models for Large-Scale Real-World Applications

infoq.com

·3h

Building a Regex Engine with a team of parallel Claudes

lesswrong.com·2d

🔤Regex Engines

OpenAI GPT-5.3-Codex-Spark Now Running at 1K Tokens Per Secondon BIG Cerebras Chips

servethehome.com·2h

🗺️Region Inference

Technical "whitepaper" for afl-fuzz

lcamtuf.coredump.cx·1d·

Discuss: Lobsters

🎲Parser Fuzzing

Loading more...