🔤 Tokenization - buckman · Scour

Language Modeling Without Neural Networks 🤖Large Language Models

nathan.rs·6d·Hacker News

Fast Attention for Short Sequences 🚀Performance

blog.qwertyforce.dev·1d·Hacker News

Spontaneous introspection in conversation tampering 💉Prompt Injection

lesswrong.com·14h

Beyond the next token: Why diffusion LLMs are changing the game 🤖LLM Inference

developers.redhat.com·3h

dogmaticdev/SIMD-Tokenizer: A Hyper Optimzed Tokenizer written in handwritten assembly. Made for SSE2 cpu architectures. 🔍Binary Diffing

github.com·1d·Hacker News

Zero-Cost Transparent Semiotic Awareness for Frozen Language Models SRT-Adapter 🧠LLM Training

sublius.substack.com·11h·Substack

The Language Tax in LLM Pricing: How Tokenization Create Price Disparity 💰Tokenomics

tokenstree.com·4d·Hacker News

Language Models: Does the brain really know what word is coming next? 📡Information Theory

elifesciences.org·11h

s/sed/ed 🔧Unix Tools

Honey, I Shrunk the Coding Agent 🔍Binary Diffing

itayinbarr.substack.com·2d·Substack

Parallel Token Prediction for Language Models ⚡Inference

justuswill.com·4d·Hacker News

Back to BERT in 2026: ModernGENA as a Strong, Efficient Baseline for DNA Foundation Models 🤖Large Language Models

biorxiv.org·2d

My Notes on Makemore Part1: Building a Character-Level Language Model from Scratch 🤖Large Language Models

How does Reinforcement Learning Affect Models 🎮Reinforcement Learning

lesswrong.com·5h

Libraries and Archives, a Natural Home for Language Models 💬NLP

rsdoiel.github.io·1d

tejpalv/cc-markup: Tokenizer cost markup between Claude model versions, measured on your own Claude Code sessions. 🤖Claude Code

github.com·3d·Hacker News

From LLM to Tokens: How AI and Crypto Are Merging Into New Business Models| KuCoin 💰API Pricing

Study Finds Language Models Can Distinguish Between Realistic, Unlikely, Impossible, and Nonsensical Events 💬NLP

digitalinformationworld.com·2d

“Training a Tokenizer That Actually Speaks Italian” 🧠LLM Training

toshareproject.it·6d

blockchain-verified rewards for walking, cycling, sustainable shopping 💎Token Economics

everact.app·1d·Hacker News

Log in to enable infinite scrolling