Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Close
You're currently offline. Some features may not work.
Close
Copied to clipboard
Close
Unable to share or copy to clipboard
Close
⚡ Tokenizer Optimization
SIMD Processing, State Machines, Unicode Handling, Performance
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
83176
posts in
818.3
ms
Taming the Regex Monster: Optimizing Massive
Literal
Alternations
modern-c.blogspot.com
·
1d
·
Discuss:
r/golang
🔤
Regex Engines
Pratt
Parsers
: Expression Parsing Made Easy
journal.stuffwithstuff.com
·
3h
📊
Pratt Parsers
Understanding LLM Inference
Engines
: Inside
Nano-vLLM
(Part 2)
neutree.ai
·
1d
·
Discuss:
Hacker News
🗺️
Region Inference
Flexible and
Economical
UTF-8
Decoder
bjoern.hoehrmann.de
·
8h
🔢
Binary Formats
ChatGPT vs.
Logic
: Why AI Code is
Slower
dev.to
·
1d
·
Discuss:
DEV
⚡
Interpreter Optimization
StatLLM
: A Dataset for Evaluating the Performance of Large Language Models in
Statistical
Analysis
nature.com
·
1d
📊
LR Parsing
Why Large Language Models Make Terrible
Compilers
— And Why the Industry Keeps Trying
Anyway
webpronews.com
·
20h
🏗️
LLVM
Rebuilding
the
spellchecker
zverok.space
·
2h
⚡
Tokenizer Benchmarks
LiteToken
: Removing Intermediate Merge Residues From
BPE
Tokenizers
arxiv.org
·
2d
🔤
Language Tokenizers
Examining
Turbopuffer
ANN v3
terencezl.github.io
·
2d
·
Discuss:
Hacker News
⚡
Performance
Hello Edge: Keyword
Spotting
on
Microcontrollers
paperium.net
·
1d
·
Discuss:
DEV
🔌
Microcontrollers
The Machine
Learned
Our Language
medium.com
·
11h
·
Discuss:
r/programming
🧠
Semantic Parsing
A
GTM
guide to AI models
revengine.substack.com
·
2h
·
Discuss:
Substack
🏷️
Attribute Grammars
Build a
Compiler
in Five Projects
kmicinski.com
·
12h
🎭
Racket Modules
Show HN:
ZigZag
– A Bubble Tea-Inspired
TUI
Framework for Zig
github.com
·
19h
·
Discuss:
Hacker News
💬
Smalltalk VMs
Free online
toolbox
with 50+ useful tools – no ads, no
signup
required
strongtools.site
·
7h
·
Discuss:
r/SideProject
✨
Code Formatters
How I
squeezed
a
BERT
sentiment analyzer into 1GB RAM on a $5 VPS
mohammedeabdelaziz.github.io
·
6h
·
Discuss:
Hacker News
🗺️
Region Inference
When Language Models Get Stuck: The Mechanics of
Repetition
Loops
pub.towardsai.net
·
19h
🦌
ANTLR
Hybrid Gated Flow (
HGF
):
Stabilizing
1.58-bit LLMs via Selective Low-Rank Correction
arxiv.org
·
1d
🔗
Memory Linearization
LLMs -
Custom
Tokenizers
dev.to
·
2d
·
Discuss:
DEV
🔤
Language Tokenizers
Loading...
Loading more...
Page 2 »
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help