Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Close
You're currently offline. Some features may not work.
Close
Copied to clipboard
Close
Unable to share or copy to clipboard
Close
⚡ Tokenizer Optimization
SIMD Processing, State Machines, Unicode Handling, Performance
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
128855
posts in
2.45
s
Faster
AI Training
Unlocked
With New System For Massive Language Models
quantumzeitgeist.com
·
1d
🚀
MLton
Coding A PoS
Tagger
from Scratch — A Statistical Part-of-Speech
Tagger
|
NLP
pub.towardsai.net
·
1d
🔤
Language Tokenizers
SIGMA
:
Selective-Interleaved
Generation with Multi-Attribute Tokens
arxiv.org
·
18h
📊
LR Parsing
A Note on
Flat
Abstract
Syntax
Trees
gist.github.com
·
1d
·
Discuss:
Hacker News
🌳
Tree Walking
AVX2
SIMD Optimization for 12-bit JPEG Decoding in
libjpeg-turbo
— Pair Programming with Copilot CLI
github.com
·
15h
·
Discuss:
DEV
📦
Executable Size
Does Visual Rendering Bypass Tokenization? Investigating
Script-Tokenizer
Misalignment
in Pixel-Based Language Models
arxiv.org
·
18h
⚡
Tokenizer Benchmarks
Benchmarking
Claude C
Compiler
dineshgdk.substack.com
·
15h
·
Discuss:
Substack
,
r/programming
⚡
Interpreter Optimization
Handwriting
vs AI: Real Performance of AI on Handwritten
Documents
hackernoon.com
·
6h
🚀
Tokenizer Performance
Using AI to
write
a
transpiler
dev.to
·
23h
·
Discuss:
DEV
🎭
Program Synthesis
Unicode
18.0
Alpha
review
blog.unicode.org
·
2h
·
Discuss:
Blogger
💬
REPL Design
Opus 4.6 Reasoning
Distill
3k
prompts
huggingface.co
·
15h
·
Discuss:
r/LocalLLaMA
🧩
Constraint Solvers
A Coding Implementation to Establish Rigorous Prompt
Versioning
and Regression Testing Workflows for Large Language Models using
MLflow
marktechpost.com
·
1d
💬
Interactive REPLs
wordchipper
- my next-gen LLM tokenizer; looking for
LTR
release help
docs.rs
·
1d
·
Discuss:
r/rust
🔤
Language Tokenizers
Interesting things about the
Lua
interpreter
thesephist.com
·
2h
🌙
Lua
DFlash
: Block Diffusion for Flash
Speculative
Decoding
z-lab.ai
·
23h
·
Discuss:
Hacker News
🗺️
Region Inference
Universal
Turing
Machine
universalturingmachine.org
·
8h
🎯
Finite Automata
Eshaancoding/ad
:
Autodiff
created in Python. Full ahead-of-time compiler. Reduces to ~12 simple operations. Multiple IRs (Graph IR --> Procedural IR). Kernel Fusion, Memory/Computation Optimization
github.com
·
1d
·
Discuss:
Hacker News
🔄
Subinterpreters
Large Language Models for
Mortals
book released
crimede-coder.com
·
8h
·
Discuss:
Hacker News
🌱
Minimal ML
Machine Learning Based
SPAM
Detection Using
ONNX
in Java
foojay.io
·
16h
🔤
Language Tokenizers
Issue #721: Classification With
zstd
,
Callables
, Gemini, and More (Feb. 10, 2026)
pycoders.com
·
3h
🛠
programming language development
Loading...
Loading more...
Page 2 »
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help