Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Tokenization
🔤 Tokenization
BPE, WordPiece, SentencePiece, Subword Encoding
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
117
posts in
7.5
ms
What Are
Tokens
in LLMs?
🤖
AI
Content type:
Blog
bearisland.dev
·
4d
4 days ago
·
Hacker News
Actions for What Are Tokens in LLMs?
Agentic RL:
Token-In
,
Token-Out
Done Right
🎮
Reinforcement Learning
qgallouedec-tito.hf.space
·
1d
1 day ago
·
Hacker News
Actions for Agentic RL: Token-In, Token-Out Done Right
Optimality of FSQ
Tokens
for Continuous Diffusion for Categorical Data with Application to Text-to-Speech
🤖
AI
Content type:
Academic
arxiv.org
·
22h
22 hours ago
Actions for Optimality of FSQ Tokens for Continuous Diffusion for Categorical Data with Application to Text-to-Speech
Vibe Diaries: Training Nanochat
🤖
AI
vibediary.dev
·
2d
2 days ago
·
Hacker News
Actions for Vibe Diaries: Training Nanochat
A system programmer’s guide to LLM inference
📝
NLP
Content type:
Blog
blog.xiangpeng.systems
·
3d
3 days ago
·
Hacker News
Actions for A system programmer’s guide to LLM inference
Machine learning from scratch, what to build before using scikit-learn
🧠
Neural Networks
Content type:
Tutorial
iwtlp.com
·
12h
12 hours ago
·
DEV
Actions for Machine learning from scratch, what to build before using scikit-learn
Tokenization
Firm Securitize Gets SEC Approval for Public Debut
📝
NLP
pymnts.com
·
2d
2 days ago
Actions for Tokenization Firm Securitize Gets SEC Approval for Public Debut
How LLMs
work
| Practical Leaders
🤖
AI
practical-leaders.com
·
6d
6 days ago
·
Hacker News
Actions for How LLMs work | Practical Leaders
tigerless-labs/cost-xray: See what Claude Code and Codex actually
send
to the API — and what each part costs.
✍️
Prompt Engineering
Content type:
Code
github.com
·
7h
7 hours ago
·
Hacker News
Actions for tigerless-labs/cost-xray: See what Claude Code and Codex actually send to the API — and what each part costs.
Tokenization
firm Securitize clears key SEC hurdle for NYSE listing
📝
NLP
cointelegraph.com
·
2d
2 days ago
Actions for Tokenization firm Securitize clears key SEC hurdle for NYSE listing
How Far Apart Does a Model Think Its
Tokens
Are?
⚡
Speculative Decoding
lesswrong.com
·
3d
3 days ago
Actions for How Far Apart Does a Model Think Its Tokens Are?
TaxoFormer: Hierarchical Transformer for Predicting the Full Taxonomic Lineage of Protein Sequences
📝
NLP
Content type:
Academic
biorxiv.org
·
1d
1 day ago
Actions for TaxoFormer: Hierarchical Transformer for Predicting the Full Taxonomic Lineage of Protein Sequences
How LLMs Actually
Work
: A Friendly Map for Humans • oreoro
💬
LLMs
oreoro.github.io
·
5d
5 days ago
·
Hacker News
Actions for How LLMs Actually Work: A Friendly Map for Humans • oreoro
IPO Positions us for Acquisitions: Securitize CEO
📝
NLP
Content type:
News
bloomberg.com
·
1d
1 day ago
Actions for IPO Positions us for Acquisitions: Securitize CEO
What an LLM Actually Does With Your Prompt First
✍️
Prompt Engineering
siliconopera.com
·
5d
5 days ago
Actions for What an LLM Actually Does With Your Prompt First
Why REAL Finance sees infrastructure as the next phase of
tokenized
finance
📝
NLP
Content type:
News
thenextweb.com
·
2d
2 days ago
Actions for Why REAL Finance sees infrastructure as the next phase of tokenized finance
"
Token
" Changing Hands — From Crypto Coin to AI Building Block
📝
NLP
Content type:
News
Content type:
Blog
dd688.substack.com
·
3d
3 days ago
·
Substack
Actions for "Token" Changing Hands — From Crypto Coin to AI Building Block
Wall Street will run entirely on the blockchain by 2030, says Brickken CEO
📝
NLP
Content type:
News
coindesk.com
·
1d
1 day ago
Actions for Wall Street will run entirely on the blockchain by 2030, says Brickken CEO
How to Measure Time To First
Token
(TTFT) in AI Systems
📝
NLP
qainsights.com
·
4d
4 days ago
·
Hacker News
Actions for How to Measure Time To First Token (TTFT) in AI Systems
Multi-task LLMs for Bug Classification: Efficient Inference with Auxiliary Decoding Heads
📝
NLP
Content type:
Academic
arxiv.org
·
22h
22 hours ago
Actions for Multi-task LLMs for Bug Classification: Efficient Inference with Auxiliary Decoding Heads
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help