Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Close
Copied to clipboard
Close
Unable to share or copy to clipboard
Close
🔤 Tokenization
BPE, SentencePiece, Subword Units, Context Windows
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
175114
posts in
21.6
ms
Reducing
TTFT
by
CPUMaxxing
Tokenization
crusoe.ai
·
1d
·
Discuss:
Hacker News
🧠
OpenAI
Tokenization
Is Killing Our
Multilingual
LLM Dream
huggingface.co
·
2d
·
Discuss:
Hacker News
🧠
OpenAI
Demystifying LLM
Tokenizers
: Building Byte Pair Encoding (
BPE
) From Scratch in Python
medium.com
·
3d
⛓️
LangChain
Mitigating
Overthinking
in Large Reasoning Language Models via Reasoning Path
Deviation
Monitoring
arxiv.org
·
1d
🪟
Context Windows
PashtoCorp
: A 1.25-Billion-Word Corpus, Evaluation Suite, and
Reproducible
Pipeline for Low-Resource Language Development
arxiv.org
·
7h
🧠
OpenAI
An Epidemic Of
Penalizing
Uncertainty: Why Language Models
Hallucinate
pub.towardsai.net
·
6h
🪟
Context Windows
LumberChunker
: Long-Form
Narrative
Document Segmentation
blog.ml.cmu.edu
·
18h
🔍
RAG
the Language of AI
dev.to
·
1d
·
Discuss:
DEV
🧠
OpenAI
Understanding the
NLP
Pipeline — From
Raw
Text to Intelligent Systems
medium.com
·
5d
🧠
OpenAI
Everything You Need to Know About
Recursive
Language Models
machinelearningmastery.com
·
1d
✍️
Prompt Engineering
AI Prompt Generator, Prompt
Optimizer
&
Templates
promptomars.com
·
3h
·
Discuss:
Hacker News
✍️
Prompt Engineering
Tree Search
Distillation
for Language Models Using
PPO
ayushtambde.com
·
3d
·
Discuss:
Hacker News
⚡
Inference Optimization
Context windows
aren
't the
bottleneck
. Context quality is
contextshift.io
·
2d
·
Discuss:
Hacker News
🪟
Context Windows
Weeknote
2026-W08
: A11y, WCAG &
KeepAndroidOpen
burgeonlab.com
·
9h
💭
Context Management
easily
share
context
with AI
dump.page
·
8h
·
Discuss:
Hacker News
🧠
OpenAI
The Human
Skill
That
Eludes
AI
theatlantic.com
·
20h
🧠
OpenAI
This one mega-prompt help me to write content that strips away verbal clutter and corporate
jargon
to reveal a narrative voice that is both
authoritative
and de...
tools.eq4c.com
·
6h
·
Discuss:
r/PromptEngineering
✍️
Prompt Engineering
We trained
Composer
to
self-summarize
through RL instead of a prompt.
twitter.macworks.dev
·
17h
✍️
Prompt Engineering
Token
optimized
query language (
Memelang
)
memelang.net
·
2d
·
Discuss:
Hacker News
🤖
AI
A
foundational
library for building
contenteditable-based
web text editors
revise.js.org
·
19h
·
Discuss:
r/javascript
💻
Cursor
Loading...
Loading more...
Page 2 »
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help