Token Processing, Grammar Rules, AST Generation, Language Recognition

Feeds to Scour
SubscribedAll
Scoured 19795 posts in 1.22 s
Are you going to finish that? A Practical Study of the Tokenization Boundary Problem
arxiv.org·2d
🔤Tokenization
Preview
Report Post
suzgunmirac/belief-in-the-machine: Belief in the Machine: Investigating Epistemological Blind Spots of Language Models
github.com·44m
🧠LLM Inference
Preview
Report Post
Taming the Flat AST: Ergonomics in the Age of Zero Allocations
modern-c.blogspot.com·15h·
📏Linear Types
Preview
Report Post
How Transformers Architecture Powers Modern LLMs
blog.bytebytego.com·1d
🧠LLM Inference
Preview
Report Post
Training a Small Language Model
elijahpotter.dev·1d
🔤Tokenization
Preview
Report Post
Highlights from UTC Meeting #186
blog.unicode.org·7h·
Discuss: Blogger
🔤Tokenization
Preview
Report Post
A Black Box Made Less Opaque (part 2)
lesswrong.com·6h
🔤Tokenization
Preview
Report Post
Ysgrifennu Côd yn Gymraeg (Writing Code in Welsh)
hackaday.com·15h
🔤Tokenization
Preview
Report Post
ChunkNorris: A High-Performance and Low-Energy Approach to PDF Parsing and Chunking
arxiv.org·1d
📄Semantic Chunking
Preview
Report Post
How to Build Safe Natural Language-Driven APIs
techcommunity.microsoft.com·21h·
Discuss: Hacker News
🦙Ollama
Preview
Report Post
Resources on West Greenlandic
oqa.dk·1d
🔤Tokenization
Preview
Report Post
Some good English word datasets
ntietz.com·2d
🎯Semantic Tokens
Preview
Report Post
Words are minimum-viable coordination tools
invertedpassion.com·5h
🔤Tokenization
Preview
Report Post
easy forth
skilldrick.github.io·1d
🌳Trie Structures
Preview
Report Post
What is Data Engineering?
databricks.com·16h
🗄️Database Engines
Preview
Report Post
ManePaw: Find documents on your Mac using natural language
producthunt.com·1d
🔎Tantivy
Preview
Report Post
Maiasa: A next-gen, fast, robust, ethical language model (that can only say "a")
maiasa.ai·18h·
Discuss: Hacker News
🦙Ollama
Preview
Report Post
Joining Igen
harpers-tale.wikidot.com·9h
💾Binary Formats
Preview
Report Post
Better Taxonomy Management for Hugo with VS Code
chriswiegman.com·1d
🎨Design Tokens
Preview
Report Post
AI Document Processing in Drupal: Technical Case Study with 95% Accuracy
droptica.com·10h
👨‍💻AI Coding
Preview
Report Post

Keyboard Shortcuts

Navigation
Next / previous item
j/k
Open post
oorEnter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help