🔍 Tokenizers

Lexical Analysis, Token Recognition, State Machines, Parsing Pipeline

Feeds to Scour
SubscribedAll
Scoured 8842 posts in 93.9 ms
suzgunmirac/belief-in-the-machine: Belief in the Machine: Investigating Epistemological Blind Spots of Language Models
github.com·10h
🌱Minimal ML
ChunkNorris: A High-Performance and Low-Energy Approach to PDF Parsing and Chunking
arxiv.org·1d
🌊Streaming Lexers
How to Build Safe Natural Language-Driven APIs
techcommunity.microsoft.com·1d·
Discuss: Hacker News
🎮Language Ergonomics
QT4 grammar explorer
so.nwalsh.com·8h
🌳Tree-sitter
Maiasa: A next-gen, fast, robust, ethical language model (that can only say "a")
maiasa.ai·1d·
Discuss: Hacker News
🌱Tiny Languages
Show HN: 32KB deductive engine that catches LLM hallucinations
news.ycombinator.com·11h·
Discuss: Hacker News
✨Gleam
Lockin, a PDF TTS reader for manuals and papers cited Q&A
lockin.pageyard.org·32m·
Discuss: Hacker News
🔤Language Tokenizers
How I Program with LLMs
blog.wesleyabbey.io·7h·
Discuss: Hacker News
🎮Language Ergonomics
Revolutionizing enterprise search: OpenSearch Vector Engine unleashed
opensearch.org·4h
🔍Search Algorithms
Chatbot Accessibility Playbook - Chatbot Accessibility Playbook
mitre.github.io·1d
🎮Language Ergonomics
A State-Transition Framework for Efficient LLM Reasoning
arxiv.org·1d
🪜Recursive Descent
AI Document Processing in Drupal: Technical Case Study with 95% Accuracy
droptica.com·20h
⚡Incremental Parsing
Beyond Lowest Bid: A Deterministic, Explainable Multi-Agent Hiring System
pub.towardsai.net
·5h
💬Prompt Engineering
How LSP Works: Building a Grammar Checker LSP from Scratch in Rust
aroy.sh·1d·
Discuss: Hacker News
🎮Language Ergonomics
Evaluating Multilingual Guardrails in Humanitarian AI
blog.mozilla.ai·1d·
Discuss: Hacker News
🎮Language Ergonomics
Edit Mind : AI-Powered Local Video Search & Analysis
producthunt.com·22h
💬Prompt Engineering
Context Engineering & Agent Memory Platform for AI Agents
getzep.com·20h
🧠Symbolic AI
Some Libraries
funcall.blogspot.com·2d·
Discuss: Blogger
🎭Racket
easy forth
skilldrick.github.io·1d
📚Forth Compilers
Your App Shouldn't Have a Happy Path
erickhun.com·1d·
Discuss: Lobsters, r/programming
💬Prompt Engineering

Keyboard Shortcuts

Navigation
Next / previous item
j/k
Open post
oorEnter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help