📝 Text Parsing

Token Processing, Grammar Rules, AST Generation, Language Recognition

From Text to Token: How Tokenization Pipelines Work
paradedb.com·23h
🔤Tokenization
Memory Retrieval and Consolidation in Large Language Models through Function Tokens
arxiv.org·19h
🔤Tokenization
I built a translator for spatial thinking (because I can't interview in Python)
graemefawcett.ca·4h·
Discuss: Hacker News
🪄Prompt Engineering
The RAG Playbook: A Data Science Guide to Document Chunking
pub.towardsai.net·6h
🔄LLM RAG Pipelines
Assuring Agent Safety Evaluations By Analysing Transcripts
lesswrong.com·13h
🏆LLM Benchmarking
Writing regex is pure joy. You can't convince me otherwise.
triangulatedexistence.mataroa.blog·21h·
Discuss: Hacker News, r/programming
📑Inverted Indexes
Let's Write a Macro in Rust
hackeryarn.com·7h·
Discuss: Hacker News
🎭Rust Macros
Show HN: Realization Jsmn on a Pure Zig
github.com·13h·
Discuss: Hacker News
🔤Tokenization
MultiPar 1.3.3.5 Beta / 1.3.2.9
majorgeeks.com·15h
📄File Formats
How different AI engines generate and cite answers
searchengineland.com·11h
📊Feed Optimization
Links 10/10/2025: US Judge Bars Attacks by ICE On Journalists and Protesters; “We Took The Freedom of Speech Away” Says the President
techrights.org·17h
🪄Prompt Engineering
LLMs and reinforcement learning
sicpers.info·13h
🪄Prompt Engineering
Bidirectional type checking step by step (in Ruby)
luizpvas.github.io·46m·
Discuss: Hacker News
💻Programming languages
(Forward) automatic implicit differentiation in Rust with num-dual 0.12.0
reddit.com·8h·
Discuss: r/rust
🎭Rust Macros
Stress-Testing Model Specs Reveals Character Differences among Language Models
arxiv.org·19h
🔤Tokenization
YouTube gets ~5% CTR lift on Shorts by replacing embedding tables with Semantic IDs
shaped.ai·23h
📊Feed Optimization
Wordle Hints, Clues & Answer for Today: October 10
fossbytes.com·18h
🌳Trie Structures
how to use AI for market research (step by step breakdown):
threadreaderapp.com·7h
💳Content Monetization
October 10, 2025: Bellingcat Online Workshop on RuNet Investigations (4-hour) [Americas / Europe-friendly time]
bellingcat.com·23h
🤝NYC Tech Meetups
HiPRAG: Hierarchical Process Rewards for Efficient Agentic Retrieval Augmented Generation
arxiv.org·19h
🏗️LLM Infrastructure