The Bitter Lesson is coming for Tokenization
lucalp.dev·1d·
Discuss: Lobsters, Hacker News, r/programming
🔗Monadic Parsing
SUTRA: Decoupling Concept & Language for Multilingual LLM Excellence
hackernoon.com·2h
💻Local LLMs
Launch HN: Reducto Studio (YC W24) – Build accurate document pipelines, fast
news.ycombinator.com·2d·
Discuss: Hacker News
🌀Brotli Internals
Best Ways to Translate Documents Online Using AI – Secure OCR, Layout Retention, and Top Tools Compared
dev.to·3d·
Discuss: DEV
🤖AI Translation
PEGTL -- Parsing Expression Grammar Template Library
github.com·19h·
Discuss: Hacker News
🔗Parser Combinators
QuranMorph: Morphologically Annotated Quranic Corpus
arxiv.org·1d
📋Document Grammar
The one-more-re-nightmare compiler (2021)
applied-langua.ge·1d·
Discuss: Lobsters, r/programming
🔍RegEx Engines
10 FREE AI Tools That’ll Save You 10+ Hours a Week
kdnuggets.com·6h
🎙️Whisper
PDF Retrieval Augmented Question Answering
arxiv.org·1d
📊Multi-vector RAG
ByteSpan: Information-Driven Subword Tokenisation
arxiv.org·1d
💾Binary Linguistics
Computational Approaches to Understanding Large Language Model Impact on Writing and Information Ecosystems
arxiv.org·1d
📜Digital Philology
StainPIDR: A Pathological Image Decouplingand Reconstruction Method for StainNormalization Based on Color VectorQuantization and Structure Restaining
arxiv.org·1d
📄OCR
Named Entity Recognition using Bidirectional LSTM and Conditional Random Fields
dev.to·3d·
Discuss: DEV
🤖Grammar Induction
Patterns for Compounding the Value of LLM interactions
spin.atomicobject.com·6h·
Discuss: Hacker News
🔗Constraint Handling
Semantic-Aware Parsing for Security Logs
arxiv.org·1d
📝Log Parsing
LongWriter-Zero: Mastering Ultra-Long Text Generation via Reinforcement Learning
arxiv.org·1d
📝Concrete Syntax
The Internal Inconsistency of Large Language Models
blog.kortlepel.com·1d·
Discuss: Hacker News
💻Local LLMs
OpenAI's Codex Aims to Ease Programmers' Headaches
hackernoon.com·13h
🤖Archive Automation
Statistical Multicriteria Evaluation of LLM-Generated Text
arxiv.org·1d
📋Document Grammar
Mind the Gap: Assessing Wiktionary's Crowd-Sourced Linguistic Knowledge on Morphological Gaps in Two Related Languages
arxiv.org·1d
🔤Morphological Analysis