📄 Text Chunking

Semantic Segmentation, Context Windows, Document Boundaries, Retrieval Units

Why Your Chunking Strategy Makes or Breaks Your AI System
medium.com·5d·
Discuss: Hacker News
📄Semantic Chunking
StoryGem: Voronoi treemap Approach for Semantics-Preserving Text Visualization
arxiv.org·1d
🔶Voronoi Diagrams
davidchisnall/igk: I got Knuth'd: A compiler for documents
github.com·17h
📝Concrete Syntax
Which Vision Language Models Should You Use for Your Apps
thenewstack.io·2d
🤖Advanced OCR
Contextualizing SUTRA: Advancements in Multilingual & Efficient LLMs
hackernoon.com·7h
💻Local LLMs
Inverse text-sizing based on text-length with attr()
daverupert.com·9h
🖋Typography
Clustering News Articles for Topic Detection: A Technical Deep Dive
dev.to·3d·
Discuss: DEV
📚Document Clustering
How to Prove That An Email Was Received
metaspike.com·4h
📄Document Digitization
New: Improve Apache Iceberg query performance in Amazon S3 with sort and z-order compaction
aws.amazon.com·1d
🔄Burrows-Wheeler
ByteSpan: Information-Driven Subword Tokenisation
arxiv.org·1d
💾Binary Linguistics
June 25, 2025 Flight Tracking Workshop (4 hour) [Americas / Europe-friendly time]
bellingcat.com·23h
🧮Prolog Parsing
JupyterLab-PKM 0.1.12
electricarchaeology.ca·5h
🌀Brotli Internals
Markov-Enhanced Clustering for Long Document Summarization: Tackling the 'Lost in the Middle' Challenge with Large Language Models
arxiv.org·1d
📥Feed Aggregation
Agentic AI: Implementing Long-Term Memory
towardsdatascience.com·1d
💾Persistence Strategies
Detecting Machine-Generated Texts: Not Just "AI vs Humans" and Explainability is Complicated
arxiv.org·19h
🧮Kolmogorov Complexity
Practical tips to optimize documentation for LLMs, AI agents, and chatbots
biel.ai·1d·
Discuss: Hacker News
🤖Archive Automation
The modern text processing pipeline: Overview
newroadoldway.com·2d·
Discuss: Lobsters, r/programming
🔤Unicode Normalization
Portable Network Graphics (PNG) Specification (Third Edition)
w3.org·1d·
Discuss: Hacker News
🕸️WebP Analysis
Automattic/harper: Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
github.com·1d
📝Concrete Syntax
The Bitter Lesson is coming for Tokenization
lucalp.dev·1d·
Discuss: Lobsters, Hacker News, r/programming
🔗Monadic Parsing