Why Your Chunking Strategy Makes or Breaks Your AI System
medium.com·5d·
Discuss: Hacker News
📄Text Chunking
ByteSpan: Information-Driven Subword Tokenisation
arxiv.org·1d
💾Binary Linguistics
davidchisnall/igk: I got Knuth'd: A compiler for documents
github.com·16h
📝Concrete Syntax
Machine Learning Fundamentals: active learning
dev.to·1d·
Discuss: DEV
🤖Grammar Induction
Which Vision Language Models Should You Use for Your Apps
thenewstack.io·2d
🤖Advanced OCR
Markov-Enhanced Clustering for Long Document Summarization: Tackling the 'Lost in the Middle' Challenge with Large Language Models
arxiv.org·1d
📄Text Chunking
New: Improve Apache Iceberg query performance in Amazon S3 with sort and z-order compaction
aws.amazon.com·1d
🔄Burrows-Wheeler
Agentic AI: Implementing Long-Term Memory
towardsdatascience.com·1d
💾Persistence Strategies
PDF Retrieval Augmented Question Answering
arxiv.org·1d
📊Multi-vector RAG
Contextualizing SUTRA: Advancements in Multilingual & Efficient LLMs
hackernoon.com·7h
💻Local LLMs
Could Open Table Formats End the Reign of Snowflake and Databricks?
prequel.co·5h·
Discuss: Hacker News
📚MARC Evolution
The Bitter Lesson is coming for Tokenization
lucalp.dev·1d·
Discuss: Lobsters, Hacker News, r/programming
🔗Monadic Parsing
V2T-CoT: From Vision to Text Chain-of-Thought for Medical Reasoning and Diagnosis
arxiv.org·19h
🤖Advanced OCR
Clustering News Articles for Topic Detection: A Technical Deep Dive
dev.to·3d·
Discuss: DEV
📚Document Clustering
StoryGem: Voronoi treemap Approach for Semantics-Preserving Text Visualization
arxiv.org·1d
🔶Voronoi Diagrams
Semantic-Aware Parsing for Security Logs
arxiv.org·1d
📝Log Parsing
Using an LLM for query planning in RAG –> 40% better answer relevance
techcommunity.microsoft.com·1d·
Discuss: Hacker News
🔍Information Retrieval
BPCLIP: A Bottom-up Image Quality Assessment from Distortion to Semantics Based on CLIP
arxiv.org·1d
🖼️JPEG XL
Automattic/harper: Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
github.com·1d
📝Concrete Syntax
Text2Struct: A Machine Learning Pipeline for Mining Structured Data from Text
arxiv.org·1d
🔤Character Classification