⚡ DataFusion

Apache Arrow, Query Engine, Rust Analytics, Columnar Processing

[P] Semlib: LLM-powered Data Processing
reddit.com·19h·
Discuss: r/MachineLearning
⚙️Query Compilers
Forging Data Symphonies: The Art of the ETL Pipeline in Rails
github.com·12h·
Discuss: DEV
🧊Iceberg Tables
Open-Sourcing Starlark Worker: Define Cadence Workflows with Starlark
uber.com·21h·
Discuss: Hacker News
📊Columnar Engines
My 18-Month Journey Building a SaaS App
dev.to·20h·
Discuss: DEV
🗂️HDF5
The Data Backbone of LLM Systems
infoq.com·18h·
Discuss: Lobsters
⚙️Query Compilers
Optimizing 100B ClickHouse Events
replo.computer·6h·
Discuss: Hacker News
⚡ClickHouse
Dispelling Myths of Open Source Complexity With Apache Iceberg
thenewstack.io·18h
🧊Iceberg Tables
Flexynesis: A deep learning toolkit for bulk multi-omics data integration for precision oncology and beyond
nature.com·1h
🧬Bioinformatics
Graph rag pipeline that runs entirely locally with ollama and has full source attribution
reddit.com·17m·
Discuss: r/programming
🏗data engineering
Accelerate serverless testing with LocalStack integration in VS Code IDE
aws.amazon.com·17h
📋Tokei
MetaRAG: Metamorphic Testing for Hallucination Detection in RAG Systems
arxiv.org·7h
📇Indexing Strategies
Automating multi-language SDK doc generation with testable code snippets
docs.hatchet.run·12h·
Discuss: Hacker News
📋Tokei
EdgeBERT: I Built My Own Neural Network Inference Engine in Rust
dev.to·30m·
Discuss: DEV
🦀Rust Scientific
Microsoft drops .NET 10 RC 'go-live' with 55,000 words on why it's faster
theregister.com·18h
⚙️Query Compilers
StringTape: Apache Arrow-compatible space-efficient "tape" class in pure Rust
github.com·16h·
Discuss: Hacker News
🦀Rust Scientific
Unweaving Warp Specialization on Modern Tensor Core GPUs
rohany.github.io·19h·
Discuss: Hacker News
📊Columnar Engines
Spiral
spiraldb.com·19h·
Discuss: Hacker News
🧊Iceberg Tables
Three tiny Go web-server experiments: exposing, executing, and extending
reddit.com·17h·
Discuss: r/golang
🏛️Lakehouse Architecture
How Skello uses Amazon Bedrock to query data in a multi-tenant environment while keeping logical boundaries
aws.amazon.com·17h
📊Data Lineage
Issue 489
haskellweekly.news·23h·
Discuss: Hacker News
🔧Functional Programming