From Hours to Minutes: How Dmall Cuts Data Integration Costs to 1/3 with Apache SeaTunnel?
dev.to·13h·
Discuss: DEV
🏗data engineering
Proposal: Deconfig – Distributed Git Infrastructure with Durable Objects
github.com·22h·
Discuss: Hacker News
⚡DataFusion
Building a real-time ICU patient analytics pipeline with AWS Lambda event source mapping
aws.amazon.com·10m
⏱️Real-time Analytics
Storage news ticker – October 10
blocksandfiles.com·12h
📊Column Stores
Zelos Tech Manages Hundreds of Millions of Files for Autonomous Driving with JuiceFS
dev.to·15h·
Discuss: DEV
🗄️Storage Tiering
Introducing GenosDB: a P2P Graph Database with Built-In Zero-Trust Security
reddit.com·1h·
Discuss: r/opensource
🏞️Delta Lake
Why Do Data Pipelines Need Streaming — Isn’t Batch Processing Enough?
linkedin.com·17h·
Discuss: DEV
🌊Stream Processing
N8n vs. Windmill vs. Temporal
blog.arcbjorn.com·22h·
Discuss: Hacker News
📊Columnar Engines
Building Scalable Multi-Tenant Integrations: Lessons from Real-World SaaS Projects
genesistechnologies.in·11h·
Discuss: DEV
⚡DataFusion
TCDRM: A Tenant Budget-Aware Data Replication Framework for Multi-Cloud Computing
arxiv.org·18h
🗄️Storage Tiering
SQL is King, But is it Your Only Ruler? A Developer's Guide to NoSQL
dev.to·9h·
Discuss: DEV
💾Databases
Understanding conflict resolution and avoidance in PostgreSQL: a complete guide
pgedge.com·2h·
Discuss: r/programming
💾Databases
Building a Production-Ready E-Commerce Platform with NestJS
dev.to·5h·
Discuss: DEV
⚡DataFusion
Finding the Path for Integrating Kubernetes With Existing VMs
thenewstack.io·9h
👁️Observability
World's largest hard drive on sale drops to its cheapest price ever just after Amazon Prime Day - 30TB Seagate Exos costs only $18.80/TB
techradar.com·6h
🗄️Storage Tiering
Debugging Humidity: Lessons from deploying software in the physical world
physical-ai.ghost.io·2h·
Discuss: Hacker News
👁️Observability
LoongCollector: Building a New Paradigm for Data Collection in the Intelligent Era
dev.to·18h·
Discuss: DEV
👁️Observability
10 Data + AI Observations for Fall 2025
towardsdatascience.com·8h
📊Data Lineage
From Permanent Access to Just-in-Time: A Startup's IAM Journey Part 1
cybernews.com·12h·
Discuss: DEV
🗄️Storage Tiering
End-to-End YouTube Channel Analytics Pipeline
dev.to·8h·
Discuss: DEV
🏗data engineering