🔗 Distributed Systems & Big Data Techniques

Sharding, Replication, Partitioning, Horizontal Scaling, Vertical Scaling, High Availability, Failover, Disaster Recovery, Hadoop, HDFS, Spark SQL, Hive, Pig, Presto, Flink, Kafka, Zookeeper, MapReduce, Columnstore, Rowstore

How Datadog Built a Custom Database to Ingest Billions of Metrics Per Second
blog.bytebytego.com·1h
⚡Query Optimization
Flag this post
Scaling data governance with Amazon DataZone: Covestro success story
aws.amazon.com·19h
🏗️Data Engineering
Flag this post
Building Resilient Event-Driven Systems: Lessons from the Distributed Trenches
dev.to·9h·
Discuss: DEV
🌐Distributed Systems
Flag this post
Data Observability in Analytics: Tools, Techniques, and Why It Matters
kdnuggets.com·3h
🏗️Data Engineering
Flag this post
DSQL: Keeping Your Pager Quiet
brooker.co.za·2d
💾Database
Flag this post
Securing the Wireless Perimeter: Modern Threats to AI, Hyperscale, Enterprise, and Classified Data Centers Part 2
bastille.net·9h
🌐Distributed Systems
Flag this post
DCcluster-Opt: Benchmarking Dynamic Multi-Objective Optimization for Geo-Distributed Data Center Workloads
arxiv.org·11h
🌐Distributed Systems
Flag this post
Building UnisonDB a DynamoDB-Inspired Database in Go with 100+ Edge Replication
reddit.com·2d·
Discuss: r/golang
💾Database
Flag this post
I Processed the Internet on a Single Machine to Find Valuable Expired Domains
blog.mbrt.dev·3h·
Discuss: Hacker News
⚡Query Optimization
Flag this post
The Infrastructure of Modern Ran king Systems, Part 2: The Data Layer - Fueling the Models with Feature and Vector Stores
shaped.ai·1d
🔧Feature Engineering
Flag this post
EMQ Introduces EMQX Tables: A Native Time-Series Database for IoT Data
prnewswire.com·3h
🏗️Data Engineering
Flag this post
On Designing Low-Latency Systems for High-Traffic Environments
hackernoon.com·1d
🌐Distributed Systems
Flag this post
"You Don't Need Kafka, Just Use Postgres" Considered Harmful
morling.dev·23h·
Discuss: Lobsters, Hacker News
🏗️Data Engineering
Flag this post
Storage news ticker – 3 November 2025
blocksandfiles.com·23h
🔪Database Sharding
Flag this post
Academic Paper: How CockroachDB Cloud Delivers Affordable, Resilient, and Globally Scalable Databases
cockroachlabs.com·1d
🔪Database Sharding
Flag this post
Evolving Ray and Kubernetes together for the future of distributed AI and ML
cloud.google.com·23h
🌐Distributed Systems
Flag this post
7 Essential Java Kafka Techniques for Building Reliable Event-Driven Systems That Scale
dev.to·18h·
Discuss: DEV
🏗️Data Engineering
Flag this post
Wärtsilä Energy Storage Announces GEMS Pulse, A Predictive Analytics Solution
cleantechnica.com·1d
📈Time Series
Flag this post
Ensuring Data Resilience in Modern Application Environments
trilio.io·1d·
Discuss: DEV
🔪Database Sharding
Flag this post
Architectural Patterns for Securing Data: At Rest, In Transit, and At Runtime
dev.to·11h·
Discuss: DEV
🌐Distributed Systems
Flag this post