🔗 Distributed Systems & Big Data Techniques

Sharding, Replication, Partitioning, Horizontal Scaling, Vertical Scaling, High Availability, Failover, Disaster Recovery, Hadoop, HDFS, Spark SQL, Hive, Pig, Presto, Flink, Kafka, Zookeeper, MapReduce, Columnstore, Rowstore

From Lists to Structured Data: A Transformation Guide
haarisekou200207.webbuzzfeed.com·5h
🏗️Data Engineering
Flag this post
Evolving Ray and Kubernetes together for the future of distributed AI and ML
cloud.google.com·1d
🌐Distributed Systems
Flag this post
11X Faster ScyllaDB Backup
scylladb.com·5h·
Discuss: Hacker News
🔪Database Sharding
Flag this post
Academic Paper: How CockroachDB Cloud Delivers Affordable, Resilient, and Globally Scalable Databases
cockroachlabs.com·2d
🔪Database Sharding
Flag this post
Context Engineering with Real-Time, Processed Data
confluent.io·3h·
Discuss: Hacker News
🏗️Data Engineering
Flag this post
Ensuring Data Resilience in Modern Application Environments
trilio.io·2d·
Discuss: DEV
🔪Database Sharding
Flag this post
7 Essential Java Kafka Techniques for Building Reliable Event-Driven Systems That Scale
dev.to·1d·
Discuss: DEV
🏗️Data Engineering
Flag this post
Wärtsilä Energy Storage Announces GEMS Pulse, A Predictive Analytics Solution
cleantechnica.com·1d
📈Time Series
Flag this post
High-Throughput HPLC Method Optimization via Bayesian Neural Network & Predictive Maintenance
dev.to·1h·
Discuss: DEV
🔧Feature Engineering
Flag this post
Architectural Patterns for Securing Data: At Rest, In Transit, and At Runtime
dev.to·1d·
Discuss: DEV
🌐Distributed Systems
Flag this post
Scaling up Prime Video monitoring service reduced costs 90% (archive) (2023)
web.archive.org·1d·
Discuss: Hacker News
🌐Distributed Systems
Flag this post
Cutting LLM Batch Inference Time in Half: Dynamic Prefix Bucketing at Scale
daft.ai·13h·
Discuss: Hacker News
⚡Query Optimization
Flag this post
Self-Healing File-Based Databroker Without The Postgres Headaches
dev.to·15h·
Discuss: DEV
🌐Distributed Systems
Flag this post
Is Your Data Stuck in the Cloud? Edge Computing to the Rescue!
dev.to·1d·
Discuss: DEV
📊OLAP
Flag this post
HashiCorp at AWS re:Invent: Accelerate every step of your cloud journey
hashicorp.com·13h
🌐Distributed Systems
Flag this post
Training: Postgres Performance and Maintenance
postgresconf.org·1d·
Discuss: Hacker News
💾Database
Flag this post
Understanding Security, Backup & Compliance in a Database as a Service Model
metizsoftinc.com·1d·
Discuss: DEV
🔪Database Sharding
Flag this post
Navigating The Next Era Of Digital Investigations: A Thought Leadership Perspective
forensicfocus.com·1d
📊OLAP
Flag this post
Design-Based Supply Chain Operations Research Model: Fostering Resilience And Sustainability In Modern Supply Chains
arxiv.org·1h
🌐Distributed Systems
Flag this post
We built a collaboration platform on Claude Code. Here's what we learned.
gbase.ai·6h·
Discuss: r/ClaudeAI
🏗️Data Engineering
Flag this post