🔗 Distributed Systems & Big Data Techniques

Sharding, Replication, Partitioning, Horizontal Scaling, Vertical Scaling, High Availability, Failover, Disaster Recovery, Hadoop, HDFS, Spark SQL, Hive, Pig, Presto, Flink, Kafka, Zookeeper, MapReduce, Columnstore, Rowstore

Unlocking Modern Risk & Compliance with Moody’s Risk Data Suite on the Databricks Data Intelligence Platform
databricks.com·5h
🏗️Data Engineering
Flag this post
Google wants to build solar-powered data centers — in space
semafor.com·8h
🌐Distributed Systems
Flag this post
How Bucket Forking Brings GitHub-Style Forking To Object Storage
thenewstack.io·1d
🔪Database Sharding
Flag this post
Thoughts on "Static Retrival Revisited"
curiouscoding.nl·1d
⚡Query Optimization
Flag this post
Lazy loading isn't the magic pill to fix AI Inference
tensorfuse-docs.mintlify.dev·11h·
Discuss: Hacker News
🌐Distributed Systems
Flag this post
🌍 Automating Africa’s Energy Data Collection Using Python, Playwright, and MongoDB (2000–2024)
dev.to·13h·
Discuss: DEV
🏗️Data Engineering
Flag this post
Detailed Technical Documentation on AI Implementation Logic (Taking Large Language Models as an Example )
nbtab.com·16h·
Discuss: DEV
🔀Transformers
Flag this post
Pg_lake: Postgres with Iceberg and data lake access
github.com·9h·
Discuss: Lobsters, Hacker News
💾Database
Flag this post
AWS Weekly Roundup: Project Rainier online, Amazon Nova, Amazon Bedrock, and more (November 3, 2025)
aws.amazon.com·1d
🌐Distributed Systems
Flag this post
Enhanced Anomaly Detection in Cryogenic Storage Unit Operations via Multi-Modal Data Fusion and Predictive Analytics
dev.to·17h·
Discuss: DEV
📈Time Series
Flag this post
CloudEvents as a Data Product
codesimple.blog·1d
🔍Query Languages & APIs
Flag this post
Building Data Tools That Work
blog.matterbeam.com·5h·
Discuss: Hacker News
🏗️Data Engineering
Flag this post
Quantum-Resistant Federated Learning: Implementing Post-Quantum Cryptography in Cross-Silo Model Aggregation
dev.to·16h·
Discuss: DEV
🌐Distributed Systems
Flag this post
Integration Digest for October 2025
dev.to·1d·
Discuss: DEV
🏗️Data Engineering
Flag this post
Real-time stock volatility prediction with deep learning on a time-series DB
medium.com·17h·
Discuss: Hacker News
💾Database
Flag this post
The Evolving Role of a Solutions Architect
linkedin.com·1d·
Discuss: DEV
🌐Distributed Systems
Flag this post
Automating FinOps cost management policies using Workload Manager
cloud.google.com·8h
🔍Query Languages & APIs
Flag this post
A Soft‑Fork Proposal for Blockchain‑Based Distributed AI Computation
hackernoon.com·1d
🌐Distributed Systems
Flag this post
Fix: externalizing network I/O in serverless computing
arxiv.org·20h·
Discuss: Hacker News
🌐Distributed Systems
Flag this post
How Data 360 Vector Search Delivers Near Real-Time Intelligence on 90% of Enterprise Data
engineering.salesforce.com·1d
🏗️Data Engineering
Flag this post