Distributed Systems & Big Data Techniques

Sharding, Replication, Partitioning, Horizontal Scaling, Vertical Scaling, High Availability, Failover, Disaster Recovery, Hadoop, HDFS, Spark SQL, Hive, Pig, Presto, Flink, Kafka, Zookeeper, MapReduce, Columnstore, Rowstore

Feeds to Scour
SubscribedAll
Scoured 324 posts in 8.1 ms

When failover isn’t safe: Building high-availability PostgreSQL on Kubernetes

 💾Database  Content type: Blog
datadoghq.com·

Real-time data replication to your data warehouse, self-serve

 🏗️Data Engineering

Linearizability and State-Machine Replication: Is It a Match?

 🌐Distributed Systems  Content type: Academic
arxiv.org··Hacker News

Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance

 🏗️Data Engineering  Content type: Blog
cloud.google.com·

Beyond Dual Writes: Microservice Integration Strategies

 💾Database  Content type: Blog
medium.com·

Franz

 🏗️Data Engineering
flathub.org·

Snowflake Datastream: Kafka-native streaming in Snowflake

 🏗️Data Engineering
snowflake.com··Hacker News

Kafka Share Groups and Parallelizing Consumption - Part 3: Client-local parallelism

 🏗️Data Engineering  Content type: Blog
jack-vanlightly.com·

Calculating speed estimates with Apache Spark

 🏗️Data Engineering  Content type: Blog
mapbox.com·

Deploy ADX Business on DigitalOcean

 🤖AI
digitalocean.com·

Introducing Streamling: Performant and Extensible Data Streaming Framework

 🏗️Data Engineering  Content type: News
streamingdata.tech·

Microservices Patterns: Architecture and Implementation

 🌐Distributed Systems  Content type: Blog
danimai.medium.com·

Real-time CDC from Aurora PostgreSQL to Amazon S3 Tables using Debezium and Firehose

 💾Database  Content type: Blog
aws.amazon.com·

Location: Edmonton, Canada Remote: Yes Willing to relocate: Yes, within Canada T...

 💾Database  Content type: Discussion

Metamorphosis by Franz Kafka

 🏗️Data Engineering  Content type: Reference
gutenberg.org·

apvcode/pocketsentry: The 18MB drop-in Sentry alternative for self-hosters.

 🗄Databases  Content type: Code
github.com··Hacker News

Our first customers were the exception

 🌐Distributed Systems  Content type: Blog

Presentation: Beyond Prompting: Context Engineering and Memory Management for AI Systems at Scale

 🏗️Data Engineering  Content type: News
infoq.com
·

New comment by curiouser12 in "Ask HN: Who wants to be hired? (June 2026)"

 💾Database

New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"

 🏗️Data Engineering  Content type: PDF

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help