Distributed Systems & Big Data Techniques

🔗 Distributed Systems & Big Data Techniques

Sharding, Replication, Partitioning, Horizontal Scaling, Vertical Scaling, High Availability, Failover, Disaster Recovery, Hadoop, HDFS, Spark SQL, Hive, Pig, Presto, Flink, Kafka, Zookeeper, MapReduce, Columnstore, Rowstore

Feeds to Scour
SubscribedAll
Scoured 318 posts in 4.5 ms

FlashCP: Load-Balanced Communication-Efficient Context Parallelism for LLM Training

 🗃Database Models & Concepts  Content type: Academic
arxiv.org·

Snowflake Datastream: Kafka-native streaming in Snowflake

 🏗️Data Engineering
snowflake.com··Hacker News

Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance

 🏗️Data Engineering  Content type: Blog
cloud.google.com·

Franz

 🏗️Data Engineering
flathub.org·

Beyond Dual Writes: Microservice Integration Strategies

 💾Database  Content type: Blog
medium.com·

Microservices Patterns: Architecture and Implementation

 🌐Distributed Systems  Content type: Blog
danimai.medium.com·

Real-time data replication to your data warehouse, self-serve

 🏗️Data Engineering
artie.com··Hacker News, Hacker News

Real-time CDC from Aurora PostgreSQL to Amazon S3 Tables using Debezium and Firehose

 💾Database  Content type: Blog
aws.amazon.com·

Location: Edmonton, Canada Remote: Yes Willing to relocate: Yes, within Canada T...

 💾Database  Content type: Discussion
news.ycombinator.com··Hacker News

Calculating speed estimates with Apache Spark

 🏗️Data Engineering  Content type: Blog
mapbox.com·

apvcode/pocketsentry: The 18MB drop-in Sentry alternative for self-hosters.

 🗄Databases  Content type: Code
github.com··Hacker News

Our first customers were the exception

 🌐Distributed Systems  Content type: Blog
apurvamehta.com··Hacker News

Introducing Streamling: Performant and Extensible Data Streaming Framework

 🏗️Data Engineering  Content type: News
streamingdata.tech·

Presentation: Beyond Prompting: Context Engineering and Memory Management for AI Systems at Scale

 🏗️Data Engineering  Content type: News
infoq.com
·

Kafka Share Groups and Parallelizing Consumption - Part 3: Client-local parallelism

 🏗️Data Engineering  Content type: Blog
jack-vanlightly.com·

New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"

 🏗️Data Engineering  Content type: PDF
markokolarek.com··Hacker News

The Server That Does Nothing Is Often the Most Critical

 🌐Distributed Systems
siliconopera.com·

Deploy ADX Business on DigitalOcean

 🤖AI
digitalocean.com·

Why Service Maps Are Replacing Traditional Observability in 2026

 🌐Distributed Systems  Content type: Blog
cloudwithazeem.medium.com
·

Modular: Modverse #55: Mojo 1.0 Beta, Community Mojo Libraries, and Real-Time Patient Conversations Powered by MAX

 🤖AI  Content type: Blog
modular.com·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help