Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
⚙️ Data Engineering
ETL, Data Pipelines, Data Warehousing, Data Processing
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
220
posts in
10.7
ms
Why the Modern
Data
Stack Trapped
Data
Engineers
in Tools
🗄️
Database Design
hackernoon.com
·
1d
1 day ago
Actions for Why the Modern Data Stack Trapped Data Engineers in Tools
Snowflake
thinks it knows what’s really slowing developers down
📡
Event-Driven Architecture
thenewstack.io
·
6d
6 days ago
Actions for Snowflake thinks it knows what’s really slowing developers down
Modern
Data
Stack Migration — Day 1: Scaling to 8+ Companies with DRY Architecture and Chasing a $2M Discrepancy
🔧
Developer Tools
Content type:
Blog
dev.to
·
8h
8 hours ago
·
DEV
Actions for Modern Data Stack Migration — Day 1: Scaling to 8+ Companies with DRY Architecture and Chasing a $2M Discrepancy
What Went Wrong with
Data
Lakes
? A 15-Year Reality Check from the Field
🌍
Distributed Systems
Content type:
Academic
arxiv.org
·
1d
1 day ago
Actions for What Went Wrong with Data Lakes? A 15-Year Reality Check from the Field
Introducing Flights: Agent-Native Ingest in MotherDuck
🐘
PostgreSQL
Content type:
Blog
motherduck.com
·
20h
20 hours ago
Actions for Introducing Flights: Agent-Native Ingest in MotherDuck
Snowflake
Datastream
:
Kafka-native
streaming in
Snowflake
📡
Event-Driven Architecture
snowflake.com
·
6d
6 days ago
·
Hacker News
Actions for Snowflake Datastream: Kafka-native streaming in Snowflake
Linux Fundamentals for
Data
Engineering
🐧
Linux
dev-to-uploads.s3.amazonaws.com
·
2d
2 days ago
·
DEV
Actions for Linux Fundamentals for Data Engineering
Snowflake
Just Dropped CoCo Desktop. Here Is What Actually Changed
🔧
Developer Tools
pub.towardsai.net
·
5d
5 days ago
Actions for Snowflake Just Dropped CoCo Desktop. Here Is What Actually Changed
Real-time
data
replication to your
data
warehouse
, self-serve
📡
Event-Driven Architecture
artie.com
·
1d
1 day ago
·
Hacker News
,
Hacker News
Actions for Real-time data replication to your data warehouse, self-serve
Senior
Data
Engineer
– Climate Friendly
🔄
DevOps
au.seek.com
·
5d
5 days ago
·
Hacker News
,
Hacker News
Actions for Senior Data Engineer – Climate Friendly
Announcing general availability of
Apache
Spark
4.0 on Amazon EMR
📉
Data Science
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Announcing general availability of Apache Spark 4.0 on Amazon EMR
lorenzopompili/jbmp: High-throughput BGP Monitoring Protocol (BMP) collector platform for the JVM.
☕
Java
Content type:
Code
github.com
·
2d
2 days ago
·
DEV
,
Hacker News
Actions for lorenzopompili/jbmp: High-throughput BGP Monitoring Protocol (BMP) collector platform for the JVM.
Using local ClickHouse for
data
processing
🗄️
Database Design
Content type:
Blog
rushter.com
·
5d
5 days ago
·
r/programming
Actions for Using local ClickHouse for data processing
Our first customers were the exception
🌊
Stream Processing
Content type:
Blog
apurvamehta.com
·
5d
5 days ago
·
Hacker News
Actions for Our first customers were the exception
Broker-Visible vs Client-Local Parallelism
📡
Event-Driven Architecture
Content type:
Blog
jack-vanlightly.com
·
6d
6 days ago
·
Lobsters
Actions for Broker-Visible vs Client-Local Parallelism
The TechBeat:
Kafka
Won’t Save Your Architecture If You Don’t Understand Coupling (6/10/2026)
📡
Event-Driven Architecture
hackernoon.com
·
6h
6 hours ago
Actions for The TechBeat: Kafka Won’t Save Your Architecture If You Don’t Understand Coupling (6/10/2026)
Apache
Kafka
Explained: A Practical Beginner Guide for
Data
Engineers
📡
Event-Driven Architecture
Content type:
Blog
dev.to
·
1d
1 day ago
·
DEV
Actions for Apache Kafka Explained: A Practical Beginner Guide for Data Engineers
The Considerate
Data
Modeler
🗄️
Databases
oranlooney.com
·
6d
6 days ago
·
Hacker News
Actions for The Considerate Data Modeler
Connections, Roles, and
Warehouses
: Getting CoCo Desktop Production-Ready from Day One
🔧
Developer Tools
pub.towardsai.net
·
2d
2 days ago
Actions for Connections, Roles, and Warehouses: Getting CoCo Desktop Production-Ready from Day One
“Whoever builds the most joyous product wins”: The agent
war
begins
⚙️
Compilers
thenewstack.io
·
4d
4 days ago
Actions for “Whoever builds the most joyous product wins”: The agent war begins
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
