Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
🗄️ Data Engineering
data pipelines, data lake, ETL, streaming data
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
276
posts in
7.4
ms
SDLC vs. AIDLC: Why
Data
Engineering
is Pushing the Boundaries of Software Development
🚀
MLOps
Content type:
Blog
medium.com
·
6d
6 days ago
Actions for SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development
Daily Deal: The 2026
Data
Engineering
Bundle featuring Databricks
🏗️
Platform Engineering
techdirt.com
·
1d
1 day ago
Actions for Daily Deal: The 2026 Data Engineering Bundle featuring Databricks
GetCassis/dbt-agent-readiness
: Audit a
dbt
project for what an
AI
agent will get wrong if you point it at the
data
today.
🔍
AI Observability
Content type:
Code
github.com
·
9h
9 hours ago
·
Hacker News
Actions for GetCassis/dbt-agent-readiness: Audit a dbt project for what an AI agent will get wrong if you point it at the data today.
Amazon MWAA Serverless now supports Amazon EventBridge notifications/
☁️
Cloud Infrastructure
aws.amazon.com
·
3h
3 hours ago
Actions for Amazon MWAA Serverless now supports Amazon EventBridge notifications/
What Went Wrong with
Data
Lakes
? A 15-Year Reality Check from the Field
🕸️
Distributed Systems
Content type:
Academic
arxiv.org
·
2d
2 days ago
Actions for What Went Wrong with Data Lakes? A 15-Year Reality Check from the Field
Open Table Format Explained: Features, Benefits, and Why It Matters in Modern
Data
Engineering
🏗️
Platform Engineering
Content type:
Blog
medium.com
·
7h
7 hours ago
Actions for Open Table Format Explained: Features, Benefits, and Why It Matters in Modern Data Engineering
Linux Fundamentals for
Data
Engineering
⚙️
Kernel Dev
dev-to-uploads.s3.amazonaws.com
·
3d
3 days ago
·
DEV
Actions for Linux Fundamentals for Data Engineering
DWH
Spark
MCP: Your Agent Can Read
Spark
History Now
💬
LLMs
Content type:
Blog
medium.com
·
8h
8 hours ago
Actions for DWH Spark MCP: Your Agent Can Read Spark History Now
Exclusive: MotherDuck adds agentic
data
ingestion to its cloud analytics service
☁️
Cloud Infrastructure
siliconangle.com
·
1d
1 day ago
Actions for Exclusive: MotherDuck adds agentic data ingestion to its cloud analytics service
I Bombed My First Python Screen: 9 Problems I Should Have Drilled
💬
LLMs
Content type:
Blog
dataexpert.medium.com
·
8h
8 hours ago
Actions for I Bombed My First Python Screen: 9 Problems I Should Have Drilled
Deep dive: How Lightning
Engine
delivers 4.9x faster
Apache
Spark
performance
☁️
Cloud Infrastructure
Content type:
Blog
cloud.google.com
·
1d
1 day ago
Actions for Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance
Run an
Apache
Airflow
DAG with Docker Compose and PostgreSQL
☸️
K8S
pyimagesearch.com
·
3d
3 days ago
Actions for Run an Apache Airflow DAG with Docker Compose and PostgreSQL
Data
Pipeline
Development: Building the Foundation of Modern
Data
Engineering
with SB Infowaves
🚀
MLOps
Content type:
Blog
medium.com
·
12h
12 hours ago
Actions for Data Pipeline Development: Building the Foundation of Modern Data Engineering with SB Infowaves
Introducing
Streamling
: Performant and Extensible
Data
Streaming
Framework
📡
Observability
Content type:
News
streamingdata.tech
·
2d
2 days ago
Actions for Introducing Streamling: Performant and Extensible Data Streaming Framework
Senior
Data
Engineer
– Climate Friendly
☁️
Cloud Infrastructure
au.seek.com
·
6d
6 days ago
·
Hacker News
,
Hacker News
Actions for Senior Data Engineer – Climate Friendly
Welcoming the first cohort of
Databricks
student fellows
🚀
MLOps
Content type:
Blog
databricks.com
·
2h
2 hours ago
Actions for Welcoming the first cohort of Databricks student fellows
Data
Modelling in 2026: The Five Paradigms Every Senior
Data
Engineer
Must Know
🤖
AI/ML
Content type:
Blog
medium.com
·
9h
9 hours ago
Actions for Data Modelling in 2026: The Five Paradigms Every Senior Data Engineer Must Know
Designing an
ETL
Application: Why I Started with a Modular Monolith Before Microservices
🏗️
Platform Engineering
Content type:
Blog
medium.com
·
1d
1 day ago
Actions for Designing an ETL Application: Why I Started with a Modular Monolith Before Microservices
Data
Agent Kit - I Explored GCS, Visualized
Data
, and Built a
Pipeline
Without Leaving My Editor
🏗️
Platform Engineering
Content type:
Blog
medium.com
·
18h
18 hours ago
Actions for Data Agent Kit - I Explored GCS, Visualized Data, and Built a Pipeline Without Leaving My Editor
New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
☁️
Cloud Infrastructure
Content type:
PDF
markokolarek.com
·
5d
5 days ago
·
Hacker News
Actions for New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
