Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
🔧 Data Engineering
data pipelines, ETL, data lakes, Apache Spark
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
266
posts in
4.4
ms
Best
Data
Engineering
Courses in 2026
📊
Query Optimization
Content type:
Blog
dataquest.io
·
6d
6 days ago
Actions for Best Data Engineering Courses in 2026
Calculating speed estimates with
Apache
Spark
⚡
Parallel Computing
Content type:
Blog
mapbox.com
·
2d
2 days ago
Actions for Calculating speed estimates with Apache Spark
Daily Deal: The 2026
Data
Engineering
Bundle featuring Databricks
🏎️
ClickHouse
techdirt.com
·
24m
24 minutes ago
Actions for Daily Deal: The 2026 Data Engineering Bundle featuring Databricks
LakeQA
: An Exploratory QA Benchmark over a Million-Scale
Data
Lake
📈
Performance
Content type:
Academic
arxiv.org
·
14h
14 hours ago
Actions for LakeQA: An Exploratory QA Benchmark over a Million-Scale Data Lake
Run an
Apache
Airflow
DAG with Docker Compose and PostgreSQL
📊
Query Optimization
pyimagesearch.com
·
2d
2 days ago
Actions for Run an Apache Airflow DAG with Docker Compose and PostgreSQL
SDLC vs. AIDLC: Why
Data
Engineering
is Pushing the Boundaries of Software Development
🏛️
Software Architecture
Content type:
Blog
medium.com
·
5d
5 days ago
Actions for SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development
Designing an
ETL
Application: Why I Started with a Modular Monolith Before Microservices
🗄️
Database Internals
Content type:
Blog
medium.com
·
9h
9 hours ago
Actions for Designing an ETL Application: Why I Started with a Modular Monolith Before Microservices
Exclusive: MotherDuck adds agentic
data
ingestion to its cloud analytics service
🗄️
SQLite
siliconangle.com
·
5h
5 hours ago
Actions for Exclusive: MotherDuck adds agentic data ingestion to its cloud analytics service
Announcing general availability of
Apache
Spark
4.0 on Amazon EMR
🗄️
Databases
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Announcing general availability of Apache Spark 4.0 on Amazon EMR
Introducing Flights: Agent-Native Ingest in MotherDuck
🔭
Observability
Content type:
Blog
motherduck.com
·
18h
18 hours ago
Actions for Introducing Flights: Agent-Native Ingest in MotherDuck
It's official: Fivetran +
dbt
Labs merge to build the
data
foundation for trustworthy
AI
agents (Sponsor)
📈
Performance
fivetran.com
·
6d
6 days ago
Actions for It's official: Fivetran + dbt Labs merge to build the data foundation for trustworthy AI agents (Sponsor)
Linux Fundamentals for
Data
Engineering
🐧
Linux
dev-to-uploads.s3.amazonaws.com
·
2d
2 days ago
·
DEV
Actions for Linux Fundamentals for Data Engineering
Enhancements to Managed Service for
Apache
Spark
clusters
🗄️
Databases
Content type:
Blog
cloud.google.com
·
6d
6 days ago
Actions for Enhancements to Managed Service for Apache Spark clusters
Introducing Streamling: Performant and Extensible
Data
Streaming Framework
🦀
Rust
Content type:
News
streamingdata.tech
·
1d
1 day ago
Actions for Introducing Streamling: Performant and Extensible Data Streaming Framework
Microsoft just shared the frontier
data
engineering
secrets
🚀
High Performance Computing
mail.bycloud.ai
·
22h
22 hours ago
Actions for Microsoft just shared the frontier data engineering secrets
Do
data
quality frameworks have to be so complex?
🏎️
ClickHouse
sparkdq-community.github.io
·
5d
5 days ago
·
r/Python
Actions for Do data quality frameworks have to be so complex?
Claude Code for Research: Preventing Hallucinations
💻
Computer Science
Content type:
News
Content type:
Blog
homeeconomics.substack.com
·
2d
2 days ago
·
Substack
Actions for Claude Code for Research: Preventing Hallucinations
CSU Student of Distinction: Anthony Arthur
💻
Computer Science
Content type:
Academic
csuohio.edu
·
7h
7 hours ago
Actions for CSU Student of Distinction: Anthony Arthur
Senior
Data
Engineer
– Climate Friendly
🏎️
ClickHouse
au.seek.com
·
5d
5 days ago
·
Hacker News
,
Hacker News
Actions for Senior Data Engineer – Climate Friendly
Gene dependency-informed inference of response to targeted cancer therapies
🗃️
Vector Databases
Content type:
Academic
nature.com
·
2d
2 days ago
Actions for Gene dependency-informed inference of response to targeted cancer therapies
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help