Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
🔧 Data Engineering
data pipelines, ETL, data warehouse, Apache Spark
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
202
posts in
6.6
ms
SDLC vs. AIDLC: Why
Data
Engineering
is Pushing the Boundaries of Software Development
🤖
Agentic AI
Content type:
Blog
medium.com
·
5d
5 days ago
Actions for SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development
Calculating speed estimates with
Apache
Spark
📊
Data Science
Content type:
Blog
mapbox.com
·
2d
2 days ago
Actions for Calculating speed estimates with Apache Spark
Deep dive: How Lightning
Engine
delivers 4.9x faster
Apache
Spark
performance
🤖
AI Agents
Content type:
Blog
cloud.google.com
·
5h
5 hours ago
Actions for Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance
Daily Deal: The 2026
Data
Engineering
Bundle featuring Databricks
🐍
Python
techdirt.com
·
6h
6 hours ago
Actions for Daily Deal: The 2026 Data Engineering Bundle featuring Databricks
Why
Snowflake
Matters Now More Than Ever
🤖
Agentic AI
Content type:
News
Content type:
Blog
clouddb.substack.com
·
2d
2 days ago
·
Substack
Actions for Why Snowflake Matters Now More Than Ever
Designing an
ETL
Application: Why I Started with a Modular Monolith Before Microservices
🖥️
Homelab
Content type:
Blog
medium.com
·
14h
14 hours ago
Actions for Designing an ETL Application: Why I Started with a Modular Monolith Before Microservices
1セント未満で実現するTPC-H:ClickHouse Cloud vs.
Snowflake
、
Databricks
、
BigQuery
、Redshift
🤖
Qwen
clickhouse.com
·
6d
6 days ago
Actions for 1セント未満で実現するTPC-H:ClickHouse Cloud vs. Snowflake、Databricks、BigQuery、Redshift
LakeQA
: An Exploratory QA Benchmark over a Million-Scale
Data
Lake
🤖
Agents
Content type:
Academic
arxiv.org
·
20h
20 hours ago
Actions for LakeQA: An Exploratory QA Benchmark over a Million-Scale Data Lake
Run an
Apache
Airflow
DAG with Docker Compose and PostgreSQL
🗄️
SQL
pyimagesearch.com
·
2d
2 days ago
Actions for Run an Apache Airflow DAG with Docker Compose and PostgreSQL
Franz
🗄️
SQL
flathub.org
·
10h
10 hours ago
Actions for Franz
Automating Real-time
Data
Pipelines
: Deploying Pub/Sub to
BigQuery
with Dataflow Custom Template…
📊
Data Science
Content type:
Blog
medium.com
·
6d
6 days ago
Actions for Automating Real-time Data Pipelines: Deploying Pub/Sub to BigQuery with Dataflow Custom Template…
Announcing general availability of
Apache
Spark
4.0 on Amazon EMR
🖥️
Homelab
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Announcing general availability of Apache Spark 4.0 on Amazon EMR
Exclusive: MotherDuck adds agentic
data
ingestion to its cloud analytics service
🗄️
SQL
siliconangle.com
·
11h
11 hours ago
Actions for Exclusive: MotherDuck adds agentic data ingestion to its cloud analytics service
Linux Fundamentals for
Data
Engineering
💎
Obsidian
dev-to-uploads.s3.amazonaws.com
·
2d
2 days ago
·
DEV
Actions for Linux Fundamentals for Data Engineering
New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
🗄️
SQL
Content type:
PDF
markokolarek.com
·
4d
4 days ago
·
Hacker News
Actions for New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
Efficient
Snowflake
Ingestion: Query-Ready
Data
at Scale
🤖
Agents
Content type:
Blog
snowflake.com
·
1d
1 day ago
Actions for Efficient Snowflake Ingestion: Query-Ready Data at Scale
Jedify raises $24M to help companies arm
AI
agents with context on their business
🤖
Agents
techcrunch.com
·
10h
10 hours ago
Actions for Jedify raises $24M to help companies arm AI agents with context on their business
Insights from
Snowflake
Summit 2026
🤖
Agents
Content type:
Blog
rowzero.com
·
4d
4 days ago
Actions for Insights from Snowflake Summit 2026
What Went Wrong with
Data
Lakes
? A 15-Year Reality Check from the Field
📊
Data Science
Content type:
Academic
arxiv.org
·
1d
1 day ago
Actions for What Went Wrong with Data Lakes? A 15-Year Reality Check from the Field
Do
data
quality frameworks have to be so complex?
💎
Obsidian
sparkdq-community.github.io
·
6d
6 days ago
·
r/Python
Actions for Do data quality frameworks have to be so complex?
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
