Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
🔄 Data Engineering
data pipelines, ETL, Apache Spark, Flink, big data
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
428
posts in
26.9
ms
Enhancements to Managed Service for
Apache
Spark
clusters
🏞️
Delta Lake
Content type:
Blog
cloud.google.com
·
6d
6 days ago
Actions for Enhancements to Managed Service for Apache Spark clusters
Calculating speed estimates with
Apache
Spark
🏞️
Delta Lake
Content type:
Blog
mapbox.com
·
2d
2 days ago
Actions for Calculating speed estimates with Apache Spark
Daily Deal: The 2026
Data
Engineering
Bundle featuring Databricks
📊
Data Science
techdirt.com
·
4h
4 hours ago
Actions for Daily Deal: The 2026 Data Engineering Bundle featuring Databricks
Designing an
ETL
Application: Why I Started with a Modular Monolith Before Microservices
⚙️
Microservices
Content type:
Blog
medium.com
·
13h
13 hours ago
Actions for Designing an ETL Application: Why I Started with a Modular Monolith Before Microservices
Announcing general availability of
Apache
Spark
4.0 on Amazon EMR
🏞️
Delta Lake
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Announcing general availability of Apache Spark 4.0 on Amazon EMR
It's official: Fivetran +
dbt
Labs merge to build the
data
foundation for trustworthy
AI
agents (Sponsor)
🤖
AI Agents
fivetran.com
·
6d
6 days ago
Actions for It's official: Fivetran + dbt Labs merge to build the data foundation for trustworthy AI agents (Sponsor)
aayush4vedi/drift-spark
:
Spark-native
embedding lifecycle- produce, CDC refresh, model-migrate, audit.
⚙️
AI Engineering
Content type:
Code
github.com
·
10h
10 hours ago
·
Hacker News
Actions for aayush4vedi/drift-spark: Spark-native embedding lifecycle- produce, CDC refresh, model-migrate, audit.
Introducing Streamling: Performant and Extensible
Data
Streaming Framework
📊
Columnar Storage
Content type:
News
streamingdata.tech
·
1d
1 day ago
Actions for Introducing Streamling: Performant and Extensible Data Streaming Framework
Exclusive: MotherDuck adds agentic
data
ingestion to its cloud analytics service
📊
Data Science
siliconangle.com
·
9h
9 hours ago
Actions for Exclusive: MotherDuck adds agentic data ingestion to its cloud analytics service
Run an
Apache
Airflow
DAG with Docker Compose and PostgreSQL
🐳
Docker
pyimagesearch.com
·
2d
2 days ago
Actions for Run an Apache Airflow DAG with Docker Compose and PostgreSQL
SDLC vs. AIDLC: Why
Data
Engineering
is Pushing the Boundaries of Software Development
🔧
MLOps
Content type:
Blog
medium.com
·
5d
5 days ago
Actions for SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development
Introducing Flights: Agent-Native Ingest in MotherDuck
💻
Code Generation
Content type:
Blog
motherduck.com
·
22h
22 hours ago
Actions for Introducing Flights: Agent-Native Ingest in MotherDuck
Linux Fundamentals for
Data
Engineering
🏞️
Delta Lake
dev-to-uploads.s3.amazonaws.com
·
2d
2 days ago
·
DEV
Actions for Linux Fundamentals for Data Engineering
New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
🕸️
Knowledge Graphs
Content type:
PDF
markokolarek.com
·
4d
4 days ago
·
Hacker News
Actions for New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
Deploy ADX Business on DigitalOcean
🏗️
System Design
digitalocean.com
·
22h
22 hours ago
Actions for Deploy ADX Business on DigitalOcean
Nike’s Coolest Running Innovation in Years Is a Lot Bigger Than the Brand Initially Let On
♟️
Game Theory
gearpatrol.com
·
2d
2 days ago
Actions for Nike’s Coolest Running Innovation in Years Is a Lot Bigger Than the Brand Initially Let On
Senior
Data
Engineer
– Climate Friendly
📊
Observability
au.seek.com
·
5d
5 days ago
·
Hacker News
,
Hacker News
Actions for Senior Data Engineer – Climate Friendly
Thermalright Introduces Peerless Assassin SE Series CPU Coolers
💻
CPU Microarchitecture
techpowerup.com
·
7h
7 hours ago
Actions for Thermalright Introduces Peerless Assassin SE Series CPU Coolers
Exempt a specific container in MDC
🐳
Docker
techcommunity.microsoft.com
·
1d
1 day ago
Actions for Exempt a specific container in MDC
Announcing
Spark
Connect on Amazon EMR Serverless: Interactive PySpark development, anywhere
🏞️
Delta Lake
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Announcing Spark Connect on Amazon EMR Serverless: Interactive PySpark development, anywhere
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
