Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
🔧 Data Engineering
data pipelines, ETL, batch processing, data warehousing
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
313
posts in
6.1
ms
It's official: Fivetran +
dbt
Labs merge to build the
data
foundation for trustworthy
AI
agents (Sponsor)
☁️
Cloud Infrastructure
fivetran.com
·
6d
6 days ago
Actions for It's official: Fivetran + dbt Labs merge to build the data foundation for trustworthy AI agents (Sponsor)
Unlock cost savings with incremental snapshot billing for Amazon
Redshift
Serverless and Amazon
Redshift
RG
☁️
Cloud Infrastructure
Content type:
Blog
aws.amazon.com
·
2d
2 days ago
Actions for Unlock cost savings with incremental snapshot billing for Amazon Redshift Serverless and Amazon Redshift RG
Deep dive: How Lightning
Engine
delivers 4.9x faster
Apache
Spark
performance
☕
Java
Content type:
Blog
cloud.google.com
·
3h
3 hours ago
Actions for Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance
LakeQA
: An Exploratory QA Benchmark over a Million-Scale
Data
Lake
🌸
Bloom Filters
Content type:
Academic
arxiv.org
·
17h
17 hours ago
Actions for LakeQA: An Exploratory QA Benchmark over a Million-Scale Data Lake
Run an
Apache
Airflow
DAG with Docker Compose and PostgreSQL
⚙️
Backend Development
pyimagesearch.com
·
2d
2 days ago
Actions for Run an Apache Airflow DAG with Docker Compose and PostgreSQL
Daily Deal: The 2026
Data
Engineering
Bundle featuring Databricks
🎓
Online Courses
techdirt.com
·
3h
3 hours ago
Actions for Daily Deal: The 2026 Data Engineering Bundle featuring Databricks
Automating Real-time
Data
Pipelines
: Deploying Pub/Sub to
BigQuery
with Dataflow Custom Template…
☁️
Cloud Infrastructure
Content type:
Blog
medium.com
·
6d
6 days ago
Actions for Automating Real-time Data Pipelines: Deploying Pub/Sub to BigQuery with Dataflow Custom Template…
Designing an
ETL
Application: Why I Started with a Modular Monolith Before Microservices
⚙️
Backend Development
Content type:
Blog
medium.com
·
12h
12 hours ago
Actions for Designing an ETL Application: Why I Started with a Modular Monolith Before Microservices
The Join-Aware Materialized View Query Rewrite Gap (4 minute read)
🗃️
Database Storage
Content type:
Blog
eric-sun.medium.com
·
2d
2 days ago
Actions for The Join-Aware Materialized View Query Rewrite Gap (4 minute read)
Redshift
2026.7.0 - June 10, 2026
🗄️
Cassandra
maxon.net
·
3h
3 hours ago
·
r/MAXON
Actions for Redshift 2026.7.0 - June 10, 2026
Exclusive: MotherDuck adds agentic
data
ingestion to its cloud analytics service
☁️
Cloud Infrastructure
siliconangle.com
·
8h
8 hours ago
Actions for Exclusive: MotherDuck adds agentic data ingestion to its cloud analytics service
1セント未満で実現するTPC-H:ClickHouse Cloud vs. Snowflake、
Databricks
、
BigQuery
、
Redshift
🌲
B-tree Variants
clickhouse.com
·
6d
6 days ago
Actions for 1セント未満で実現するTPC-H:ClickHouse Cloud vs. Snowflake、Databricks、BigQuery、Redshift
Linux Fundamentals for
Data
Engineering
🖥️
Operating Systems
dev-to-uploads.s3.amazonaws.com
·
2d
2 days ago
·
DEV
Actions for Linux Fundamentals for Data Engineering
Introducing Flights: Agent-Native Ingest in MotherDuck
⚙️
Backend Development
Content type:
Blog
motherduck.com
·
21h
21 hours ago
Actions for Introducing Flights: Agent-Native Ingest in MotherDuck
SDLC vs. AIDLC: Why
Data
Engineering
is Pushing the Boundaries of Software Development
🔐
MVCC
Content type:
Blog
medium.com
·
5d
5 days ago
Actions for SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development
Introducing Streamling: Performant and Extensible
Data
Streaming Framework
📨
Kafka
Content type:
News
streamingdata.tech
·
1d
1 day ago
Actions for Introducing Streamling: Performant and Extensible Data Streaming Framework
Integration Patterns: How To Choose for Your Architecture
🔒
Concurrency Control
Content type:
Blog
blog.n8n.io
·
2d
2 days ago
Actions for Integration Patterns: How To Choose for Your Architecture
New comment by dwpeachtree in "Ask HN: Who is hiring? (June 2026)"
🐘
PostgreSQL
Content type:
Discussion
news.ycombinator.com
·
6d
6 days ago
·
Hacker News
Actions for New comment by dwpeachtree in "Ask HN: Who is hiring? (June 2026)"
Senior
Data
Engineer
– Climate Friendly
🔧
DevOps
au.seek.com
·
5d
5 days ago
·
Hacker News
,
Hacker News
Actions for Senior Data Engineer – Climate Friendly
Site Selection with Mapbox Movement &
Big
Query
🧠
Query Planners
Content type:
Blog
mapbox.com
·
2d
2 days ago
Actions for Site Selection with Mapbox Movement & Big Query
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
