Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
⚙️ Data Engineering
ETL, Data Pipelines, Data Warehousing, Data Processing
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
313
posts in
74.6
ms
Best
Data
Engineering
Courses in 2026
📊
Big Data
Content type:
Blog
dataquest.io
·
6d
6 days ago
Actions for Best Data Engineering Courses in 2026
Unlock cost savings with incremental snapshot billing for Amazon
Redshift
Serverless and Amazon
Redshift
RG
🌠
Cosmology
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Unlock cost savings with incremental snapshot billing for Amazon Redshift Serverless and Amazon Redshift RG
Transit
Data
Ingestion
Platform Dev 101: Lyondle & Colosse
⚡
Serverless
Content type:
Blog
johanmontorfano.com
·
21h
21 hours ago
·
Lobsters
Actions for Transit Data Ingestion Platform Dev 101: Lyondle & Colosse
Introducing
Streamling
: Performant and Extensible
Data
Streaming
Framework
📊
Big Data
Content type:
News
streamingdata.tech
·
15h
15 hours ago
Actions for Introducing Streamling: Performant and Extensible Data Streaming Framework
Run an
Apache
Airflow
DAG with Docker Compose and PostgreSQL
📦
Containerization
pyimagesearch.com
·
1d
1 day ago
Actions for Run an Apache Airflow DAG with Docker Compose and PostgreSQL
Automating Real-time
Data
Pipelines
: Deploying Pub/Sub to
BigQuery
with Dataflow Custom Template…
☁️
GCP
Content type:
Blog
medium.com
·
6d
6 days ago
Actions for Automating Real-time Data Pipelines: Deploying Pub/Sub to BigQuery with Dataflow Custom Template…
The Join-Aware Materialized View Query Rewrite Gap (4 minute read)
📊
Big Data
Content type:
Blog
eric-sun.medium.com
·
2d
2 days ago
Actions for The Join-Aware Materialized View Query Rewrite Gap (4 minute read)
SDLC vs. AIDLC: Why
Data
Engineering
is Pushing the Boundaries of Software Development
📊
Big Data
Content type:
Blog
medium.com
·
4d
4 days ago
Actions for SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development
Linux Fundamentals for
Data
Engineering
📊
Big Data
dev-to-uploads.s3.amazonaws.com
·
1d
1 day ago
·
DEV
Actions for Linux Fundamentals for Data Engineering
1セント未満で実現するTPC-H:ClickHouse Cloud vs.
Snowflake
、
Databricks
、
BigQuery
、Redshift
📊
Big Data
clickhouse.com
·
6d
6 days ago
Actions for 1セント未満で実現するTPC-H:ClickHouse Cloud vs. Snowflake、Databricks、BigQuery、Redshift
It's official: Fivetran +
dbt
Labs
merge to build the
data
foundation for trustworthy AI agents (Sponsor)
📊
Big Data
fivetran.com
·
6d
6 days ago
Actions for It's official: Fivetran + dbt Labs merge to build the data foundation for trustworthy AI agents (Sponsor)
Enhancements to Managed Service for
Apache
Spark
clusters
⚡
Apache Spark
Content type:
Blog
cloud.google.com
·
6d
6 days ago
Actions for Enhancements to Managed Service for Apache Spark clusters
Senior
Data
Engineer
– Climate Friendly
📊
Big Data
au.seek.com
·
5d
5 days ago
·
Hacker News
,
Hacker News
Actions for Senior Data Engineer – Climate Friendly
New comment by dwpeachtree in "Ask HN: Who is hiring? (June 2026)"
☁️
GCP
Content type:
Discussion
news.ycombinator.com
·
6d
6 days ago
·
Hacker News
Actions for New comment by dwpeachtree in "Ask HN: Who is hiring? (June 2026)"
New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
🔍
BigQuery
Content type:
PDF
markokolarek.com
·
3d
3 days ago
·
Hacker News
Actions for New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
Amazon
Redshift
reduces manual snapshot cost for Serverless and RG instances
🌠
Cosmology
aws.amazon.com
·
1d
1 day ago
Actions for Amazon Redshift reduces manual snapshot cost for Serverless and RG instances
Embedding
pipelines
are the new
ETL
📊
Big Data
Content type:
Blog
infoworld.com
·
4d
4 days ago
Actions for Embedding pipelines are the new ETL
New comment by wbazant in "Ask HN: Who wants to be hired? (June 2026)"
📊
Big Data
Content type:
Discussion
news.ycombinator.com
·
6d
6 days ago
·
Hacker News
Actions for New comment by wbazant in "Ask HN: Who wants to be hired? (June 2026)"
Real Estate Lifecycle Analysis with
BigQuery
SQL Graph: Graph
Modeling
Beyond LLM Record Linkage
📊
Big Data
Content type:
Blog
medium.com
·
6d
6 days ago
Actions for Real Estate Lifecycle Analysis with BigQuery SQL Graph: Graph Modeling Beyond LLM Record Linkage
Query Amazon
Redshift
using natural language with Kiro
🔌
Model Context Protocol
Content type:
Blog
aws.amazon.com
·
5d
5 days ago
Actions for Query Amazon Redshift using natural language with Kiro
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
