Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
🔧 Data Engineering
data pipelines, ETL, ELT, data infrastructure
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
330
posts in
14.9
ms
Automating Real-time
Data
Pipelines
: Deploying Pub/Sub to
BigQuery
with Dataflow Custom Template…
🔵
Google Cloud
Content type:
Blog
medium.com
·
6d
6 days ago
Actions for Automating Real-time Data Pipelines: Deploying Pub/Sub to BigQuery with Dataflow Custom Template…
Azerbaijani Central Bank set to adopt
data
Lakehouse
system in 2026
🏠
Lakehouse
trend.az
·
1d
1 day ago
Actions for Azerbaijani Central Bank set to adopt data Lakehouse system in 2026
Deep dive: How Lightning
Engine
delivers 4.9x faster
Apache
Spark
performance
⚡
Apache Spark
Content type:
Blog
cloud.google.com
·
6h
6 hours ago
Actions for Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance
Designing an
ETL
Application: Why I Started with a Modular Monolith Before Microservices
📊
Analytics Engineering
Content type:
Blog
medium.com
·
15h
15 hours ago
Actions for Designing an ETL Application: Why I Started with a Modular Monolith Before Microservices
Run an
Apache
Airflow
DAG with Docker Compose and PostgreSQL
⚡
Apache Spark
pyimagesearch.com
·
2d
2 days ago
Actions for Run an Apache Airflow DAG with Docker Compose and PostgreSQL
1セント未満で実現するTPC-H:ClickHouse Cloud vs.
Snowflake
、
Databricks
、
BigQuery
、Redshift
📊
Analytics Engineering
clickhouse.com
·
6d
6 days ago
Actions for 1セント未満で実現するTPC-H:ClickHouse Cloud vs. Snowflake、Databricks、BigQuery、Redshift
Exclusive: MotherDuck adds agentic
data
ingestion to its cloud analytics service
📊
Analytics Engineering
siliconangle.com
·
11h
11 hours ago
Actions for Exclusive: MotherDuck adds agentic data ingestion to its cloud analytics service
Why
Snowflake
Matters Now More Than Ever
📊
Analytics Engineering
Content type:
News
Content type:
Blog
clouddb.substack.com
·
2d
2 days ago
·
Substack
Actions for Why Snowflake Matters Now More Than Ever
Deploying Vector High-Performance Observability
Data
Pipeline
on Ubuntu 24.04
🟠
AWS
Content type:
Reference
Content type:
Tutorial
docs.vultr.com
·
1h
1 hour ago
·
DEV
Actions for Deploying Vector High-Performance Observability Data Pipeline on Ubuntu 24.04
SDLC vs. AIDLC: Why
Data
Engineering
is Pushing the Boundaries of Software Development
🧱
Databricks
Content type:
Blog
medium.com
·
5d
5 days ago
Actions for SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development
Introducing Flights: Agent-Native Ingest in MotherDuck
📊
Analytics Engineering
Content type:
Blog
motherduck.com
·
1d
1 day ago
Actions for Introducing Flights: Agent-Native Ingest in MotherDuck
Location: Lubbock, TX, USA Remote: Yes (Remote-friendly, US-based) Technologies:...
📊
Analytics Engineering
Content type:
Discussion
news.ycombinator.com
·
9h
9 hours ago
·
Hacker News
Actions for Location: Lubbock, TX, USA Remote: Yes (Remote-friendly, US-based) Technologies:...
Integration Patterns: How To Choose for Your
Architecture
📊
Analytics Engineering
Content type:
Blog
blog.n8n.io
·
2d
2 days ago
Actions for Integration Patterns: How To Choose for Your Architecture
Senior
Data
Engineer
– Climate Friendly
📊
Analytics Engineering
au.seek.com
·
5d
5 days ago
·
Hacker News
,
Hacker News
Actions for Senior Data Engineer – Climate Friendly
Choosing the right workflow orchestration service for your use case: Amazon MWAA and AWS Step Functions
🟠
AWS
Content type:
Blog
aws.amazon.com
·
8h
8 hours ago
Actions for Choosing the right workflow orchestration service for your use case: Amazon MWAA and AWS Step Functions
Connections, Roles, and
Warehouses
: Getting CoCo Desktop Production-Ready from Day One
📊
Analytics Engineering
Content type:
Blog
towardsai.net
·
2d
2 days ago
Actions for Connections, Roles, and Warehouses: Getting CoCo Desktop Production-Ready from Day One
New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
🐍
Python
Content type:
PDF
markokolarek.com
·
4d
4 days ago
·
Hacker News
Actions for New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
QoreAI Launches Industry-First Dealership
Data
Platform, Announces
Lokam.ai
as First Native Agentic Partner
🗂️
Data Governance
Content type:
News
prweb.com
·
11h
11 hours ago
Actions for QoreAI Launches Industry-First Dealership Data Platform, Announces Lokam.ai as First Native Agentic Partner
Introducing Streamling: Performant and Extensible
Data
Streaming Framework
📦
Parquet
Content type:
News
streamingdata.tech
·
1d
1 day ago
Actions for Introducing Streamling: Performant and Extensible Data Streaming Framework
Snowflake
thinks it knows what’s really slowing developers down
📊
Analytics Engineering
thenewstack.io
·
6d
6 days ago
Actions for Snowflake thinks it knows what’s really slowing developers down
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help