Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
⚙️ Data Engineering
ETL, Data Pipelines, Data Warehousing, Data Processing
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
298
posts in
7.4
ms
Automating Real-time
Data
Pipelines
: Deploying Pub/Sub to
BigQuery
with Dataflow Custom Template…
🔄
DevOps
Content type:
Blog
medium.com
·
6d
6 days ago
Actions for Automating Real-time Data Pipelines: Deploying Pub/Sub to BigQuery with Dataflow Custom Template…
Why
Snowflake
Matters Now More Than Ever
🤖
Agents
Content type:
News
Content type:
Blog
clouddb.substack.com
·
2d
2 days ago
·
Substack
Actions for Why Snowflake Matters Now More Than Ever
Deep dive: How Lightning
Engine
delivers 4.9x faster
Apache
Spark
performance
☁️
Cloud Computing
Content type:
Blog
cloud.google.com
·
7h
7 hours ago
Actions for Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance
Daily Deal: The 2026
Data
Engineering
Bundle featuring Databricks
📊
Data Visualization
techdirt.com
·
7h
7 hours ago
Actions for Daily Deal: The 2026 Data Engineering Bundle featuring Databricks
Run an
Apache
Airflow
DAG with Docker Compose and PostgreSQL
🔄
DevOps
pyimagesearch.com
·
2d
2 days ago
Actions for Run an Apache Airflow DAG with Docker Compose and PostgreSQL
SDLC vs. AIDLC: Why
Data
Engineering
is Pushing the Boundaries of Software Development
🔄
DevOps
Content type:
Blog
medium.com
·
5d
5 days ago
Actions for SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development
Designing an
ETL
Application: Why I Started with a Modular Monolith Before Microservices
🌍
Distributed Systems
Content type:
Blog
medium.com
·
16h
16 hours ago
Actions for Designing an ETL Application: Why I Started with a Modular Monolith Before Microservices
What Went Wrong with
Data
Lakes
? A 15-Year Reality Check from the Field
📊
Data Visualization
Content type:
Academic
arxiv.org
·
1d
1 day ago
Actions for What Went Wrong with Data Lakes? A 15-Year Reality Check from the Field
Deploying Vector High-Performance Observability
Data
Pipeline
on Ubuntu 24.04
🔄
DevOps
Content type:
Reference
Content type:
Tutorial
docs.vultr.com
·
3h
3 hours ago
·
DEV
Actions for Deploying Vector High-Performance Observability Data Pipeline on Ubuntu 24.04
Exclusive: MotherDuck adds agentic
data
ingestion to its cloud analytics service
🤖
Agents
siliconangle.com
·
12h
12 hours ago
Actions for Exclusive: MotherDuck adds agentic data ingestion to its cloud analytics service
Linux Fundamentals for
Data
Engineering
🗄️
Databases
dev-to-uploads.s3.amazonaws.com
·
2d
2 days ago
·
DEV
Actions for Linux Fundamentals for Data Engineering
Star Schema vs
Snowflake
Schema in PostgreSQL
🗄️
Databases
digitalocean.com
·
6d
6 days ago
Actions for Star Schema vs Snowflake Schema in PostgreSQL
Efficient
Snowflake
Ingestion: Query-Ready
Data
at Scale
🤖
Agents
Content type:
Blog
snowflake.com
·
1d
1 day ago
Actions for Efficient Snowflake Ingestion: Query-Ready Data at Scale
Choosing the right workflow orchestration service for your use case: Amazon MWAA and AWS Step Functions
☁️
Cloud Computing
Content type:
Blog
aws.amazon.com
·
9h
9 hours ago
Actions for Choosing the right workflow orchestration service for your use case: Amazon MWAA and AWS Step Functions
Senior
Data
Engineer
– Climate Friendly
🔄
DevOps
au.seek.com
·
5d
5 days ago
·
Hacker News
,
Hacker News
Actions for Senior Data Engineer – Climate Friendly
Introducing Flights: Agent-Native Ingest in MotherDuck
🤖
Agents
Content type:
Blog
motherduck.com
·
1d
1 day ago
Actions for Introducing Flights: Agent-Native Ingest in MotherDuck
Snowflake
thinks it knows what’s really slowing developers down
☁️
Cloud Computing
thenewstack.io
·
6d
6 days ago
Actions for Snowflake thinks it knows what’s really slowing developers down
Location: Lubbock, TX, USA Remote: Yes (Remote-friendly, US-based) Technologies:...
☁️
Cloud Computing
Content type:
Discussion
news.ycombinator.com
·
10h
10 hours ago
·
Hacker News
Actions for Location: Lubbock, TX, USA Remote: Yes (Remote-friendly, US-based) Technologies:...
Introducing Streamling: Performant and Extensible
Data
Streaming Framework
🗄️
Databases
Content type:
News
streamingdata.tech
·
1d
1 day ago
Actions for Introducing Streamling: Performant and Extensible Data Streaming Framework
Jedify raises $24M to help companies arm
AI
agents with context on their business
🤖
Agents
techcrunch.com
·
11h
11 hours ago
Actions for Jedify raises $24M to help companies arm AI agents with context on their business
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
