Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
🛠️ Data Engineering
data pipeline, ETL, columnar storage, data formats
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
283
posts in
7.1
ms
SDLC vs. AIDLC: Why
Data
Engineering
is Pushing the Boundaries of Software Development
🏹
Apache Arrow
Content type:
Blog
medium.com
·
5d
5 days ago
Actions for SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development
Daily Deal: The 2026
Data
Engineering
Bundle featuring Databricks
📊
OLAP
techdirt.com
·
9h
9 hours ago
Actions for Daily Deal: The 2026 Data Engineering Bundle featuring Databricks
Run an
Apache
Airflow
DAG with Docker Compose and PostgreSQL
⚡
Query Engines
pyimagesearch.com
·
2d
2 days ago
Actions for Run an Apache Airflow DAG with Docker Compose and PostgreSQL
LakeQA
: An Exploratory QA Benchmark over a Million-Scale
Data
Lake
⚡
Query Engines
Content type:
Academic
arxiv.org
·
23h
23 hours ago
Actions for LakeQA: An Exploratory QA Benchmark over a Million-Scale Data Lake
Announcing general availability of
Apache
Spark
4.0 on Amazon EMR
📦
Parquet
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Announcing general availability of Apache Spark 4.0 on Amazon EMR
Snowflake pushes interoperability-first vision as
Apache
Iceberg
gains enterprise momentum
🏹
Apache Arrow
siliconangle.com
·
6d
6 days ago
Actions for Snowflake pushes interoperability-first vision as Apache Iceberg gains enterprise momentum
Designing an
ETL
Application: Why I Started with a Modular Monolith Before Microservices
📊
OLAP
Content type:
Blog
medium.com
·
18h
18 hours ago
Actions for Designing an ETL Application: Why I Started with a Modular Monolith Before Microservices
Linux Fundamentals for
Data
Engineering
📦
Parquet
dev-to-uploads.s3.amazonaws.com
·
2d
2 days ago
·
DEV
Actions for Linux Fundamentals for Data Engineering
Deploying Vector High-Performance Observability
Data
Pipeline
on Ubuntu 24.04
🦀
Rust
Content type:
Reference
Content type:
Tutorial
docs.vultr.com
·
5h
5 hours ago
·
DEV
Actions for Deploying Vector High-Performance Observability Data Pipeline on Ubuntu 24.04
Deep dive: How Lightning
Engine
delivers 4.9x faster
Apache
Spark
performance
📦
Parquet
Content type:
Blog
cloud.google.com
·
9h
9 hours ago
Actions for Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance
Automating
Apache
Iceberg
Table Maintenance
⚡
Query Engines
Content type:
Blog
lakeops.dev
·
4d
4 days ago
·
r/coding
Actions for Automating Apache Iceberg Table Maintenance
Introducing Flights: Agent-Native Ingest in MotherDuck
⚡
Query Engines
Content type:
Blog
motherduck.com
·
1d
1 day ago
Actions for Introducing Flights: Agent-Native Ingest in MotherDuck
Introducing
Streamling
: Performant and Extensible
Data
Streaming
Framework
⚡
Query Engines
Content type:
News
streamingdata.tech
·
1d
1 day ago
Actions for Introducing Streamling: Performant and Extensible Data Streaming Framework
Senior
Data
Engineer
– Climate Friendly
⚡
Query Engines
au.seek.com
·
6d
6 days ago
·
Hacker News
,
Hacker News
Actions for Senior Data Engineer – Climate Friendly
Integration Patterns: How To Choose for Your Architecture
📊
OLAP
Content type:
Blog
blog.n8n.io
·
2d
2 days ago
Actions for Integration Patterns: How To Choose for Your Architecture
CSU Student of Distinction: Anthony Arthur
🪱
Soil Science
Content type:
Academic
csuohio.edu
·
16h
16 hours ago
Actions for CSU Student of Distinction: Anthony Arthur
Embedding
pipelines
are the new
ETL
⚡
Query Engines
Content type:
Blog
infoworld.com
·
5d
5 days ago
Actions for Embedding pipelines are the new ETL
Apache
Iceberg
v4: The Current State, the Proposals, and Why They Matter
🌐
Open Source
books.alexmerced.com
·
1d
1 day ago
·
DEV
Actions for Apache Iceberg v4: The Current State, the Proposals, and Why They Matter
Databricks
wants to kill the “email me a file” problem for
AI
agent skills
📦
Parquet
thenewstack.io
·
13h
13 hours ago
Actions for Databricks wants to kill the “email me a file” problem for AI agent skills
Apache
Iceberg
™ 1.11 Released: A Smarter REST Catalog, Production-Ready Encryption and the Road to v4
📦
Parquet
Content type:
Blog
snowflake.com
·
6d
6 days ago
Actions for Apache Iceberg™ 1.11 Released: A Smarter REST Catalog, Production-Ready Encryption and the Road to v4
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
