Skip to main content
Scour
Discover
Docs
Login
Sign Up
Discover
About
Docs
Changelog
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
🏗️ Data Engineering
data pipelines, ETL, Apache Spark, data lakehouse
Filter Results
Timeframe
Choose a timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
213
posts in
14.8
ms
🏗️
Systems Design
Databricks
·
6d
6 days ago
What is
data
pipeline
architecture?
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for What is data pipeline architecture?
⚙️
MLOps
medium.com
·
10h
10 hours ago
The Future of
Data
Engineering
: How
AI
Is Automating the Modern
Data
Stack
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for The Future of Data Engineering: How AI Is Automating the Modern Data Stack
⚙️
MLOps
Amazon Web Services
·
3h
3 hours ago
Why tombola chose Graviton-powered RG instances for Amazon Redshift
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Why tombola chose Graviton-powered RG instances for Amazon Redshift
🧠
Transformer Architecture
GitHub
·
8h
8 hours ago
Show HN: Duckle a drag-and-drop visual
pipeline
designer
Covers
Model Context Protocol And OAuth
Discussed on
Hacker News
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Show HN: Duckle a drag-and-drop visual pipeline designer
✍️
Prompt Engineering
medium.com
·
2d
2 days ago
he Proxy That Snitched on Itself
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for he Proxy That Snitched on Itself
⚙️
MLOps
Confluent Blog
·
3d
3 days ago
Meeting
Data
(and Analytics)
Engineers
Where They Are: Introducing the
dbt
Adapter for Confluent Cloud
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Meeting Data (and Analytics) Engineers Where They Are: Introducing the dbt Adapter for Confluent Cloud
📈
LLM Scaling
cmswire.com
·
2d
2 days ago
Why
Databricks
CustomerLake Just Rewired the CDP Space
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Why Databricks CustomerLake Just Rewired the CDP Space
🏗️
Systems Design
getdbt.com
·
20h
20 hours ago
The analytics
engineer
in 2026: system designer, governance owner,
AI
context provider (5 minute read)
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for The analytics engineer in 2026: system designer, governance owner, AI context provider (5 minute read)
🗄️
Vector Databases
medium.com
·
2d
2 days ago
Apache
Spark
| Structured
Data
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Apache Spark | Structured Data
🕸️
Multi-Agent Systems
Databricks
·
6d
6 days ago
Introducing CustomerLake: The Agentic CDP embedded in
Databricks
Covered by
5 sources
See all sources covering this story
including
therundown.ai
,
Blocks and Files
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Introducing CustomerLake: The Agentic CDP embedded in Databricks
🏗️
Systems Design
jack-vanlightly.com
·
20h
20 hours ago
Can We Agree on a Storage/Workload Architecture Taxonomy?
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Can We Agree on a Storage/Workload Architecture Taxonomy?
🖧
Distributed Systems
techcommunity.microsoft.com
·
2d
2 days ago
OneLake in Azure: The
Data
Lakehouse
Revolution Changing the Future of Enterprise
Data
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for OneLake in Azure: The Data Lakehouse Revolution Changing the Future of Enterprise Data
🏗️
Systems Design
Databricks
·
6d
6 days ago
Databricks
Launches LTAP: A Unified OLAP/OLTP Data Architecture
Covered by
5 sources
See all sources covering this story
including
therundown.ai
,
The New Stack
Discussed on
Hacker News
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Databricks Launches LTAP: A Unified OLAP/OLTP Data Architecture
🖧
Distributed Systems
thedatabytes.substack.com
·
1d
1 day ago
Databricks
vs. AWS managed service which one fits your need?
Discussed on
Substack
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Databricks vs. AWS managed service which one fits your need?
📚
RAG
rickw.bearblog.dev
·
4h
4 hours ago
Father's Day
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Father's Day
🗄️
Vector Databases
venturebeat.com
·
5d
5 days ago
Databricks
says it solved the decades-old data
pipeline
problem that's been slowing
AI
agents
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Databricks says it solved the decades-old data pipeline problem that's been slowing AI agents
🖧
Distributed Systems
medium.com
·
2d
2 days ago
Building a Serverless, Multi-Source
Data
Ingestion Framework on GCP (Snowflake & Databricks to…
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Building a Serverless, Multi-Source Data Ingestion Framework on GCP (Snowflake & Databricks to…
⚙️
MLOps
robertsahlin.substack.com
·
5d
5 days ago
Data
quality traffic lights (13 minute read)
Discussed on
Substack
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Data quality traffic lights (13 minute read)
📈
LLM Scaling
medium.com
·
2d
2 days ago
Beyond the 80% Grind: Automated
ETL
and the Instant Synthetic
Data
Revolution
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Beyond the 80% Grind: Automated ETL and the Instant Synthetic Data Revolution
🏗️
Systems Design
SD Times
·
3h
3 hours ago
pgEdge Announces ColdFront for PostgreSQL, Seamlessly Uniting
AI
, Analytical and OLTP Workloads
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for pgEdge Announces ColdFront for PostgreSQL, Seamlessly Uniting AI, Analytical and OLTP Workloads
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous post
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Discover
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
Like
Save
Not for me
Report