Skip to main content
Scour
Discover
Docs
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
🏗️ Data Engineering
data pipelines, ETL, Apache Spark, data lakehouse
Filter Results
Timeframe
Choose a timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
221
posts in
23.6
ms
🏗️
Systems Design
Databricks
·
6d
6 days ago
What is
data
pipeline
architecture?
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for What is data pipeline architecture?
🔐
Cybersecurity
Opus
·
4h
4 hours ago
Why Payment
Data
Pipelines
Break Under Real-Time Load (And How Banks Fix the Latency Problem)
Discussed on
DEV
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Why Payment Data Pipelines Break Under Real-Time Load (And How Banks Fix the Latency Problem)
⚙️
MLOps
medium.com
·
1d
1 day ago
The Future of
Data
Engineering
: How
AI
Is Automating the Modern
Data
Stack
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for The Future of Data Engineering: How AI Is Automating the Modern Data Stack
🧠
Transformer Architecture
GitHub
·
23h
23 hours ago
Show HN: Duckle a drag-and-drop visual
pipeline
designer
Covers
Model Context Protocol And OAuth
Discussed on
Hacker News
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Show HN: Duckle a drag-and-drop visual pipeline designer
🏗️
Systems Design
getdbt.com
·
1d
1 day ago
The analytics
engineer
in 2026: system designer, governance owner,
AI
context provider (5 minute read)
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for The analytics engineer in 2026: system designer, governance owner, AI context provider (5 minute read)
⚙️
MLOps
Confluent Blog
·
4d
4 days ago
Meeting
Data
(and Analytics)
Engineers
Where They Are: Introducing the
dbt
Adapter for Confluent Cloud
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Meeting Data (and Analytics) Engineers Where They Are: Introducing the dbt Adapter for Confluent Cloud
⚙️
MLOps
AWS
·
18h
18 hours ago
Why tombola chose Graviton-powered RG instances for Amazon Redshift
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Why tombola chose Graviton-powered RG instances for Amazon Redshift
⚙️
MLOps
arXiv
·
7h
7 hours ago
DBT-Bleed
: Dual-Branch Temporal Modeling with Key-Frame Selection for Surgical Bleeding Detection
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for DBT-Bleed: Dual-Branch Temporal Modeling with Key-Frame Selection for Surgical Bleeding Detection
🖧
Distributed Systems
thedatabytes.substack.com
·
2d
2 days ago
Databricks
vs. AWS managed service which one fits your need?
Discussed on
Substack
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Databricks vs. AWS managed service which one fits your need?
🕸️
Multi-Agent Systems
Databricks
·
6d
6 days ago
Introducing CustomerLake: The Agentic CDP embedded in
Databricks
Covered by
5 sources
See all sources covering this story
including
The Rundown AI
,
Blocks and Files
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Introducing CustomerLake: The Agentic CDP embedded in Databricks
🧠
Transformer Architecture
medium.com
·
8h
8 hours ago
The Architecture of REM: Why Sleep Posture Triggers Systems-Level Hallucinations
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for The Architecture of REM: Why Sleep Posture Triggers Systems-Level Hallucinations
🏗️
Systems Design
jack-vanlightly.com
·
1d
1 day ago
Can We Agree on a Storage/Workload Architecture Taxonomy?
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Can We Agree on a Storage/Workload Architecture Taxonomy?
🔥
PyTorch
Nature
·
11h
11 hours ago
Ligand-mediated suppression of Ostwald ripening enables low-temperature sol-gel ZnO for efficient inverted flexible organic photovoltaics
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Ligand-mediated suppression of Ostwald ripening enables low-temperature sol-gel ZnO for efficient inverted flexible organic photovoltaics
🏗️
Systems Design
Databricks
·
6d
6 days ago
Databricks
Launches LTAP: A Unified OLAP/OLTP Data Architecture
Covered by
5 sources
See all sources covering this story
including
The Rundown AI
,
The New Stack
Discussed on
Hacker News
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Databricks Launches LTAP: A Unified OLAP/OLTP Data Architecture
🔥
PyTorch
advanced.onlinelibrary.wiley.com
·
19h
19 hours ago
Concurrent Perovskite Crystallization and Interface Modulation via Sulfonamides for High‐Performance Printable Mesoscopic Perovskite Solar Cells
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Concurrent Perovskite Crystallization and Interface Modulation via Sulfonamides for High‐Performance Printable Mesoscopic Perovskite Solar Cells
📈
LLM Scaling
medium.com
·
2d
2 days ago
Beyond the 80% Grind: Automated
ETL
and the Instant Synthetic
Data
Revolution
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Beyond the 80% Grind: Automated ETL and the Instant Synthetic Data Revolution
🗄️
Vector Databases
venturebeat.com
·
6d
6 days ago
Databricks
says it solved the decades-old data
pipeline
problem that's been slowing
AI
agents
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Databricks says it solved the decades-old data pipeline problem that's been slowing AI agents
🖧
Distributed Systems
medium.com
·
5h
5 hours ago
Apache
Kafka
for .NET Developers — Complete Guide (Explained Like a 5-Year-Old)
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Apache Kafka for .NET Developers — Complete Guide (Explained Like a 5-Year-Old)
📚
RAG
rickw.bearblog.dev
·
19h
19 hours ago
Father's Day
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Father's Day
⚙️
MLOps
robertsahlin.substack.com
·
6d
6 days ago
Data
quality traffic lights (13 minute read)
Discussed on
Substack
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Data quality traffic lights (13 minute read)
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous post
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Discover
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
Like
Save
Not for me
Report