Skip to main content
Scour
Discover
Docs
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
🏗️ Data Engineering
data pipelines, ETL, Apache Spark, data lakehouse
Filter Results
Timeframe
Choose a timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
206
posts in
22.8
ms
🔧
Software Engineering
Databricks
·
5d
5 days ago
Data
Pipeline
Best Practices: Architecture, Modern Pipelines, and Deployment
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Data Pipeline Best Practices: Architecture, Modern Pipelines, and Deployment
🤖
AI
Confluent
·
16h
16 hours ago
How to Eliminate Training-Serving Skew With a Unified Real-Time Streaming ML
Pipeline
(2026 Guide)
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for How to Eliminate Training-Serving Skew With a Unified Real-Time Streaming ML Pipeline (2026 Guide)
🛠️
DevOps
Opus
·
1d
1 day ago
Why Payment
Data
Pipelines
Break Under Real-Time Load (And How Banks Fix the Latency Problem)
Discussed on
DEV
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Why Payment Data Pipelines Break Under Real-Time Load (And How Banks Fix the Latency Problem)
🛠️
DevOps
AWS
·
19h
19 hours ago
Autonomous troubleshooting for Medallion Architecture with AWS DevOps Agent and
Apache
Spark
Troubleshooting Agent
Covers
AWS CLI in Action: Automate Everything From Your Terminal ⚡🖥️
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Autonomous troubleshooting for Medallion Architecture with AWS DevOps Agent and Apache Spark Troubleshooting Agent
💻
Tech
medium.com
·
2d
2 days ago
The Future of
Data
Engineering
: How
AI
Is Automating the Modern
Data
Stack
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for The Future of Data Engineering: How AI Is Automating the Modern Data Stack
🐛
Fuzzing
GitHub
·
6d
6 days ago
Show HN: A
dbt-first
semantic assumption check for SQL changes
Discussed on
Hacker News
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Show HN: A dbt-first semantic assumption check for SQL changes
🔌
APIs
medium.com
·
22h
22 hours ago
Metadata-Driven Azure
Data
Platform with Azure
Data
Factory, Databricks, and
dbt
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Metadata-Driven Azure Data Platform with Azure Data Factory, Databricks, and dbt
💿
software
getdbt.com
·
2d
2 days ago
The analytics
engineer
in 2026: system designer, governance owner,
AI
context provider (5 minute read)
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for The analytics engineer in 2026: system designer, governance owner, AI context provider (5 minute read)
🛠️
Ghidra
blocksandfiles
·
21h
21 hours ago
Komprise provides
lakehouse
access to petabytes of unstructured
data
Covers
Apache Iceberg
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Komprise provides lakehouse access to petabytes of unstructured data
🛠️
DevOps
dataengineeringcentral.substack.com
·
4d
4 days ago
Review of
Databricks
Data +
AI
Summit 2026 (14 minute read)
Covers
2 stories
See all stories this covers
including
Databricks Launches LTAP: A Unified OLAP/OLTP Data Architecture
Discussed on
Substack
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Review of Databricks Data + AI Summit 2026 (14 minute read)
👁️
Computer Vision
arXiv
·
1d
1 day ago
DBT-Bleed
: Dual-Branch Temporal Modeling with Key-Frame Selection for Surgical Bleeding Detection
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for DBT-Bleed: Dual-Branch Temporal Modeling with Key-Frame Selection for Surgical Bleeding Detection
🐧
Linux
Techzine Global
·
3h
3 hours ago
Nokia and
Databricks
test platform for
AI-driven
networks
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Nokia and Databricks test platform for AI-driven networks
🤖
LLMs
Search CIO
·
19h
19 hours ago
Everpure
Data
Stream preps
data
pipeline
for enterprise
AI
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Everpure Data Stream preps data pipeline for enterprise AI
🐛
Fuzzing
medium.com
·
1d
1 day ago
The Architecture of REM: Why Sleep Posture Triggers Systems-Level Hallucinations
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for The Architecture of REM: Why Sleep Posture Triggers Systems-Level Hallucinations
🤖
AI Agents
optixlog.medium.com
·
13h
13 hours ago
Context is the bottleneck for
AI
in the physical world
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Context is the bottleneck for AI in the physical world
🤖
AI
MotherDuck Blog posts
·
6d
6 days ago
Flight Plans: Templates for
AI-Native
Data
Pipelines
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Flight Plans: Templates for AI-Native Data Pipelines
🤖
AI
InfoWorld
·
18h
18 hours ago
EDB converges analytics on Postgres to support
AI
agents
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for EDB converges analytics on Postgres to support AI agents
⚡
Performance
Nature
·
1d
1 day ago
Ligand-mediated suppression of Ostwald ripening enables low-temperature sol-gel ZnO for efficient inverted flexible organic photovoltaics
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Ligand-mediated suppression of Ostwald ripening enables low-temperature sol-gel ZnO for efficient inverted flexible organic photovoltaics
🧠
Claude
perceptiontheory.bearblog.dev
·
6d
6 days ago
Improving a
data
pipeline
with DSPy
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Improving a data pipeline with DSPy
🔌
APIs
storagereview.com
·
20h
20 hours ago
VDURA Unveils Multi-Tenant Control Plane and S3 Enhancements at ISC 2026
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for VDURA Unveils Multi-Tenant Control Plane and S3 Enhancements at ISC 2026
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous post
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Discover
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
Like
Save
Not for me
Report