Skip to main content
Scour
Discover
Docs
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
๐๏ธ Data Engineering
data pipelines, ETL, Apache Spark, data lakehouse
Filter Results
Timeframe
Choose a timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
206
posts in
22.8
ms
๐ง
Software Engineering
Databricks
ยท
5d
5 days ago
Data
Pipeline
Best Practices: Architecture, Modern Pipelines, and Deployment
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Data Pipeline Best Practices: Architecture, Modern Pipelines, and Deployment
๐ค
AI
Confluent
ยท
16h
16 hours ago
How to Eliminate Training-Serving Skew With a Unified Real-Time Streaming ML
Pipeline
(2026 Guide)
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for How to Eliminate Training-Serving Skew With a Unified Real-Time Streaming ML Pipeline (2026 Guide)
๐ ๏ธ
DevOps
Opus
ยท
1d
1 day ago
Why Payment
Data
Pipelines
Break Under Real-Time Load (And How Banks Fix the Latency Problem)
Discussed on
DEV
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Why Payment Data Pipelines Break Under Real-Time Load (And How Banks Fix the Latency Problem)
๐ ๏ธ
DevOps
AWS
ยท
19h
19 hours ago
Autonomous troubleshooting for Medallion Architecture with AWS DevOps Agent and
Apache
Spark
Troubleshooting Agent
Coversย
AWS CLI in Action: Automate Everything From Your Terminal โก๐ฅ๏ธ
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Autonomous troubleshooting for Medallion Architecture with AWS DevOps Agent and Apache Spark Troubleshooting Agent
๐ป
Tech
medium.com
ยท
2d
2 days ago
The Future of
Data
Engineering
: How
AI
Is Automating the Modern
Data
Stack
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for The Future of Data Engineering: How AI Is Automating the Modern Data Stack
๐
Fuzzing
GitHub
ยท
6d
6 days ago
Show HN: A
dbt-first
semantic assumption check for SQL changes
Discussed on
Hacker News
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Show HN: A dbt-first semantic assumption check for SQL changes
๐
APIs
medium.com
ยท
22h
22 hours ago
Metadata-Driven Azure
Data
Platform with Azure
Data
Factory, Databricks, and
dbt
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Metadata-Driven Azure Data Platform with Azure Data Factory, Databricks, and dbt
๐ฟ
software
getdbt.com
ยท
2d
2 days ago
The analytics
engineer
in 2026: system designer, governance owner,
AI
context provider (5 minute read)
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for The analytics engineer in 2026: system designer, governance owner, AI context provider (5 minute read)
๐ ๏ธ
Ghidra
blocksandfiles
ยท
21h
21 hours ago
Komprise provides
lakehouse
access to petabytes of unstructured
data
Coversย
Apache Iceberg
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Komprise provides lakehouse access to petabytes of unstructured data
๐ ๏ธ
DevOps
dataengineeringcentral.substack.com
ยท
4d
4 days ago
Review of
Databricks
Data +
AI
Summit 2026 (14 minute read)
Coversย
2ย stories
See all stories this covers
ย includingย
Databricks Launches LTAP: A Unified OLAP/OLTP Data Architecture
Discussed on
Substack
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Review of Databricks Data + AI Summit 2026 (14 minute read)
๐๏ธ
Computer Vision
arXiv
ยท
1d
1 day ago
DBT-Bleed
: Dual-Branch Temporal Modeling with Key-Frame Selection for Surgical Bleeding Detection
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for DBT-Bleed: Dual-Branch Temporal Modeling with Key-Frame Selection for Surgical Bleeding Detection
๐ง
Linux
Techzine Global
ยท
3h
3 hours ago
Nokia and
Databricks
test platform for
AI-driven
networks
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Nokia and Databricks test platform for AI-driven networks
๐ค
LLMs
Search CIO
ยท
19h
19 hours ago
Everpure
Data
Stream preps
data
pipeline
for enterprise
AI
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Everpure Data Stream preps data pipeline for enterprise AI
๐
Fuzzing
medium.com
ยท
1d
1 day ago
The Architecture of REM: Why Sleep Posture Triggers Systems-Level Hallucinations
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for The Architecture of REM: Why Sleep Posture Triggers Systems-Level Hallucinations
๐ค
AI Agents
optixlog.medium.com
ยท
13h
13 hours ago
Context is the bottleneck for
AI
in the physical world
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Context is the bottleneck for AI in the physical world
๐ค
AI
MotherDuck Blog posts
ยท
6d
6 days ago
Flight Plans: Templates for
AI-Native
Data
Pipelines
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Flight Plans: Templates for AI-Native Data Pipelines
๐ค
AI
InfoWorld
ยท
18h
18 hours ago
EDB converges analytics on Postgres to support
AI
agents
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for EDB converges analytics on Postgres to support AI agents
โก
Performance
Nature
ยท
1d
1 day ago
Ligand-mediated suppression of Ostwald ripening enables low-temperature sol-gel ZnO for efficient inverted flexible organic photovoltaics
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Ligand-mediated suppression of Ostwald ripening enables low-temperature sol-gel ZnO for efficient inverted flexible organic photovoltaics
๐ง
Claude
perceptiontheory.bearblog.dev
ยท
6d
6 days ago
Improving a
data
pipeline
with DSPy
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Improving a data pipeline with DSPy
๐
APIs
storagereview.com
ยท
20h
20 hours ago
VDURA Unveils Multi-Tenant Control Plane and S3 Enhancements at ISC 2026
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for VDURA Unveils Multi-Tenant Control Plane and S3 Enhancements at ISC 2026
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous post
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Discover
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
Like
Save
Not for me
Report