Data Engineering

Feeds to Scour
SubscribedAll
Scoured 212 posts in 23.2 ms

AI Agents and the Fight for Customer Data

 🔄ETL Pipelines
a16z.simplecast.com·

Run an Apache Airflow DAG with Docker Compose and PostgreSQL

 💾Databases
pyimagesearch.com·

Designing an ETL Application: Why I Started with a Modular Monolith Before Microservices

 🔄ETL Pipelines  Content type: Blog
medium.com
·

Exclusive: MotherDuck adds agentic data ingestion to its cloud analytics service

 🏗️Data Platforms
siliconangle.com·

Introducing Flights: Agent-Native Ingest in MotherDuck

 🏗️Data Platforms  Content type: Blog
motherduck.com·

Senior Data Engineer – Climate Friendly

 🚀DevOps
au.seek.com··Hacker News, Hacker News

Deploying Vector High-Performance Observability Data Pipeline on Ubuntu 24.04

 🚀DevOps  Content type: Reference  Content type: Tutorial
docs.vultr.com··DEV

Data Agent Kit - I Explored GCS, Visualized Data, and Built a Pipeline Without Leaving My Editor

 🏗️Data Platforms  Content type: Blog
medium.com
·

Introducing Streamling: Performant and Extensible Data Streaming Framework

 ⚡DataFusion  Content type: News
streamingdata.tech·

benseverndev-oss/goldenmatch: Zero-config entity resolution that scales from a CSV to 100M+ rows on a Ray cluster (verified: 100M deduped in 213s, 0.30 GB driver). Fuzzy + exact + probabilistic dedupe, identity graph, PPRL, LLM boost. Python + full TypeScript port; SQL-native in PostgreSQL & DuckDB; MCP/REST servers, dbt + Airflow recipes.

 💾Databases  Content type: Code
github.com··Hacker News

Choosing the right workflow orchestration service for your use case: Amazon MWAA and AWS Step Functions

 ☁️Cloud Computing  Content type: Blog
aws.amazon.com·

Integration Patterns: How To Choose for Your Architecture

 🔄ETL Pipelines  Content type: Blog
blog.n8n.io·

Real-time data replication to your data warehouse, self-serve

 🏗️Data Platforms
artie.com··Hacker News, Hacker News

Embedding pipelines are the new ETL

 🔄ETL Pipelines  Content type: Blog
infoworld.com·

Towards Post-Quantum Secure Pharmacovigilance with ML-KEM and ML-DSA

 🔄Data Pipelines  Content type: Academic
arxiv.org·

SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development

 🔄ETL Pipelines  Content type: Blog
medium.com·

Azerbaijani Central Bank set to adopt data Lakehouse system in 2026

 🏗️Data Platforms
trend.az·

15 years of Software Center – A Look in the Mirror and over the Front Windshield

 🚀DevOps  Content type: Blog
metrics.blogg.gu.se·

The Hidden Tax Killing Your ML Team’s Velocity – And the Architecture Decision That Fixes It

 📊Data Lineage  Content type: Blog
medium.com·

DuckDB Storage Engine for MariaDB. When the Sea Lion Learns to Quack.

 📊Columnar Engines
mariadb.org··Hacker News

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help