ETL Pipelines

🔄 ETL Pipelines

Data Transformation, Pipeline Orchestration, Data Integration, Workflow Management

Feeds to Scour
SubscribedAll
Scoured 193 posts in 10.4 ms

Real-time CDC from Aurora PostgreSQL to Amazon S3 Tables using Debezium and Firehose

 📊AWS Analytics  Content type: Blog
aws.amazon.com·

Run an Apache Airflow DAG with Docker Compose and PostgreSQL

 💾Databases
pyimagesearch.com·

AI Agents and the Fight for Customer Data

 🔧Data Engineering
a16z.simplecast.com·

Designing an ETL Application: Why I Started with a Modular Monolith Before Microservices

 📋CSV Processing  Content type: Blog
medium.com
·

Integration Patterns: How To Choose for Your Architecture

 🔧Data Engineering  Content type: Blog
blog.n8n.io·

Exclusive: MotherDuck adds agentic data ingestion to its cloud analytics service

 🏗️Data Platforms
siliconangle.com·

SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development

 🏗data engineering  Content type: Blog
medium.com·

Introducing Flights: Agent-Native Ingest in MotherDuck

 🔧Data Engineering  Content type: Blog
motherduck.com·

Data Agent Kit - I Explored GCS, Visualized Data, and Built a Pipeline Without Leaving My Editor

 🏗️Data Platforms  Content type: Blog
medium.com
·

Deploying Vector High-Performance Observability Data Pipeline on Ubuntu 24.04

 🚀DevOps  Content type: Reference  Content type: Tutorial
docs.vultr.com··DEV

Embedding pipelines are the new ETL

 🔧Data Engineering  Content type: Blog
infoworld.com·

Real-time data replication to your data warehouse, self-serve

 🏗️Data Platforms
artie.com··Hacker News, Hacker News

Introducing Streamling: Performant and Extensible Data Streaming Framework

 ⚡DataFusion  Content type: News
streamingdata.tech·

Senior Data Engineer – Climate Friendly

 🔧Data Engineering
au.seek.com··Hacker News, Hacker News

Towards Post-Quantum Secure Pharmacovigilance with ML-KEM and ML-DSA

 🔧Data Engineering  Content type: Academic
arxiv.org·

Storage news ticker - 4 June

 🔧Data Engineering
blocksandfiles.com·

15 years of Software Center – A Look in the Mirror and over the Front Windshield

 🚀DevOps  Content type: Blog
metrics.blogg.gu.se·

Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance

 🌟spark  Content type: Blog
cloud.google.com·

Streaming and Batch Data Architectures with Microsoft Fabric to Azure Databricks

 🏗data engineering
techcommunity.microsoft.com
·

Redis Data Integration in Redis Cloud is now GA in AWS

 ☁️Cloud Computing  Content type: Blog
redis.io·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help