🔄 ETL Pipelines

Data Transformation, Pipeline Orchestration, Data Integration, Workflow Management

Day 26: The Dead Letter Queue Pattern
javatsc.substack.com·8h·
Discuss: r/programming
👁️Observability
Flag this post
How We Integrate Legacy Systems With Modern Stacks
dev.to·3d·
Discuss: DEV
🧊Iceberg Tables
Flag this post
How to Avoid Common Data Management Pitfalls in Enterprise RAG Systems: A Guide to Effective Governance and Observability
dev.to·4d·
Discuss: DEV
🗂️Metadata Management
Flag this post
Moving tables across PostgreSQL instances
ananthakumaran.in·5d·
Discuss: Lobsters, Hacker News
💾Databases
Flag this post
Show HN: Kumi – a portable, declarative, functional core for business logic
kumi-play-web.fly.dev·1d·
Discuss: Hacker News
🔧Functional Programming
Flag this post
The Design Innovations of NopGraphQL: From API Protocol to a General-Purpose Information Operation Engine
dev.to·4d·
Discuss: DEV
⚡DataFusion
Flag this post
Building a Scalable API Event Logger using Pub/Sub, and BigQuery
dev.to·3d·
Discuss: DEV
🌊Apache Flink
Flag this post
Building Data Tools That Work
blog.matterbeam.com·2d·
Discuss: Hacker News
🏗data engineering
Flag this post
From Signals to Reliability: SLOs, Runbooks and Post-Mortems
fatihkoc.net·4d·
Discuss: Hacker News, r/devops
👁️Observability
Flag this post
Reactive Tree Management in Nuxt 4: How I Modeled Complex Hierarchies with Pinia
dev.to·5d·
Discuss: DEV
🧮Apache Calcite
Flag this post
Supercharging the ML and AI Development Experience at Netflix
netflixtechblog.medium.com·2d·
Discuss: Hacker News
📊Columnar Engines
Flag this post
Migration Case: From Azkaban to DolphinScheduler
dev.to·1d·
Discuss: DEV
🏞️Delta Lake
Flag this post
Durable execution workflow system based on Postgres
github.com·6d·
Discuss: Hacker News
🔄Concurrency
Flag this post
ScaleCall - Agentic Tool Calling at Scale for Fintech: Challenges, Methods, and Deployment Insights
arxiv.org·3d
🏗data engineering
Flag this post
Detailed Technical Documentation on AI Implementation Logic (Taking Large Language Models as an Example )
nbtab.com·3d·
Discuss: DEV
⚙️Query Compilers
Flag this post
How Do Zapier Specialists Automate Data Flow?
dev.to·2d·
Discuss: DEV
📋CSV Processing
Flag this post
Deep Learning Approach to Anomaly Detection in Enterprise ETL Processes with Autoencoders
arxiv.org·3d
📋CSV Processing
Flag this post
Building our geospatial database in production
radar.com·1d·
Discuss: Hacker News
⚙️Database Internals
Flag this post
Enabling Trillion-Parameter Models on AWS EFA
research.perplexity.ai·2d·
Discuss: Hacker News
📊Columnar Engines
Flag this post
Building a highly-available web service without a database
screenshotbot.io·2d·
Discuss: r/programming
🧊Iceberg Tables
Flag this post