🛠️ Data Engineering - Phoneix_355 · Scour

Automate Your Data + ML Pipelines With Apache Airflow 🧠LLM Apps

gitanjalisoni.medium.com·5d

Dawn of the autonomous data pipeline 🌐Distributed Systems

zyte.com·2d

Spark creator bags computing gong for making big data a little bit smaller 🏗️System Design

theregister.com·11h

Data Pipelines for Machine Learning: From Ingestion to Training (2026 Guide) 🧠LLM Apps

flexiana.com·15h

Show HN: I built a local data lake for AI powered data engineering and analytics 🧠LLM Apps

stream-sock-3f5.notion.site·1d·Hacker News

Nvidia can't have every data center workload 🏗️System Design

runtime.news·4h

Microsoft ADO.NET Driver for Microsoft Fabric Data Engineering (Preview) | Microsoft Fabric Blog 🏗️Design Patterns

blog.fabric.microsoft.com·3d

AI Agent Database Infrastructure: Streaming + Branching by Claudiu Dascalescu 🤖AI Agents

xata.io·11h·Hacker News

Learn data engineering by building a real project (sponsored tutorial + competition with prizes) 🧠LLM Apps

getbruin.com·2d·r/learnprogramming

How I Built a Fine-Tuned Medical AI App and Deployed It End-to-End on AWS 🧠LLM Apps

medium.com·3h

How Zalando built a unified data foundation for AI and analytics on Databricks 🌐Distributed Systems

databricks.com·12h

Aspect oriented data quality for dataflows 🏗️Design Patterns

docs.tabsdata.com·1d·Hacker News

Consulting the Oracle: Claude on the Future of Data 🤖AI Agents

motherduck.com·6d

☕🤖 Anthropic Just Launched Cloud Agents You Can Deploy in Minutes 🤖AI Agents

theaibreak.substack.com·14h·Substack

CUDA Programming for NVIDIA H100s 🏗️System Design

freecodecamp.org·5h

Designing an Analytics Engine for AI Agent Workloads 🤖AI Agents

starrocks.io·2d

Article: Building Hierarchical Agentic RAG Systems: Multi-Modal Reasoning with Autonomous Error Recovery 🌐Distributed Systems

infoq.com·19h

Zero Data Loss Migration: Moving Billions of Rows from SQL Server to Aurora RDS — Architecture, Predictive CDC Monitoring & Lessons from Production 🏗️System Design

linkedin.com·4d·DEV

Beyond Cron: 5 Automation Plays to Slash Your Company's OpEx 🏗️System Design

getmichaelai.com·2d·DEV

I built a Travel Data Platform API in .NET - search, analytics, and recommendations with Redis caching 🧠LLM Apps

github.com·23h·DEV

Loading more...