🔄 Data Pipelines - gbakes · Scour

AI agents on Microsoft Fabric for faster retail merchandising decisions 🏛️Clickhouse

techcommunity.microsoft.com·9h

Medallion Architecture 🏗️Design Patterns

dataengineering.wiki·5d

Visual Data Preparation 🔄Data Engineering

Amazon MWAA now supports Apache Airflow 3.2 📊Apache Kafka

aws.amazon.com·1d

MCP YAML API – A Model Context Protocol server that creates tools from API configurations defined in YAML files, allowing easy integration of external APIs into... 📊Apache Kafka

glama.ai·5d·r/mcp

The future of agentic development: Redefining the data practitioner lifecycle with Data Agent Kit 🔀ETL Patterns

cloud.google.com·1d

Scaling Real-Time Traffic Forecasting with a Graph-Aware Transformer 🔄dbt

uber.com·10h·Hacker News

The Data Infrastructure Behind Algorithmic Trading: Understanding Financial Data APIs 🔀ETL Patterns

blog.quantinsti.com·5d

Announcing the Databricks analytics engineer learning pathway 🔄dbt

databricks.com·2d

PyPlumber/Incorporator: A schema-free data mapper and pipeline orchestrator that turns JSON, XML, CSV, SQLite, Parquet formats into a unified Python object graph with dot-notation and access-at-runtime. ✅Pydantic

github.com·5d·Hacker News

The Future of Data Engineering Is Not ETL. It’s Autonomous Systems. 🔄Data Engineering

cloudwithazeem.medium.com

·2d

Why the Elasticsearch Platform is the missing piece in your AI stack 🏛️Clickhouse

Encrypting large artifacts and streaming workloads with Vault 📊Parquet

hashicorp.com·10h

New in Confluent Cloud: Making Data, Pipelines, and Ops Accessible for AI-Ready Streaming 📊Parquet

confluent.io·1d

McGill researchers help secure Canadian access to the world’s largest telescope 📓Jupyter Notebooks

The AI Data Analyst that onboards itself 🔧Dagster

zenlytic.com·11h

Frontier Risk Report (February to March 2026) ✅Pydantic

Environmental Burden of United States Data Centers in the Artificial Intelligence Era 📊Parquet

May 26 workshop: Agent orchestration on AWS (Sponsor) 📡Event-Driven Architecture

pages.awscloud.com·3d

New comment by jochem9 in "Hershey Bets on Agentic AI to Rethink $2B in Marketing Spend" 🔄Data Engineering

news.ycombinator.com·2d·Hacker News

Log in to enable infinite scrolling