🏗️ Data Engineering - tyler · Scour

From Pipelines to AI Platforms: How Agentic AI Is Redefining the Role of Data Engineers 💬Prompt Engineering

hackernoon.com·2d·

Maximize engineering value in the AI era 💬Prompt Engineering

flowstate.inc·6d·Hacker News·

grove/pg-trickle: A PostgreSQL extension for streaming tables with incremental view maintenance, powered by differential dataflow in Rust. 🗄️Database Internals

github.com·2d·Hacker News·

Build AWS Glue Data Quality pipeline using Terraform 📦PWA Tooling

aws.amazon.com·6d·

From Distributed Scheduler to WebAssembly: Secure Orchestration of AI Agents 🌍Distributed Systems

volodymyrrudyi.com·1d·Hacker News·

Under the hood: Redpanda Cloud Topics architecture 📡RSS

redpanda.com·2d·Hacker News·

Introducing AURA: Building an Open Agentic harness for production AI 📦PWA Tooling

platformengineering.org·5d·Hacker News·

Pipevals: Evaluation pipelines for every LLM application 📊LLM Evals

pipevals.com·1d·Lobsters, Hacker News·

Show HN: Built Loony for builders who want to spin up data infrastructure fast ⌚Quantified Self

loony.dev·5d·Hacker News·

Semlib: Semantic Data Processing 🔧Code Generation

anishathalye.com·2d·Hacker News·

What Category Theory Teaches Us About DataFrames 🗄️Database Internals

mchav.github.io·4d·Lobsters, Hacker News, Hacker News, r/programming·

Kafka Has Become the Postgres of Streaming — And That Changes Everything 📮Message Queues

hackernoon.com·6h·

Dux: Distributed DuckDB-native DataFrames for Elixir 🗄️Database Internals

dux.now·5d·Hacker News·

Daily Deal: The Ultimate AWS Data Master Class Bundle 🗂️IPFS

techdirt.com·6d·

Agent Skills: One-Shot PySpark from the CLI 🤖Creative Automation

lakesail.com·6d·Hacker News·

lynxbase/lynxdb: A lightweight schema-on-read analytics in a single binary 🗄️Database Internals

github.com·1d·Hacker News·

What if data platforms had agents that coordinated changes automati 📦PWA Tooling

thegyrus.com·3d·Hacker News·

How to Optimize Big Data Platform Costs Across the Data Lifecycle 🏗System Design

hackernoon.com·2d·

provero-org/provero: Declarative data quality engine. Define checks in YAML, run anywhere. 🪟Tauri

github.com·2d·Hacker News·

From SQL Analytics to Predictive Decision Systems: Operationalizing ML Models in Business Operation 📈Query Optimization

hackernoon.com·2d·

Loading more...