🏗 data engineering - widget101 · Scour

I Built a RAG Application from Scratch - Here's the Real Cost and Performance Data

dev.to·18h·

Discuss: DEV

🧮Apache Calcite

5 Ways Spark 4.1 Moves Data Engineering From Manual Pipelines to Intent-Driven Design

hackernoon.com·6d

🔄ETL Pipelines

hanig/engram: Personal knowledge graph and automation system

github.com·10h

🗂️Obsidian

Production pain points and coordination patterns from building a dual-orchestrator (Claude + Kimi) system on Claude Code. 8 failure modes with specs and invariants.

gist.github.com·12h·

Discuss: Hacker News

📊Columnar Engines

Structured outputs on Amazon Bedrock: Schema-compliant AI responses

aws.amazon.com·1d

Database Schema as Code Intelligence

dev.to·2h·

Discuss: DEV

🧮Apache Calcite

Visual data modelling in the browser (open source)

github.com·15h·

Discuss: Hacker News

📉data visualisation

How to Design Systems That Actually Scale? Think Like a Senior Engineer

javarevisited.substack.com·1h·

Discuss: r/programming

🏗️Hardware Architecture

Why RAG Failed Us for SRE and How We Built Dynamic Memory Retrieval Instead

drdroid.io·1d·

Discuss: Hacker News

⚙️Database Internals

How I squeezed a BERT sentiment analyzer into 1GB RAM on a $5 VPS

mohammedeabdelaziz.github.io·20h·

Discuss: Hacker News

gharasathi (घरासाठी) — A Privacy-First Household AI Running on a $200 Mini PC

amazon.com.au·7h·

Discuss: DEV

🧊Iceberg Tables

Feedoise - Breaking Language Barriers in Product Feedback

medium.com·2h·

Discuss: r/programming

Improving atlas-scale single-cell annotation models with hierarchical cross-entropy loss

nature.com·2d

🧭Vector Databases

Data Integration

databricks.com·4d

🔧Data Engineering

What if we treated the Nvidia GB10 as an employee: AI could remove reporting roles entirely from businesses with thousands of job losses, here's how this review...

techradar.com

·13h

📊Data Lineage

Data Agent Ready Database: Designing the Next-Gen Enterprise Data Warehouse

databend.com·4d·

Discuss: Hacker News

🏛️Lakehouse Architecture

Kubernetes Operator for automated Jupyter Notebook validation in MLOps pipelines

reddit.com·1d·

Discuss: r/kubernetes

I struggled with system design until I learned these 114 concepts

newsletter.systemdesign.one

·21h

🏛️Lakehouse Architecture

Building the Future with AI That Acts

devxt.com·12h·

Discuss: Hacker News

🎮Reinforcement Learning

A Modern Python Stack for Data Projects (uv + ruff + ty + Marimo + Polars)

mameli.dev·3d·

Discuss: r/programming

Loading more...