Data Engineering

Feeds to Scour
SubscribedAll
Scoured 125 posts in 4.3 ms

From Data Quality Checks to Analytics-Ready Parquet with Python

 📋CSV Processing  Content type: Blog
dev.to··DEV

Senior Data Engineer – Climate Friendly

 🚀DevOps
au.seek.com··Hacker News, Hacker News

Deploying Vector High-Performance Observability Data Pipeline on Ubuntu 24.04

 🚀DevOps  Content type: Reference  Content type: Tutorial
docs.vultr.com··DEV

Why the Modern Data Stack Trapped Data Engineers in Tools

 🏗️Data Platforms
hackernoon.com·

Choosing the right workflow orchestration service for your use case: Amazon MWAA and AWS Step Functions

 ☁️Cloud Computing  Content type: Blog
aws.amazon.com·

benseverndev-oss/goldenmatch: Zero-config entity resolution that scales from a CSV to 100M+ rows on a Ray cluster (verified: 100M deduped in 213s, 0.30 GB driver). Fuzzy + exact + probabilistic dedupe, identity graph, PPRL, LLM boost. Python + full TypeScript port; SQL-native in PostgreSQL & DuckDB; MCP/REST servers, dbt + Airflow recipes.

 💾Databases  Content type: Code
github.com··Hacker News

Real-time data replication to your data warehouse, self-serve

 🏗️Data Platforms
artie.com··Hacker News, Hacker News

Gene dependency-informed inference of response to targeted cancer therapies

 🔄ETL Pipelines  Content type: Academic
nature.com·

Modern Data Stack Migration — Day 1: Scaling to 8+ Companies with DRY Architecture and Chasing a $2M Discrepancy

 🏗️Data Platforms  Content type: Blog
dev.to··DEV

DuckDB Storage Engine for MariaDB. When the Sea Lion Learns to Quack.

 📊Columnar Engines
mariadb.org··Hacker News

Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance

 🌟spark  Content type: Blog
cloud.google.com·

The Considerate Data Modeler

 💾Databases
oranlooney.com··Hacker News

How to Build Data Pipelines That Resist Partition Drift

 🏗️Data Platforms
hackernoon.com·

Storage news ticker - 4 June

 🔄ETL Pipelines
blocksandfiles.com·

COSS Weekly: Supabase achieves $10B valuation, DeepSeek eyes $7B funding round, Martin Scorsese joins Black Forest Labs, and more

 🔄ETL Pipelines  Content type: Blog
dev.to··DEV

Paramount is merging Pluto TV, BET+, and Paramount+ onto one tech stack to prepare for HBO Max

 🔄ETL Pipelines  Content type: News
thenextweb.com·

ETLs in the Era of AI and Sandboxes

 📋CSV Processing
zozo123.github.io··Hacker News

aws/agent-toolkit-for-aws: Official, AWS-supported MCP servers, skills, and plugins to help AI agents build on AWS

 ☁️AWS Infrastructure  Content type: Code
github.com··Hacker News

I Processed 2.4 Billion Tokens Across 52 AI Models for $0.52. Here's the Full Breakdown.

 🚀DevOps
saintlex.sbs··DEV

Data Lineage Is a Vanity Metric Without Business Context

 🗂️Metadata Management  Content type: Blog
dev.to··DEV

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help