Data Engineering

Feeds to Scour
SubscribedAll
Scoured 320 posts in 10.1 ms

benseverndev-oss/goldenmatch: Zero-config entity resolution that scales from a CSV to 100M+ rows on a Ray cluster (verified: 100M deduped in 213s, 0.30 GB driver). Fuzzy + exact + probabilistic dedupe, identity graph, PPRL, LLM boost. Python + full TypeScript port; SQL-native in PostgreSQL & DuckDB; MCP/REST servers, dbt + Airflow recipes.

 🐍Python  Content type: Code
github.com··Hacker News

Introducing Flights: Agent-Native Ingest in MotherDuck

 🔌Data Integration  Content type: Blog
motherduck.com·

Snowflake CEO says there’s a big myth at the heart of every org chart

 📰Newsroom Tech  Content type: News
fortune.com
·

Senior Data Engineer – Climate Friendly

 🔄ETL Pipelines
au.seek.com··Hacker News, Hacker News

Snowflake and 1Password tackle the growing challenge of securing AI agents at scale

 🔌Data Integration
siliconangle.com·

SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development

 🔄ETL Pipelines  Content type: Blog
medium.com·

Unveiling Enhanced Location Intelligence Features: Distance & Duration, and Isochrones

 ⚡ClickHouse  Content type: Blog
mapbox.com·

Embedding pipelines are the new ETL

 🔄ETL Pipelines  Content type: Blog
infoworld.com·

Efficient Snowflake Ingestion: Query-Ready Data at Scale

 📊Columnar Databases  Content type: Blog
snowflake.com·

Introducing Streamling: Performant and Extensible Data Streaming Framework

 ⚙️DataFusion  Content type: News
streamingdata.tech·

The Buffett Rule Investors Should Apply To The Next Wave Of Mega‑IPOs

 🚨Fraud Detection
forbes.com·

Integration Patterns: How To Choose for Your Architecture

 🔌Data Integration  Content type: Blog
blog.n8n.io·

Redis Data Integration in Redis Cloud is now GA in AWS

 🧠Memory Databases  Content type: Blog
redis.io·

How the Other Half Counts

 📝SQL  Content type: Blog
thebuild.com··Hacker News

The Hidden Tax Killing Your ML Team’s Velocity – And the Architecture Decision That Fixes It

 🔌Data Integration  Content type: Blog
medium.com·

The Join-Aware Materialized View Query Rewrite Gap (4 minute read)

 ♻️Incremental View  Content type: Blog
eric-sun.medium.com·

On theCUBE: Snowflake, Databricks and more battle for control of AI stack

 🏠Lakehouse
siliconangle.com·

Automating Real-time Data Pipelines: Deploying Pub/Sub to BigQuery with Dataflow Custom Template…

 🔌Data Integration  Content type: Blog
medium.com
·

Gene dependency-informed inference of response to targeted cancer therapies

 🔌Data Integration  Content type: Academic
nature.com·

“Whoever builds the most joyous product wins”: The agent war begins

 🔌Data Integration
thenewstack.io·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help