Serverless ETL, Data Catalog, Crawlers, Job Scheduling, PySpark

From Postgres to Iceberg
dev.to·1d·
Discuss: DEV
🏠Data Lakehouse
Flag this post
AWS Weekly Roundup: Project Rainier online, Amazon Nova, Amazon Bedrock, and more (November 3, 2025)
aws.amazon.com·3d
☁️AWS Infrastructure
Flag this post
A self-hosted Security Operations Center in a box to avoid vendor lock
github.com·3h·
☁️AWS Infrastructure
Flag this post
Scaling data governance with Amazon DataZone: Covestro success story
aws.amazon.com·3d
🏛️Lakehouse Architecture
Flag this post
Beyond Pinecone: A Developer's Deep Dive into the Top 10 Vector Databases for GenAI in 2024
dev.to·1h·
Discuss: DEV
DataFusion
Flag this post
How Distributed ACID Transactions Work in TiDB
pingcap.com·6d
⚛️Atomic Databases
Flag this post
Orchestrating big data processing with AWS Step Functions Distributed Map
aws.amazon.com·2d
📊AWS Analytics
Flag this post
The Data Engineering Agent is now in preview
cloud.google.com·3d
🏗data engineering
Flag this post
Announcing Magika 1.0: now faster, smarter, and rebuilt in Rust
blogger.com·17h
📋Tokei
Flag this post
Digest #186: Inside the AWS Outage, Docker Compose in Production, F1 Hacks and 86,000 npm Packages Attacks
devopsbulletin.com·6d
☁️AWS Infrastructure
Flag this post
Redpanda 25.3 delivers near-instant disaster recovery, and more
redpanda.com·1d
🏠Data Lakehouse
Flag this post
Apache Arrow’s Final Frontier: Replacing Outdated Database Drivers
thenewstack.io·3d
DataFusion
Flag this post
Moving tables across PostgreSQL instances
ananthakumaran.in·5d·
💾Databases
Flag this post
Deploying Temporal on AWS ECS with Terraform
papnori.github.io·2d·
Discuss: Hacker News
☁️AWS Infrastructure
Flag this post
From Lab PC to Serverless: DNA Sequence Alignment on AWS
dev.to·4d·
Discuss: DEV
📊AWS Analytics
Flag this post
Snowflake goes all out to woo PostgreSQL developers with lakehouse extensions
theregister.com·2d
🧊Iceberg Tables
Flag this post
How to Scale Analytics When You’re Tracking Billions of Events Without Exploding Cost
mitzu.io·3h·
Discuss: DEV
🏠Data Lakehouse
Flag this post
Breaking Monoliths Taught Me How to Fix Data
blog.matterbeam.com·6d·
Discuss: Hacker News
🏛️Lakehouse Architecture
Flag this post
Rapid-eks – Production EKS in 13 minutes with Terraform + Python
hackernoon.com·1d
☁️AWS Infrastructure
Flag this post
Leaving PyTorch and Meta
soumith.ch·18h·
📓Jupyter
Flag this post