Serverless ETL, Data Catalog, Crawlers, Job Scheduling, PySpark

Storage news ticker – 3 November 2025
blocksandfiles.com·3d
🏛️Lakehouse Architecture
Flag this post
Leaving PyTorch and Meta
soumith.ch·16h·
📓Jupyter
Flag this post
Document Chat System
document-chat-system.vercel.app·12h·
Discuss: Hacker News
🗂️Obsidian
Flag this post
AI-Powered AWS CloudWatch Alarm Triage Terraform Module
github.com·6h·
Discuss: DEV
📊AWS Analytics
Flag this post
Best Open Source Observability Solutions
clickhouse.com·6d·
Discuss: Hacker News
👁️Observability
Flag this post
Pg_lake: Postgres with Iceberg and data lake access
github.com·2d·
💾Databases
Flag this post
flowengineR: A Modular and Extensible Framework for Fair and Reproducible Workflow Design in R
arxiv.org·3d
🔧Data Engineering
Flag this post
Google's MCP Toolbox for Databases: A Technical Deep Dive for Engineering Teams
agnost.ai·13h·
Discuss: Hacker News
DataFusion
Flag this post
🌍 Automating Africa’s Energy Data Collection Using Python, Playwright, and MongoDB (2000–2024)
dev.to·2d·
Discuss: DEV
🔄ETL Pipelines
Flag this post
Show HN: Vercel-like deployments on your own VPS
outlap.dev·5d·
Discuss: Hacker News
☁️AWS Infrastructure
Flag this post
Monthly Partitioning and Automatic Rotation of Tables in PostgreSQL (AWS RDS)
dev.to·2d·
Discuss: DEV
💾Databases
Flag this post
Understanding Security, Backup & Compliance in a Database as a Service Model
metizsoftinc.com·4d·
Discuss: DEV
☁️AWS Infrastructure
Flag this post
Building “AI Disaster Response Platform” with Google Cloud Run and Gemini
ai-risk-dashboard-192565971483.asia-south1.run.app·5d·
Discuss: DEV
🏗data engineering
Flag this post
Building a highly-available web service without a database
screenshotbot.io·2d·
Discuss: r/programming
🧊Iceberg Tables
Flag this post
What Is Serverless? A Beginner’s Guide to AWS Lambda & Event-Driven Architectures
dev.to·3d·
Discuss: DEV
☁️Cloud Computing
Flag this post
Deploying to Amazon's cloud is a pain in the AWS younger devs won't tolerate
theregister.com·2d·
Discuss: Hacker News
☁️AWS Infrastructure
Flag this post
We Stopped Reaching for PySpark by Habit. Polars Made Our Small Jobs Boringly Fast.
dev.to·2h·
Discuss: DEV
🏗data engineering
Flag this post
Training: Postgres Performance and Maintenance
postgresconf.org·3d·
Discuss: Hacker News
💾Databases
Flag this post
Automating MongoDB Atlas Cluster Discovery Across All Projects Using PowerShell
dev.to·1d·
Discuss: DEV
DataFusion
Flag this post
AWS exceeds Wall Street’s expectations as demand for cloud infra remains high
techcrunch.com·6d
☁️AWS Infrastructure
Flag this post