⚡ Apache Spark

Distributed Computing, DataFrames, Big Data Processing, Analytics

Scaling up Prime Video monitoring service reduced costs 90% (archive) (2023)
web.archive.org·2h·
Discuss: Hacker News
📊Columnar Databases
Flag this post
We found embedding indexing bottleneck in the least expected place: JSON parsing
nixiesearch.substack.com·8h·
Discuss: Substack
📊Columnar Databases
Flag this post
"You Don't Need Kafka, Just Use Postgres" Considered Harmful
morling.dev·8h·
Discuss: Lobsters, Hacker News
📊Columnar Databases
Flag this post
I just trained a physics-based earthquake forecasting model on a $1000 GPU
news.ycombinator.com·55m·
Discuss: Hacker News
⚡ClickHouse
Flag this post
Building Yantra: A Visual Workflow Automation Engine
patali.dev·21h·
Discuss: Hacker News
🔄ETL Pipelines
Flag this post
A Thesis and Playbook for Edge AI
ondeviceguy.substack.com·14h·
Discuss: Substack
📊Columnar Databases
Flag this post
Open Sourcing Kubetorch
run.house·9h·
Discuss: Hacker News
⚡ClickHouse
Flag this post
My First Multi-GPU Kernel: Writing All-to-All for AMD MI300X
gau-nernst.github.io·1d·
Discuss: Hacker News
📊Columnar Databases
Flag this post
The Case Against PGVector
alex-jacobs.com·12h·
Discuss: Hacker News
📊Columnar Databases
Flag this post
Geonum – geometric number library for unlimited dimensions with O(1) complexity
github.com·10h·
Discuss: Hacker News
📊Columnar Databases
Flag this post
Best Digital Marketing Institute in Allahabad – Ndmit Prayagraj
ndmit.com·1d·
Discuss: Hacker News
🔧Data Engineering
Flag this post
Building blobd: single-machine object store with sub-millisecond reads and 15 GB/s uploads
blog.wilsonl.in·1d·
Discuss: Hacker News
🔧Database Internals
Flag this post
Fortytwo's decentralized AI has the answer to life, the universe, and everything
theregister.com·1d·
Discuss: Hacker News
📊Columnar Databases
Flag this post
Why We Migrated from Python to Node.js
blog.yakkomajuri.com·8h·
Discuss: Hacker News, r/node
🐍Python
Flag this post
Writing an LLM from scratch, part 27 – what's left, and what's next?
gilesthomas.com·15m·
Discuss: Hacker News
⚡OLTP Systems
Flag this post
Show HN: Claude Code disrupted programming. Bringing that power to office worker
blog.gbase.ai·13h·
Discuss: Hacker News
🔄ETL Pipelines
Flag this post
Catalog of reliability properties for blockchains (Antithesis)
antithesis.com·7h·
Discuss: Hacker News
⚡OLTP Systems
Flag this post
Challenging the Fastest OSS Workflow Engine
obeli.sk·3d·
Discuss: Lobsters, Hacker News
⚡OLTP Systems
Flag this post
Absurd Workflows: Durable Execution With Just Postgres
lucumr.pocoo.org·1d·
Discuss: Lobsters, Hacker News
⚡OLTP Systems
Flag this post
Best Open Source Observability Solutions
clickhouse.com·3d·
Discuss: Hacker News
⚡ClickHouse
Flag this post