🌟 spark

optimisation, memory management, query plans, predicate push down, Livy

Building a Streaming Data Pipeline with Kafka and Spark: Real-Time Analytics Implementation Guide
dev.to·10h·
Discuss: DEV
🌊Stream Processing
Homomorphism Problems in Graph Databases and Automatic Structures
arxiv.org·15h
🕸️Graph Databases
Let's Write a Macro in Rust
hackeryarn.com·3h·
Discuss: Hacker News
🔧Functional Programming
GoMem is a high-performance memory allocator library for Go
github.com·16h
🧠Memory Management
Built FoldCMS: a type-safe static CMS with Effect and SQLite with full relations support (open source)
reddit.com·5h·
Discuss: r/opensource
⚡DataFusion
We Benchmarked DuckDB, SQLite, and Pandas on 1M Rows: Here’s What Happened
kdnuggets.com·5h
💾Databases
Evaluating Gemini 2.5 Deep Think's math capabilities
epoch.ai·5h·
Discuss: Hacker News
🔢NumPy
Storage news ticker – October 10
blocksandfiles.com·9h
📊Column Stores
N8n vs. Windmill vs. Temporal
blog.arcbjorn.com·19h·
Discuss: Hacker News
📊Columnar Engines
From CAP to GAP?
fsharpforfunandprofit.com·12h·
Discuss: DEV
🔧Functional Programming
Has anyone here tried Artiforge? It’s a toolkit that helps coding with AI using MCP. I’ve been exploring it lately and I’m curious if someone had tried it.
artiforge.ai·9h·
Discuss: r/programming
🤖AI
CubicLog – A single-binary logging server with zero-config smart analytics
github.com·21h·
Discuss: Hacker News
⏱️Real-time Analytics
I Tried an AI Tool That Turns Any Content Into a Mind Map So You Actually Remember Stuff
future.forem.com·14h·
Discuss: DEV
🔬Academic Search
Krish Naik: Complete RAG Crash Course With Langchain In 2 Hours
dev.to·12h·
Discuss: DEV
⚙️Query Compilers
The effective LLM multi-tenant security with SQL
getbruin.com·23h·
Discuss: Hacker News
⚡DataFusion
AsyncSpade: Efficient Test-Time Scaling with Asynchronous Sparse Decoding
arxiv.org·15h
📊Columnar Engines
Atlassian's 4M PostgreSQL Database Migration
infoq.com·21h·
Discuss: Hacker News
🏛️Lakehouse Architecture
Implementing ZADD If Key Exists
rozumem.xyz·13h·
Discuss: Hacker News
🏞️Delta Lake
Python For Data Engineering
github.com·10h·
Discuss: DEV
🏗data engineering
🚀 From Rejection to Reinvention: How I Built an AI That Finds My Jobs
youtu.be·5h·
Discuss: DEV
🤖AI