🌟 spark

optimisation, memory management, query plans, predicate push down, Livy

EdgeBERT: I Built My Own Neural Network Inference Engine in Rust
dev.to·13h·
Discuss: DEV
🦀Rust Scientific
Optimizing 100B ClickHouse Events
replo.computer·20h·
Discuss: Hacker News
⚡ClickHouse
AlloyDB on Axion-powered C4A instances is generally available
cloud.google.com·7h
📊Column Stores
Tuning guide for AMD Amazon EC2 instances
aws.amazon.com·6h
📈Performance Profiling
Choosing Rust for LLM-generated code
runmat.org·6h·
Discuss: Hacker News
🦀Rust Scientific
We engineered RAG to be 50% faster
elevenlabs.io·15h·
Discuss: Hacker News
🧮Apache Calcite
Get Excited About Postgres 18
crunchydata.com·12h·
Discuss: Hacker News, r/programming
📊Column Stores
Checking object existence in large AWS S3 buckets using Python and PySpark
github.com·17h·
Discuss: DEV
🏗data engineering
From SQL to Python: Uniting Stored Power with Functional Flexibility
dev.to·10h·
Discuss: DEV
💾Databases
GraphQL Router / API Gateway framework written in Golang
github.com·21h·
Discuss: r/golang
⚡DataFusion
Analog Optical Computer for Inference and Combinatorial Optimization
hackaday.com·22h
💡Optical Computing
LLMs as Retrieval and Recommendation Engines
medium.com·7h·
Discuss: Hacker News
📇Indexing Strategies
K2-Think: A Parameter-Efficient Reasoning System
arxiviq.substack.com·8h·
Discuss: Substack
⚙️Query Compilers
MiniRust
github.com·40m·
Discuss: Hacker News
🦀Rust Scientific
Synthetic data could help when it comes to evaluating RAGs, researchers find
blocksandfiles.com·11h
🏗data engineering
Graph rag pipeline that runs entirely locally with ollama and has full source attribution
reddit.com·13h·
Discuss: r/programming
⚡DataFusion
Your APIs Are Costing More Than You Think
thenewstack.io·7h
👁️Observability
LLM-Generated Rules Engines for LLM Explainability
brain.co·12h·
Discuss: Hacker News
🔄Feed Aggregation
Constructing a Question-Answering Simulator through the Distillation of LLMs
arxiv.org·20h
🔍AI Detection
AWS Glue: The Serverless Architect of Your Data Lake
dev.to·7h·
Discuss: DEV
🏗data engineering