🌟 spark

optimisation, memory management, query plans, predicate push down, Livy

From SQL to Python: Uniting Stored Power with Functional Flexibility
dev.to·20h·
Discuss: DEV
💾Databases
MiniRust
github.com·11h·
Discuss: Hacker News
🦀Rust Scientific
AlloyDB on Axion-powered C4A instances is generally available
cloud.google.com·18h
📊Column Stores
Tuning guide for AMD Amazon EC2 instances
aws.amazon.com·16h
📈Performance Profiling
LLMs as Retrieval and Recommendation Engines
medium.com·17h·
Discuss: Hacker News
📇Indexing Strategies
Graph rag pipeline that runs entirely locally with ollama and has full source attribution
reddit.com·23h·
Discuss: r/programming
⚡DataFusion
Get Excited About Postgres 18
crunchydata.com·23h·
Discuss: Hacker News, r/programming
📊Column Stores
K2-Think: A Parameter-Efficient Reasoning System
arxiviq.substack.com·19h·
Discuss: Substack
⚙️Query Compilers
From Legal Documents to Knowledge Graphs
neo4j.com·1h·
Discuss: Hacker News
📊Data Lineage
Choosing Rust for LLM-generated code
runmat.org·17h·
Discuss: Hacker News
🦀Rust Scientific
Synthetic data could help when it comes to evaluating RAGs, researchers find
blocksandfiles.com·22h
🏗data engineering
Automate advanced agentic RAG pipeline with Amazon SageMaker AI
aws.amazon.com·17h
📊Data Lineage
Your APIs Are Costing More Than You Think
thenewstack.io·18h
👁️Observability
The future of microoptimization
goldenstack.net·6h·
Discuss: Hacker News
⚡SIMD Optimization
Unlock LLM Potential at the Edge: Secure, Efficient Inference Without the Cloud
dev.to·22h·
Discuss: DEV
⚡DataFusion
FastAPI Mistakes That Kill Your Performance
dev.to·6h·
Discuss: DEV
🧮Apache Calcite
AWS Glue: The Serverless Architect of Your Data Lake
dev.to·18h·
Discuss: DEV
🏗data engineering
Why OpenAI’s solution to AI hallucinations would kill ChatGPT tomorrow
theconversation.com·19h
🎮Reinforcement Learning
Docling: The Document Alchemist
towardsdatascience.com·18h
📓Jupyter
The Capability-Tractability Tradeoff (2023)
buttondown.com·14h·
Discuss: Hacker News
🛡️Memory Safety