🌟 spark

optimisation, memory management, query plans, predicate push down, Livy

Build a RAG application with LangChain and Local LLMs powered by Ollama
dev.to·16h·
Discuss: DEV
⚡DataFusion
I tried DSPy and now I get why everyone won't shut up about it
pedramnavid.com·27m·
Discuss: Hacker News
⚙️Query Compilers
Monolith vs Microservices: The $1M ML Design Decision
javarevisited.substack.com·19h·
Discuss: r/programming
📊Columnar Engines
Amazon Redshift Serverless at 4 RPUs: High-value analytics at low cost
aws.amazon.com·9h
🗄️Storage Tiering
Graphzep -TypeScript implementation of temporal knowledge graph memory system
github.com·9h·
Discuss: Hacker News
⚡DataFusion
Accelerate intelligent document processing with generative AI on AWS - Amazon Web Services
news.google.com·13h
🔍AI Detection
The dangers of the JDBC bottleneck in Trino
starburst.io·13h·
Discuss: Hacker News
⚙️Database Internals
Shortcuts for the Long Run: Automated Workflows for Aspiring Data Engineers
kdnuggets.com·16h
🏗data engineering
ChatGPT Is Everywhere, But What Can It Do and How Does It Work?
pcmag.com·22h
⏱️Real-time Analytics
My tips for using LLM agents to create software
efitz-thoughts.blogspot.com·5h·
Discuss: Hacker News
🤖AI
Do I need a Lisp Machine comeback?
far.chickenkiller.com·18h·
Discuss: Hacker News
⚙️Query Compilers
Building a Lambda-Style Feature Platform with GCP Native Services
hackernoon.com·17h
🏗data engineering
Pgschema: Postgres Declarative Schema Migration, Like Terraform
pgschema.com·13h·
Discuss: Hacker News
💾Databases
Show HN: Tabwise – AI data analyst that outperforms ChatGPT and Claude
tabwise.ai·15h·
Discuss: Hacker News
⚡ClickHouse
Cracking the Density Code: Why MAF Flows Where KDE Stalls
towardsdatascience.com·13h
📊Columnar Engines
Accelerate intelligent document processing with generative AI on AWS
aws.amazon.com·13h
📊Columnar Engines
Dreaming of Graphs in the Open Lakehouse
semyonsinchenko.github.io·22h·
Discuss: Hacker News
🏛️Lakehouse Architecture
Digest #177: AWS in 2025, HashiCorp Vault Zero-Day Flaws, Why No SRE, Docker-Compose Tricks
devopsbulletin.com·13h
🏗data engineering
Kumo.AI trains foundation model for relational databases
blocksandfiles.com·15h
🏛️Lakehouse Architecture
Why Was Apache Kafka Created?
bigdata.2minutestreaming.com·11h·
Discuss: Hacker News
⚡DataFusion