🏠 Self-hosted AI

Model Optimization, Inference Engines, LLM Quantization, Privacy-focused Deployments

Optimal Scheduling Algorithms for LLM Inference: Theory and Practice
arxiv.org·8h
💻Local LLMs
Show HN: AI Sandbox with Kata, Firecracker, Cloud HV (E2B, Daytona Alternative)
cognitora.dev·1d·
Discuss: Hacker News
🤖AI agents
Why benchmarks are key to AI progress
infoworld.com·3h
🏗️AI Infrastructure
Machine Learning Fundamentals: machine learning with python
dev.to·18h·
Discuss: DEV
🏗️AI Infrastructure
How LLMs See the World
blog.bytebytego.com·20h
💻Local LLMs
Living with LLMs
matiasklemola.com·2h·
Discuss: Hacker News
🧩Low-code
Evading Data Provenance in Deep Neural Networks
arxiv.org·8h
💻Local LLMs
From Drift to Discipline: How Governed Cognition Makes AI a Reliable Junior Developer
hackernoon.com·14h
🧩Low-code
Beyond Manually Designed Pruning Policies with Second-Level Performance Prediction: A Pruning Framework for LLMs
arxiv.org·8h
💻Local LLMs
Juris.js: The Thousand Masters Architecture That AI Can't Even Figure Out Where to Start
dev.to·16h·
Discuss: DEV
🤖AI agents
The hidden engineering behind foundation model building
poolside.ai·2d·
Discuss: Hacker News
🏗️AI Infrastructure
Announcing Burn-LM (alpha): LLM Inference Engine
reddit.com·16h·
Discuss: r/rust
🏗️AI Infrastructure
Lumo privacy and security model
proton.me·18h·
Discuss: Hacker News
💻Local LLMs
AI-Driven Cybersecurity Threat Detection: Building Resilient Defense Systems Using Predictive Analytics
arxiv.org·8h
🏗️AI Infrastructure
Filtering with Self-Attention and Storing with MLP: One-Layer Transformers Can Provably Acquire and Extract Knowledge
arxiv.org·8h
🤝Federated Learning
ProCut: LLM Prompt Compression via Attribution Estimation
arxiv.org·8h
💻Local LLMs
Refine-n-Judge: Curating High-Quality Preference Chains for LLM-Fine-Tuning
arxiv.org·8h
💻Local LLMs
SAT Requires Exhaustive Search
link.springer.com·15h·
Discuss: Hacker News
λFunctional Programming
TRACEALIGN -- Tracing the Drift: Attributing Alignment Failures to Training-Time Belief Sources in LLMs
arxiv.org·8h
💻Local LLMs
D-Wave Introduces New Developer Tools to Advance Quantum AI Developement
dwavequantum.com·18h·
Discuss: Hacker News
🧠Neuromorphic Chips