💻 Local LLMs

Model Quantization, Inference Optimization, GGUF Format, Privacy-preserving AI

OBCache: Optimal Brain KV Cache Pruning for Efficient Long-Context LLM Inference
arxiv.org·18h
🏠Self-hosted AI
2025-10-10 # LLMs Are Transpilers
alloc.dev·22h·
Discuss: Hacker News
🏠Self-hosted AI
A small number of samples can poison LLMs of any size
dev.to·19h·
Discuss: DEV
🏠Self-hosted AI
LLM-Based AI Agent That Automates The Transistor Sizing Process (Univ. of Edinburgh)
semiengineering.com·1h
🧠Neuromorphic Chips
RND1: Simple, Scalable AR-to-Diffusion Conversion
radicalnumerics.ai·1d·
Discuss: Hacker News
🏗️AI Infrastructure
Three Solutions to Nondeterminism in AI
blog.hellas.ai·2d·
Discuss: Hacker News
🏗️AI Infrastructure
LoRA Explained: Faster, More Efficient Fine-Tuning with Docker
docker.com·1d
🏠Self-hosted AI
VLLM Predicted Outputs
cascadetech.ai·1h·
Discuss: Hacker News
🎙️Whisper
Hardware Vulnerability Allows Attackers to Hack AI Training Data – NC State News
news.ncsu.edu·1h·
Discuss: Hacker News
⚡Hardware Acceleration
Analyzing Dialectical Biases in LLMs for Knowledge and Reasoning Benchmarks
machinelearning.apple.com·1d
🎙️Whisper
SPAD: Specialized Prefill and Decode Hardware for Disaggregated LLM Inference
arxiv.org·18h·
Discuss: r/LLM
🏗️AI Infrastructure
LLM Optimization Notes: Memory, Compute and Inference Techniques
gaurigupta19.github.io·4d·
Discuss: Hacker News
🏗️AI Infrastructure
The Hidden Oracle Inside Your AI: Unveiling Data Density with Latent Space Magic by Arvind Sundararajan
dev.to·1d·
Discuss: DEV
📱Edge AI
Towards a Typology of Strange LLM Chains-of-Thought
lesswrong.com·1d
🏗️AI Infrastructure
Neuro-Symbolic AI
en.wikipedia.org·7h·
Discuss: Hacker News
🧠Neuromorphic Chips
Evaluating Gemini 2.5 Deep Think's math capabilities
epoch.ai·8h·
Discuss: Hacker News
🏗️AI Infrastructure
Scaling LLM Multi-turn RL with End-to-end Summarization-based Context Management
arxiv.org·1d
🏠Self-hosted AI
Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning
arxiviq.substack.com·1d·
Discuss: Substack
🏗️AI Infrastructure
Operationalizing Data Minimization for Privacy-Preserving LLM Prompting
arxiv.org·3d
🏠Self-hosted AI
Show HN: Nanowakeword – Automates custom wake word model training
github.com·10h·
Discuss: Hacker News
🎙️Whisper