🏠 Self-hosted AI

Model Optimization, Inference Engines, LLM Quantization, Privacy-focused Deployments

Feeds to Scour
SubscribedAll
Scoured 10202 posts in 168.5 ms
Zero-Latency Local AI: Tuning Your Linux Kernel for LLM Inference 🐧🧠
dev.to·5h·
Discuss: DEV
🏗️AI Infrastructure
I run local LLMs daily, but I'll never trust them for these tasks
xda-developers.com·1d
💻Local LLMs
Understanding LLM Inference Engines: Inside Nano-vLLM (Part 2)
neutree.ai·1d·
Discuss: Hacker News
💻Local LLMs
Humane, adaptive AI bootstrapping
natemeyvis.com·1d
🤖AI Coding Tools
FHAIM: Fully Homomorphic AIM For Private Synthetic Data Generation
arxiv.org·1d
🔢Homomorphic Encryption
Lessons from securing AI systems at runtime (agents, MCPs, LLMs)
news.ycombinator.com·1d·
Discuss: Hacker News
🤖AI agents
a proposal for AI that's on your side
r.github.io·21h·
Discuss: Hacker News
🤖AI agents
Building Production-Grade Agentic AI Systems: A Comprehensive Guide
dev.to·5h·
Discuss: DEV
🏗️AI Infrastructure
Synthesizing scientific literature with retrieval-augmented language models
nature.com·1d
🔍RAG
ML-LIB: Machine Learning Library Proposed For The Linux Kernel
phoronix.com·20h·
Discuss: Hacker News
🚀MLOps
Sixteen Claude AI agents working together created a new C compiler
arstechnica.com·15h
🤖AI Coding Tools
Securing GenAI: Vol. 8 — Deploying AI apps securely
pub.towardsai.net·13h
🤖AI Coding Tools
The control layer for AI
blog.dottxt.ai·15h·
Discuss: Hacker News
🏗️AI Infrastructure
Scalable Explainability-as-a-Service (XaaS) for Edge AI Systems
arxiv.org·2d
📱Edge AI
AI content optimization platforms
open.forem.com·2d·
Discuss: DEV
🏗️AI Infrastructure
A Neuro Symbolic Architecture For Induced Epistemic Agency and System 2 Reasoning in Quantized Large Language Models
papers.ssrn.com·1d·
Discuss: Hacker News
🤖Anthropic Claude
Finding the needle in the logstack: Reducing LLM context with TF-IDF
eliseomartelli.it·1d
💻Local LLMs
How we cut Vertex AI latency by 35% with GKE Inference Gateway
cloud.google.com·21h
🏗️AI Infrastructure
Optimized LLM Inference Engines
rishirajacharya.com·3d
💻Local LLMs
Continual learning and the post monolith AI era
baseten.co·16h·
Discuss: Hacker News
🏗️AI Infrastructure

Keyboard Shortcuts

Navigation
Next / previous item
j/k
Open post
oorEnter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help