💻 Local LLMs

Model Quantization, Inference Optimization, GGUF Format, Privacy-preserving AI

Feeds to Scour
SubscribedAll
Scoured 5006 posts in 299.9 ms
No, Small Models Are Not the "Budget Option" (English)
mostlylucid.net·4h
🚀MLOps
Preview
Report Post
Running Local LLMs in Game Engines - Here's My Journey with Godot + Ollama
dev.to·15h·
Discuss: DEV
☁️Serverless Rust
Preview
Report Post
is this legit? Supposedly LangVAE straps a VAE + compression algorithm onto any LLM image, reduces resource requirements by up to...
arxiv.org·3d·
Discuss: r/LocalLLaMA
📱Edge AI
Preview
Report Post
Yann LeCun’s VL-JEPA: The breakthrough that gives AI a "Mind's Eye" (instead of just a mouth).
hisohan.substack.com·11h·
Discuss: Substack
📱Edge AI
Preview
Report Post
From Online Profile Paranoia to AI Complacency: Have We Really Stopped Caring About Privacy?
metamood.ai·2d
🏠Self-hosted AI
Preview
Report Post
Introducing the XLab AI Security Guide
lesswrong.com·12h
🛡️Computer Security
Preview
Report Post
GateBreaker: Gate-Guided Attacks on Mixture-of-Expert LLMs
arxiv.org·3d
🏠Self-hosted AI
Preview
Report Post
The Transformer Architecture: A Deep Dive into How LLMs Actually Work
dev.to·9h·
Discuss: DEV
🤖Transformers
Preview
Report Post
Show HN: Why is ML inference still so ad-hoc in practice?
news.ycombinator.com·1d·
Discuss: Hacker News
🚀MLOps
Preview
Report Post
A Linux User’s Approach to Local, Privacy-Respecting Image Editing using Local AI Model
reddit.com·2d·
Discuss: r/linux
🏠Self-hosted AI
Preview
Report Post
vagos/llm-grep: Match lines using both classic and semantic regular expressions with LLM.
github.com·1d·
Discuss: Lobsters
📝NLP
Preview
Report Post
Real Time Detection and Quantitative Analysis of Spurious Forgetting in Continual Learning
arxiv.org·3d
📝Parser Combinators
Preview
Report Post
Study: Shrinking AI memory boosts accuracy
ed.ac.uk·3d·
Discuss: Hacker News
📱Edge AI
Preview
Report Post
TRUNAJOD: A text complexity library for text analysis built on spaCy — TRUNAJOD 0.1.1 documentation
trunajod20.readthedocs.io·14h
📝NLP
Preview
Report Post
TrafficLLM: Why LLMs Are Becoming Essential for Encrypted Network Traffic Analysis
dev.to·21h·
Discuss: DEV
🏠Self-hosted AI
Preview
Report Post
How To Use LLM-Powered Coding Assistants Safely: Risks & Best Practices
xebia.com·16h·
Discuss: Hacker News
🤖AI Coding Tools
Preview
Report Post
Book Review: Why Machines Learn
philippdubach.com·1d·
Discuss: Hacker News
📱Edge AI
Preview
Report Post
Optimizing LLM inference on Amazon SageMaker AI with BentoML’s LLM- Optimizer
aws.amazon.com·3d
🏗️AI Infrastructure
Preview
Report Post
Thread by @theresanaiforit on Thread Reader App
threadreaderapp.com·6h
🤖Anthropic Claude
Preview
Report Post
What Deep Learning Theory Teaches Us About AI Memory
dev.to·1d·
Discuss: DEV
🧠Memory Models
Preview
Report Post