💻 Local LLMs

Model Quantization, Inference Optimization, GGUF Format, Privacy-preserving AI

I'm an AI tools expert, and these are the 4 I pay for now (plus 2 I'm eyeing) - ZDNET
news.google.com·2d
🤖AI agents
Constant-Time Crypto in Fil-C
fil-c.org·9h·
Discuss: Hacker News
🔌Embedded Rust
Laion, the dataset behind Stable Diffusion (2023)
deeplearning.ai·1d·
Discuss: Hacker News
🏗️AI Infrastructure
Access Control Policy Generation from High-Level Natural Language Requirements
dl.acm.org·3d·
Discuss: Hacker News
🧩Low-code
Beyond the AI Hype: Guido van Rossum on Python's Philosophy, Simplicity, and Th
odbms.org·1d·
Discuss: Lobsters, Hacker News
🧩Low-code
[P] Lossless compression for 1D CNNs
reddit.com·2d·
Discuss: r/MachineLearning
⏱️Time-series Optimization
Show HN: I built a local AI agent desk toy
blog.simone.computer·3d·
Discuss: Hacker News
🎙️Whisper
Efficient Test-Time Scaling for Small Vision-Language Models
arxiv.org·5d
📱Edge AI
Responsible Vibe Coding
dev.to·21h·
Discuss: DEV
✨vibe-coding
3 MCP servers that changed how I use my local LLM and made it better than the cloud
xda-developers.com·4d
💬Language Servers
Mitigating Premature Exploitation in Particle-based Monte Carlo for Inference-Time Scaling
arxiv.org·4d
🏗️AI Infrastructure
To model human linguistic prediction, make LLMs less superhuman
arxiv.org·4d
🎙️Whisper
Revisiting Long-context Modeling from Context Denoising Perspective
arxiv.org·4d
📱Edge AI
JEPAs: Unveiling the Hidden Density Oracle Within by Arvind Sundararajan
dev.to·3d·
Discuss: DEV
🏠Self-hosted AI
XRPO: Pushing the limits of GRPO with Targeted Exploration and Exploitation
arxiv.org·3d
🏗️AI Infrastructure
Relational Database Distillation: From Structured Tables to Condensed Graph Data
arxiv.org·3d
🗃️database engineering
Intro to RL: Off-Policy Methods
neelsomaniblog.com·3d·
Discuss: Hacker News
⏱️Time-series Optimization
How Google Translate & ChatGPT Work: The Transformer, Unboxed
dev.to·2d·
Discuss: DEV
🗣️Speech Synthesis
Automated Design of Peptide-Based Drug Candidates via Constrained Generative Adversarial Networks
dev.to·1d·
Discuss: DEV
🏗️AI Infrastructure
LLC Artificial Intelligence Trained to Lie by Omission
dev.to·22h·
Discuss: DEV
🧩Low-code