💻 Local LLMs

Model Quantization, Inference Optimization, GGUF Format, Privacy-preserving AI

Real-Time Adaptive Sparsity Optimization for Edge-Deployed AI Inference Accelerators
dev.to·12h·
Discuss: DEV
🏗️AI Infrastructure
The key to conversational speech recognition
datasciencecentral.com·1d
🎤Voice Interfaces
Expanding the Action Space of LLMs to Reason Beyond Language
arxiv.org·18h
🏗️AI Infrastructure
[D] Anyone using smaller, specialized models instead of massive LLMs?
reddit.com·1d·
Discuss: r/MachineLearning
🌐Distributed systems
OpenAI's inflated valuation, as I understand it
taloranderson.com·6h·
Discuss: Hacker News
📱Edge AI
How the Rise of Tabular Foundation Models Is Reshaping Data Science
towardsdatascience.com·1d
📱Edge AI
Show HN: Comparegpt.io – Trustworthy Mode to reduce LLM hallucinations
news.ycombinator.com·21h·
Discuss: Hacker News
🏠Self-hosted AI
What is a Large Language Model (LLM)
dev.to·5h·
Discuss: DEV
🗣️Speech Synthesis
AI Guardrails, Gateways, Governance Nightmares
go.mcptotal.io·14h·
Discuss: Hacker News
🏠Self-hosted AI
LightReasoner: Can Small Language Models Teach Large Language Models Reasoning?
arxiv.org·18h
🏗️AI Infrastructure
The Alignment Auditor: A Bayesian Framework for Verifying and Refining LLM Objectives
arxiv.org·2d
🏠Self-hosted AI
InferenceMAX – open-source Inference Frequent Benchmarking
github.com·2h·
Discuss: Hacker News
🏗️AI Infrastructure
microsoft/UserLM-8b - “Unlike typical LLMs that are trained to play the role of the 'assistant' in conversation, we trained UserLM-8b to simulate the 'user' rol...
huggingface.co·1d·
Discuss: DEV, Hacker News, r/LocalLLaMA
🎙️Whisper
TRIM: Token-wise Attention-Derived Saliency for Data-Efficient Instruction Tuning
arxiv.org·1d
🏗️AI Infrastructure
100 Poisoned Examples Can Hijack Any AI Model (Even GPT-4-Scale LLMs)
dev.to·1d·
Discuss: DEV
📱Edge AI
LLMs Learn to Deceive Unintentionally: Emergent Misalignment in Dishonesty from Misaligned Samples to Biased Human-AI Interactions
arxiv.org·18h
🏠Self-hosted AI
Integral Signatures of Activation Functions: A 9-Dimensional Taxonomy and Stability Theory for Deep Learning
arxiv.org·18h
🤝Federated Learning
In-Depth Analysis: "Attention Is All You Need"
dev.to·7h·
Discuss: DEV
🏗️AI Infrastructure
Mitigating Judgment Preference Bias in Large Language Models through Group-Based Polling
arxiv.org·18h
🔍Query Compilers
How to Teach Large Multimodal Models New Skills
arxiv.org·18h
🏗️AI Infrastructure