💻 Local LLMs

Model Quantization, Inference Optimization, GGUF Format, Privacy-preserving AI

Is GRPO Broken?
neelsomaniblog.com·10h·
Discuss: Hacker News
🛡️Byzantine Consensus
[R] DeepSeek 3.2's sparse attention mechanism
reddit.com·1d·
Discuss: r/MachineLearning
🏗️AI Infrastructure
Quantum Agents: The Algorithmic Alchemists Reshaping Discovery
dev.to·1h·
Discuss: DEV
🤖AI agents
H1B-KV: Hybrid One-Bit Caches for Memory-Efficient Large Language Model Inference
arxiv.org·3d
🏗️AI Infrastructure
Less Is More: Recursive Reasoning with Tiny Networks
github.com·2d·
Discuss: Hacker News
📱Edge AI
Active Confusion Expression in Large Language Models: Leveraging World Models toward Better Social Reasoning
arxiv.org·1d
🏗️AI Infrastructure
Automated Fault Isolation & Healing in Linear Control Systems via Multi-Modal Data Fusion & Reinforcement Learning
dev.to·5h·
Discuss: DEV
💧Hydroponics Control
ARMOR: High-Performance Semi-Structured Pruning via Adaptive Matrix Factorization
arxiv.org·3d
🎯Vector Databases
LinVideo: A Post-Training Framework towards O(n) Attention in Efficient Video Generation
arxiv.org·1d
🏗️AI Infrastructure
VideoNorms: Benchmarking Cultural Awareness of Video Language Models
arxiv.org·1d
🎤Voice Interfaces
ACE: Attribution-Controlled Knowledge Editing for Multi-hop Factual Recall
arxiv.org·1d
🏗️AI Infrastructure
Thinking on the Fly: Test-Time Reasoning Enhancement via Latent Thought Policy Optimization
arxiv.org·4d
🏠Self-hosted AI
MultiCNKG: Integrating Cognitive Neuroscience, Gene, and Disease Knowledge Graphs Using Large Language Models
arxiv.org·2d
🏗️AI Infrastructure
Off-Trajectory Reasoning: Can LLMs Collaborate on Reasoning Trajectory?
arxiv.org·2d
📱Edge AI
Stress-Testing Model Specs Reveals Character Differences among Language Models
arxiv.org·1d
🎙️Whisper
Effective and Stealthy One-Shot Jailbreaks on Deployed Mobile Vision-Language Agents
arxiv.org·1d
🤖AI agents
Out-of-Distribution Generalization in Climate-Aware Yield Prediction with Earth Observation Data
arxiv.org·1d
📱Edge AI
Certifiable Safe RLHF: Fixed-Penalty Constraint Optimization for Safer Language Models
arxiv.org·4d
🎙️Whisper
Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement Learning
arxiv.org·2d
🏗️AI Infrastructure
Covert Quantum Learning: Privately and Verifiably Learning from Quantum Data
arxiv.org·2d
🔐Decentralized Identity