💻 Local LLMs

Model Quantization, Inference Optimization, GGUF Format, Privacy-preserving AI

PLEX: Perturbation-free Local Explanations for LLM-Based Text Classification
arxiv.org·5h
🧠Machine Learning
Students, here are 5 key things to know when learning how to train large language models
techradar.com·15h
🎵Audio ML
A Minimal DDPM
github.com·7h·
Discuss: Hacker News
🧠Machine Learning
AirLLM: Diffusion Policy-based Adaptive LoRA for Remote Fine-Tuning of LLM over the Air
arxiv.org·5h
🧮Kolmogorov Complexity
Machine Learning Fundamentals: decision trees with python
dev.to·15h·
Discuss: DEV
🔗Topological Sorting
Effectively Zero-Knowledge Proofs for NP with No Interaction, No Setup
eccc.weizmann.ac.il·11h·
Discuss: Hacker News
🎯Interactive Provers
What can we expect of LLMs as Software Engineers?
chelseatroy.com·1d
📝Text Parsing
Benchmarking AWS Nova on Log Data: How It Compares to ChatGPT-3.5
bronto.io·18h·
Discuss: Hacker News
📝Log Parsing
Comprehension Without Competence: Architectural Limits of LLMs in Symbolic Computation and Reasoning
arxiv.org·5h
🌳Context free grammars
Fine-tuning Large Language Model for Automated Algorithm Design
arxiv.org·5h
🔨Compilers
Learning to Quantize and Precode in Massive MIMO Systems for Energy Reduction: a Graph Neural Network Approach
arxiv.org·5h
📊Quantization
A Practical Two-Stage Recipe for Mathematical LLMs: Maximizing Accuracy with SFT and Efficiency with Reinforcement Learning
arxiv.org·2d
⚔️Lean Tactics
Translation using deep neural networks – Transformer
aamster.github.io·1d·
Discuss: Hacker News
🧠Neural Codecs
From Equal Weights to Smart Weights: OTPO’s Approach to Better LLM Alignment
towardsdatascience.com·15h
🧮Kolmogorov Bounds
NativeMind: Replace ChatGPT in 3 Minutes
dev.to·1h·
Discuss: DEV
🌀Brotli Internals
The Man Behind the Sound: Demystifying Audio Private Attribute Profiling via Multimodal Large Language Model Agents
arxiv.org·1d
🎵Audio ML
The Fine-Tuning Revolution: How PEFT, LoRA, and QLoRA Are Democratizing AI Customization in 2025
dev.to·1h·
Discuss: DEV
📊Quantization
Huawei's star AI model was built on burnout and plagiarism
the-open-source-ward.ghost.io·10h·
Discuss: Hacker News
🇨🇳Chinese Computing
Detecting and Pruning Prominent but Detrimental Neurons in Large Language Models
arxiv.org·1d
📊Quantization
DCR: Quantifying Data Contamination in LLMs Evaluation
arxiv.org·5h
✨Effect Handlers