💻 Local LLMs

Model Quantization, Inference Optimization, GGUF Format, Privacy-preserving AI

Toward Environmentally Equitable AI
cacm.acm.org·3h
🔲Cellular Automata
CodeMorph: Mitigating Data Leakage in Large Language Model Assessment
arxiv.org·1d
🎯Gradual Typing
OpusLM: A Family of Open Unified Speech Language Models
arxiv.org·1d
🎵Audio ML
HE-LRM: Encrypted Deep Learning Recommendation Models using Fully Homomorphic Encryption
arxiv.org·1d
🔐Homomorphic Encryption
Why Your Next LLM Might Not Have A Tokenizer
towardsdatascience.com·23h
🤖Grammar Induction
A Minimalist Optimizer Design for LLM Pretraining
arxiv.org·2d
🧠Machine Learning
Machine Learning Fundamentals: active learning project
dev.to·3h·
Discuss: DEV
🧠Machine Learning
Existing LLMs Are Not Self-Consistent For Simple Tasks
arxiv.org·1d
💻Programming languages
The more LLMs think, the worse they translate
nuenki.app·6h·
Discuss: Hacker News
⚙️Compression Benchmarking
Semantic-Preserving Adversarial Attacks on LLMs: An Adaptive Greedy Binary Search Approach
arxiv.org·1d
🔍Information Retrieval
[D] Applying COCONUT continuous reasoning into a learnt linear layer that produces sampling parameters (temp, top-k, top-p, etc.) for the current token?
reddit.com·1d·
Discuss: r/MachineLearning
📊Quantization
Confucius3-Math: A Lightweight High-Performance Reasoning LLM for Chinese K-12 Mathematics Learning
arxiv.org·1d
🧮SMT Solvers
Towards Deeper GCNs: Alleviating Over-smoothing via Iterative Training and Fine-tuning
arxiv.org·1d
📊Learned Metrics
LLM-driven Medical Report Generation via Communication-efficient Heterogeneous Federated Learning
arxiv.org·1d
🧠Machine Learning
Getting an LLM to set its own temperature
amanvir.com·19h·
Discuss: Hacker News
🐛Fuzzing
Running 🤖 GPT-Style Transformers on a $5 Microcontroller 🎛️ (TinyML 2.0 Era)
dev.to·1d·
Discuss: DEV
📊Quantization
Finetuning a Weather Foundation Model with Lightweight Decoders for Unseen Physical Processes
arxiv.org·14h
🔍Type Inference
EvoLM: In Search of Lost Language Model Training Dynamics
arxiv.org·2d
🎙️Whisper
SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoning
arxiv.org·14h
💻Programming languages
CLGRPO: Reasoning Ability Enhancement for Small VLMs
arxiv.org·1d
📏Linear Logic