💻 Local LLMs

Model Quantization, Inference Optimization, GGUF Format, Privacy-preserving AI

Hierarchical Verification of Speculative Beams for Accelerating LLM Inference
arxiv.org·20h
🔨Compilers
Parametric Matrix Models
nature.com·7h·
Discuss: Hacker News
📐Linear Algebra
Training Specialist Models: Automating Malware Development
outflank.nl·4h
🧮SMT Solvers
[$] On the use of LLM assistants for kernel development
lwn.net·9h
🔩Systems Programming
Neurosymbolic AI: Why, What, and How
muratbuffalo.blogspot.com·9h·
Discuss: www.blogger.com
🧠Intelligence Compression
Scrutinizing LLM Reasoning Models
cacm.acm.org·6h
✓Automated Theorem Proving
Pushing the limits of long-context LLM training for 1M-token+ medical records
akasa.com·6h·
Discuss: Hacker News
🎵Audio ML
OpenAI intros two open-weight language models that can run on consumer GPUs — optimized to run on devices with just 16GB of memory.
tomshardware.com·7h
🦾ARM Cortex-M
Small Language Models: A better way to Agentic AI
dev.to·7h·
Discuss: DEV
🌀Brotli Internals
Evolution Tree of Encoder / Decoder / Encoder-Decoder Models.
reddit.com·18h·
Discuss: r/artificial
🧠Learned Codecs
LLMs can predict educational and psychological outcomes from childhood essays with remarkable accuracy
phys.org·13h
🧠Intelligence Compression
Optimal Scheduling Algorithms for LLM Inference: Theory and Practice
arxiv.org·2d
🧮Kolmogorov Complexity
AWS-LC is a general-purpose cryptographic library
github.com·7h·
Discuss: Hacker News
🌳Archive Merkle Trees
Machine Learning Fundamentals: model overfitting tutorial
dev.to·7h·
Discuss: DEV
👁️Observatory Systems
Fine-tuning with GPT-OSS and Hugging Face Transformers
cookbook.openai.com·2d·
Discuss: Hacker News
📝ABNF Parsing
Estimating Worst-Case Frontier Risks of Open-Weight LLMs
arxiv.org·1d
🧮Kolmogorov Bounds
OpenAI Releases gpt-oss AI Model, Offers Bounty For Vulnerabilities
hackaday.com·22h
🔓Open Source Software
Beyond Manually Designed Pruning Policies with Second-Level Performance Prediction: A Pruning Framework for LLMs
arxiv.org·2d
🧠Intelligence Compression
Things I Wish I Had Known Before Starting ML
towardsdatascience.com·2d
🧮Kolmogorov Complexity
GeRe: Towards Efficient Anti-Forgetting in Continual Learning of LLM via General Samples Replay
arxiv.org·20h
✨Effect Handlers