💻 Local LLMs

Model Quantization, Inference Optimization, GGUF Format, Privacy-preserving AI

Is it legal to use copyrighted works to train LLMs?
spinellis.gr·1d·
Discuss: Hacker News
🎙️Whisper
I Built a Confidence-Aware Filter and It Removed 8% of Garbage
askthegame.bearblog.dev·2h
🎙️Whisper
Structured data response with Amazon Bedrock: Prompt Engineering and Tool Use
aws.amazon.com·1d
☁️Serverless Rust
Getting an LLM to set its own temperature
amanvir.com·2d·
Discuss: Hacker News
🏗️AI Infrastructure
Show HN: Empromptu.ai – Agentic AI Building AI Apps
news.ycombinator.com·5h·
Discuss: Hacker News
🤖AI agents
RepuNet: A Reputation System for Mitigating Malicious Clients in DFL
arxiv.org·1d
⚖️Consensus Networks
Hitchhiker’s Guide to RAG with ChatGPT API and LangChain
towardsdatascience.com·22h
🏗️AI Infrastructure
Machine Learning Fundamentals: active learning
dev.to·3d·
Discuss: DEV
🤝Federated Learning
Language Bottleneck Models: A Framework for Interpretable Knowledge Tracing and Beyond
arxiv.org·4d
🏠Self-hosted AI
LongWriter-Zero: Mastering Ultra-Long Text Generation via Reinforcement Learning
arxiv.org·3d
🎙️Whisper
Biomed-Enriched: A Biomedical Dataset Enriched with LLMs for Pretraining and Extracting Rare and Hidden Content
arxiv.org·1d
📝CMS
UltraSketchLLM: Saliency-Driven Sketching for Ultra-Low Bit LLM Compression
arxiv.org·3d
🎙️Whisper
Fast Rate Information-theoretic Bounds on Generalization Errors
arxiv.org·3d
🤝Federated Learning
ReasonFlux-PRM: Trajectory-Aware PRMs for Long Chain-of-Thought Reasoning in LLMs
arxiv.org·3d
🏗️AI Infrastructure
Context Engineering: A Primer
ai.intellectronica.net·1d·
Discuss: Hacker News
🧩Low-code
Machine Learning Fundamentals: accuracy with python
dev.to·3d·
Discuss: DEV
🏗️AI Infrastructure
Mirage of Mastery: Memorization Tricks LLMs into Artificially Inflated Self-Knowledge
arxiv.org·2d
🏠Self-hosted AI
Self-Adapting Language Models: The Future of AI That Learns to Learn
dev.to·1d·
Discuss: DEV
🏗️AI Infrastructure
Distilling On-device Language Models for Robot Planning with Minimal Human Intervention
arxiv.org·3d
🏠Self-hosted AI
MATE: LLM-Powered Multi-Agent Translation Environment for Accessibility Applications
arxiv.org·2d
🧠AI