💻 Local LLMs

Model Quantization, Inference Optimization, GGUF Format, Privacy-preserving AI

Do LLMs 'store' personal data? This is asking the wrong question (2024)
iapp.org·1d·
Discuss: Hacker News
⚖️Legal Compliance
TPLA: Tensor Parallel Latent Attention for Efficient Disaggregated Prefill \& Decode Inference
arxiv.org·1d
🚀SIMD Text Processing
Build and deploy small AI models from the browser
blog.minibase.ai·21h·
Discuss: Hacker News
🌀Brotli Internals
On the Algorithmic Bias of Aligning Large Language Models with RLHF: Preference Collapse and Matching Regularization
arxiv.org·9h
🧮Kolmogorov Bounds
DAIQ: Auditing Demographic Attribute Inference from Question in LLMs
arxiv.org·1d
👤Search Personalization
Show HN: yolo-cls – C++ batch image classification CLI with ONNX Runtime
github.com·2d·
Discuss: Hacker News
🔤Character Classification
LLMs: Common terms explained, simply
newsletter.eng-leadership.com·2d·
Discuss: Hacker News, r/programming
🧠Intelligence Compression
L-XAIDS: A LIME-based eXplainable AI framework for Intrusion Detection Systems
arxiv.org·9h
🔍Vector Forensics
NVFP4 Trains with Precision of 16-Bit and Speed and Efficiency of 4-Bit
developer.nvidia.com·1d·
Discuss: Hacker News
🧠Learned Codecs
Bridging Foundation Models and Efficient Architectures: A Modular Brain Imaging Framework with Local Masking and Pretrained Representation Learning
arxiv.org·9h
📊Learned Metrics
Better Language Model-Based Judging Reward Modeling through Scaling Comprehension Boundaries
arxiv.org·9h
🔗Monadic Parsing
NinA: Normalizing Flows in Action. Training VLA Models with Normalizing Flows
arxiv.org·9h
🎙️Whisper
NEAT: Concept driven Neuron Attribution in LLMs
arxiv.org·1d
🔍Vector Forensics
RL Is Neither a Panacea Nor a Mirage: Understanding Supervised vs. Reinforcement Learning Fine-Tuning for LLMs
arxiv.org·1d
🎧Learned Audio
Certificates and Witnesses for Multi-objective {\omega}-regular Queries in Markov Decision Processes
arxiv.org·9h
🎯Performance Proofs
Propose and Rectify: A Forensics-Driven MLLM Framework for Image Manipulation Localization
arxiv.org·9h
🖼️JPEG Forensics
k-NN Classification and Model Evaluation
dev.to·5h·
Discuss: DEV
🧠Machine Learning
Language Models Coupled with Metacognition Can Outperform Reasoning Models
arxiv.org·9h
🧠Intelligence Compression
FedKLPR: Personalized Federated Learning for Person Re-Identification with Adaptive Pruning
arxiv.org·9h
🧠Machine Learning
Programmable k-local Ising Machines and all-optical Kolmogorov-Arnold Networks on Photonic Platforms
arxiv.org·9h
🕸️Tensor Networks