vLLM Performance Tuning: The Ultimate Guide to xPU Inference Configuration
cloud.google.comยท6h
๐Ÿ—๏ธAI Infrastructure
DAIQ: Auditing Demographic Attribute Inference from Question in LLMs
arxiv.orgยท18h
๐Ÿ Self-hosted AI
Deep Think with Confidence
arxiviq.substack.comยท1dยท
Discuss: Substack
๐Ÿ Self-hosted AI
Beyond the ban: A better way to secure generative AI applications - The Cloudflare Blog
news.google.comยท8h
๐Ÿ Self-hosted AI
Song recommendations with F# free monads
blog.ploeh.dkยท14h
ฮปFunctional Programming
The MLOps Maturity Playbook: Practical Steps to Production-Ready ML
blog.devops.devยท10h
๐Ÿ—๏ธAI Infrastructure
Paying attention to feature distribution alignment (pun intended)
alexshtf.github.ioยท13hยท
Discuss: Hacker News
๐ŸŽฏVector Databases
Show HN: SecretMemoryLocker โ€“ File Encryption Without Static Passwords
news.ycombinator.comยท5hยท
Discuss: Hacker News
๐Ÿ”Decentralized Identity
Notes on Autograd
aschrein.github.ioยท3hยท
Discuss: Hacker News
๐Ÿ—๏ธAI Infrastructure
ALAS: Autonomous Learning Agent for Self-Updating Language Models
arxiv.orgยท18h
๐Ÿ Self-hosted AI
Enterprise essentials for generative AI
infoworld.comยท13h
๐ŸงฉLow-code
Tinker with LLMs in the privacy of your own home using Llama.cpp
theregister.comยท1dยท
Discuss: Hacker News
๐Ÿ Self-hosted AI
TPLA: Tensor Parallel Latent Attention for Efficient Disaggregated Prefill \& Decode Inference
arxiv.orgยท18h
๐Ÿ—๏ธAI Infrastructure
Hardware Technologies And Algorithms for Vector Symbolic Architectures (Purdue Univ., Georgia Tech)
semiengineering.comยท11m
๐Ÿง Neuromorphic Chips
Do LLMs 'store' personal data? This is asking the wrong question (2024)
iapp.orgยท19hยท
Discuss: Hacker News
๐Ÿ Self-hosted AI
Build and deploy small AI models from the browser
blog.minibase.aiยท6hยท
Discuss: Hacker News
๐Ÿ—๏ธAI Infrastructure
How to Use DeepSeek-V3.1 API โ€” a practical developer tutorial
dev.toยท10hยท
Discuss: DEV
๐Ÿ—๏ธAI Infrastructure
Show HN: yolo-cls โ€“ C++ batch image classification CLI with ONNX Runtime
github.comยท1dยท
Discuss: Hacker News
๐ŸŽ™๏ธWhisper
Constitutional Classifiers: Protecting LLM's with Mini Bodyguards
ahnaf.bearblog.devยท13h
๐Ÿ—๏ธAI Infrastructure
LLMs: Common terms explained, simply
newsletter.eng-leadership.comยท1dยท
Discuss: Hacker News, r/programming
๐Ÿ—ฃ๏ธSpeech Synthesis