⚙️ MLOps - hop1.ng.1357 · Scour

MCAP: Deployment-Time Layer Profiling for Memory-Constrained LLM Inference 📱Edge AI Optimization

The Data Layer Tax for Robot Learning 🧠Machine Learning

rerun.io·2h·Hacker News

GoogleCloudPlatform/activation-model-scanner: Verify language model safety before deployment by analyzing activation patterns 💉Prompt Injection

github.com·11h·Hacker News

How we built the most performant DeepSeek V3.2, MiniMax-M2.5 and Qwen 3.5 397B on DigitalOcean NVIDIA HGX™ B300 GPU Droplets 📱Edge AI Optimization

digitalocean.com·2d

Three Cobblers, One Zhuge Liang: Making Cheaper Models Work Together 🪄Prompt Engineering

markhuang.ai·15h·Hacker News

vLLM-Lens: Fast Interpretability Tooling That Scales to Trillion-Parameter Models 📱Edge AI Optimization

lesswrong.com·6d

What agentic AI borrowed from microservices (and made worse) 🔧Agent Tooling

temporal.io·20h·Hacker News

umbecanessa/neural-ledger-system: An inference architecture that makes LLMs stateful. Patent pending (US 64/050,345). 🪄Prompt Engineering

github.com·1d·Hacker News

AutoPyVerifier: Learning Compact Executable Verifiers for Large Language Model Outputs ✅Formal Verification

Lessons from Building an OTel Normalizer for GenAI (Part 1) 🪝eBPF

groundcover.com·10h·Hacker News

Monitoring LLM behavior: Drift, retries, and refusal patterns 🛡️AI Safety

venturebeat.com·5d·Hacker News

Fixing What LLMs Get Wrong (22 minute read) 🪄Prompt Engineering

thebigdataguy.substack.com·3d·Substack

Programming with Data: Test-Driven Data Engineering for Self-Improving LLMs from Raw Corpora ✨LLMs

DeepSeek-V4 on Day 0: From Fast Inference to Verified RL with SGLang and Miles 📱Edge AI Optimization

lmsys.org·4d·Hacker News

Adaptive and Fine-grained Module-wise Expert Pruning for Efficient LoRA-MoE Fine-Tuning 🤖LLM

Building Semantic Version Control in Rust ⚙️Compilers

therohansharma.com·4d·Hacker News

A Survey on Split Learning for LLM Fine-Tuning: Models, Systems, and Privacy Optimizations ✨LLMs

Show HN: Récif – Open-source control tower for AI agents on Kubernetes 🔧Agent Tooling

recif-platform.github.io·6d·Hacker News

Rcarmo/gte-go: Golang inference for the GTE Small embedding model 🤖LLM

github.com·5d·Hacker News

AI Observability for Large Language Model Systems: A Multi-Layer Analysis of Monitoring Approaches from Confidence Calibration to Infrastructure Tracing 🛡️AI Safety

Log in to enable infinite scrolling