How to Give Your RTX 4090 Nearly Infinite Memory for LLM Inference
medium.com·6h·
Discuss: Hacker News
🗃️SQLite
A2HCoder: An LLM-Driven Coding Agent for Hierarchical Algorithm-to-HDL Translation
arxiv.org·1d
🗃️SQLite
flow-run: LLM Orchestration, Prompt Testing & Cost Monitoring
vitaliihonchar.com·17h·
Discuss: r/golang, r/programming
🖥️Self-hosted apps
Show HN: Self-hosted Amazon Bedrock router that learns from feedback (online RL)
arfniia.com·9h·
Discuss: Hacker News
🖥️Self-hosted apps
Cut LLM API Costs with Smart Caching
github.com·1d·
Discuss: r/LLM, r/typescript
🗃️SQLite
GPT-OSS from the Ground Up
cameronrwolfe.substack.com·7h·
Discuss: Substack
🖥️Self-hosted apps
Show HN: Stateful LLM inference (no cost for input tokens, not prompt-caching)
news.ycombinator.com·1d·
Discuss: Hacker News
🗃️SQLite
Train a GPT2 model with JAX on TPU for free
developers.googleblog.com·8h
🖥️Self-hosted apps
Bringing AI to the Edge: MCP for IoT
dev.to·11h·
Discuss: DEV
🖥️Self-hosted apps
ML Observability: Bringing Transparency to Payments and Beyond
netflixtechblog.com·1d
🗃️SQLite
The 4 Pillars of Successful LLMOps
thenewstack.io·1d
🖥️Self-hosted apps
Cursor: 1.5x Faster Moe Training on Blackwell with MXFP8 Kernels
cursor.com·1h·
Discuss: Hacker News
🗃️SQLite
Inference performance evaluation for LLMs on edge devices with a novel benchmarking framework and metric
arxiv.org·1d
🗃️SQLite
How I Cut Agentic Workflow Latency by 3-5x Without Increasing Model Costs
hackernoon.com·1d
🗃️SQLite
BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-Scale Pretraining
blog.datologyai.com·1d·
Discuss: Hacker News
🗃️SQLite
Building Code Retrieval for Claude Code from Scratch
zc277584121.github.io·9h·
Discuss: Hacker News
🗃️SQLite
LLM Testing Strategies from OpenAI, Google, Anthropic, Meta
azilen.com·1d·
Discuss: r/programming
🖥️Self-hosted apps
How Infosys built a generative AI solution to process oil and gas drilling data with Amazon Bedrock
aws.amazon.com·6h
🗃️SQLite
We raised $7.3M to build an open-source stack for industrial-grade LLM apps
tensorzero.com·17h·
Discuss: Hacker News
🖥️Self-hosted apps
Fuzzing Hardware Like Software (2021)
arxiv.org·3h·
Discuss: Hacker News
🗃️SQLite