📱 Edge AI - nmarshall · Scour

Show HN: GPT-2 inference in pure C#, 0 bytes allocated per token 🔥Burn

github.com·3d·Hacker News

SuperInfer: SLO-Aware Rotary Scheduling and Memory Management for LLM Inference on Superchips 🔁Cache Coherence

supercomputing-system-ai-lab.github.io·2d·Hacker News

GPU Memory Math for LLMs: Formula That Tells You What Fits on Your GPU 🏗️AI Infrastructure

theahmadosman.substack.com·7h·Substack, r/LocalLLaMA

Less-relevant results

AMD just dropped a compact AI workstation that makes discrete GPUs look outdated for running LLMs ⚡Hardware Acceleration

xda-developers.com·4h

Artain-AI/ignite-ms: Fast self-hosted embedding engine for search, RAG, and reindexing workloads on NVIDIA GPUs. Built in Rust + TensorRT for teams that care about scale, cost, and control. 🔥Burn

github.com·11h·Hacker News

The AI Cold War: A $10 Billion Silicon Valley Sales Pitch 🤖Cyberpunk

sinodatacrit.substack.com·1d·Substack

Vision-Language-Action Models Arrive 🏗️AI Infrastructure

semiengineering.com·6d

Command A+: Making sovereign agentic capabilities available to all 🤖AI Coding Tools

cohere.com·12h·Hacker News

CPritch/shiftpaper: Parallax wallpaper for Wayland with depth estimation, written in Rust + WGSL 📈Grafana

github.com·2d·Hacker News

OpenAI Parameter Golf: what 1,100 researchers built in six weeks ☁️Serverless Rust

runpod.io·6d·Hacker News

wojciechowskiapp/Kaption: Real-time in-game subtitle translation for Hoyoverse titles like Genshin Impact, Honkai: Star Rail on Windows 🗣️Voice Coding

github.com·2d·Hacker News

Benchmark and optimize LLMs on-device with AI Edge Portal 🏗️AI Infrastructure

cloud.google.com·12h

codexstar69/pi-listen: Hold-to-talk voice input for Pi CLI — Deepgram streaming STT with live transcription, voice commands, and cross-platform hold detection 🎙️Whisper

github.com·1d·Hacker News

GNOME 51 Could End Up Replacing System Tools With "Resources" App 🖥️Linux Desktop

phoronix.com·4d·Hacker News

AI to infest eight in ten premium phones within two years ⚡Hardware Acceleration

theregister.com·6d·Hacker News

I stopped chasing Ultra and my mid-range GPU became a powerhouse 🎮Game Engines

xda-developers.com·1d

PyTorch, rewritten from scratch in pure Rust 🔥Burn

github.com·6d·Hacker News

Microsoft is quietly walking back Copilot+, but the Googlebook is proof that Google didn't get the memo 🖥computers

xda-developers.com·1d

The Day Google Stopped Selling Software 🚀Astro

newtonschooloftech.substack.com·10h·Substack

The gaming mode on your router is a marketing lie — here’s what actually lowers your ping 🎮Game Engines

xda-developers.com·1d

Log in to enable infinite scrolling