🔮 Speculative Decoding - standonopenstds · Scour

ROCm 7 on Strix Halo: Benchmarking the New Toolbox Images 🔧Nix Flakes

sleepingrobots.com·4d

Less-relevant results

GPUs: A high-throughput architecture confronting a workload shift 🌐Edge Computing

My RTX 5090 can't keep up with Apple Silicon on the biggest local LLMs, and I hate to admit it 📦Parquet

xda-developers.com·6d

SpecSA: Bridging Speculative Decoding and Sparse Attention for Efficient LLM Inference 🧠LLM Inference

How do I get the superfast DFlash / MTP tokens per second that I'm seeing on here? Dual 3090s 🔧Nix Flakes

github.com·3d·r/LocalLLaMA

JWT Tokens Decoded: What's Actually Inside Your Auth Token 📦Parquet

snappytools.app·18h·DEV

DrBearJew/llama.cpp at tbq4-rdna3-experiment 🔧Nix Flakes

github.com·6d·r/LocalLLaMA

D-PACE: Dynamic Position-Aware Cross-Entropy for Parallel Speculative Drafting 📦Parquet

Priced to Scale, Priced To Fail: How Flat-Rate AI Subscriptions Create a Subsidy for Its Best Customers — and a Seven-Lever Strategy to Reverse It 🧠LLM Inference

interestingengineering.substack.com·3d·Substack

Alchemize: PyMC’s model to replace Stan/PyMC, etc. with an LLM 🧠LLM Inference

statmodeling.stat.columbia.edu·6d·Hacker News

Tower signs customer contracts for $1.3bn silicon photonics revenue for 2027 📦Parquet

semiconductor-today.com·6d

VeriCache: Turning Lossy KV Cache into Lossless LLM Inference 🧠LLM Inference

I built my own Googlebook with a Raspberry Pi, local LLMs, and old hardware 🥧Raspberry pi

xda-developers.com·3d

I've updated my glorified Llama fork (LLM Inference Server) for P40's to utilise MTP + TurboQuant + DFlash 🔧Nix Flakes

github.com·4d·r/LocalLLaMA

Microsoft Identity Manager 2016 SP3: SQL Server 2022, Azure SQL, and AD FS SSO 🗄️SQLite

4sysops.com·2d

NLA Verbalizations on AuditBench: Llama 70B 🧠LLM Inference

lesswrong.com·5d

Deep Learning Weekly: Issue 455 🧠LLM Inference

deeplearningweekly.com·6d

Traffic Generator AI: The Future of Smart Website Growth and Automated Audience Expansion ⚡Query Optimization

rebrand.ly·6d·DEV

Most teams ship prompts like its 2008. I built something better. 🧠LLM Inference

github.com·2d·r/PromptEngineering

Used over a million tokens in three separate sessions to test Qwen 3.6 35b (new Multi-token Prediction version) 🔧Nix Flakes

huggingface.co·5d·r/LocalLLaMA

Sign up or log in to see more results

Log in to enable infinite scrolling