Inference Cards (opens in new tab)

Why skip past the why When someone says “I run Qwen 3.6 at 25 tokens per second”, or makes any similar performance claim about their self-hosted LLM setup, this is only meaningful if we know several other things. Which model variant? Qwen 3.6 could be the dense 27B or the 35B-A3B MoE, totally different architectures. Better, just link to the repo you downloaded the weights from. Which quantization? Q8, Q4_K_XL, and IQ3_XXS are at different points in quality/speed/size space. What hardware and...