Searching actually viable alternative to Ollama
reddit.com·10h·
Discuss: r/LocalLLaMA
Does NVIDIA Parakeet-TDT 0.6B v2 STT transcribe real-time audio streams?
huggingface.co·14h·
Discuss: r/LocalLLaMA
I Gave Up Trying to Run Gemma 3 27B on AWS P3dn.24xlarge
medium.com·5h·
Discuss: Hacker News, r/LocalLLaMA
Built a new VLM (MicroLlaVA) on a single NVIDIA 4090
reddit.com·1d·
Discuss: r/LocalLLaMA
One model, multiple 'personalities'/system prompts
reddit.com·18h·
Discuss: r/LocalLLaMA
Diffusion Language Models are Super Data Learners
jinjieni.notion.site·1d·
Discuss: r/LocalLLaMA
zauberzeug/nicegui
github.com·23h
Jan now supports gpt-oss
reddit.com·5d·
Discuss: r/LocalLLaMA
Finally, I Wrote a 600-Page Book About My Mad LLM fine-tuning experiments
amazon.com·2d·
Discuss: r/LocalLLaMA
Qwen 3 0.6B beats GPT-5 in simple math
reddit.com·2d·
Discuss: r/LocalLLaMA
Qwen3-30B-A3B-Instruct-2507@Q8_0 vs GLM-4.5-Air@UD-Q2_K_XL
reddit.com·14h·
Discuss: r/LocalLLaMA
Created a new version of my Qwen3-Coder-30b-A3B-480b-distill and it performs much better now
reddit.com·15h·
Discuss: r/LocalLLaMA
NVIDIA Expands Its RTX PRO ‘Blackwell’ Workstation GPU Lineup With Two New Variants at SIGGRAPH 2025: RTX PRO 4000 SFF and RTX PRO 2000
wccftech.com·8h·
Discuss: r/LocalLLaMA
PCI/MMIO/BAR resource exhaustion issues with 2x PRO 6000 Workstation and 2x RTX A6000 GPUs on a Gigabyte-based EPYC server. Any of you grizzled old multi-GPU mi...
reddit.com·10h·
Discuss: r/LocalLLaMA
Infinite Network Attached Memory for LLM Inference for RTX 4090
reddit.com·6h·
Discuss: r/LocalLLaMA
GLM 4.5 355b (IQ3_XXS) is amazing at creative writing.
reddit.com·1d·
Discuss: r/LocalLLaMA
Why are Diffusion-Encoder LLMs not more popular?
reddit.com·1d·
Discuss: r/LocalLLaMA
Whisper Key - Simple local STT app for Windows with global hotkey (auto-paste, auto-ENTER)
reddit.com·16h·
Discuss: r/LocalLLaMA
Newb Alert
reddit.com·1d·
Discuss: r/LocalLLaMA
Local LLM for creative writing.
reddit.com·1d·
Discuss: r/LocalLLaMA