Reddit - Dive into anything reddit.com

M4 Max + 128GB RAM setup: Which LLMs can I realistically run locally?

reddit.com·68w·r/LocalLLM

Quantization chart/graph/plot

reddit.com·68w·r/LocalLLM

Self Hosted chatgpt vs Chatgpt plus in term of cost

reddit.com·68w·r/LocalLLM

I am considering adding a 5090 to my existing 4090 build vs. selling the 4090, for larger LLM support

us.msi.com·68w·r/LocalLLM

Long term memory & running contextual learning

reddit.com·68w·r/LocalLLM

Best qwen distill?

reddit.com·68w·r/LocalLLM

Quantization and parameters efficiency

reddit.com·68w·r/LocalLLM

AI/ML Checkpointing difficulty. I will not promote

reddit.com·68w·r/LocalLLM

Notate v1.0.5 - LlamaCPP and Transformers + Native embeddings Support + More Providers & UI/UX improvements

github.com·68w·Hacker News, r/LocalLLM, r/LocalLLaMA, r/reactjs

What is the best available model and flags that I can use to run DeepSeek work on 8/16 GB?

reddit.com·68w·r/LocalLLM

Does running a LLM on a dedicated machine make any difference?

reddit.com·68w·r/LocalLLM

Local AI setup and limitations.

reddit.com·68w·r/LocalLLM

Open Source Equity Researcher

github.com·68w·r/LocalLLM

ollama mistral-nemo performance MB Air M2 24 GB vs MB Pro M3Pro 36GB

reddit.com·68w·r/LocalLLM

Google API error

reddit.com·68w·r/LocalLLM

How Do You Currently Manage GPU Usage and API Costs in Your Workflows?

reddit.com·68w·r/LocalLLM

Rpi Ai Hat et AI Kit sont-ils utiles ou serveur Ollama domestique ?

reddit.com·68w·r/LocalLLM

Nup with 16 TOPS

reddit.com·68w·r/LocalLLM

What does "Token count: Up to 9T tokens" mean?

huggingface.co·68w·r/LocalLLM

How can I train Local llm with my own jira board data?

reddit.com·68w·r/LocalLLM

Log in to enable infinite scrolling