🤖 Local LLMs - tomasz · Scour

AI shouldn't have a meter. Unlimited tokens. Forever 💬Prompt Engineering

openmonoagent.ai·6d·Hacker News

Local Red-Team AI Assistant 🤖AI Agents

·6d

How I Built a Free Voice AI Pipeline Using Whisper, LLaMA 3.1 & Groq 💬Prompt Engineering

youtu.be·6d·DEV

Local AI for document search — Informity AI, runs entirely on-device 💾Local-first Software

discuss.privacyguides.net·4d

I added a second GPU just for local AI workloads, and it cost less than upgrading my main one 🧠Deep Learning

xda-developers.com·1d

Qwen’s MTP test puts local AI back in startup math 🥶Cold Start Problem

startupfortune.com·3d

Foundry Local 1.1: Live Transcription, Embeddings, and Responses API 🔗RAG

devblogs.microsoft.com·6d

LocalVibe – Pure-Rust local AI stack with MCP, in one binary (Apple Silicon) 💾Local-first Software

github.com·2d·Hacker News

https://www.together.ai/blog/llama-2-7b-32k-instruct 🥶Cold Start Problem

together.ai·5d

Budget Instruction Fine-tuning of Llama 3 8B Instruct (on Medical Data) with Hugging Face Google Colab and Unsloth 🤖Transformer Architecture

mlops.community·5d

I've updated my glorified Llama fork (LLM Inference Server) for P40's to utilise MTP + TurboQuant + DFlash 💾Local-first Software

github.com·2d·r/LocalLLaMA

🤸⚕️Unleashing the Power of Large Language Models in Healthcare and Wellness: Practical Context Providing in Healthcare and Wellness with Mistral 7B 🧠LLM Reasoning

mlops.community·5d

AWS Inferentia and AWS Trainium deliver lowest cost to deploy Llama 3 models in Amazon SageMaker JumpStart ⚡Static Site Generators

mlops.community·5d

I stopped hitting Claude's message limit by building a local AI pipeline that does the heavy lifting 🥶Cold Start Problem

xda-developers.com·4d

ollama/ollama v0.24.0-rc0 🥶Cold Start Problem

·5d

oobabooga/textgen: Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 🎨Design Systems

ApexForgeTech/ApexForge_Swarm: An open-source AI agent platform that inspects, plans, coordinates, and executes tasks locally via Ollama, llama.cpp, or OpenAI. 💾Local-first Software

github.com·5d·DEV

The End of the Memory Tax: How Google’s TurboQuant is Rewriting the Rules of Local RAG Systems 🥶Cold Start Problem

github.com·4d·DEV

Log in to enable infinite scrolling