🏠 Local AI - bigkevuk

martidu4/honey-ai: 🍯 All-in-one AI honeypot powered by local LLMs. SSH, HTTP, FTP, Telnet, SMTP, MySQL, Redis, Git, VNC, RDP — with canary tokens, tarpits, GZIP bombs, and threat intel reporting.

☁️Cloud Infrastructure Code

github.com··Hacker News

The AI automation tool nobody talks about just replaced my entire workflow setup

⚙️AI Automation

xda-developers.com·

‘Getting control where we can’—Europe wants sovereign AI but most of the chips are from the U.S.

🤖AI Agents News

fortune.com

LLM AI Chatbots are letting me down every single day

🧠LLMs

umrashrf.github.io··Hacker News

How I benchmarked a 100% local RAG pipeline to 9/9 (zero API keys)

🔍RAG

buy.polar.sh··DEV

Running Qwen 35B MoE at 450k Context on a Single 32GB GPU

🪟Windows

local-llm.utop.workers.dev··Hacker News

Treating LLMs as Programming Books

☁️Cloud Infrastructure Blog

jola.dev··Hacker News

The latest Gemma 4 models use a training trick to slash their on-device memory footprint

⚡AI Hardware

androidauthority.com·

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good

⚡AI Hardware Blog

towardsai.net·

Run (your largest) local models from your iPhone

⚙️LLM Fine-tuning Blog

lmstudio.ai··Hacker News, r/LocalLLaMA

The Shibboleth Effect: Auditing the Cross-Lingual Distributional Skew of Large Language Models

🧠LLMs Academic

arxiv.org·

Why agentic AI needs an open inference stack

🤖AI Agents

redhat.com·

Minor bummer that I wasn’t expecting when doing more local LLM work in my app: the mlx-swift package adds quite a bit to application size ...

⚙️LLM Fine-tuning

manton.org·

Self-hosted remote access for Ollama without complicated setup

🖥️Self-Hosting

oab.arc-i.co.uk··r/selfhosted

Humans and LLMs share a mental disorder: Fugue Lock

✍️Prompt Engineering

vwwwv.org··Hacker News

DeskDash - a free Windows tool to easily manage your GGUF files

💻AI Coding

gerry7.itch.io··r/LocalLLaMA

LM Link launches on iPhone, bringing local AI model access to iOS devices

⚙️LLM Fine-tuning

alternativeto.net·

defai-digital/ax-engine: Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes

💾ARM Code

github.com··Hacker News

Tales of an Ollama Honeypot (Part 3): More Traffic, More Findings

MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better

martidu4/honey-ai: 🍯 All-in-one AI honeypot powered by local LLMs. SSH, HTTP, FTP, Telnet, SMTP, MySQL, Redis, Git, VNC, RDP — with canary tokens, tarpits, GZIP bombs, and threat intel reporting.

The AI automation tool nobody talks about just replaced my entire workflow setup

‘Getting control where we can’—Europe wants sovereign AI but most of the chips are from the U.S.

LLM AI Chatbots are letting me down every single day

How I benchmarked a 100% local RAG pipeline to 9/9 (zero API keys)

Running Qwen 35B MoE at 450k Context on a Single 32GB GPU

Treating LLMs as Programming Books

The latest Gemma 4 models use a training trick to slash their on-device memory footprint

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good

Run (your largest) local models from your iPhone

The Shibboleth Effect: Auditing the Cross-Lingual Distributional Skew of Large Language Models

Why agentic AI needs an open inference stack

Minor bummer that I wasn’t expecting when doing more local LLM work in my app: the mlx-swift package adds quite a bit to application size ...

Self-hosted remote access for Ollama without complicated setup

Humans and LLMs share a mental disorder: Fugue Lock

DeskDash - a free Windows tool to easily manage your GGUF files

LM Link launches on iPhone, bringing local AI model access to iOS devices

defai-digital/ax-engine: Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes