Open Source AI

Feeds to Scour
SubscribedAll
Scoured 537 posts in 9.7 ms

zhongkaifu/TensorSharp: A C# inference engine for running large language models (LLMs) locally using GGUF model files. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability

 💬LLMs  Content type: Code
github.com··Hacker News

lightmetal: GPU LLM Inference From a Single Java 25 JAR

 💬LLMs  Content type: Blog
adambien.blog·

Google fills out the middle with the Gemma 4 12B

 🤖ai
jonpeddie.com·

LeLab Is Hugging Face’s New Browser-Based GUI for the LeRobot Ecosystem

 🤖ai  Content type: News
hackster.io·

How Small Can You Go? LoRA Fine-Tuning 270M-8B Models for Merchant Information Extraction in Financial Transactions

 🤖ai  Content type: Academic
arxiv.org·

Using Scikit-LLM with Open-Source LLMs

 💬LLMs

Researchers Build Self-Replicating AI Worm That Operates Entirely on Local, Open-Weight Models

 👨‍💻Andrej Karpathy
thehackernews.com·

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

 💬LLMs
alternativeto.net·

google/gemma-4-12B-it-qat-q4_0-gguf

 🤖ai
huggingface.co·

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good

 ⚙️ML Engineering  Content type: Blog
towardsai.net·

I added this open-source tool to my local AI stack, and my local LLM finally has persistent memory

 💬LLMs
xda-developers.com·

Improved performance and model support with GGUF

 🤖ai  Content type: Blog
ollama.com·

What's in the Box? A Field Guide to AI Models

 🤖ai  Content type: Blog
iankduncan.com·

Token4Token — pay-per-token inference on Gnosis + Swarm

 ⚙️ML Engineering
t4t.eth.link··Hacker News

Using local LLMs for agentic coding

 💬LLMs  Content type: Blog
blog.alexewerlof.com·

Florian Brand, Prime Intellect research engineer, adopts Gemma 4 E4B 6-bit quantized as his primary local Mac LLM

 ⚙️ML Engineering  Content type: News
digg.com··Hacker News

Autonomous AI worm uses local models to exploit networks and repair its own code

 🤖ai
4sysops.com·

local llm on laptop 780M GPU using llama + gemma 4 qat

 💬LLMs  Content type: Blog
alper.bearblog.dev·

A system programmer’s guide to LLM inference

 ⚙️ML Engineering  Content type: Blog

LLM-as-a-Discriminator: When Synthetic Tables Still Look Real

 💬LLMs  Content type: Academic
arxiv.org·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help