🔢 BitNet Inference - emschwartz · Scour

Power Aware Dynamic Reallocation For Inference

arxiv.org·1d

🏗️LLM Infrastructure

meta-pytorch/segment-anything-fast: A batched offline inference oriented version of segment-anything

github.com·55m

📦Batch Embeddings

Gated DeltaNet: The “Surgical Eraser” Solving Linear Attention’s Memory Problem

pub.towardsai.net·1d

🧠LLM Inference

ianbarber.blog·1d·

Discuss: Hacker News

🔤Tokenization

Analog hardware may solve Internet of Things' speed bumps and bottlenecks

techxplore.com·12h

🖥️Hardware Architecture

Uncovering Unfaithful CoT in Deceptive Models

lesswrong.com·7h

🛡️AI Security

Model-agnostic linear-memory online learning in spiking neural networks

nature.com·2d

🧠LLM Inference

Hardware-Aware Reformulation of Convolutions for Efficient Execution on Specialized AI Hardware: A Case Study on NVIDIA Tensor Cores

arxiv.org·1d

⚡Hardware Acceleration

Making a Language

thunderseethe.dev·11h

💻Programming languages

Co-optimization Approaches For Reliable and Efficient AI Acceleration (Peking University et al.)

semiengineering.com·16h

⚡Hardware Acceleration

Why AI Needs GPUs and TPUs: The Hardware Behind LLMs

blog.bytebytego.com·2d

⚡Hardware Acceleration

Bye Bye Big Tech Step 5: AI assistents and chatbots

bitsoffreedom.nl·31m

Randomization in Typst

idraluna-archives.bearblog.dev·14h

💾Prompt Caching

Conductor Quantum: Coda - Natural language quantum computing

producthunt.com·14h

🧮SMT Solvers

Arctic Wolf’s Liquid Clustering Architecture Tuned for Petabyte Scale

databricks.com·15h

Polimi chip speeds up computing and drastically reduces energy consumption

polimi.it·2h·

Discuss: Hacker News

🖥️Hardware Architecture

Jacobson's Rank

denvaar.dev·1d

🌳Data Structures

dolthub.com·9h

💾Prompt Caching

understanding LSM trees via read, write, and space amplification

bitsxpages.com·10h·

Discuss: Substack

Playing with GPT-3, LangChain, and the OpenAI Embeddings API

shruggingface.com·1d

🏗️LLM Infrastructure

Loading more...