🔄 Incremental Tokenizers - abnv · Scour

Stop Taking Tokenizers for Granted: They Are Core Design Decisions in Large Language Models

arxiv.org·1d

🔤Language Tokenizers

A simple AI speech-to-text tool that actually saves me time

dev.to·1d·

Discuss: DEV

🔄Incremental Lexing

Making a Language

thunderseethe.dev·12h

🔬programming language theory

huggingface.co·30m

🔤Language Tokenizers

Reducing Tokenization Premiums for Low-Resource Languages

arxiv.org·1d

⚡Tokenizer Benchmarks

I [[musttail]] You About a Tokenizer

neilhenning.dev·2d

Harper: Free, Open Source Grammar Checker

writewithharper.com·9h·

Discuss: r/webdev

🔄Incremental Lexing

Wispr Flow-inspired voice input for any web app

speechos.ai·19h·

Discuss: Hacker News

🔄Incremental Lexing

Show HN: Upgrade from Ralph to Eric for a more autonomous AI

dbuild.dev·1d·

Discuss: Hacker News

💬Interactive REPLs

Momory: AI Real-Time Stream Subtitles and Translation

momory.dev·6h·

Discuss: Hacker News

🔄Incremental Parsers

featurestorebook/mlfs-book: O'Reilly book - Building Machine Learning Systems with a feature store: batch, real-time, and LLMs

github.com·10h·

Discuss: Hacker News

Making large language models reliable data science programming copilots for biomedical research

nature.com·35m

🔍ML Language

A Guide to TF-IDF

pub.towardsai.net

·7h

⚡Tokenizer Benchmarks

t2x - a CLI tool for AI-first text operations

shruggingface.com·1d

🔄Incremental Lexing

Explainer: Tree-sitter vs. LSP

lambdaland.org·1d

🌲Tree-sitter

How Does ChatGPT Work? A Guide for the Rest of Us

producttalk.org

·21h

🚀Tokenizer Performance

DevUtils, a Mac app for text conversion and processing

blakewatson.com·1d

🔄Incremental Lexing

From Audiobooks to Manuscripts: How New Speech-to-Text Tools Support Book Creation

groups.io·1d

🔄Incremental Lexing

Exploring Text Compression

denvaar.dev·1d

📦Compression Algorithms

FlashLabs Chroma 1.0: A Real-Time End-to-End Spoken Dialogue Model

huggingface.co·19h·

Discuss: Hacker News

Loading more...