🔄 Incremental Tokenizers - abnv · Scour

Stop Taking Tokenizers for Granted: They Are Core Design Decisions in Large Language Models

arxiv.org·1d

🔤Language Tokenizers

A simple AI speech-to-text tool that actually saves me time

dev.to·1d·

Discuss: DEV

🔄Incremental Lexing

Making a Language

thunderseethe.dev·8h

🔬programming language theory

Reducing Tokenization Premiums for Low-Resource Languages

arxiv.org·1d

⚡Tokenizer Benchmarks

I [[musttail]] You About a Tokenizer

neilhenning.dev·2d

featurestorebook/mlfs-book: O'Reilly book - Building Machine Learning Systems with a feature store: batch, real-time, and LLMs

github.com·6h·

Discuss: Hacker News

Harper: Free, Open Source Grammar Checker

writewithharper.com·5h·

Discuss: r/webdev

🔄Incremental Lexing

Wispr Flow-inspired voice input for any web app

speechos.ai·15h·

Discuss: Hacker News

🔄Incremental Lexing

Show HN: Upgrade from Ralph to Eric for a more autonomous AI

dbuild.dev·1d·

Discuss: Hacker News

💬Interactive REPLs

FlashLabs Chroma 1.0: A Real-Time End-to-End Spoken Dialogue Model

huggingface.co·15h·

Discuss: Hacker News

Momory: AI Real-Time Stream Subtitles and Translation

momory.dev·2h·

Discuss: Hacker News

🔄Incremental Parsers

A Guide to TF-IDF

pub.towardsai.net

·3h

⚡Tokenizer Benchmarks

How Does ChatGPT Work? A Guide for the Rest of Us

producttalk.org

·17h

🚀Tokenizer Performance

t2x - a CLI tool for AI-first text operations

shruggingface.com·1d

🔄Incremental Lexing

Explainer: Tree-sitter vs. LSP

lambdaland.org·1d

🌲Tree-sitter

DevUtils, a Mac app for text conversion and processing

blakewatson.com·1d

🔄Incremental Lexing

From Audiobooks to Manuscripts: How New Speech-to-Text Tools Support Book Creation

groups.io·1d

🔄Incremental Lexing

Exploring Text Compression

denvaar.dev·1d

📦Compression Algorithms

The Parable of the Languages (2002)

web.archive.org·1d·

Discuss: Lobsters

🔬programming language theory

What are Recursive Language Models (RLM)?

analyticsvidhya.com·1d

🪜Recursive Descent

Loading more...