📝 Parsing - hello · Scour

From parser combinators to hand-written TDOP: adopting sqlparser-rs at Readyset 📝Parser Combinators

readyset.io·5d·DEV

i should have paid a closer look at tokenizer 💬Natural Language Processing

harsh-ps-2003.bearblog.dev·2d

UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perception 🤖TVM

mjklmg/mathint: mathematical expression interpeter written in c 🧮MKL

github.com·2d·r/learnprogramming

https://research.perplexity.ai/articles/improving-unigram-tokenizer-cpu-performance 🔄Glommio vs Tokio

research.perplexity.ai·5d

Stock Market Today, May 29: AST SpaceMobile Falls After Blue Origin Rocket Test Failure Raises Launch Delay Fears 🚀Space Technology

Training Azerbaijani language models on Amazon SageMaker AI 🔥PyTorch

aws.amazon.com·3d

AST SpaceMobile’s Next Chapter Changes Everything (NASDAQ:ASTS) 🚀Space Technology

seekingalpha.com

·3d

Subword Splitting 📝Parser Combinators

MergeTok: Unified Continuous and Discrete Visual Tokenization via Token Merging ✏️Count-Min Sketch

Show HN: The X Programming Language 🔨Compiler Design

github.com·6d·Hacker News

LoSATok: Low-dimensional Semantic-Acoustic Tokenizer for Cross-Domain Audio Understanding and Generation 🍱Nom

ahinchman1/Kotlin-Compiler-Crash-Course: A repository of helpful sources to figure out what the Kotlin compiler really is 🔨Compiler Design

dhruv2x/semanticQL: Deterministic natural-language to SQL engine without LLMs. ⛽Diesel

github.com·4d·r/SideProject

The Tokenizer Tax Across 25 European Languages: Domain Invariance, Cross-Lingual Few-Shot Effects, and the Ukrainian Penalty 🐻‍❄️Polars

How Reliable Are Semantic-ID Tokenizer Comparisons in Generative Recommendation? 🔍RAG

whitecell-dev/cljys: A pragmatic Clojure-to-YAMLScript transpiler toolchain that uses an LLM canonical front-end pass to safely compile expressive Lisp queries into deterministic, zero-overhead native binaries for semantic IR analysis 🔵Clojure

github.com·4d·Hacker News

BrahmicTokenizer-131K: An Indic-Capable Drop-In Replacement for o200k_base ♻️Boehm GC

imjasonh/pasta: Using ASTs and CUE to describe multi-language linters and fixers 🦗Pest

github.com·3d·Lobsters

Structure over Pixels: Learning Variable-Length Visual Programs 🧮Vector Databases

Log in to enable infinite scrolling