ℹ️ Information Theory - tomasz · Scour

Polar Complexity: A New Descriptive Complexity with Applications to Source and Joint Source-Channel Coding 🔢Kolmogorov Complexity

Compute Optimal Tokenization: Scaling Laws for Data Compression in LLMs 🔢Kolmogorov Complexity

co-tok.github.io·4h·Hacker News

Gleaning Information from Noise 🔗Mutual Information

link.aps.org·6h

Predicting the Fallen Token: Environmental Signal Detection and Information-Theoretic Analysis of… 🔗Mutual Information

·2d

Free Communication Protocol Specification 🦋ATProto

fcp.md·2d·Hacker News

Data storage and retrieval with unnatural proteins expressed via E. coli 🥩Alternative Proteins

nature.com·21h

Compression, Dynamics, and Control in Large Language Models: Toward a High-Level Theory 🔢Kolmogorov Complexity

philsci-archive.pitt.edu·3d

Building Last Message: A Local-First Gemma Emergency Intelligence App 🤖Local LLMs

dailybuild.xyz·6h·DEV

25 🤖Local LLMs

pepijn.club·1d

Compute Optimal Tokenization (2 minute read) ✂️Tokenization

arxiviq.substack.com

Weekly Bookmarks 🌱Digital Gardens

inkdroid.org·2d

Medium Access Control Protocols 📡Community Networks

jasonfantl.com·6d

https://www.together.ai/blog/neurips-2022-overcoming-communication-bottlenecks-for-decentralized-training-2 🔢Kolmogorov Complexity

together.ai·5d

"On Communication" by Romano Alquati (1993) 🤝Plurality

Finite-Frequency Fluctuation-Response Inequality 📊Stochastic Processes

link.aps.org·11h

SumComp: Coding for Digital Over-the-Air Computation via the Ring of Integers 📊Shannon Entropy

More Efficient SNARKs via Quasi-Abelian Codes: Faster, Smaller, and Field-Agnostic 🤝Consensus Protocols

eprint.iacr.org·6d

End-to-End Encrypted RCS Messaging: The Feature Everyone Demanded! #shorts 🦋ATProto

youtube.com·4d

Peter Neijens, Theo Araujo, Judith Möller, and Claes de Vreese (Eds.), Measuring Exposure and Attention to Media and Communication: Solutions to Wicked Problems 👥Crowdsourcing

Introduction 📂Open Government

docs.jami.net·5d

Log in to enable infinite scrolling