🔄 Deduplication - abnv · Scour

understanding LSM trees via read, write, and space amplification

bitsxpages.com·7h

🔗Memory Linearization

A Scientific Data Integrity system based on Blockchain

arxiv.org·1d

🔗Hash Functions

Back Up Multiple Drives to Backblaze with Deduplication

dev.to·3d·

Discuss: DEV

📁File Systems

denvaar.dev·1d

🔢Binary Formats

cwida/fsst: Fast Static Symbol Table (FSST): efficient random-access string compression

github.com·2d·

Discuss: Hacker News

📦Compression Algorithms

Sorting secrets: how to organize encrypted data

confer.to·22h

🪢Rope Data Structures

Treat Data Like Hazardous Material: Risks of Over-Collection and Retention

lmgsecurity.com·2h

🛡️Security Type Systems

Streamline large binary object migrations: A Kafka-based solution for Oracle to Amazon Aurora PostgreSQL and Amazon S3

aws.amazon.com·12h

📡Protocol Buffers

How I Rebuilt a RAG System that Actually Works

pub.towardsai.net·1d

🦀MIR Optimization

Build Your Own Key-Value Storage Engine—Week 6

read.thecoder.cafe·17h

📦Compact Data

GPU-Resident Inverted File Index for Streaming Vector Databases

arxiv.org·1d

🌸Bloom Indexing

OMEGA-369 Breaking SHA-256 Through Recursive Markov Compression: The Tesla 3-6-9 Pattern Applied to Cryptographic Collapse Proof of Full SHA-256 Hash Collision Using 36-Level Dimensional Compression

zenodo.org·2d·

Discuss: Hacker News

🔗Hash Functions

datahaven-xyz/datahaven: An EVM compatible Substrate chain, powered by StorageHub and secured by EigenLayer

github.com·4h

🛡️Capability VMs

An introduction to XET, Hugging Face's storage system (part 1)

00f.net·3d·

Discuss: Lobsters, Hacker News, r/programming

🔢Binary Formats

Reducing Log Volume with the OpenTelemetry Log Deduplication Processor

opentelemetry.io·2d

📮Persistent Queues

But You Knew That Already

dataharness.org·1d·

Discuss: Hacker News

📮Message Queues

Union-Find Path Compression: A Visual Dry Run

dev.to·1d·

Discuss: DEV

📐Succinct Data Structures

Memory layout matters: Reducing metric storage overhead by 4x in a Rust TSDB

baarse.substack.com·14h·

Discuss: r/rust

📦Compact Data

How poor chunking increases AI costs and weakens accuracy

blog.logrocket.com·16h

⚡Tokenizer Benchmarks

Merge-pdf.app – A free, privacy-first PDF Merging tool

ryansouthgate.com·22h·

Discuss: Hacker News

🔗Text Deduplication

Loading more...