Storage engine choices
reddit.com·7h·
Discuss: r/rust
Flag this post

Objective: mobile, offline first storage choices for an event storage system.

I started to write a storage engine building my on file storage with reads and writes routed from my own memtable to sstable, using mmap + my own event loop rolled.

I realized that it was too complex, it worked but I needed secondary indexing etc. to support a lot of practical usecases, a problem that had long been solved.

I then moved to LMDB, it does work and is quick, however mmap has some issues when dealing with iOS and ipad and many other things for example: the unsafe code for a new into Rust guy like me slows down my development much much faster. RocksDB was another choice and so was LevelDB but leveldb I had heard from anecdotal evidence that crashes a lot

I pivoted to SQLLite - things were so …

Similar Posts

Loading similar posts...