Pebble

View Current Viewing Revision #5 from 11/24/2019 9:34 p.m.

Pebble is a key-value store written in Go and developed by Cockroach Labs. It is based on an unfinished Go port of LevelDB. Furthermore, additional features and optimizations are inspired by parts of RocksDB. Pebble is specifically created to suit the needs of CockroachDB, and has unique features that neither LevelDB nor RocksDB have.

History

The project started in 2018 as a replacement for RocksDB running inside of CockroachDB.

System Architecture

Embedded

Indexes

Log-Structured Merge Tree

Pebble uses a LSM tree to store writes. All records are stored in batches, which in turn are stored in in-memory memtables and sstables. There is a separate skiplist implementation which contains offsets of the records within their batch in order to perform reads.