rocksdb/utilities/blob_db
Yi Wu d66bb21e18 Blob DB: Inline small values in base DB
Summary:
Adding the `min_blob_size` option to allow storing small values in base db (in LSM tree) together with the key. The goal is to improve performance for small values, while taking advantage of blob db's low write amplification for large values.

Also adding expiration timestamp to blob index. It will be useful to evict stale blob indexes in base db by adding a compaction filter. I'll work on the compaction filter in future patches.

See blob_index.h for the new blob index format. There are 4 cases when writing a new key:
* small value w/o TTL: put in base db as normal value (i.e. ValueType::kTypeValue)
* small value w/ TTL: put (type, expiration, value) to base db.
* large value w/o TTL: write value to blob log and put (type, file, offset, size, compression) to base db.
* large value w/TTL: write value to blob log and put (type, expiration, file, offset, size, compression) to base db.
Closes https://github.com/facebook/rocksdb/pull/3066

Differential Revision: D6142115

Pulled By: yiwu-arbug

fbshipit-source-id: 9526e76e19f0839310a3f5f2a43772a4ad182cd0
2017-11-02 23:37:16 -07:00
..
blob_db_impl.cc Blob DB: Inline small values in base DB 2017-11-02 23:37:16 -07:00
blob_db_impl.h Blob DB: Inline small values in base DB 2017-11-02 23:37:16 -07:00
blob_db_iterator.h Blob DB: Store blob index as kTypeBlobIndex in base db 2017-11-02 23:37:07 -07:00
blob_db_test.cc Blob DB: Inline small values in base DB 2017-11-02 23:37:16 -07:00
blob_db.cc Fix memory leak on blob db open 2017-11-02 17:37:40 -07:00
blob_db.h Blob DB: Inline small values in base DB 2017-11-02 23:37:16 -07:00
blob_dump_tool.cc Blob DB: not writing sequence number as blob record footer 2017-11-02 23:07:27 -07:00
blob_dump_tool.h Change RocksDB License 2017-07-15 16:11:23 -07:00
blob_file.cc Blob DB: Inline small values in base DB 2017-11-02 23:37:16 -07:00
blob_file.h Blob DB: not writing sequence number as blob record footer 2017-11-02 23:07:27 -07:00
blob_index.h Blob DB: Inline small values in base DB 2017-11-02 23:37:16 -07:00
blob_log_format.cc Blob DB: not writing sequence number as blob record footer 2017-11-02 23:07:27 -07:00
blob_log_format.h Blob DB: not writing sequence number as blob record footer 2017-11-02 23:07:27 -07:00
blob_log_reader.cc Blob DB: not writing sequence number as blob record footer 2017-11-02 23:07:27 -07:00
blob_log_reader.h Blob DB: not writing sequence number as blob record footer 2017-11-02 23:07:27 -07:00
blob_log_writer.cc Blob DB: not writing sequence number as blob record footer 2017-11-02 23:07:27 -07:00
blob_log_writer.h Blob DB: not writing sequence number as blob record footer 2017-11-02 23:07:27 -07:00
ttl_extractor.cc Move blob_db/ttl_extractor.h into blob_db/blob_db.h 2017-07-28 14:28:21 -07:00