A library that provides an embeddable, persistent key-value store for fast storage.
Go to file
Andrew Kryczka b104b87814 Maintain position in range deletions map
Summary:
When deletion-collapsing mode is enabled (i.e., for DBIter/CompactionIterator), we maintain position in the tombstone maps across calls to ShouldDelete(). Since iterators often access keys sequentially (or reverse-sequentially), scanning forward/backward from the last position can be faster than binary-searching the map for every key.

- When Next() is invoked on an iterator, we use kForwardTraversal to scan forwards, if needed, until arriving at the range deletion containing the next key.
- Similarly for Prev(), we use kBackwardTraversal to scan backwards in the range deletion map.
- When the iterator seeks, we use kBinarySearch for repositioning
- After tombstones are added or before the first ShouldDelete() invocation, the current position is set to invalid, which forces kBinarySearch to be used.
- Non-iterator users (i.e., Get()) use kFullScan, which has the same behavior as before---scan the whole map for every key passed to ShouldDelete().
Closes https://github.com/facebook/rocksdb/pull/1701

Differential Revision: D4350318

Pulled By: ajkr

fbshipit-source-id: 5129b76
2017-01-05 10:39:12 -08:00
arcanist_util Show sandcastle URL in phabricator 2016-12-20 11:09:12 -08:00
build_tools Fix the directory path for RocksDB repo 2016-12-27 22:24:16 -08:00
cmake/modules cmake support for linux and osx (#1358) 2016-09-28 11:53:15 -07:00
coverage Fix coverage script 2014-11-03 14:53:00 -08:00
db Maintain position in range deletions map 2017-01-05 10:39:12 -08:00
docs Add pcache documentation images 2016-12-14 11:54:22 -08:00
examples examples: Add options_file_example to target all 2016-12-28 19:09:16 -08:00
hdfs Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 2016-09-14 10:17:34 -07:00
include/rocksdb C API: support total_order_mode 2017-01-03 18:39:14 -08:00
java Fix rocksdb::Status::getState 2017-01-03 18:39:14 -08:00
memtable Unified InlineSkipList::Insert algorithm with hinting 2016-11-22 14:09:13 -08:00
port Enable conditionally using adaptive mutexes 2016-12-27 16:09:12 -08:00
table Delegate Cleanables 2016-12-29 15:54:19 -08:00
third-party Kill flashcache code in RocksDB 2016-12-01 10:09:22 -08:00
tools Update db_bench and sst_dump to test with block cache mid-point inser? 2017-01-03 18:39:14 -08:00
util Fix rocksdb::Status::getState 2017-01-03 18:39:14 -08:00
utilities Fix backupable db test 2017-01-01 11:24:14 -08:00
.arcconfig Make rocksdb work with internal repo 2016-10-28 14:59:50 -07:00
.clang-format A script that automatically reformat affected lines 2014-01-14 12:21:24 -08:00
.gitignore Less linear search in DBIter::Seek() when keys are overwritten a lot 2016-11-28 10:24:11 -08:00
.travis.yml Remove gflags as travis build dependency 2016-12-20 17:09:16 -08:00
appveyor.yml fix vs generator (#1269) 2016-08-10 09:08:13 -07:00
AUTHORS Add AUTHORS file. Fix #203 2014-09-29 10:52:18 -07:00
CMakeLists.txt Iterator should be in corrupted status if merge operator return false 2016-12-16 11:09:16 -08:00
CONTRIBUTING.md facebook accounts are not required for CLA signers 2014-07-08 05:57:54 -04:00
DEFAULT_OPTIONS_HISTORY.md Release RocksDB 4.8.0 2016-05-02 14:38:04 -07:00
DUMP_FORMAT.md First version of rocksdb_dump and rocksdb_undump. 2015-06-19 16:24:36 -07:00
HISTORY.md Always fsync the file after file copying 2016-12-28 19:09:16 -08:00
INSTALL.md Update documentation to point at gcc 4.8 2016-10-29 12:09:17 -07:00
LANGUAGE-BINDINGS.md Update LANGUAGE-BINDINGS.md 2016-07-15 13:09:30 +02:00
LICENSE Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
Makefile Delegate Cleanables 2016-12-29 15:54:19 -08:00
PATENTS Update Patent Grant. 2015-04-13 10:33:43 +01:00
README.md Appveyor badge to show master branch 2016-07-26 13:54:08 -07:00
ROCKSDB_LITE.md Optimistic Transactions 2015-05-29 14:36:35 -07:00
src.mk Iterator should be in corrupted status if merge operator return false 2016-12-16 11:09:16 -08:00
thirdparty.inc Introduce XPRESS compresssion on Windows. (#1081) 2016-04-19 22:54:24 -07:00
USERS.md Update Netflix section of USERS.md 2016-12-19 12:09:12 -08:00
Vagrantfile Update Vagrant file (test internal phabricator workflow) 2016-10-28 15:39:19 -07:00
WINDOWS_PORT.md Commit both PR and internal code review changes 2015-07-07 16:58:20 -07:00

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

Build Status Build status

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/