A library that provides an embeddable, persistent key-value store for fast storage.
Go to file
Andrew Kryczka 3f62215210 Lazily initialize RangeDelAggregator's map and pinning manager
Summary:
Since a RangeDelAggregator is created for each read request, these heap-allocating member variables were consuming significant CPU (~3% total) which slowed down request throughput. The map and pinning manager are only necessary when range deletions exist, so we can defer their initialization until the first range deletion is encountered. Currently lazy initialization is done for reads only since reads pass us a single snapshot, which is easier to store on the stack for later insertion into the map than the vector passed to us by flush or compaction.

Note the Arena member variable is still expensive, I will figure out what to do with it in a subsequent diff. It cannot be lazily initialized because we currently use this arena even to allocate empty iterators, which is necessary even when no range deletions exist.
Closes https://github.com/facebook/rocksdb/pull/1539

Differential Revision: D4203488

Pulled By: ajkr

fbshipit-source-id: 3b36279
2016-11-18 17:09:11 -08:00
arcanist_util Rocksdb contruns to new Sandcastle API 2016-11-10 10:54:20 -08:00
build_tools Introduce Lua Extension: RocksLuaCompactionFilter 2016-11-16 15:39:12 -08:00
cmake/modules cmake support for linux and osx (#1358) 2016-09-28 11:53:15 -07:00
coverage Fix coverage script 2014-11-03 14:53:00 -08:00
db Lazily initialize RangeDelAggregator's map and pinning manager 2016-11-18 17:09:11 -08:00
docs Remove all instances of relative_url until GitHub pages problem is fixed. 2016-11-15 07:40:18 -08:00
examples Fix failed compaction_filter_example and add it into make all 2016-11-15 17:09:10 -08:00
hdfs Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 2016-09-14 10:17:34 -07:00
include/rocksdb Release RocksDB 5.0 2016-11-17 18:39:15 -08:00
java Remove Ticker::SEQUENCE_NUMBER 2016-11-16 22:39:09 -08:00
memtable Optimize sequential insert into memtable - Part 1: Interface 2016-11-13 19:09:18 -08:00
port Fix integer overflow in GetL0ThresholdSpeedupCompaction (#1378) 2016-10-23 18:43:29 -07:00
table Allow plain table to store index on file with bloom filter disabled 2016-11-17 11:09:13 -08:00
third-party Fix clang analyzer errors 2016-07-08 17:50:51 -07:00
tools DeleteRange support for db_bench 2016-11-15 17:39:47 -08:00
util Enable allow_concurrent_memtable_write and enable_write_thread_adaptive_yield by default 2016-11-16 09:39:09 -08:00
utilities Fix heap use after free ASAN/Valgrind 2016-11-17 12:24:12 -08:00
.arcconfig Make rocksdb work with internal repo 2016-10-28 14:59:50 -07:00
.clang-format A script that automatically reformat affected lines 2014-01-14 12:21:24 -08:00
.gitignore Make rocksdb work with internal repo 2016-10-28 14:59:50 -07:00
.travis.yml Ask travis to use JDK 7 2016-11-16 10:54:12 -08:00
appveyor.yml fix vs generator (#1269) 2016-08-10 09:08:13 -07:00
AUTHORS Add AUTHORS file. Fix #203 2014-09-29 10:52:18 -07:00
CMakeLists.txt cmake: s/STEQUAL/STREQUAL/ 2016-11-18 14:54:14 -08:00
CONTRIBUTING.md facebook accounts are not required for CLA signers 2014-07-08 05:57:54 -04:00
DEFAULT_OPTIONS_HISTORY.md Release RocksDB 4.8.0 2016-05-02 14:38:04 -07:00
DUMP_FORMAT.md First version of rocksdb_dump and rocksdb_undump. 2015-06-19 16:24:36 -07:00
HISTORY.md Release RocksDB 5.0 2016-11-17 18:39:15 -08:00
INSTALL.md Update documentation to point at gcc 4.8 2016-10-29 12:09:17 -07:00
LANGUAGE-BINDINGS.md Update LANGUAGE-BINDINGS.md 2016-07-15 13:09:30 +02:00
LICENSE Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
Makefile Introduce Lua Extension: RocksLuaCompactionFilter 2016-11-16 15:39:12 -08:00
PATENTS Update Patent Grant. 2015-04-13 10:33:43 +01:00
README.md Appveyor badge to show master branch 2016-07-26 13:54:08 -07:00
ROCKSDB_LITE.md Optimistic Transactions 2015-05-29 14:36:35 -07:00
src.mk Fix src.mk 2016-11-16 18:05:19 -08:00
thirdparty.inc Introduce XPRESS compresssion on Windows. (#1081) 2016-04-19 22:54:24 -07:00
USERS.md Adding Dgraph to list of Users (#1291) 2016-09-12 17:33:44 -07:00
Vagrantfile Update Vagrant file (test internal phabricator workflow) 2016-10-28 15:39:19 -07:00
WINDOWS_PORT.md Commit both PR and internal code review changes 2015-07-07 16:58:20 -07:00

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

Build Status Build status

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/