andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
A library that provides an embeddable, persistent key-value store for fast storage.
4,781 Commits 152 Branches 236 Tags 271 MiB
C++ 82.1%
Java 10.3%
C 2.5%
Python 1.7%
Perl 1.1%
Other 2.1%
580fede347
Go to file
Islam AbdelRahman 580fede347 Aggregate hot Iterator counters in LocalStatistics (DBIter::Next perf regression) 
Summary:
This patch bump the counters in the frequent code path DBIter::Next() / DBIter::Prev() in a local data members and send them to Statistics when the iterator is destroyed
A better solution will be to have thread_local implementation for Statistics

New performance
```
readseq      :       0.035 micros/op 28597881 ops/sec; 3163.7 MB/s
     1,851,568,819      stalled-cycles-frontend   #   31.29% frontend cycles idle    [49.86%]
       884,929,823      stalled-cycles-backend    #   14.95% backend  cycles idle    [50.21%]
readreverse  :       0.071 micros/op 14077393 ops/sec; 1557.3 MB/s
     3,239,575,993      stalled-cycles-frontend   #   27.36% frontend cycles idle    [49.96%]
     1,558,253,983      stalled-cycles-backend    #   13.16% backend  cycles idle    [50.14%]

```

Existing performance

```
readreverse  :       0.174 micros/op 5732342 ops/sec;  634.1 MB/s
    20,570,209,389      stalled-cycles-frontend   #   70.71% frontend cycles idle    [50.01%]
    18,422,816,837      stalled-cycles-backend    #   63.33% backend  cycles idle    [50.04%]

readseq      :       0.119 micros/op 8400537 ops/sec;  929.3 MB/s
    15,634,225,844      stalled-cycles-frontend   #   79.07% frontend cycles idle    [49.96%]
    14,227,427,453      stalled-cycles-backend    #   71.95% backend  cycles idle    [50.09%]
```

Test Plan: unit tests

Reviewers: yhchiang, sdong, igor

Reviewed By: sdong

Subscribers: andrewkr, dhruba

Differential Revision: https://reviews.facebook.net/D55107
2016-03-11 19:01:12 -08:00
arcanist_util Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
build_tools Update dependencies / Fix Clang 2016-03-07 12:57:19 -08:00
coverage Fix coverage script 2014-11-03 14:53:00 -08:00
db Aggregate hot Iterator counters in LocalStatistics (DBIter::Next perf regression) 2016-03-11 19:01:12 -08:00
doc Lint everything 2015-11-16 12:56:21 -08:00
examples Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
hdfs Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
include/rocksdb Cache to have an option to fail Cache::Insert() when full 2016-03-10 17:35:19 -08:00
java Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
memtable Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
port Implement ConsistentChildrenAttribute 2016-02-19 14:20:34 -08:00
table Cache to have an option to fail Cache::Insert() when full 2016-03-10 17:35:19 -08:00
third-party Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
tools Add multithreaded transaction test 2016-03-11 15:16:52 -08:00
util Add multithreaded transaction test 2016-03-11 15:16:52 -08:00
utilities Add multithreaded transaction test 2016-03-11 15:16:52 -08:00
.arcconfig Integrate Jenkins with Phabricator 2015-04-07 11:56:29 -07:00
.clang-format A script that automatically reformat affected lines 2014-01-14 12:21:24 -08:00
.gitignore Ignore db_test2 2016-03-07 15:56:16 -08:00
.travis.yml Travis CI to disable ROCKSDB_LITE tests 2016-02-01 18:42:01 -08:00
appveyor.yml Exclude DBTest.FileCreationRandomFailure as a long running test 2015-11-17 13:54:13 -08:00
AUTHORS Add AUTHORS file. Fix #203 2014-09-29 10:52:18 -07:00
CMakeLists.txt Cache to have an option to fail Cache::Insert() when full 2016-03-10 17:35:19 -08:00
CONTRIBUTING.md facebook accounts are not required for CLA signers 2014-07-08 05:57:54 -04:00
DUMP_FORMAT.md First version of rocksdb_dump and rocksdb_undump. 2015-06-19 16:24:36 -07:00
HISTORY.md Aggregate hot Iterator counters in LocalStatistics (DBIter::Next perf regression) 2016-03-11 19:01:12 -08:00
INSTALL.md Simple changes to support builds for ppc64[le] consistent with X86 2016-01-19 09:08:19 -06:00
LICENSE Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
Makefile Cache to have an option to fail Cache::Insert() when full 2016-03-10 17:35:19 -08:00
PATENTS Update Patent Grant. 2015-04-13 10:33:43 +01:00
README.md Replaced "built on on earlier work" by "built on earlier work" in README.md 2014-09-17 01:16:17 -07:00
ROCKSDB_LITE.md Optimistic Transactions 2015-05-29 14:36:35 -07:00
src.mk Add multithreaded transaction test 2016-03-11 15:16:52 -08:00
thirdparty.inc Enable override to 3rd party linkage 2015-11-24 11:51:37 -08:00
USERS.md Add Wingify to USERS.md 2016-01-28 01:04:49 +05:30
Vagrantfile RocksDB on FreeBSD support 2015-02-26 15:19:17 -08:00
WINDOWS_PORT.md Commit both PR and internal code review changes 2015-07-07 16:58:20 -07:00

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

Build Status

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/