andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
A library that provides an embeddable, persistent key-value store for fast storage.
1,787 Commits 152 Branches 236 Tags 271 MiB
C++ 82.1%
Java 10.3%
C 2.5%
Python 1.7%
Perl 1.1%
Other 2.1%
462796697c
Go to file
sdong 462796697c dynamic_bloom: replace some divide (remainder) operations with shifts in locality mode, and other improvements 
Summary:
This patch changes meaning of options.bloom_locality: 0 means disable cache line optimization and any positive number means use CACHE_LINE_SIZE as block size (the previous behavior is the block size will be CACHE_LINE_SIZE*options.bloom_locality). By doing it, the divide operations inside a block can be replaced by a shift.

Performance is improved:
https://reviews.facebook.net/P471

Also, improve the basic algorithm in two ways:
(1) make sure num of blocks is an odd number
(2) rotate bytes after every probe in locality mode. Since the divider is 2^n, unless doing it, we are never able to use all the bits.
Improvements of false positive: https://reviews.facebook.net/P459

Test Plan: make all check

Reviewers: ljin, haobo

Reviewed By: haobo

Subscribers: dhruba, yhchiang, igor, leveldb

Differential Revision: https://reviews.facebook.net/D18843
2014-06-02 17:36:38 -07:00
build_tools hdfs cleanup and compile test against CDH 4.4. 2014-05-20 17:22:12 -04:00
coverage Disable the html-based coverage report by default 2014-02-06 12:58:13 -08:00
db Only signal cond variable if need to 2014-06-02 17:23:55 -07:00
doc doc: table_stats_collectors -> table_properties_collectors. 2014-02-07 12:19:25 -08:00
examples Make it easier to start using RocksDB 2014-05-10 10:49:33 -07:00
hdfs hdfs cleanup and compile test against CDH 4.4. 2014-05-20 17:22:12 -04:00
helpers/memenv Expose in memory Env to the world 2014-04-14 12:28:15 -07:00
include dynamic_bloom: replace some divide (remainder) operations with shifts in locality mode, and other improvements 2014-06-02 17:36:38 -07:00
java [Java] Generalize dis-own native handle and refine dispose framework. 2014-05-28 18:16:29 -07:00
linters allow lambda function syntax in cpplint 2014-02-20 12:47:05 -08:00
port Make rocksdb work with all versions of lz4 2014-05-05 11:35:40 -07:00
table forward iterator 2014-05-30 14:31:55 -07:00
third-party/rapidjson Add rapidjson to RocksDB 2014-05-15 16:07:05 -07:00
tools db_stress to add an option to periodically change background thread pool size. 2014-06-02 10:32:09 -07:00
util dynamic_bloom: replace some divide (remainder) operations with shifts in locality mode, and other improvements 2014-06-02 17:36:38 -07:00
utilities Make RateLimiting unit test less flakey 2014-05-20 17:09:38 -07:00
.arcconfig Improve/fix bugs for the cpp linter 2014-02-13 17:48:11 -08:00
.clang-format A script that automatically reformat affected lines 2014-01-14 12:21:24 -08:00
.gitignore Add .swp to gitignore 2014-05-16 13:17:29 -07:00
.travis.yml Turn off travis notifications 2014-05-14 16:08:02 -07:00
CONTRIBUTING.md New CLA form 2014-04-22 09:12:19 -07:00
HISTORY.md Update HISTORY.md 2014-05-21 15:25:05 -07:00
INSTALL.md Better INSTALL.md and Makefile rules 2014-05-07 16:51:30 -07:00
LICENSE Fix copyright year 2014-03-12 12:06:58 -07:00
Makefile Move master version to 3.2 2014-05-23 10:27:56 -07:00
PATENTS Fix the patent format 2013-10-16 15:37:32 -07:00
README.md Add build status to README.md 2014-05-15 10:16:58 -07:00
ROCKSDB_LITE.md RocksDBLite 2014-04-15 13:39:26 -07:00

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

Build Status

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has an Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See doc/index.html and github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/