A library that provides an embeddable, persistent key-value store for fast storage.
Go to file
sdong b23bbaa82a Universal Compactions with Small Files
Summary:
With this change, we use L1 and up to store compaction outputs in universal compaction.
The compaction pick logic stays the same. Outputs are stored in the largest "level" as possible.

If options.num_levels=1, it behaves all the same as now.

Test Plan:
1) convert most of existing unit tests for universal comapaction to include the option of one level and multiple levels.
2) add a unit test to cover parallel compaction in universal compaction and run it in one level and multiple levels
3) add unit test to migrate from multiple level setting back to one level setting
4) add a unit test to insert keys to trigger multiple rounds of compactions and verify results.

Reviewers: rven, kradhakrishnan, yhchiang, igor

Reviewed By: igor

Subscribers: meyering, leveldb, MarkCallaghan, dhruba

Differential Revision: https://reviews.facebook.net/D34539
2015-03-30 15:12:02 -07:00
build_tools rocksdb: fix make unity 2015-03-18 19:12:23 -07:00
coverage Fix coverage script 2014-11-03 14:53:00 -08:00
db Universal Compactions with Small Files 2015-03-30 15:12:02 -07:00
doc Remove seek compaction 2014-06-20 10:23:02 +02:00
examples Fix formatting 2015-02-09 09:53:30 -08:00
hdfs Remove unused parameter in CancelAllBackgroundWork 2015-03-16 21:07:54 -07:00
include db_bench can now disable flashcache for background threads 2015-03-30 09:51:11 -07:00
java Fixed a typo in RocksDBSample.java 2015-03-25 11:09:30 -07:00
linters Return fbson 2015-02-27 00:04:14 +03:00
port stack_trace.cc: fix #elif check for OS_MACOSX 2015-03-17 12:00:55 +01:00
table Fix build 2015-03-24 17:00:28 -07:00
third-party db_bench can now disable flashcache for background threads 2015-03-30 09:51:11 -07:00
tools Add --stats_interval_seconds to db_bench 2015-03-30 12:58:32 -07:00
util Universal Compactions with Small Files 2015-03-30 15:12:02 -07:00
utilities Fix clang build 2015-03-30 10:03:23 -07:00
.arcconfig build: abbreviate AR command, too 2015-02-19 11:48:09 -08:00
.clang-format A script that automatically reformat affected lines 2014-01-14 12:21:24 -08:00
.gitignore rocksdb: changes to support 'make analyze' in Jenkins 2015-02-23 17:45:25 -08:00
.travis.yml Only run db_test in Travis 2015-03-17 15:24:16 -07:00
AUTHORS Add AUTHORS file. Fix #203 2014-09-29 10:52:18 -07:00
CONTRIBUTING.md facebook accounts are not required for CLA signers 2014-07-08 05:57:54 -04:00
HISTORY.md Universal Compactions with Small Files 2015-03-30 15:12:02 -07:00
INSTALL.md Optimize default compile to compilation platform by default 2014-12-15 11:29:41 +01:00
LICENSE Fix copyright year 2014-03-12 12:06:58 -07:00
Makefile Makefile minor cleanup 2015-03-30 16:05:35 -04:00
PATENTS Fix the patent format 2013-10-16 15:37:32 -07:00
README.md Replaced "built on on earlier work" by "built on earlier work" in README.md 2014-09-17 01:16:17 -07:00
ROCKSDB_LITE.md RocksDBLite 2014-04-15 13:39:26 -07:00
src.mk Makefile minor cleanup 2015-03-30 16:05:35 -04:00
Vagrantfile RocksDB on FreeBSD support 2015-02-26 15:19:17 -08:00

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

Build Status

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/