andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
A library that provides an embeddable, persistent key-value store for fast storage.
5,764 Commits 152 Branches 236 Tags 271 MiB
C++ 82.1%
Java 10.3%
C 2.5%
Python 1.7%
Perl 1.1%
Other 2.1%
adce9c0a87
Go to file
Andrew Kryczka adce9c0a87 Fix DeleteRange file boundary correctness issue with max_compaction_bytes 
Summary:
Cockroachdb exposed this bug in #1778. The bug happens when a compaction's output files are ended due to exceeding max_compaction_bytes. In that case we weren't taking into account the next file's start key when deciding how far to extend the current file's max_key. This caused the non-overlapping key-range invariant to be violated.

Note this was correctly handled for the usual case of cutting compaction output, which is file size exceeding max_output_file_size. I am not sure why these are two separate code paths, but we can consider refactoring it to prevent such errors in the future.
Closes https://github.com/facebook/rocksdb/pull/1784

Differential Revision: D4430235

Pulled By: ajkr

fbshipit-source-id: 80af748
2017-01-18 13:39:44 -08:00
arcanist_util Show sandcastle URL in phabricator 2016-12-20 11:09:12 -08:00
build_tools Fix the directory path for RocksDB repo 2016-12-27 22:24:16 -08:00
cmake/modules cmake support for linux and osx (#1358) 2016-09-28 11:53:15 -07:00
coverage Fix coverage script 2014-11-03 14:53:00 -08:00
db Fix DeleteRange file boundary correctness issue with max_compaction_bytes 2017-01-18 13:39:44 -08:00
docs 5.0.1 release blog post 2017-01-06 15:24:15 -08:00
examples examples: Add options_file_example to target all 2016-12-28 19:09:16 -08:00
hdfs Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 2016-09-14 10:17:34 -07:00
include/rocksdb Update release version to 5.1.0 2017-01-13 16:44:14 -08:00
java Fix rocksdb::Status::getState 2017-01-03 18:39:14 -08:00
memtable Unified InlineSkipList::Insert algorithm with hinting 2016-11-22 14:09:13 -08:00
port change UseDirectIO() to use_direct_io() 2017-01-13 12:09:15 -08:00
table Revert "PinnableSlice" 2017-01-08 14:24:12 -08:00
third-party Kill flashcache code in RocksDB 2016-12-01 10:09:22 -08:00
tools Revert "PinnableSlice" 2017-01-08 14:24:12 -08:00
util change UseDirectIO() to use_direct_io() 2017-01-13 12:09:15 -08:00
utilities change UseDirectIO() to use_direct_io() 2017-01-13 12:09:15 -08:00
.arcconfig Make rocksdb work with internal repo 2016-10-28 14:59:50 -07:00
.clang-format A script that automatically reformat affected lines 2014-01-14 12:21:24 -08:00
.gitignore Less linear search in DBIter::Seek() when keys are overwritten a lot 2016-11-28 10:24:11 -08:00
.travis.yml travis: For linux, do all tests under gcc 2017-01-13 15:39:13 -08:00
appveyor.yml fix vs generator (#1269) 2016-08-10 09:08:13 -07:00
AUTHORS Add AUTHORS file. Fix #203 2014-09-29 10:52:18 -07:00
CMakeLists.txt Iterator should be in corrupted status if merge operator return false 2016-12-16 11:09:16 -08:00
CONTRIBUTING.md facebook accounts are not required for CLA signers 2014-07-08 05:57:54 -04:00
DEFAULT_OPTIONS_HISTORY.md Release RocksDB 4.8.0 2016-05-02 14:38:04 -07:00
DUMP_FORMAT.md First version of rocksdb_dump and rocksdb_undump. 2015-06-19 16:24:36 -07:00
HISTORY.md Update release version to 5.1.0 2017-01-13 16:44:14 -08:00
INSTALL.md Update documentation to point at gcc 4.8 2016-10-29 12:09:17 -07:00
LANGUAGE-BINDINGS.md Update LANGUAGE-BINDINGS.md 2016-07-15 13:09:30 +02:00
LICENSE Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
Makefile Delegate Cleanables 2016-12-29 15:54:19 -08:00
PATENTS Update Patent Grant. 2015-04-13 10:33:43 +01:00
README.md Appveyor badge to show master branch 2016-07-26 13:54:08 -07:00
ROCKSDB_LITE.md Optimistic Transactions 2015-05-29 14:36:35 -07:00
src.mk Iterator should be in corrupted status if merge operator return false 2016-12-16 11:09:16 -08:00
thirdparty.inc Introduce XPRESS compresssion on Windows. (#1081) 2016-04-19 22:54:24 -07:00
USERS.md Update Netflix section of USERS.md 2016-12-19 12:09:12 -08:00
Vagrantfile Update Vagrant file (test internal phabricator workflow) 2016-10-28 15:39:19 -07:00
WINDOWS_PORT.md Commit both PR and internal code review changes 2015-07-07 16:58:20 -07:00

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

Build Status Build status

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/