A library that provides an embeddable, persistent key-value store for fast storage.
Go to file
Dhruba Borthakur c1bb32e1ba Trigger read compaction only if seeks to storage are incurred.
Summary:
In the current code, a Get() call can trigger compaction if it has to look at more than one file. This causes unnecessary compaction because looking at more than one file is a penalty only if the file is not yet in the cache. Also, th current code counts these files before the bloom filter check is applied.

This patch counts a 'seek' only if the file fails the bloom filter
check and has to read in data block(s) from the storage.

This patch also counts a 'seek' if a file is not present in the file-cache, because opening a file means that its index blocks need to be read into cache.

Test Plan: unit test attached. I will probably add one more unti tests.

Reviewers: heyongqiang

Reviewed By: heyongqiang

CC: MarkCallaghan

Differential Revision: https://reviews.facebook.net/D5709
2012-09-28 11:10:52 -07:00
db Trigger read compaction only if seeks to storage are incurred. 2012-09-28 11:10:52 -07:00
doc merge 1.5 2012-08-28 11:43:33 -07:00
hdfs Allow a configurable number of background threads. 2012-09-19 15:51:08 -07:00
helpers/memenv A number of fixes: 2011-10-31 17:22:06 +00:00
include/leveldb Trigger read compaction only if seeks to storage are incurred. 2012-09-28 11:10:52 -07:00
port put log in a seperate dir 2012-09-06 17:52:08 -07:00
scribe fix db_test error with scribe logger turned on 2012-08-28 11:22:58 -07:00
snappy Build with gcc-4.7.1-glibc-2.14.1. 2012-09-17 10:56:26 -07:00
table Trigger read compaction only if seeks to storage are incurred. 2012-09-28 11:10:52 -07:00
thrift Expose new configration variables via the thrift api 2012-08-17 10:29:12 -07:00
tools Add db_dump tool to dump DB keys 2012-09-27 09:53:58 -07:00
util The BackupAPI should also list the length of the manifest file. 2012-09-25 03:13:25 -07:00
.arcconfig Support arcdiff. 2012-05-09 23:35:05 -07:00
.gitignore Added bloom filter support. 2012-04-17 08:36:46 -07:00
AUTHORS reverting disastrous MOE commit, returning to r21 2011-04-19 23:11:15 +00:00
build_detect_platform build scribe with thrift lib Summary: 2012-09-06 17:41:53 -07:00
build_detect_version Record the version of the source repository that was used to build the leveldb library. 2012-08-24 15:18:43 -07:00
fbcode.gcc471.sh Use correct version of jemalloc. 2012-09-17 15:00:19 -07:00
fbcode.sh Do not use scribe for release builds. 2012-09-04 16:33:49 -07:00
LICENSE reverting disastrous MOE commit, returning to r21 2011-04-19 23:11:15 +00:00
Makefile Add db_dump tool to dump DB keys 2012-09-27 09:53:58 -07:00
NEWS sync with upstream @ 21409451 2011-05-21 02:17:43 +00:00
README @20776309 2011-04-20 22:48:11 +00:00
README.fb Release 1.5.3.fb. 2012-09-25 08:30:46 -07:00
TODO A number of smaller fixes and performance improvements: 2011-06-22 02:36:45 +00:00

leveldb: A key-value store
Authors: Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

The code under this directory implements a system for maintaining a
persistent key/value store.

See doc/index.html for more explanation.
See doc/impl.html for a brief overview of the implementation.

The public interface is in include/*.h.  Callers should not include or
rely on the details of any other header files in this package.  Those
internal APIs may be changed without warning.

Guide to header files:

include/db.h
    Main interface to the DB: Start here

include/options.h
    Control over the behavior of an entire database, and also
    control over the behavior of individual reads and writes.

include/comparator.h
    Abstraction for user-specified comparison function.  If you want
    just bytewise comparison of keys, you can use the default comparator,
    but clients can write their own comparator implementations if they
    want custom ordering (e.g. to handle different character
    encodings, etc.)

include/iterator.h
    Interface for iterating over data. You can get an iterator
    from a DB object.

include/write_batch.h
    Interface for atomically applying multiple updates to a database.

include/slice.h
    A simple module for maintaining a pointer and a length into some
    other byte array.

include/status.h
    Status is returned from many of the public interfaces and is used
    to report success and various kinds of errors.

include/env.h
    Abstraction of the OS environment.  A posix implementation of
    this interface is in util/env_posix.cc

include/table.h
include/table_builder.h
    Lower-level modules that most clients probably won't use directly