andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
rocksdb/util
History
Igor Canadi 82e5c842b6 Fix bad performance in debug mode 
Summary:
See github issue 574: https://github.com/facebook/rocksdb/issues/574

Basically when we're running in DEBUG mode we're calling `usleep(0)` on
every mutex lock. I bisected the issue to
https://reviews.facebook.net/D36963. Instead of calling sleep(0), this
diff just avoids calling SleepForMicroseconds() when delay is not set.

Test Plan:
    bpl=10485760;overlap=10;mcz=2;del=300000000;levels=2;ctrig=10000000; delay=10000000; stop=10000000; wbn=30; mbc=20; mb=1073741824;wbs=268435456; dds=1; sync=0; r=100000; t=1; vs=800; bs=65536; cs=1048576; of=500000; si=1000000; ./db_bench --benchmarks=fillrandom --disable_seek_compaction=1 --mmap_read=0 --statistics=1 --histogram=1 --num=$r --threads=$t --value_size=$vs --block_size=$bs --cache_size=$cs --bloom_bits=10 --cache_numshardbits=4 --open_files=$of --verify_checksum=1 --db=/tmp/rdb10test --sync=$sync --disable_wal=1 --compression_type=snappy --stats_interval=$si --compression_ratio=0.5 --disable_data_sync=$dds --write_buffer_size=$wbs --target_file_size_base=$mb --max_write_buffer_number=$wbn --max_background_compactions=$mbc --level0_file_num_compaction_trigger=$ctrig --level0_slowdown_writes_trigger=$delay --level0_stop_writes_trigger=$stop --num_levels=$levels --delete_obsolete_files_period_micros=$del --min_level_to_compress=$mcz --max_grandparent_overlap_factor=$overlap --stats_per_interval=1 --max_bytes_for_level_base=$bpl --memtablerep=vector --use_existing_db=0 --disable_auto_compactions=1 --source_compaction_factor=10000000 | grep ops

Before:
fillrandom   :     117.525 micros/op 8508 ops/sec;    6.6 MB/s
After:
fillrandom   :       1.283 micros/op 779502 ops/sec;  606.6 MB/s

Reviewers: rven, yhchiang, sdong

Reviewed By: sdong

Subscribers: meyering, dhruba, leveldb

Differential Revision: https://reviews.facebook.net/D36963
2015-04-13 15:59:29 -07:00
..
allocator.h
Enforce write buffer memory limit across column families
2014-12-02 12:09:20 -08:00
arena_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
arena.cc
Make arena use hugepage if possible
2014-11-21 14:11:40 -08:00
arena.h
Removing unnecessary kInlineSize
2015-03-12 21:13:53 +03:00
auto_roll_logger_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
auto_roll_logger.cc
Add Header to logging to capture application level information
2015-02-06 10:37:45 -08:00
auto_roll_logger.h
rocksdb: Add missing override
2015-02-26 11:28:41 -08:00
autovector_test.cc
rocksdb: Remove #include "util/string_util.h" from util/testharness.h
2015-03-19 17:29:37 -07:00
autovector.h
Replace exception by assertion in autovector
2014-12-04 11:41:56 -08:00
benchharness_test.cc
Turn on -Wshorten-64-to-32 and fix all the errors
2014-11-11 16:47:22 -05:00
benchharness.cc
Add rocksdb::ToString() to address cases where std::to_string is not available.
2014-11-24 20:44:49 -08:00
benchharness.h
mark as unused some variables with cpp-derived names
2015-02-20 11:07:21 -08:00
bloom_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
bloom.cc
Turn on -Wshorten-64-to-32 and fix all the errors
2014-11-11 16:47:22 -05:00
build_version.h
build: do not relink every single binary just for a timestamp
2015-02-19 13:11:10 -08:00
cache_bench.cc
Fix -Wshadow for tools
2014-11-07 15:04:30 -08:00
cache_test.cc
rocksdb: Remove #include "util/string_util.h" from util/testharness.h
2015-03-19 17:29:37 -07:00
cache.cc
Deprecate removeScanCountLimit in NewLRUCache
2015-03-17 15:04:37 -07:00
coding_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
coding.cc
Removing BitStream* functions
2014-08-19 06:48:21 -07:00
coding.h
Turn on -Wshorten-64-to-32 and fix all the errors
2014-11-11 16:47:22 -05:00
comparator.cc
rocksdb: Add missing override
2015-02-26 11:28:41 -08:00
compression.h
New BlockBasedTable version -- better compressed block format
2015-01-14 16:24:24 -08:00
crc32c_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
crc32c.cc
Turn on -Wshorten-64-to-32 and fix all the errors
2014-11-11 16:47:22 -05:00
crc32c.h
Add appropriate LICENSE and Copyright message.
2013-10-16 17:48:41 -07:00
db_info_dumper.cc
Fix iOS compile with -Wshorten-64-to-32
2014-11-13 14:39:30 -05:00
db_info_dumper.h
Fix iOS compile with -Wshorten-64-to-32
2014-11-13 14:39:30 -05:00
dynamic_bloom_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
dynamic_bloom.cc
Enforce write buffer memory limit across column families
2014-12-02 12:09:20 -08:00
dynamic_bloom.h
Enforce write buffer memory limit across column families
2014-12-02 12:09:20 -08:00
env_hdfs.cc
Add rocksdb::ToString() to address cases where std::to_string is not available.
2014-11-24 20:44:49 -08:00
env_posix.cc
Using chrono as a fallback
2015-03-18 11:26:10 -07:00
env_test.cc
rocksdb: Remove #include "util/string_util.h" from util/testharness.h
2015-03-19 17:29:37 -07:00
env.cc
Add Header to logging to capture application level information
2015-02-06 10:37:45 -08:00
event_logger_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
event_logger.cc
Include chrono
2015-03-13 10:29:32 -07:00
event_logger.h
Include chrono
2015-03-13 10:29:32 -07:00
file_util.cc
Provide openable snapshots
2014-11-14 11:38:26 -08:00
file_util.h
Provide openable snapshots
2014-11-14 11:38:26 -08:00
filelock_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
filter_policy.cc
Add appropriate LICENSE and Copyright message.
2013-10-16 17:48:41 -07:00
hash_cuckoo_rep.cc
Enforce write buffer memory limit across column families
2014-12-02 12:09:20 -08:00
hash_cuckoo_rep.h
Enforce write buffer memory limit across column families
2014-12-02 12:09:20 -08:00
hash_linklist_rep.cc
rocksdb: Add missing override
2015-02-26 11:28:41 -08:00
hash_linklist_rep.h
Enforce write buffer memory limit across column families
2014-12-02 12:09:20 -08:00
hash_skiplist_rep.cc
rocksdb: Add missing override
2015-02-26 11:28:41 -08:00
hash_skiplist_rep.h
Enforce write buffer memory limit across column families
2014-12-02 12:09:20 -08:00
hash.cc
Turn on -Wshorten-64-to-32 and fix all the errors
2014-11-11 16:47:22 -05:00
hash.h
Introduce GetThreadList API
2014-11-20 10:49:32 -08:00
histogram_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
histogram.cc
Fix iOS compile with -Wshorten-64-to-32
2014-11-13 14:39:30 -05:00
histogram.h
Fix iOS compile with -Wshorten-64-to-32
2014-11-13 14:39:30 -05:00
instrumented_mutex.cc
Perf Context to report DB mutex waiting time
2015-02-09 17:55:12 -08:00
instrumented_mutex.h
Add a counter for collecting the wait time on db mutex.
2015-02-04 21:39:45 -08:00
iostats_context_imp.h
Fix ios compile
2014-08-28 12:46:05 -04:00
iostats_context.cc
Fix ios compile
2014-08-28 12:46:05 -04:00
ldb_cmd_execute_result.h
rocksdb: Small refactoring before migrating to gtest
2015-03-16 18:08:59 -07:00
ldb_cmd.cc
Deprecate removeScanCountLimit in NewLRUCache
2015-03-17 15:04:37 -07:00
ldb_cmd.h
rocksdb: Small refactoring before migrating to gtest
2015-03-16 18:08:59 -07:00
ldb_tool.cc
Added 'dump_live_files' command to ldb tool.
2014-12-12 17:50:36 -08:00
log_buffer.cc
Enlarge log size cap when printing file summary
2014-09-23 16:56:34 -07:00
log_buffer.h
RocksDB on FreeBSD support
2015-02-26 15:19:17 -08:00
log_write_bench.cc
Fix more gflag namespace issues
2014-05-09 08:41:02 -07:00
logging.cc
Make RecordIn/RecordOut human readable
2015-03-14 15:12:41 -07:00
logging.h
Make RecordIn/RecordOut human readable
2015-03-14 15:12:41 -07:00
manual_compaction_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
memenv_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
memenv.cc
rocksdb: Add missing override
2015-02-26 11:28:41 -08:00
mock_env_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
mock_env.cc
rocksdb: Add missing override
2015-02-26 11:28:41 -08:00
mock_env.h
rocksdb: Add missing override
2015-02-26 11:28:41 -08:00
murmurhash.cc
Add appropriate LICENSE and Copyright message.
2013-10-16 17:48:41 -07:00
murmurhash.h
Turn on -Wshorten-64-to-32 and fix all the errors
2014-11-11 16:47:22 -05:00
mutable_cf_options.cc
options.level_compaction_dynamic_level_bytes to allow RocksDB to pick size bases of levels dynamically.
2015-03-02 22:40:41 -08:00
mutable_cf_options.h
options.level_compaction_dynamic_level_bytes to allow RocksDB to pick size bases of levels dynamically.
2015-03-02 22:40:41 -08:00
mutexlock.h
Add separate Read/WriteUnlock methods in MutexRW.
2014-06-16 15:41:46 -07:00
options_builder.cc
Remove the compability check on log2 OS_ANDROID as it's already blocked by ROCKSDB_LITE
2014-12-04 13:56:14 -08:00
options_helper.cc
Deprecate removeScanCountLimit in NewLRUCache
2015-03-17 15:04:37 -07:00
options_helper.h
Missing header in build on CentOS
2014-11-18 22:21:02 +01:00
options_test.cc
rocksdb: Remove #include "util/random.h" from util/testharness.h
2015-03-19 17:06:02 -07:00
options.cc
Fixed xfunc related compile errors in ROCKSDB_LITE
2015-04-09 21:32:03 -07:00
perf_context_imp.h
Refactor PerfStepTimer to stop on destruct
2014-09-02 12:04:22 -07:00
perf_context.cc
Adding stats for the merge and filter operation
2015-03-24 14:42:04 -07:00
posix_logger.h
rocksdb: Add missing override
2015-02-26 11:28:41 -08:00
random.h
Add appropriate LICENSE and Copyright message.
2013-10-16 17:48:41 -07:00
rate_limiter_test.cc
Enable dynamic changing of rate limiter's bytes_per_second
2015-03-18 15:35:55 -07:00
rate_limiter.cc
Enable dynamic changing of rate limiter's bytes_per_second
2015-03-18 15:35:55 -07:00
rate_limiter.h
Enable dynamic changing of rate limiter's bytes_per_second
2015-03-18 15:35:55 -07:00
scoped_arena_iterator.h
Remove path with arena==nullptr from NewInternalIterator
2014-09-04 17:40:41 -07:00
signal_test.cc
rocksdb: Fix scan-build 'Called C++ object pointer is null' and 'Dereference of null pointer' bugs
2015-02-13 15:10:47 -08:00
skiplistrep.cc
Enforce write buffer memory limit across column families
2014-12-02 12:09:20 -08:00
slice_transform_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
slice.cc
rocksdb: Add missing override
2015-02-26 11:28:41 -08:00
sst_dump_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
sst_dump_tool_imp.h
Disable pre-fetching of index and filter blocks for sst_dump_tool.
2015-02-25 16:34:26 -08:00
sst_dump_tool.cc
Make SSTDumpTest.GetProperties less noisy
2015-03-23 14:30:11 -07:00
statistics.cc
Fix assert in histogramData
2015-01-23 18:10:52 -08:00
statistics.h
make statistics forward-able
2014-07-28 12:10:49 -07:00
status.cc
Turn on -Wshorten-64-to-32 and fix all the errors
2014-11-11 16:47:22 -05:00
stl_wrappers.h
Killing Transform Rep
2013-12-03 12:42:15 -08:00
stop_watch.h
Change StopWatch interface
2014-07-28 12:22:37 -07:00
string_util.cc
Clean up StringSplit
2014-11-21 11:05:28 -05:00
string_util.h
Add rocksdb::ToString() to address cases where std::to_string is not available.
2014-11-24 20:44:49 -08:00
sync_point.cc
options.level_compaction_dynamic_level_bytes to allow RocksDB to pick size bases of levels dynamically.
2015-03-02 22:40:41 -08:00
sync_point.h
options.level_compaction_dynamic_level_bytes to allow RocksDB to pick size bases of levels dynamically.
2015-03-02 22:40:41 -08:00
testharness.cc
rocksdb: print status error message when (ASSERT|EXPECT)_OK fails
2015-03-19 17:32:43 -07:00
testharness.h
rocksdb: print status error message when (ASSERT|EXPECT)_OK fails
2015-03-19 17:32:43 -07:00
testutil.cc
Merger test
2014-09-08 22:24:40 -07:00
testutil.h
rocksdb: Add missing override
2015-02-26 11:28:41 -08:00
thread_list_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
thread_local_test.cc
rocksdb: switch to gtest
2015-03-17 14:08:00 -07:00
thread_local.cc
Use ustricter consistency in thread local operations
2015-01-27 13:56:03 -08:00
thread_local.h
Improve the comment of util/thread_local.h
2014-10-21 17:28:31 -07:00
thread_operation.h
Allow GetThreadList() to report operation stage.
2015-03-13 10:45:40 -07:00
thread_status_impl.cc
Fix compile error when NROCKSDB_THREAD_STATUS is not used.
2015-03-24 14:52:59 -07:00
thread_status_updater_debug.cc
Allow GetThreadList() to indicate a thread is doing Compaction.
2015-01-13 00:04:08 -08:00
thread_status_updater.cc
Report elapsed time in micros in ThreadStatus instead of start time.
2015-03-24 11:32:25 -07:00
thread_status_updater.h
Report elapsed time in micros in ThreadStatus instead of start time.
2015-03-24 11:32:25 -07:00
thread_status_util_debug.cc
Fix bad performance in debug mode
2015-04-13 15:59:29 -07:00
thread_status_util.cc
Report elapsed time in micros in ThreadStatus instead of start time.
2015-03-24 11:32:25 -07:00
thread_status_util.h
Fix compile warning in thread_status_util.h on Mac
2015-03-13 18:09:01 -07:00
vectorrep.cc
Enforce write buffer memory limit across column families
2014-12-02 12:09:20 -08:00
xfunc.cc
Fixed xfunc related compile errors in ROCKSDB_LITE
2015-04-09 21:32:03 -07:00
xfunc.h
Fixed xfunc related compile errors in ROCKSDB_LITE
2015-04-09 21:32:03 -07:00
xxhash.cc
Prevent xxhash symbols from polluting global namespace
2015-03-12 12:07:10 -07:00
xxhash.h
Prevent xxhash symbols from polluting global namespace
2015-03-12 12:07:10 -07:00