andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
rocksdb/tools
History
Lingjing You 1a928c22a0 Add insert hints for each writebatch (#5728) 
Summary:
Add insert hints for each writebatch so that they can be used in concurrent write, and add write option to enable it.

Bench result (qps):

`./db_bench --benchmarks=fillseq -allow_concurrent_memtable_write=true -num=4000000 -batch-size=1 -threads=1 -db=/data3/ylj/tmp -write_buffer_size=536870912 -num_column_families=4`

master:

| batch size \ thread num | 1       | 2       | 4       | 8       |
| ----------------------- | ------- | ------- | ------- | ------- |
| 1                       | 387883  | 220790  | 308294  | 490998  |
| 10                      | 1397208 | 978911  | 1275684 | 1733395 |
| 100                     | 2045414 | 1589927 | 1798782 | 2681039 |
| 1000                    | 2228038 | 1698252 | 1839877 | 2863490 |

fillseq with writebatch hint:

| batch size \ thread num | 1       | 2       | 4       | 8       |
| ----------------------- | ------- | ------- | ------- | ------- |
| 1                       | 286005  | 223570  | 300024  | 466981  |
| 10                      | 970374  | 813308  | 1399299 | 1753588 |
| 100                     | 1962768 | 1983023 | 2676577 | 3086426 |
| 1000                    | 2195853 | 2676782 | 3231048 | 3638143 |
Pull Request resolved: https://github.com/facebook/rocksdb/pull/5728

Differential Revision: D17297240

fbshipit-source-id: b053590a6d77871f1ef2f911a7bd013b3899b26c
2019-09-12 17:15:18 -07:00
..
advisor
Rules Advisor: some fixes to support fetching stats from ODS (#4223)
2018-08-02 15:42:42 -07:00
block_cache_analyzer
Fix RocksDB bug in block_cache_trace_analyzer.cc on Windows (#5786)
2019-09-11 18:36:41 -07:00
dump
simplify include directive involving inttypes (#5402)
2019-06-06 13:56:07 -07:00
rdb
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
analyze_txn_stress_test.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
auto_sanity_test.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
benchmark_leveldb.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
benchmark.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
blob_dump.cc
comment unused parameters to turn on -Wunused-parameter flag
2018-04-12 17:59:16 -07:00
check_format_compatible.sh
Add more release versions to tools/check_format_compatible.sh (#5518)
2019-06-28 17:41:58 -07:00
CMakeLists.txt
cmake support for linux and osx (#1358)
2016-09-28 11:53:15 -07:00
db_bench_tool_test.cc
Refactor trimming logic for immutable memtables (#5022)
2019-08-23 13:55:34 -07:00
db_bench_tool.cc
Add insert hints for each writebatch (#5728)
2019-09-12 17:15:18 -07:00
db_bench.cc
simplify include directive involving inttypes (#5402)
2019-06-06 13:56:07 -07:00
db_crashtest.py
Temporarily disable hash index in stress tests (#5792)
2019-09-12 12:11:34 -07:00
db_repl_stress.cc
Move some memory related files from util/ to memory/ (#5382)
2019-05-30 17:44:09 -07:00
db_sanity_test.cc
Change RocksDB License
2017-07-15 16:11:23 -07:00
db_stress.cc
Support partitioned index and filters in stress/crash tests (#4020)
2019-09-11 14:13:38 -07:00
dbench_monitor
Fix /bin/bash shebangs
2017-08-03 15:56:46 -07:00
Dockerfile
adding docker build script and dockerfile
2015-05-22 16:03:39 -07:00
generate_random_db.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
ingest_external_sst.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
ldb_cmd_impl.h
Add command "list_file_range_deletes" in ldb (#5615)
2019-08-15 17:01:03 -07:00
ldb_cmd_test.cc
Add command "list_file_range_deletes" in ldb (#5615)
2019-08-15 17:01:03 -07:00
ldb_cmd.cc
Add command "list_file_range_deletes" in ldb (#5615)
2019-08-15 17:01:03 -07:00
ldb_test.py
Fix interpreter lines for files with python2-only syntax.
2019-07-09 10:51:37 -07:00
ldb_tool.cc
Add command "list_file_range_deletes" in ldb (#5615)
2019-08-15 17:01:03 -07:00
ldb.cc
comment unused parameters to turn on -Wunused-parameter flag
2018-04-12 17:59:16 -07:00
pflag
Fix /bin/bash shebangs
2017-08-03 15:56:46 -07:00
reduce_levels_test.cc
Organizing rocksdb/db directory
2019-05-31 11:57:01 -07:00
regression_test.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
report_lite_binary_size.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
rocksdb_dump_test.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
run_flash_bench.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
run_leveldb.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
sample-dump.dmp
First version of rocksdb_dump and rocksdb_undump.
2015-06-19 16:24:36 -07:00
sst_dump_test.cc
Move some memory related files from util/ to memory/ (#5382)
2019-05-30 17:44:09 -07:00
sst_dump_tool_imp.h
tools: use provided options instead of the default (#4839)
2019-01-03 11:23:49 -08:00
sst_dump_tool.cc
Do readahead in VerifyChecksum() (#5713)
2019-08-16 16:42:56 -07:00
sst_dump.cc
comment unused parameters to turn on -Wunused-parameter flag
2018-04-12 17:59:16 -07:00
trace_analyzer_test.cc
Move util/trace_replay.* to trace_replay/ (#5376)
2019-06-03 13:25:26 -07:00
trace_analyzer_tool.cc
replace sprintf with its safe version snprintf (#5475)
2019-06-18 16:42:26 -07:00
trace_analyzer_tool.h
Move util/trace_replay.* to trace_replay/ (#5376)
2019-06-03 13:25:26 -07:00
trace_analyzer.cc
RocksDB Trace Analyzer (#4091)
2018-08-13 11:44:02 -07:00
verify_random_db.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
write_external_sst.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
write_stress_runner.py
Fix interpreter lines for files with python2-only syntax.
2019-07-09 10:51:37 -07:00
write_stress.cc
simplify include directive involving inttypes (#5402)
2019-06-06 13:56:07 -07:00