andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
rocksdb/tools
History
Peter (Stig) Edwards b20737709f Add -report_open_timing to db_bench (#8464) 
Summary:
Hello and thanks for RocksDB,

This PR adds support for ```-report_open_timing true``` to ```db_bench```.
It can be useful when tuning RocksDB on filesystem/env with high latencies for file level operations (create/delete/rename...) seen during ```((Optimistic)Transaction)DB::Open```.

Some examples:

```
> db_bench -benchmarks updaterandom -num 1 -db /dev/shm/db_bench
> db_bench -benchmarks updaterandom -num 0 -db /dev/shm/db_bench -use_existing_db true -report_open_timing true -readonly true 2>&1 | grep OpenDb
OpenDb:     3.90133 milliseconds
> db_bench -benchmarks updaterandom -num 0 -db /dev/shm/db_bench -use_existing_db true -report_open_timing true -use_secondary_db true 2>&1 | grep OpenDb
OpenDb:     3.33414 milliseconds
> db_bench -benchmarks updaterandom -num 0 -db /dev/shm/db_bench -use_existing_db true -report_open_timing true 2>&1 | grep -A1 OpenDb
OpenDb:     6.05423 milliseconds

> db_bench -benchmarks updaterandom -num 1
> db_bench -benchmarks updaterandom -num 0 -use_existing_db true -report_open_timing true -readonly true 2>&1 | grep OpenDb
OpenDb:     4.06859 milliseconds
> db_bench -benchmarks updaterandom -num 0 -use_existing_db true -report_open_timing true -use_secondary_db true 2>&1 | grep OpenDb
OpenDb:     2.85794 milliseconds
> db_bench -benchmarks updaterandom -num 0 -use_existing_db true -report_open_timing true 2>&1 | grep OpenDb
OpenDb:     6.46376 milliseconds

> db_bench -benchmarks updaterandom -num 1 -db /clustered_fs/db_bench
> db_bench -benchmarks updaterandom -num 0 -db /clustered_fs/db_bench -use_existing_db true -report_open_timing true -readonly true 2>&1 | grep OpenDb
OpenDb:     3.79805 milliseconds
> db_bench -benchmarks updaterandom -num 0 -db /clustered_fs/db_bench -use_existing_db true -report_open_timing true -use_secondary_db true 2>&1 | grep OpenDb
OpenDb:     3.00174 milliseconds
> db_bench -benchmarks updaterandom -num 0 -db /clustered_fs/db_bench -use_existing_db true -report_open_timing true 2>&1 | grep OpenDb
OpenDb:     24.8732 milliseconds
```

Pull Request resolved: https://github.com/facebook/rocksdb/pull/8464

Reviewed By: hx235

Differential Revision: D29398096

Pulled By: zhichao-cao

fbshipit-source-id: 8f05dc3284f084612a3f30234e39e1c37548f50c
2021-07-01 18:42:19 -07:00
..
advisor
remediation of S205607
2020-07-17 17:20:49 -07:00
block_cache_analyzer
Fix cmake build failure with gflags (#8324)
2021-06-01 14:43:15 -07:00
dump
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
rdb
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
analyze_txn_stress_test.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
auto_sanity_test.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
backup_db.sh
Revamp check_format_compatible.sh (#8012)
2021-03-02 11:42:27 -08:00
benchmark_leveldb.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
benchmark.sh
Fixed typo in benchmark.sh (#6434)
2020-02-19 17:08:02 -08:00
blob_dump.cc
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
check_all_python.py
Allow missing "unversioned" python, as in CentOS 8 (#6883)
2020-05-29 11:29:23 -07:00
check_format_compatible.sh
Add 6.18, 6.19 and 6.20 to check_format_compatible.sh (#8236)
2021-04-27 10:24:27 -07:00
CMakeLists.txt
Mark dependencies as PRIVATE and fix missing dependencies in tools. (#6790)
2020-05-12 21:07:55 -07:00
db_bench_tool_test.cc
Add support for the integrated BlobDB to db_bench (#7956)
2021-02-17 11:10:18 -08:00
db_bench_tool.cc
Add -report_open_timing to db_bench (#8464)
2021-07-01 18:42:19 -07:00
db_bench.cc
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
db_crashtest.py
Stress Test to inject write failures in reopen (#8474)
2021-06-30 16:46:41 -07:00
db_repl_stress.cc
Migrate away from Travis+Linux+amd64 (#7791)
2020-12-22 00:20:57 -08:00
db_sanity_test.cc
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
dbench_monitor
Fix /bin/bash shebangs
2017-08-03 15:56:46 -07:00
Dockerfile
adding docker build script and dockerfile
2015-05-22 16:03:39 -07:00
generate_random_db.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
ingest_external_sst.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
io_tracer_parser_test.cc
Fix cmake build failure with gflags (#8324)
2021-06-01 14:43:15 -07:00
io_tracer_parser_tool.cc
Add request_id in IODebugContext. (#8045)
2021-04-01 13:14:51 -07:00
io_tracer_parser_tool.h
Add IO Tracer Parser (#7333)
2020-09-23 15:50:26 -07:00
io_tracer_parser.cc
Add IO Tracer Parser (#7333)
2020-09-23 15:50:26 -07:00
ldb_cmd_impl.h
Add list live files metadata (#8446)
2021-06-22 19:07:46 -07:00
ldb_cmd_test.cc
Add CreateFrom methods to Env/FileSystem (#8174)
2021-06-15 03:43:48 -07:00
ldb_cmd.cc
Add list live files metadata (#8446)
2021-06-22 19:07:46 -07:00
ldb_test.py
Add list live files metadata (#8446)
2021-06-22 19:07:46 -07:00
ldb_tool.cc
Add list live files metadata (#8446)
2021-06-22 19:07:46 -07:00
ldb.cc
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
pflag
Fix /bin/bash shebangs
2017-08-03 15:56:46 -07:00
reduce_levels_test.cc
Add more tests for assert status checked (#7524)
2020-12-22 23:45:58 -08:00
regression_test.sh
Update internal build script (#7957)
2021-02-11 14:55:43 -08:00
report_lite_binary_size.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
restore_db.sh
Revamp check_format_compatible.sh (#8012)
2021-03-02 11:42:27 -08:00
rocksdb_dump_test.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
run_flash_bench.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
run_leveldb.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
sample-dump.dmp
First version of rocksdb_dump and rocksdb_undump.
2015-06-19 16:24:36 -07:00
simulated_hybrid_file_system.cc
Write file temperature information to manifest (#8284)
2021-05-17 15:15:23 -07:00
simulated_hybrid_file_system.h
Write file temperature information to manifest (#8284)
2021-05-17 15:15:23 -07:00
sst_dump_test.cc
Add CreateFrom methods to Env/FileSystem (#8174)
2021-06-15 03:43:48 -07:00
sst_dump_tool.cc
Add CreateFrom methods to Env/FileSystem (#8174)
2021-06-15 03:43:48 -07:00
sst_dump.cc
Implement a new subcommand "identify" for sst_dump (#6943)
2020-06-08 13:58:28 -07:00
trace_analyzer_test.cc
Trace MultiGet Keys and CF_IDs to the trace file (#8421)
2021-06-18 15:04:05 -07:00
trace_analyzer_tool.cc
Trace MultiGet Keys and CF_IDs to the trace file (#8421)
2021-06-18 15:04:05 -07:00
trace_analyzer_tool.h
Introduce a new trace file format (v 0.2) for better extension (#7977)
2021-02-18 23:05:35 -08:00
trace_analyzer.cc
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
verify_random_db.sh
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
write_external_sst.sh
Revamp check_format_compatible.sh (#8012)
2021-03-02 11:42:27 -08:00
write_stress_runner.py
Allow missing "unversioned" python, as in CentOS 8 (#6883)
2020-05-29 11:29:23 -07:00
write_stress.cc
Add a SystemClock class to capture the time functions of an Env (#7858)
2021-01-25 22:09:11 -08:00