andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
rocksdb/include/rocksdb
History
Lingjing You 1a928c22a0 Add insert hints for each writebatch (#5728) 
Summary:
Add insert hints for each writebatch so that they can be used in concurrent write, and add write option to enable it.

Bench result (qps):

`./db_bench --benchmarks=fillseq -allow_concurrent_memtable_write=true -num=4000000 -batch-size=1 -threads=1 -db=/data3/ylj/tmp -write_buffer_size=536870912 -num_column_families=4`

master:

| batch size \ thread num | 1       | 2       | 4       | 8       |
| ----------------------- | ------- | ------- | ------- | ------- |
| 1                       | 387883  | 220790  | 308294  | 490998  |
| 10                      | 1397208 | 978911  | 1275684 | 1733395 |
| 100                     | 2045414 | 1589927 | 1798782 | 2681039 |
| 1000                    | 2228038 | 1698252 | 1839877 | 2863490 |

fillseq with writebatch hint:

| batch size \ thread num | 1       | 2       | 4       | 8       |
| ----------------------- | ------- | ------- | ------- | ------- |
| 1                       | 286005  | 223570  | 300024  | 466981  |
| 10                      | 970374  | 813308  | 1399299 | 1753588 |
| 100                     | 1962768 | 1983023 | 2676577 | 3086426 |
| 1000                    | 2195853 | 2676782 | 3231048 | 3638143 |
Pull Request resolved: https://github.com/facebook/rocksdb/pull/5728

Differential Revision: D17297240

fbshipit-source-id: b053590a6d77871f1ef2f911a7bd013b3899b26c
2019-09-12 17:15:18 -07:00
..
utilities
Use delete to disable automatic generated methods. (#5009)
2019-09-11 18:09:00 -07:00
advanced_options.h
Refactor trimming logic for immutable memtables (#5022)
2019-08-23 13:55:34 -07:00
c.h
Add insert hints for each writebatch (#5728)
2019-09-12 17:15:18 -07:00
cache.h
Use delete to disable automatic generated methods. (#5009)
2019-09-11 18:09:00 -07:00
cleanable.h
Use delete to disable automatic generated methods. (#5009)
2019-09-11 18:09:00 -07:00
compaction_filter.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
compaction_job_stats.h
Add a new CPU time counter to compaction report (#4889)
2019-01-29 17:24:00 -08:00
comparator.h
The ObjectRegistry class replaces the Registrar and NewCustomObjects.… (#5293)
2019-07-23 17:13:05 -07:00
concurrent_task_limiter.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
convenience.h
Do readahead in VerifyChecksum() (#5713)
2019-08-16 16:42:56 -07:00
db_bench_tool.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
db_dump_tool.h
Fix some typos in comments and docs.
2018-03-08 10:27:25 -08:00
db.h
Use delete to disable automatic generated methods. (#5009)
2019-09-11 18:09:00 -07:00
env_encryption.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
env.h
Use delete to disable automatic generated methods. (#5009)
2019-09-11 18:09:00 -07:00
experimental.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
filter_policy.h
Remove a couple of non-public includes from public header file (#5219)
2019-04-19 11:10:33 -07:00
flush_block_policy.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
iostats_context.h
Add a new CPU time counter to compaction report (#4889)
2019-01-29 17:24:00 -08:00
iterator.h
Use delete to disable automatic generated methods. (#5009)
2019-09-11 18:09:00 -07:00
ldb_tool.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
listener.h
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
memory_allocator.h
JemallocNodumpAllocator: option to limit tcache memory usage (#4736)
2018-11-29 17:33:40 -08:00
memtablerep.h
Add insert hints for each writebatch (#5728)
2019-09-12 17:15:18 -07:00
merge_operator.h
The ObjectRegistry class replaces the Registrar and NewCustomObjects.… (#5293)
2019-07-23 17:13:05 -07:00
metadata.h
Export Import sst files (#5495)
2019-07-17 12:27:14 -07:00
options.h
Add insert hints for each writebatch (#5728)
2019-09-12 17:15:18 -07:00
perf_context.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
perf_level.h
Introduce a CPU time counter in perf_context (#4741)
2018-12-20 12:03:44 -08:00
persistent_cache.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
rate_limiter.h
Fix typos in comments (#4819)
2018-12-26 09:43:56 -08:00
slice_transform.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
slice.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
snapshot.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
sst_dump_tool.h
tools: use provided options instead of the default (#4839)
2019-01-03 11:23:49 -08:00
sst_file_manager.h
Smooth the deletion of WAL files (#5116)
2019-03-28 15:17:13 -07:00
sst_file_reader.h
Do readahead in VerifyChecksum() (#5713)
2019-08-16 16:42:56 -07:00
sst_file_writer.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
statistics.h
WritePrepared: fix Get without snapshot (#5664)
2019-08-05 13:41:21 -07:00
stats_history.h
Persistent Stats: persist stats history to disk (#5046)
2019-06-17 15:21:50 -07:00
status.h
New API to get all merge operands for a Key (#5604)
2019-08-06 14:26:44 -07:00
table_properties.h
Add copyright headers per FB open-source checkup tool. (#5199)
2019-04-18 10:55:01 -07:00
table.h
LRU Cache to enable mid-point insertion by default (#5508)
2019-06-27 10:20:57 -07:00
thread_status.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
threadpool.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
trace_reader_writer.h
Add the max trace file size limitation option to Tracing (#4610)
2018-11-27 14:27:05 -08:00
transaction_log.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
types.h
WriteUnPrepared: less virtual in iterator callback (#5049)
2019-04-02 14:47:16 -07:00
universal_compaction.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
version.h
Update history and version for 6.4.0 (#5652)
2019-07-30 16:10:06 -07:00
wal_filter.h
Run automatic formatter against public header files (#5115)
2019-03-27 13:24:25 -07:00
write_batch_base.h
Fix WriteBatchBase::DeleteRange API comment (#4935)
2019-01-31 14:43:40 -08:00
write_batch.h
upgrade gtest 1.7.0 => 1.8.1 for json result writing
2019-09-09 11:24:11 -07:00
write_buffer_manager.h
Use delete to disable automatic generated methods. (#5009)
2019-09-11 18:09:00 -07:00