andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
rocksdb/table
History
anand76 e10570331d Support row cache with batched MultiGet (#5706) 
Summary:
This PR adds support for row cache in ```rocksdb::TableCache::MultiGet```.
Pull Request resolved: https://github.com/facebook/rocksdb/pull/5706

Test Plan:
1. Unit tests in db_basic_test
2. db_bench results with batch size of 2 (```Get``` is faster than ```MultiGet``` for single key) -
Get -
readrandom   :       3.935 micros/op 254116 ops/sec;   28.1 MB/s (22870998 of 22870999 found)
MultiGet -
multireadrandom :       3.743 micros/op 267190 ops/sec; (24047998 of 24047998 found)

Command used -
TEST_TMPDIR=/dev/shm/multiget numactl -C 10  ./db_bench -use_existing_db=true -use_existing_keys=false -benchmarks="readtorowcache,[read|multiread]random" -write_buffer_size=16777216 -target_file_size_base=4194304 -max_bytes_for_level_base=16777216 -num=12000000 -reads=12000000 -duration=90 -threads=1 -compression_type=none -cache_size=4194304000 -row_cache_size=4194304000 -batch_size=2 -disable_auto_compactions=true -bloom_bits=10 -cache_index_and_filter_blocks=true -pin_l0_filter_and_index_blocks_in_cache=true -multiread_batched=true -multiread_stride=131072

Differential Revision: D17086297

Pulled By: anand1976

fbshipit-source-id: 85784378da913e05f1baf31ec1b4e7c9345e7f57
2019-08-28 16:11:56 -07:00
..
adaptive
Organizing rocksdb/table directory by format
2019-05-30 14:51:11 -07:00
block_based
Revert to storing UncompressionDicts in the cache (#5645)
2019-08-23 08:27:30 -07:00
cuckoo
Optimizing ApproximateSize to create index iterator just once (#5693)
2019-08-16 14:18:28 -07:00
plain
Optimizing ApproximateSize to create index iterator just once (#5693)
2019-08-16 14:18:28 -07:00
block_fetcher.cc
Add an option to put first key of each sst block in the index (#5289)
2019-06-24 20:54:04 -07:00
block_fetcher.h
Combine the read-ahead logic for user reads and compaction reads (#5431)
2019-06-19 14:10:46 -07:00
bloom_block.cc
Change RocksDB License
2017-07-15 16:11:23 -07:00
bloom_block.h
Disallow customized hash function in DynamicBloom (#4915)
2019-01-24 10:34:30 -08:00
cleanable_test.cc
Move test related files under util/ to test_util/ (#5377)
2019-05-30 11:25:51 -07:00
format.cc
Add an option to put first key of each sst block in the index (#5289)
2019-06-24 20:54:04 -07:00
format.h
MultiGet parallel IO (#5464)
2019-06-30 20:56:04 -07:00
full_filter_bits_builder.h
Skip duplicate bloom keys when whole_key and prefix are mixed
2018-04-24 10:58:16 -07:00
get_context.cc
New API to get all merge operands for a Key (#5604)
2019-08-06 14:26:44 -07:00
get_context.h
Fix local includes
2019-08-22 16:21:47 -07:00
internal_iterator.h
Reduce iterator key comparison for upper/lower bound check (2nd attempt) (#5468)
2019-07-02 11:48:46 -07:00
iter_heap.h
Make InternalKeyComparator final and directly use it in merging iterator
2017-09-11 12:04:21 -07:00
iterator_wrapper.h
Reduce iterator key comparison for upper/lower bound check (2nd attempt) (#5468)
2019-07-02 11:48:46 -07:00
iterator.cc
Add an option to put first key of each sst block in the index (#5289)
2019-06-24 20:54:04 -07:00
merger_test.cc
Move test related files under util/ to test_util/ (#5377)
2019-05-30 11:25:51 -07:00
merging_iterator.cc
Reduce iterator key comparison for upper/lower bound check (2nd attempt) (#5468)
2019-07-02 11:48:46 -07:00
merging_iterator.h
Index value delta encoding (#3983)
2018-08-09 16:58:40 -07:00
meta_blocks.cc
Add an option to put first key of each sst block in the index (#5289)
2019-06-24 20:54:04 -07:00
meta_blocks.h
Make the 'block read count' performance counters consistent (#5484)
2019-06-18 19:03:24 -07:00
mock_table.cc
Add more callers for table reader. (#5454)
2019-06-20 14:31:48 -07:00
mock_table.h
Optimizing ApproximateSize to create index iterator just once (#5693)
2019-08-16 14:18:28 -07:00
multiget_context.h
Support row cache with batched MultiGet (#5706)
2019-08-28 16:11:56 -07:00
persistent_cache_helper.cc
Organizing rocksdb/table directory by format
2019-05-30 14:51:11 -07:00
persistent_cache_helper.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
persistent_cache_options.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
scoped_arena_iterator.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
sst_file_reader_test.cc
simplify include directive involving inttypes (#5402)
2019-06-06 13:56:07 -07:00
sst_file_reader.cc
Do readahead in VerifyChecksum() (#5713)
2019-08-16 16:42:56 -07:00
sst_file_writer_collectors.h
Fix SstFileReader not able to open ingested file (#5097)
2019-03-26 10:25:18 -07:00
sst_file_writer.cc
Move some memory related files from util/ to memory/ (#5382)
2019-05-30 17:44:09 -07:00
table_builder.h
Integrate block cache tracer into db_impl (#5433)
2019-06-13 15:43:10 -07:00
table_properties_internal.h
Index value delta encoding (#3983)
2018-08-09 16:58:40 -07:00
table_properties.cc
Organizing rocksdb/table directory by format
2019-05-30 14:51:11 -07:00
table_reader_bench.cc
New API to get all merge operands for a Key (#5604)
2019-08-06 14:26:44 -07:00
table_reader_caller.h
Add more callers for table reader. (#5454)
2019-06-20 14:31:48 -07:00
table_reader.h
Do readahead in VerifyChecksum() (#5713)
2019-08-16 16:42:56 -07:00
table_test.cc
Refactor trimming logic for immutable memtables (#5022)
2019-08-23 13:55:34 -07:00
two_level_iterator.cc
Add an option to put first key of each sst block in the index (#5289)
2019-06-24 20:54:04 -07:00
two_level_iterator.h
Add an option to put first key of each sst block in the index (#5289)
2019-06-24 20:54:04 -07:00