andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
rocksdb/table
History
Akanksha Mahajan 0c7f455f85 Make initial auto readahead_size configurable (#9836) 
Summary:
Make initial auto readahead_size configurable

Pull Request resolved: https://github.com/facebook/rocksdb/pull/9836

Test Plan:
Added new unit test
Ran regression:
Without change:

```
./db_bench -use_existing_db=true -db=/tmp/prefix_scan_prefetch_main -benchmarks="seekrandom" -key_size=32 -value_size=512 -num=5000000 -use_direct_reads=true -seek_nexts=327680 -duration=120 -ops_between_duration_checks=1
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
RocksDB:    version 7.0
Date:       Thu Mar 17 13:11:34 2022
CPU:        24 * Intel Core Processor (Broadwell)
CPUCache:   16384 KB
Keys:       32 bytes each (+ 0 bytes user-defined timestamp)
Values:     512 bytes each (256 bytes after compression)
Entries:    5000000
Prefix:    0 bytes
Keys per prefix:    0
RawSize:    2594.0 MB (estimated)
FileSize:   1373.3 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: Snappy
Compression sampling rate: 0
Memtablerep: SkipListFactory
Perf Level: 1
------------------------------------------------
DB path: [/tmp/prefix_scan_prefetch_main]
seekrandom   :  483618.390 micros/op 2 ops/sec;  338.9 MB/s (249 of 249 found)
```

With this change:
```
 ./db_bench -use_existing_db=true -db=/tmp/prefix_scan_prefetch_main -benchmarks="seekrandom" -key_size=32 -value_size=512 -num=5000000 -use_direct_reads=true -seek_nexts=327680 -duration=120 -ops_between_duration_checks=1
Set seed to 1649895440554504 because --seed was 0
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
RocksDB:    version 7.2
Date:       Wed Apr 13 17:17:20 2022
CPU:        24 * Intel Core Processor (Broadwell)
CPUCache:   16384 KB
Keys:       32 bytes each (+ 0 bytes user-defined timestamp)
Values:     512 bytes each (256 bytes after compression)
Entries:    5000000
Prefix:    0 bytes
Keys per prefix:    0
RawSize:    2594.0 MB (estimated)
FileSize:   1373.3 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: Snappy
Compression sampling rate: 0
Memtablerep: SkipListFactory
Perf Level: 1
------------------------------------------------
DB path: [/tmp/prefix_scan_prefetch_main]
... finished 100 ops
seekrandom   :  476892.488 micros/op 2 ops/sec;  344.6 MB/s (252 of 252 found)
```

Reviewed By: anand1976

Differential Revision: D35632815

Pulled By: akankshamahajan15

fbshipit-source-id: c8057a88f9294c9d03b1d434b03affe02f74d796
2022-04-15 17:28:09 -07:00
..
adaptive
More refactoring ahead of footer & meta changes (#9240)
2021-12-10 08:13:26 -08:00
block_based
Make initial auto readahead_size configurable (#9836)
2022-04-15 17:28:09 -07:00
cuckoo
Add rate limiter priority to ReadOptions (#9424)
2022-02-16 23:18:14 -08:00
plain
Meta-internal folly integration with F14FastMap (#9546)
2022-04-13 07:34:01 -07:00
block_fetcher_test.cc
Make MemoryAllocator into a Customizable class (#8980)
2021-12-17 04:20:47 -08:00
block_fetcher.cc
Fix segfault in FilePrefetchBuffer with async_io enabled (#9777)
2022-04-04 15:35:43 -07:00
block_fetcher.h
More refactoring ahead of footer & meta changes (#9240)
2021-12-10 08:13:26 -08:00
cleanable_test.cc
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
format.cc
Add rate limiter priority to ReadOptions (#9424)
2022-02-16 23:18:14 -08:00
format.h
Optimize & clean up footer code (#9280)
2021-12-13 17:43:07 -08:00
get_context.cc
Support readahead during compaction for blob files (#9187)
2021-11-19 17:53:47 -08:00
get_context.h
Cleanup includes in dbformat.h (#8930)
2021-09-29 04:04:40 -07:00
internal_iterator.h
Reuse internal auto readhead_size at each Level (expect L0) for Iterations (#9056)
2021-11-10 16:20:04 -08:00
iter_heap.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
iterator_wrapper.h
Reuse internal auto readhead_size at each Level (expect L0) for Iterations (#9056)
2021-11-10 16:20:04 -08:00
iterator.cc
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
merger_test.cc
Cleanup multiple implementations of VectorIterator (#8901)
2021-10-06 07:48:31 -07:00
merging_iterator.cc
MergingIterator: rearrange fields to reduce paddings (#9024)
2021-10-14 12:01:56 -07:00
merging_iterator.h
Cleanup includes in dbformat.h (#8930)
2021-09-29 04:04:40 -07:00
meta_blocks.cc
Tests for filter compatibility (#9773)
2022-04-06 15:54:40 -07:00
meta_blocks.h
Tests for filter compatibility (#9773)
2022-04-06 15:54:40 -07:00
mock_table.cc
Add rate limiter priority to ReadOptions (#9424)
2022-02-16 23:18:14 -08:00
mock_table.h
Fix some minor issues in the Customizable infrastructure (#8566)
2021-08-19 10:10:47 -07:00
multiget_context.h
Fix major bug with MultiGet, DeleteRange, and memtable Bloom (#9453)
2022-01-27 14:55:04 -08:00
persistent_cache_helper.cc
New stable, fixed-length cache keys (#9126)
2021-12-16 17:15:13 -08:00
persistent_cache_helper.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
persistent_cache_options.h
New stable, fixed-length cache keys (#9126)
2021-12-16 17:15:13 -08:00
scoped_arena_iterator.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
sst_file_dumper.cc
New backup meta schema, with file temperatures (#9660)
2022-03-18 11:06:17 -07:00
sst_file_dumper.h
New backup meta schema, with file temperatures (#9660)
2022-03-18 11:06:17 -07:00
sst_file_reader_test.cc
Use the comparator from the sst file table properties in sst_dump_tool (#9491)
2022-02-08 12:15:35 -08:00
sst_file_reader.cc
Fast path for detecting unchanged prefix_extractor (#9407)
2022-01-21 11:37:46 -08:00
sst_file_writer_collectors.h
Cleanup includes in dbformat.h (#8930)
2021-09-29 04:04:40 -07:00
sst_file_writer.cc
compression_per_level should be used for flush and changeable (#9658)
2022-03-07 18:06:19 -08:00
table_builder.h
Fast path for detecting unchanged prefix_extractor (#9407)
2022-01-21 11:37:46 -08:00
table_factory.cc
Restore Regex support for ObjectLibrary::Register, rename new APIs to allow old one to be deprecated in the future (#9362)
2022-01-11 06:33:48 -08:00
table_properties_internal.h
Improve / clean up meta block code & integrity (#9163)
2021-11-18 11:43:44 -08:00
table_properties.cc
Fix a bug of TEST_SetRandomTableProperties due to non-zero padding between fields in TableProperties struct (#9812)
2022-04-07 12:25:43 -07:00
table_reader_bench.cc
Fast path for detecting unchanged prefix_extractor (#9407)
2022-01-21 11:37:46 -08:00
table_reader_caller.h
Fix and detect headers with missing dependencies (#8893)
2021-09-10 10:00:26 -07:00
table_reader.h
dedup ReadOptions in iterator hierarchy (#7210)
2020-08-03 15:23:04 -07:00
table_test.cc
Remove BlockBasedTableOptions.hash_index_allow_collision (#9454)
2022-03-01 13:58:02 -08:00
two_level_iterator.cc
Clarify caching behavior for index and filter partitions (#9068)
2021-10-27 17:23:04 -07:00
two_level_iterator.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
unique_id_impl.h
Experimental support for SST unique IDs (#8990)
2021-10-18 23:32:01 -07:00
unique_id.cc
Experimental support for SST unique IDs (#8990)
2021-10-18 23:32:01 -07:00