andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
rocksdb/table
History
Yanqin Jin 82b3888433 Enable backward iterator for keys with user-defined timestamp (#8035) 
Summary:
This PR does the following:

- Enable backward iteration for keys with user-defined timestamp. Note that merge, single delete, range delete are not supported yet.
- Introduces a new helper API `Comparator::EqualWithoutTimestamp()`.
- Fix a typo in `SetTimestamp()`.
- Add/update unit tests

Run db_bench (built with DEBUG_LEVEL=0) to demonstrate that no overhead is introduced for CPU-intensive workloads with a lot of `Prev()`. Also provided results of iterating keys with timestamps.

1. Disable timestamp, run:
```
./db_bench -db=/dev/shm/rocksdb -disable_wal=1 -benchmarks=fillseq,seekrandom[-W1-X6] -reverse_iterator=1 -seek_nexts=5
```
Results:
> Baseline
> - seekrandom [AVG    6 runs] : 96115 ops/sec;   53.2 MB/sec
> - seekrandom [MEDIAN 6 runs] : 98075 ops/sec;   54.2 MB/sec
>
> This PR
> - seekrandom [AVG    6 runs] : 95521 ops/sec;   52.8 MB/sec
> - seekrandom [MEDIAN 6 runs] : 96338 ops/sec;   53.3 MB/sec

2. Enable timestamp, run:
```
./db_bench -user_timestamp_size=8  -db=/dev/shm/rocksdb -disable_wal=1 -benchmarks=fillseq,seekrandom[-W1-X6] -reverse_iterator=1 -seek_nexts=5
```
Result:
> Baseline: not supported
>
> This PR
> - seekrandom [AVG    6 runs] : 90514 ops/sec;   50.1 MB/sec
> - seekrandom [MEDIAN 6 runs] : 90834 ops/sec;   50.2 MB/sec

Pull Request resolved: https://github.com/facebook/rocksdb/pull/8035

Reviewed By: ltamasi

Differential Revision: D26926668

Pulled By: riversand963

fbshipit-source-id: 95330cc2242397c03e09d29e5417dfb0adc98ef5
2021-03-10 11:15:46 -08:00
..
adaptive
Bring the Configurable options together (#5753)
2020-09-14 17:01:01 -07:00
block_based
Refine Ribbon configuration, improve testing, add Homogeneous (#7879)
2021-02-26 08:50:42 -08:00
cuckoo
Remove Legacy and Custom FileWrapper classes from header files (#7851)
2021-01-28 22:10:32 -08:00
plain
Create a Customizable class to load classes and configurations (#6590)
2020-11-11 15:10:41 -08:00
block_fetcher_test.cc
Fix testcase failures on windows (#7992)
2021-02-23 14:35:06 -08:00
block_fetcher.cc
Add a SystemClock class to capture the time functions of an Env (#7858)
2021-01-25 22:09:11 -08:00
block_fetcher.h
Reduce memory copies when fetching and uncompressing blocks from SST files (#6689)
2020-04-24 15:32:56 -07:00
cleanable_test.cc
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
format.cc
Add a SystemClock class to capture the time functions of an Env (#7858)
2021-01-25 22:09:11 -08:00
format.h
Add a host location property to TableProperties (#7479)
2020-10-19 11:38:48 -07:00
get_context.cc
Enable backward iterator for keys with user-defined timestamp (#8035)
2021-03-10 11:15:46 -08:00
get_context.h
Add a SystemClock class to capture the time functions of an Env (#7858)
2021-01-25 22:09:11 -08:00
internal_iterator.h
Clean up InternalIterator upper bound logic a little bit (#7200)
2020-08-05 10:44:57 -07:00
iter_heap.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
iterator_wrapper.h
Redesign block cache pinning API (#7520)
2020-10-11 14:58:24 -07:00
iterator.cc
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
merger_test.cc
More Makefile Cleanup (#7097)
2020-07-09 14:35:17 -07:00
merging_iterator.cc
Add some simulator cache and block tracer tests to ASSERT_STATUS_CHECKED (#7305)
2020-08-24 16:43:31 -07:00
merging_iterator.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
meta_blocks.cc
Add a host location property to TableProperties (#7479)
2020-10-19 11:38:48 -07:00
meta_blocks.h
Extend Get/MultiGet deadline support to table open (#6982)
2020-06-29 14:53:17 -07:00
mock_table.cc
Remove Legacy and Custom FileWrapper classes from header files (#7851)
2021-01-28 22:10:32 -08:00
mock_table.h
No elide constructors (#7798)
2020-12-23 16:55:53 -08:00
multiget_context.h
Add initial blob support to batched MultiGet (#7766)
2020-12-14 13:48:22 -08:00
persistent_cache_helper.cc
Add more tests to ASSERT_STATUS_CHECKED (#7367)
2020-09-16 15:48:07 -07:00
persistent_cache_helper.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
persistent_cache_options.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
scoped_arena_iterator.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
sst_file_dumper.cc
Limit buffering for collecting samples for compression dictionary (#7970)
2021-02-19 14:09:54 -08:00
sst_file_dumper.h
Limit buffering for collecting samples for compression dictionary (#7970)
2021-02-19 14:09:54 -08:00
sst_file_reader_test.cc
Add a host location property to TableProperties (#7479)
2020-10-19 11:38:48 -07:00
sst_file_reader.cc
Remove Legacy and Custom FileWrapper classes from header files (#7851)
2021-01-28 22:10:32 -08:00
sst_file_writer_collectors.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
sst_file_writer.cc
Handoff checksum Implementation (#7523)
2021-02-10 22:20:32 -08:00
table_builder.h
Store DB identity and DB session ID in SST files (#6983)
2020-06-17 10:57:40 -07:00
table_factory.cc
Create a Customizable class to load classes and configurations (#6590)
2020-11-11 15:10:41 -08:00
table_properties_internal.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
table_properties.cc
aggregated-table-properties with GetMapProperty (#7779)
2020-12-19 08:00:14 -08:00
table_reader_bench.cc
Remove Legacy and Custom FileWrapper classes from header files (#7851)
2021-01-28 22:10:32 -08:00
table_reader_caller.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
table_reader.h
dedup ReadOptions in iterator hierarchy (#7210)
2020-08-03 15:23:04 -07:00
table_test.cc
Make format_version=5 new default (#8017)
2021-03-09 12:42:53 -08:00
two_level_iterator.cc
Redesign block cache pinning API (#7520)
2020-10-11 14:58:24 -07:00
two_level_iterator.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00