rocksdb

History

Zhichao Cao d1c510baec Handoff checksum Implementation (#7523 ) Summary: in PR https://github.com/facebook/rocksdb/issues/7419 , we introduce the new Append and PositionedAppend APIs to WritableFile at File System, which enable RocksDB to pass the data verification information (e.g., checksum of the data) to the lower layer. In this PR, we use the new API in WritableFileWriter, such that the file created via WritableFileWrite can pass the checksum to the storage layer. To control which types file should apply the checksum handoff, we add checksum_handoff_file_types to DBOptions. User can use this option to control which file types (Currently supported file tyes: kLogFile, kTableFile, kDescriptorFile.) should use the new Append and PositionedAppend APIs to handoff the verification information. Pull Request resolved: https://github.com/facebook/rocksdb/pull/7523 Test Plan: add new unit test, pass make check/ make asan_check Reviewed By: pdillinger Differential Revision: D24313271 Pulled By: zhichao-cao fbshipit-source-id: aafd69091ae85c3318e3e17cbb96fe7338da11d0		2021-02-10 22:20:32 -08:00
..
adaptive	Bring the Configurable options together (#5753 )	2020-09-14 17:01:01 -07:00
block_based	Add prefetching (batched MultiGet) for experimental Ribbon filter (#7889 )	2021-02-10 21:04:56 -08:00
cuckoo	Remove Legacy and Custom FileWrapper classes from header files (#7851 )	2021-01-28 22:10:32 -08:00
plain	Create a Customizable class to load classes and configurations (#6590 )	2020-11-11 15:10:41 -08:00
block_fetcher_test.cc	Remove Legacy and Custom FileWrapper classes from header files (#7851 )	2021-01-28 22:10:32 -08:00
block_fetcher.cc	Add a SystemClock class to capture the time functions of an Env (#7858 )	2021-01-25 22:09:11 -08:00
block_fetcher.h	Reduce memory copies when fetching and uncompressing blocks from SST files (#6689 )	2020-04-24 15:32:56 -07:00
cleanable_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
format.cc	Add a SystemClock class to capture the time functions of an Env (#7858 )	2021-01-25 22:09:11 -08:00
format.h	Add a host location property to TableProperties (#7479 )	2020-10-19 11:38:48 -07:00
get_context.cc	Add a SystemClock class to capture the time functions of an Env (#7858 )	2021-01-25 22:09:11 -08:00
get_context.h	Add a SystemClock class to capture the time functions of an Env (#7858 )	2021-01-25 22:09:11 -08:00
internal_iterator.h	Clean up InternalIterator upper bound logic a little bit (#7200 )	2020-08-05 10:44:57 -07:00
iter_heap.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
iterator_wrapper.h	Redesign block cache pinning API (#7520 )	2020-10-11 14:58:24 -07:00
iterator.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
merger_test.cc	More Makefile Cleanup (#7097 )	2020-07-09 14:35:17 -07:00
merging_iterator.cc	Add some simulator cache and block tracer tests to ASSERT_STATUS_CHECKED (#7305 )	2020-08-24 16:43:31 -07:00
merging_iterator.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
meta_blocks.cc	Add a host location property to TableProperties (#7479 )	2020-10-19 11:38:48 -07:00
meta_blocks.h	Extend Get/MultiGet deadline support to table open (#6982 )	2020-06-29 14:53:17 -07:00
mock_table.cc	Remove Legacy and Custom FileWrapper classes from header files (#7851 )	2021-01-28 22:10:32 -08:00
mock_table.h	No elide constructors (#7798 )	2020-12-23 16:55:53 -08:00
multiget_context.h	Add initial blob support to batched MultiGet (#7766 )	2020-12-14 13:48:22 -08:00
persistent_cache_helper.cc	Add more tests to ASSERT_STATUS_CHECKED (#7367 )	2020-09-16 15:48:07 -07:00
persistent_cache_helper.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
persistent_cache_options.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
scoped_arena_iterator.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
sst_file_dumper.cc	Remove Legacy and Custom FileWrapper classes from header files (#7851 )	2021-01-28 22:10:32 -08:00
sst_file_dumper.h	Add sst_file_dumper status check (#7315 )	2020-09-04 19:26:42 -07:00
sst_file_reader_test.cc	Add a host location property to TableProperties (#7479 )	2020-10-19 11:38:48 -07:00
sst_file_reader.cc	Remove Legacy and Custom FileWrapper classes from header files (#7851 )	2021-01-28 22:10:32 -08:00
sst_file_writer_collectors.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
sst_file_writer.cc	Handoff checksum Implementation (#7523 )	2021-02-10 22:20:32 -08:00
table_builder.h	Store DB identity and DB session ID in SST files (#6983 )	2020-06-17 10:57:40 -07:00
table_factory.cc	Create a Customizable class to load classes and configurations (#6590 )	2020-11-11 15:10:41 -08:00
table_properties_internal.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
table_properties.cc	aggregated-table-properties with GetMapProperty (#7779 )	2020-12-19 08:00:14 -08:00
table_reader_bench.cc	Remove Legacy and Custom FileWrapper classes from header files (#7851 )	2021-01-28 22:10:32 -08:00
table_reader_caller.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
table_reader.h	dedup ReadOptions in iterator hierarchy (#7210 )	2020-08-03 15:23:04 -07:00
table_test.cc	Integrity protection for live updates to WriteBatch (#7748 )	2021-01-29 12:18:58 -08:00
two_level_iterator.cc	Redesign block cache pinning API (#7520 )	2020-10-11 14:58:24 -07:00
two_level_iterator.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00