rocksdb

History

Zhichao Cao d1c510baec Handoff checksum Implementation (#7523 ) Summary: in PR https://github.com/facebook/rocksdb/issues/7419 , we introduce the new Append and PositionedAppend APIs to WritableFile at File System, which enable RocksDB to pass the data verification information (e.g., checksum of the data) to the lower layer. In this PR, we use the new API in WritableFileWriter, such that the file created via WritableFileWrite can pass the checksum to the storage layer. To control which types file should apply the checksum handoff, we add checksum_handoff_file_types to DBOptions. User can use this option to control which file types (Currently supported file tyes: kLogFile, kTableFile, kDescriptorFile.) should use the new Append and PositionedAppend APIs to handoff the verification information. Pull Request resolved: https://github.com/facebook/rocksdb/pull/7523 Test Plan: add new unit test, pass make check/ make asan_check Reviewed By: pdillinger Differential Revision: D24313271 Pulled By: zhichao-cao fbshipit-source-id: aafd69091ae85c3318e3e17cbb96fe7338da11d0		2021-02-10 22:20:32 -08:00
..
utilities	Allow range deletions in `*TransactionDB` only when safe (#7929 )	2021-02-05 15:57:26 -08:00
advanced_options.h	Revert "Turn on memtable bloom filter by default. (#6584 )" (#7939 )	2021-02-06 22:34:30 -08:00
c.h	Add get/set deadline and io_timeout C functions (read options) (#7914 )	2021-02-04 17:00:58 -08:00
cache.h	Fix various spelling errors still found in code (#7785 )	2021-01-15 20:07:39 -08:00
cleanable.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
compaction_filter.h	Fix typos in comments (#7790 )	2021-01-04 11:39:14 -08:00
compaction_job_stats.h	Add is_full_compaction to CompactionJobStats, cleanup (#7451 )	2020-10-01 12:52:58 -07:00
comparator.h	Iterator with timestamp (#6255 )	2020-03-06 16:24:27 -08:00
compression_type.h	Move CompressionType to its own header file (#7162 )	2020-08-03 15:49:31 -07:00
concurrent_task_limiter.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
configurable.h	Fix typos in comments (#7790 )	2021-01-04 11:39:14 -08:00
convenience.h	Bring the Configurable options together (#5753 )	2020-09-14 17:01:01 -07:00
customizable.h	Create a Customizable class to load classes and configurations (#6590 )	2020-11-11 15:10:41 -08:00
data_structure.h	Handoff checksum Implementation (#7523 )	2021-02-10 22:20:32 -08:00
db_bench_tool.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
db_dump_tool.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
db_stress_tool.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
db.h	Add more tests to ASSERT_STATUS_CHECKED (3), API change (#7715 )	2021-01-06 14:15:02 -08:00
env_encryption.h	Changes to EncryptedEnv public API (#7279 )	2020-09-15 17:14:10 -07:00
env.h	Add a SystemClock class to capture the time functions of an Env (#7858 )	2021-01-25 22:09:11 -08:00
experimental.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
file_checksum.h	Fix typos in comments (#7790 )	2021-01-04 11:39:14 -08:00
file_system.h	Handoff checksum Implementation (#7523 )	2021-02-10 22:20:32 -08:00
filter_policy.h	Use size_t for filter APIs, protect against overflow (#7726 )	2020-12-11 22:18:12 -08:00
flush_block_policy.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
io_status.h	Add a new IOStatus subcode to indicate that writes are fenced off (#7374 )	2020-09-14 16:04:47 -07:00
iostats_context.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
iterator.h	Iterator with timestamp (#6255 )	2020-03-06 16:24:27 -08:00
ldb_tool.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
listener.h	Add kManifestWriteNoWAL to BackgroundErrorReason to handle Flush IO Error when WAL is disabled (#7693 )	2020-12-02 18:24:01 -08:00
memory_allocator.h	slightly improve jemalloc allocator API header (#7592 )	2020-10-28 13:47:12 -07:00
memtablerep.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
merge_operator.h	Fix merge operator docs typo (#7716 )	2020-11-30 12:09:39 -08:00
metadata.h	Expose the start of the expiration range for TTL blob files through LiveFileMetaData (#7365 )	2020-09-10 11:33:33 -07:00
options.h	Handoff checksum Implementation (#7523 )	2021-02-10 22:20:32 -08:00
perf_context.h	Fix more defects reported by Coverity Scan (#6935 )	2020-06-04 15:35:08 -07:00
perf_level.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
persistent_cache.h	Fix persistent cache on windows (#6932 )	2020-06-13 13:28:31 -07:00
rate_limiter.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
rocksdb_namespace.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
slice_transform.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
slice.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
snapshot.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
sst_dump_tool.h	Add --version and --help to ldb and sst_dump (#6951 )	2020-06-09 10:04:01 -07:00
sst_file_manager.h	Add logs and stats in DeleteScheduler (#6927 )	2020-06-05 09:43:04 -07:00
sst_file_reader.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
sst_file_writer.h	Generate file checksum in SstFileWriter (#6859 )	2020-05-20 11:55:31 -07:00
sst_partitioner.h	SST Partitioner interface that allows to split SST files (#6957 )	2020-07-24 13:44:49 -07:00
statistics.h	Add Stats for MultiGet (#7366 )	2020-10-07 13:28:48 -07:00
stats_history.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
status.h	Revert `Status`es returned from pre-`Configurable` options functions (#7563 )	2020-10-20 11:53:28 -07:00
system_clock.h	Add a SystemClock class to capture the time functions of an Env (#7858 )	2021-01-25 22:09:11 -08:00
table_properties.h	aggregated-table-properties with GetMapProperty (#7779 )	2020-12-19 08:00:14 -08:00
table.h	Create a Customizable class to load classes and configurations (#6590 )	2020-11-11 15:10:41 -08:00
thread_status.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
threadpool.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
trace_reader_writer.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
transaction_log.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
types.h	Make FileType Public and Replace kLogFile with kWalFile (#7580 )	2020-10-22 17:06:20 -07:00
universal_compaction.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
version.h	Make builds reproducible (#7866 )	2021-01-28 17:42:16 -08:00
wal_filter.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
write_batch_base.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	2020-02-20 12:09:57 -08:00
write_batch.h	Integrity protection for live updates to WriteBatch (#7748 )	2021-01-29 12:18:58 -08:00
write_buffer_manager.h	Add new API to report dummy entries size in cache in WriteBufferManager (#7837 )	2021-01-08 13:26:24 -08:00