andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
rocksdb/db
History
Andrew Kryczka d7d6a9a41d Fix recovery for WALs without data for all CFs 
Summary:
if one or more CFs had no data in the WAL, the log number that's used
by FindObsoleteFiles() wasn't updated. We need to treat this case the same as
if the data for that WAL had been flushed.

Test Plan: new unit test

Reviewers: IslamAbdelRahman, yiwu, sdong

Reviewed By: sdong

Subscribers: andrewkr, dhruba, leveldb

Differential Revision: https://reviews.facebook.net/D63963
2016-09-19 12:51:54 -07:00
..
auto_roll_logger_test.cc
Cleanup auto-roll logger flush-while-rolling test
2016-07-07 11:35:40 -07:00
auto_roll_logger.cc
Eliminate use of 'using namespace std'. Also remove a number of ADL references to std functions.
2016-05-20 07:42:18 -07:00
auto_roll_logger.h
Redo SyncPoints for flush while rolling test
2016-02-22 21:32:19 -08:00
builder.cc
[rocksdb] make more options dynamic
2016-05-17 13:11:56 -07:00
builder.h
Remove ImmutableCFOptions from public API
2016-09-02 14:16:31 -07:00
c_test.c
add C api for set wal_recovery_mode (#1327)
2016-09-09 10:11:30 -07:00
c.cc
add C api for set wal_recovery_mode (#1327)
2016-09-09 10:11:30 -07:00
column_family_test.cc
Fix Flaky ColumnFamilyTest.FlushCloseWALFiles
2016-09-07 11:19:15 -07:00
column_family.cc
Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes
2016-09-01 14:33:24 -07:00
column_family.h
Remove ImmutableCFOptions from public API
2016-09-02 14:16:31 -07:00
compact_files_test.cc
Fix flaky test ObsoleteFiles
2016-08-03 15:19:35 -07:00
compacted_db_impl.cc
CompactedDB should not be used if there is outstanding WAL files
2016-04-26 14:22:07 -07:00
compacted_db_impl.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
compaction_iterator_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
compaction_iterator.cc
Single Delete Mismatch and Fallthrough statistics
2016-08-16 08:21:43 -07:00
compaction_iterator.h
Single Delete Mismatch and Fallthrough statistics
2016-08-16 08:21:43 -07:00
compaction_job_stats_test.cc
UniversalCompaction should ignore sorted runs being compacted (when compacting for file num)
2016-08-10 12:37:43 -07:00
compaction_job_test.cc
Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes
2016-09-01 14:33:24 -07:00
compaction_job.cc
Fix uninitlized CompactionJob::SubcompactionState::current_output_file_size
2016-09-02 17:06:20 -07:00
compaction_job.h
[rocksdb] make more options dynamic
2016-05-17 13:11:56 -07:00
compaction_picker_test.cc
Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes
2016-09-01 14:33:24 -07:00
compaction_picker.cc
Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes
2016-09-01 14:33:24 -07:00
compaction_picker.h
Remove ImmutableCFOptions from public API
2016-09-02 14:16:31 -07:00
compaction.cc
Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes
2016-09-01 14:33:24 -07:00
compaction.h
Remove ImmutableCFOptions from public API
2016-09-02 14:16:31 -07:00
comparator_db_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
convenience.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
corruption_test.cc
Change several option defaults
2016-04-28 17:50:58 -07:00
cuckoo_table_db_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
db_block_cache_test.cc
Not insert into block cache if cache is full and not holding handle
2016-08-23 13:53:49 -07:00
db_bloom_filter_test.cc
Deprectate filter_deletes
2016-06-17 10:30:47 -07:00
db_compaction_filter_test.cc
Change some RocksDB default options
2016-03-31 17:12:18 -07:00
db_compaction_test.cc
Compaction picker to expand output level files for keys cross files' boundary too.
2016-07-26 17:56:36 -07:00
db_dynamic_level_test.cc
Merge options source_compaction_factor, max_grandparent_overlap_bytes and expanded_compaction_factor into max_compaction_bytes
2016-09-01 14:33:24 -07:00
db_filesnapshot.cc
Backup Options
2016-06-09 19:03:10 -07:00
db_flush_test.cc
Fix unit test which breaks lite build
2016-07-21 14:32:12 -07:00
db_impl_add_file.cc
Fix data race in AddFile() with multiple files + custom comparator bug
2016-09-02 11:17:58 -07:00
db_impl_debug.cc
[rocksdb] make more options dynamic
2016-05-17 13:11:56 -07:00
db_impl_experimental.cc
Clean up the ComputeCompactionScore() API
2016-05-23 15:55:29 -07:00
db_impl_readonly.cc
Add Iterator Property rocksdb.iterator.version_number
2016-03-02 16:23:59 -08:00
db_impl_readonly.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
db_impl.cc
Fix recovery for WALs without data for all CFs
2016-09-19 12:51:54 -07:00
db_impl.h
Temporarily revert Prev() prefix support
2016-09-08 14:45:32 -07:00
db_info_dumper.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
db_info_dumper.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
db_inplace_update_test.cc
Change some RocksDB default options
2016-03-31 17:12:18 -07:00
db_io_failure_test.cc
Add NoSpace subcode to IOError (#1320)
2016-09-07 12:37:45 -07:00
db_iter_test.cc
Temporarily revert Prev() prefix support
2016-09-08 14:45:32 -07:00
db_iter.cc
Temporarily revert Prev() prefix support
2016-09-08 14:45:32 -07:00
db_iter.h
Remove ImmutableCFOptions from public API
2016-09-02 14:16:31 -07:00
db_iterator_test.cc
Remove %z Format Specifier and Fix Windows Build of sim_cache.cc (#1224)
2016-07-20 15:28:04 -07:00
db_log_iter_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
db_options_test.cc
Make DBOptionsTest::EnableAutoCompactionAndTriggerStall less falky
2016-08-05 16:45:57 -07:00
db_properties_test.cc
[Flaky Test] Disable DBPropertiesTest.GetProperty
2016-08-24 15:32:01 -07:00
db_sst_test.cc
Move AddFile() tests to external_sst_file_test.cc
2016-09-07 15:41:54 -07:00
db_table_properties_test.cc
DBTablePropertiesTest.GetPropertiesOfTablesInRange: Fix Flaky
2016-07-19 15:46:20 -07:00
db_tailing_iter_test.cc
Change Property name from "rocksdb.current_version_number" to "rocksdb.current-super-version-number"
2016-03-04 18:15:29 -08:00
db_test2.cc
Support ZSTD with finalized format
2016-09-06 12:22:16 -07:00
db_test_util.cc
Eliminate memcpy from ForwardIterator
2016-08-11 19:10:16 -07:00
db_test_util.h
Add NoSpace subcode to IOError (#1320)
2016-09-07 12:37:45 -07:00
db_test.cc
Support ZSTD with finalized format
2016-09-06 12:22:16 -07:00
db_universal_compaction_test.cc
UniversalCompaction should ignore sorted runs being compacted (when compacting for file num)
2016-08-10 12:37:43 -07:00
db_wal_test.cc
Fix recovery for WALs without data for all CFs
2016-09-19 12:51:54 -07:00
dbformat_test.cc
Improve BytewiseComparatorImpl::FindShortestSeparator
2016-04-25 23:02:14 -07:00
dbformat.cc
WriteBatch support for range deletion
2016-08-16 08:16:04 -07:00
dbformat.h
TableBuilder / TableReader support for range deletion
2016-08-19 15:10:31 -07:00
deletefile_test.cc
Fix a bug that accesses invalid address in iterator cleanup function
2016-07-05 11:57:14 -07:00
event_helpers.cc
Added EventListener::OnTableFileCreationStarted() callback
2016-04-29 11:35:00 -07:00
event_helpers.h
Added EventListener::OnTableFileCreationStarted() callback
2016-04-29 11:35:00 -07:00
experimental.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
external_sst_file_test.cc
Move AddFile() tests to external_sst_file_test.cc
2016-09-07 15:41:54 -07:00
fault_injection_test.cc
Fix test data race in two FaultInjectionTest tests
2016-08-10 13:56:50 -07:00
file_indexer_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
file_indexer.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
file_indexer.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
filename_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
filename.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
filename.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
flush_job_test.cc
Need to make sure log file synced before flushing memtable of one column family
2016-07-21 16:29:06 -07:00
flush_job.cc
Need to make sure log file synced before flushing memtable of one column family
2016-07-21 16:29:06 -07:00
flush_job.h
read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too.
2016-08-10 13:16:41 -07:00
flush_scheduler.cc
Fix clang analyzer errors
2016-07-08 17:50:51 -07:00
flush_scheduler.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
forward_iterator_bench.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
forward_iterator.cc
Fix valgrind memory leak
2016-08-11 23:34:19 -07:00
forward_iterator.h
Eliminate memcpy from ForwardIterator
2016-08-11 19:10:16 -07:00
inlineskiplist_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
inlineskiplist.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
internal_stats.cc
Compaction stats printing: "batch" => "commit group"
2016-08-15 10:47:29 -07:00
internal_stats.h
Add InternalStats and logging for AddFile()
2016-06-16 16:21:41 -07:00
job_context.h
read_options.background_purge_on_iterator_cleanup to cover forward iterator and log file closing too.
2016-08-10 13:16:41 -07:00
listener_test.cc
Add a callback for when memtable is moved to immutable (#1137)
2016-06-02 11:57:31 -07:00
log_format.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
log_reader.cc
Fix clang analyzer errors
2016-07-08 17:50:51 -07:00
log_reader.h
db/log_reader: treat bad record length or checksum as EOF
2016-05-22 22:00:15 -07:00
log_test.cc
db/log_reader: treat bad record length or checksum as EOF
2016-05-22 22:00:15 -07:00
log_writer.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
log_writer.h
Need to make sure log file synced before flushing memtable of one column family
2016-07-21 16:29:06 -07:00
managed_iterator.cc
Fixes warnings and ensure correct int behavior on 32-bit platforms.
2016-03-16 22:57:57 +01:00
managed_iterator.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
manual_compaction_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
memtable_allocator.cc
Avoid updating memtable allocated bytes if write_buffer_size is not set
2016-07-13 19:33:57 -07:00
memtable_allocator.h
Add options.write_buffer_manager: control total memtable size across DB instances
2016-07-05 18:11:25 -07:00
memtable_list_test.cc
Add options.write_buffer_manager: control total memtable size across DB instances
2016-07-05 18:11:25 -07:00
memtable_list.cc
Fix flush not being commit while writing manifest
2016-07-21 10:10:41 -07:00
memtable_list.h
[rocksdb] Memtable Log Referencing and Prepared Batch Recovery
2016-05-10 14:06:07 -07:00
memtable.cc
Change options memtable_prefix_bloom_huge_page_tlb_size => memtable_huge_page_size and cover huge page to memtable too
2016-07-26 18:15:11 -07:00
memtable.h
Remove ImmutableCFOptions from public API
2016-09-02 14:16:31 -07:00
memtablerep_bench.cc
Add options.write_buffer_manager: control total memtable size across DB instances
2016-07-05 18:11:25 -07:00
merge_context.h
Fix MergeContext::copied_operands_ strings moving
2016-07-25 15:31:41 -07:00
merge_helper_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
merge_helper.cc
Introduce FullMergeV2 (eliminate memcpy from merge operators)
2016-07-20 09:49:03 -07:00
merge_helper.h
Introduce FullMergeV2 (eliminate memcpy from merge operators)
2016-07-20 09:49:03 -07:00
merge_operator.cc
Introduce FullMergeV2 (eliminate memcpy from merge operators)
2016-07-20 09:49:03 -07:00
merge_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
options_file_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
perf_context_test.cc
CompactedDB should not be used if there is outstanding WAL files
2016-04-26 14:22:07 -07:00
pinned_iterators_manager.h
Minor PinnedIteratorsManager Refactoring
2016-08-11 11:54:17 -07:00
plain_table_db_test.cc
Only cache level 0 indexes and filter when opening table reader
2016-07-20 11:23:31 -07:00
prefix_test.cc
Temporarily revert Prev() prefix support
2016-09-08 14:45:32 -07:00
repair_test.cc
ColumnFamilyOptions API [CF + RepairDB part 3/3]
2016-06-24 16:29:43 -07:00
repair.cc
Remove ImmutableCFOptions from public API
2016-09-02 14:16:31 -07:00
skiplist_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
skiplist.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
snapshot_impl.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
snapshot_impl.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
table_cache.cc
Fix a crash when compaction fails to open a file
2016-08-25 04:39:26 -07:00
table_cache.h
Remove ImmutableCFOptions from public API
2016-09-02 14:16:31 -07:00
table_properties_collector_test.cc
Remove ImmutableCFOptions from public API
2016-09-02 14:16:31 -07:00
table_properties_collector.cc
Added "number of merge operands" to statistics in ssts.
2016-05-19 14:24:48 -07:00
table_properties_collector.h
Added "number of merge operands" to statistics in ssts.
2016-05-19 14:24:48 -07:00
transaction_log_impl.cc
Eliminate use of 'using namespace std'. Also remove a number of ADL references to std functions.
2016-05-20 07:42:18 -07:00
transaction_log_impl.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
version_builder_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
version_builder.cc
Only cache level 0 indexes and filter when opening table reader
2016-07-20 11:23:31 -07:00
version_builder.h
Only cache level 0 indexes and filter when opening table reader
2016-07-20 11:23:31 -07:00
version_edit_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
version_edit.cc
Miscellaneous performance improvements
2016-07-12 14:15:32 -07:00
version_edit.h
Avoid FileMetaData copy
2016-07-13 15:36:22 -07:00
version_set_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
version_set.cc
Only cache level 0 indexes and filter when opening table reader
2016-07-20 11:23:31 -07:00
version_set.h
Add options.write_buffer_manager: control total memtable size across DB instances
2016-07-05 18:11:25 -07:00
wal_manager_test.cc
Fix GetSortedWalFiles when log recycling enabled
2016-09-19 12:51:48 -07:00
wal_manager.cc
Fix GetSortedWalFiles when log recycling enabled
2016-09-19 12:51:48 -07:00
wal_manager.h
Fix GetSortedWalFiles when log recycling enabled
2016-09-19 12:51:48 -07:00
write_batch_base.cc
WriteBatch support for range deletion
2016-08-16 08:16:04 -07:00
write_batch_internal.h
WriteBatch support for range deletion
2016-08-16 08:16:04 -07:00
write_batch_test.cc
WriteBatch support for range deletion
2016-08-16 08:16:04 -07:00
write_batch.cc
WriteBatch support for range deletion
2016-08-16 08:16:04 -07:00
write_callback_test.cc
write_callback_test: clean test directory before running tests
2016-04-18 10:18:41 -07:00
write_callback.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
write_controller_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
write_controller.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
write_controller.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
write_thread.cc
WriteBatch support for range deletion
2016-08-16 08:16:04 -07:00
write_thread.h
fix simple typos (#1183)
2016-06-25 08:29:40 +01:00
xfunc_test_points.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
xfunc_test_points.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00