andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
rocksdb/util
History
Reid Horuff 1b8a2e8fdd [rocksdb] Memtable Log Referencing and Prepared Batch Recovery 
Summary:
This diff is built on top of WriteBatch modification: https://reviews.facebook.net/D54093 and adds the required functionality to rocksdb core necessary for rocksdb to support 2PC.

modfication of DBImpl::WriteImpl()
- added two arguments *uint64_t log_used = nullptr, uint64_t log_ref = 0;
- *log_used is an output argument which will return the log number which the incoming batch was inserted into, 0 if no WAL insert took place.
-  log_ref is a supplied log_number which all memtables inserted into will reference after the batch insert takes place. This number will reside in 'FindMinPrepLogReferencedByMemTable()' until all Memtables insertinto have flushed.

- Recovery/writepath is now aware of prepared batches and commit and rollback markers.

Test Plan: There is currently no test on this diff. All testing of this functionality takes place in the Transaction layer/diff but I will add some testing.

Reviewers: IslamAbdelRahman, sdong

Subscribers: leveldb, santoshb, andrewkr, vasilep, dhruba, hermanlee4

Differential Revision: https://reviews.facebook.net/D56919
2016-05-10 14:06:07 -07:00
..
aligned_buffer.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
allocator.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
arena_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
arena.cc
Fixes warnings and ensure correct int behavior on 32-bit platforms.
2016-03-16 22:57:57 +01:00
arena.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
autovector_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
autovector.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
bloom_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
bloom.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
build_version.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
cache_bench.cc
Cache to have an option to fail Cache::Insert() when full
2016-03-10 17:35:19 -08:00
cache_test.cc
Cache to have an option to fail Cache::Insert() when full
2016-03-10 17:35:19 -08:00
cache.cc
Change default number of cache shard bit to be 6 and max_file_opening_threads to be 16.
2016-04-07 13:55:10 -07:00
channel.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
coding_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
coding.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
coding.h
Fixed compile warnings in posix_logger.h and coding.h
2016-03-31 16:01:47 -07:00
compaction_job_stats_impl.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
comparator.cc
Improve BytewiseComparatorImpl::FindShortestSeparator
2016-04-25 23:02:14 -07:00
compression.h
Shared dictionary compression using reference block
2016-04-27 17:36:03 -07:00
concurrent_arena.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
concurrent_arena.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
crc32c_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
crc32c.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
crc32c.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
delete_scheduler_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
delete_scheduler.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
delete_scheduler.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
dynamic_bloom_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
dynamic_bloom.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
dynamic_bloom.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
env_chroot.cc
Follow symlinks in chroot directory
2016-05-10 09:53:52 -07:00
env_chroot.h
Introduce chroot Env
2016-05-06 17:42:50 -07:00
env_hdfs.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
env_posix.cc
Remove the SyncPoint usage in the destructor of PosixEnv
2016-02-17 23:32:14 -08:00
env_test.cc
Properly destroy ChrootEnv in env_test
2016-05-09 14:38:50 -07:00
env.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
event_logger_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
event_logger.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
event_logger.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
file_reader_writer_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
file_reader_writer.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
file_reader_writer.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
file_util.cc
Forge current file for checkpoint
2016-03-17 10:07:21 -07:00
file_util.h
Forge current file for checkpoint
2016-03-17 10:07:21 -07:00
filelock_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
filter_policy.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
hash.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
hash.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
heap_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
heap.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
histogram_test.cc
Fix Build Error
2016-03-11 22:56:25 -08:00
histogram_windowing.cc
Fix in HistogramWindowingImpl
2016-03-17 14:28:41 -07:00
histogram_windowing.h
Histogram Concurrency Improvement and Time-Windowing Support
2016-03-11 16:54:25 -08:00
histogram.cc
Fix FB internal CI build failure
2016-03-15 11:38:15 -07:00
histogram.h
Histogram Concurrency Improvement and Time-Windowing Support
2016-03-11 16:54:25 -08:00
instrumented_mutex.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
instrumented_mutex.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
io_posix.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
io_posix.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
iostats_context_imp.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
iostats_context_test.cc
IOStatsContext::ToString() add option to exclude zero counters
2016-02-23 10:26:24 -08:00
iostats_context.cc
IOStatsContext::ToString() add option to exclude zero counters
2016-02-23 10:26:24 -08:00
kv_map.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
log_buffer.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
log_buffer.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
log_write_bench.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
logging.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
logging.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
memenv_test.cc
[directory includes cleanup] Finish removing util->db dependencies
2016-01-26 10:49:24 -08:00
memenv.cc
Refactor to support file_reader_writer on Windows.
2015-09-11 09:57:02 -07:00
mock_env_test.cc
[directory includes cleanup] Finish removing util->db dependencies
2016-01-26 10:49:24 -08:00
mock_env.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
mock_env.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
murmurhash.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
murmurhash.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
mutable_cf_options.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
mutable_cf_options.h
Rename options.compaction_measure_io_stats to options.report_bg_io_stats and include flush too.
2016-04-15 10:22:18 -07:00
mutexlock.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
options_builder.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
options_helper.cc
Make max_dict_bytes optional in options string
2016-05-06 11:27:28 -07:00
options_helper.h
[rocksdb] Memtable Log Referencing and Prepared Batch Recovery
2016-05-10 14:06:07 -07:00
options_parser.cc
Add parsing of missing DB options
2016-03-02 10:34:14 -08:00
options_parser.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
options_sanity_check.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
options_sanity_check.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
options_settable_test.cc
[rocksdb] Memtable Log Referencing and Prepared Batch Recovery
2016-05-10 14:06:07 -07:00
options_test.cc
Add bottommost_compression option
2016-05-09 15:57:19 -07:00
options.cc
Add bottommost_compression option
2016-05-09 15:57:19 -07:00
perf_context_imp.h
fix ios build error
2016-02-17 20:22:40 +08:00
perf_context.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
perf_level_imp.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
perf_level.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
perf_step_timer.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
posix_logger.h
Fixed compile warnings in posix_logger.h and coding.h
2016-03-31 16:01:47 -07:00
random.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
random.h
Fixes warnings and ensure correct int behavior on 32-bit platforms.
2016-03-16 22:57:57 +01:00
rate_limiter_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
rate_limiter.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
rate_limiter.h
Add a minimum value for the refill bytes per period value
2016-04-13 09:01:42 -07:00
slice_transform_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
slice.cc
[ldb] Export ldb_cmd*.h
2016-05-06 16:09:09 -07:00
sst_file_manager_impl.cc
Fix SstFileManager uninitialized data member
2016-02-18 11:25:19 -08:00
sst_file_manager_impl.h
Introduce SstFileManager::SetMaxAllowedSpaceUsage() to cap disk space usage
2016-02-17 15:20:23 -08:00
statistics.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
statistics.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
status_message.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
status.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
stderr_logger.h
Stderr info logger
2016-04-01 11:06:06 -07:00
stop_watch.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
string_util.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
string_util.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
sync_point.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
sync_point.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
testharness.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
testharness.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
testutil.cc
Rename options.compaction_measure_io_stats to options.report_bg_io_stats and include flush too.
2016-04-15 10:22:18 -07:00
testutil.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
thread_list_test.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
thread_local_test.cc
Fix LITE build thread_local_test
2016-02-19 13:57:18 -08:00
thread_local.cc
Fixed a dependency issue of ThreadLocalPtr
2016-02-10 16:56:01 -08:00
thread_local.h
Fixed a dependency issue of ThreadLocalPtr
2016-02-10 16:56:01 -08:00
thread_operation.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
thread_posix.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
thread_posix.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
thread_status_impl.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
thread_status_updater_debug.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
thread_status_updater.cc
Use pure if-then check instead of assert in EraseColumnFamilyInfo
2016-03-04 16:03:31 -08:00
thread_status_updater.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
thread_status_util_debug.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
thread_status_util.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
thread_status_util.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
transaction_test_util.cc
Add multithreaded transaction test
2016-03-11 15:16:52 -08:00
transaction_test_util.h
Fix AppVeyor build error
2016-03-15 10:57:33 -07:00
xfunc.cc
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
xfunc.h
Updated all copyright headers to the new format.
2016-02-09 15:12:00 -08:00
xxhash.cc
Enable MS Warning C4804 : unsafe use of type 'bool' in operation
2015-11-18 16:23:19 -08:00
xxhash.h
Prevent xxhash symbols from polluting global namespace
2015-03-12 12:07:10 -07:00