andreacavalli/rocksdb
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
rocksdb/util
History
Yanqin Jin a69d4deefb Atomic ingest (#4895) 
Summary:
Make file ingestion atomic.

 as title.
Ingesting external SST files into multiple column families should be atomic. If
a crash occurs and db reopens, either all column families have successfully
ingested the files before the crash, or non of the ingestions have any effect
on the state of the db.

Also add unit tests for atomic ingestion.

Note that the unit test here does not cover the case of incomplete atomic group
in the MANIFEST, which is covered in VersionSetTest already.
Pull Request resolved: https://github.com/facebook/rocksdb/pull/4895

Differential Revision: D13718245

Pulled By: riversand963

fbshipit-source-id: 7df97cc483af73ad44dd6993008f99b083852198
2019-02-12 19:16:17 -08:00
..
aligned_buffer.h
Fix Copying of data between buffers in FilePrefetchBuffer (#4100)
2018-07-11 12:28:13 -07:00
allocator.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
arena_test.cc
arena: derive alignment unit from std::max_align_t
2017-10-17 11:13:19 -07:00
arena.cc
comment unused parameters to turn on -Wunused-parameter flag
2018-04-12 17:59:16 -07:00
arena.h
arena: derive alignment unit from std::max_align_t
2017-10-17 11:13:19 -07:00
auto_roll_logger_test.cc
Update all unique/shared_ptr instances to be qualified with namespace std (#4638)
2018-11-09 11:19:58 -08:00
auto_roll_logger.cc
Change RocksDB License
2017-07-15 16:11:23 -07:00
auto_roll_logger.h
Fix the Logger::Close() and DBImpl::Close() design pattern
2018-02-23 13:57:26 -08:00
autovector_test.cc
fix memory leak in two_level_iterator
2018-04-15 17:26:26 -07:00
autovector.h
optimized the performance of autovector::emplace_back. (#4606)
2018-11-13 14:39:03 -08:00
bloom_test.cc
fix gflags namespace
2017-12-01 10:42:05 -08:00
bloom.cc
Improve FullFilterBitsReader::HashMayMatch's doc (#4202)
2018-08-06 11:13:18 -07:00
build_version.cc.in
Makefile: generate util/build_version.cc from .in file (#1384)
2016-10-25 11:31:39 -07:00
build_version.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
cast_util.h
Add a missing "once" in .h
2017-07-31 12:12:03 -07:00
channel.h
Support pragma once in all header files and cleanup some warnings (#4339)
2018-09-05 18:13:31 -07:00
coding_test.cc
Coding.h: Added Fixed16 support (#4142)
2018-07-16 23:43:41 -07:00
coding.cc
Enable MSVC W4 with a few exceptions. Fix warnings and bugs
2017-10-19 10:57:12 -07:00
coding.h
Add path to WritableFileWriter. (#4039)
2018-08-23 10:12:58 -07:00
compaction_job_stats_impl.cc
Add a new CPU time counter to compaction report (#4889)
2019-01-29 17:24:00 -08:00
comparator.cc
Improve point-lookup performance using a data block hash index (#4174)
2018-08-15 14:30:03 -07:00
compression_context_cache.cc
run make format for PR 3838 (#3954)
2018-06-05 12:58:02 -07:00
compression_context_cache.h
run make format for PR 3838 (#3954)
2018-06-05 12:58:02 -07:00
compression.h
Reduce scope of compression dictionary to single SST (#4952)
2019-02-11 19:47:32 -08:00
concurrent_arena.cc
Cap concurrent arena's shard block size to 128KB (#4147)
2018-07-18 10:43:54 -07:00
concurrent_arena.h
util: Fix coverity issues
2017-11-03 14:42:08 -07:00
concurrent_task_limiter_impl.cc
Compaction limiter miscs (#4795)
2018-12-26 13:59:35 -08:00
concurrent_task_limiter_impl.h
Concurrent task limiter for compaction thread control (#4332)
2018-12-13 13:18:28 -08:00
core_local.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
crc32c_ppc_asm.S
Updated CRC32 Power Optimization Changes
2017-08-31 14:16:30 -07:00
crc32c_ppc_constants.h
Support pragma once in all header files and cleanup some warnings (#4339)
2018-09-05 18:13:31 -07:00
crc32c_ppc.c
Updated CRC32 Power Optimization Changes
2017-08-31 14:16:30 -07:00
crc32c_ppc.h
Support pragma once in all header files and cleanup some warnings (#4339)
2018-09-05 18:13:31 -07:00
crc32c_test.cc
Build and tests fixes for Solaris Sparc (#4000)
2018-06-15 12:42:53 -07:00
crc32c.cc
Add GCC 8 to Travis (#3433)
2018-07-13 10:58:06 -07:00
crc32c.h
Updated CRC32 Power Optimization Changes
2017-08-31 14:16:30 -07:00
delete_scheduler_test.cc
Auto recovery from out of space errors (#4164)
2018-09-15 13:43:04 -07:00
delete_scheduler.cc
Always delete Blob DB files in the background (#4928)
2019-01-29 15:50:03 -08:00
delete_scheduler.h
Always delete Blob DB files in the background (#4928)
2019-01-29 15:50:03 -08:00
duplicate_detector.h
Improve db_stress with transactions
2018-04-18 16:32:35 -07:00
dynamic_bloom_test.cc
Two code changes to make "clang analyze" happy (#4292)
2018-08-20 17:43:41 -07:00
dynamic_bloom.cc
Disallow customized hash function in DynamicBloom (#4915)
2019-01-24 10:34:30 -08:00
dynamic_bloom.h
Disallow customized hash function in DynamicBloom (#4915)
2019-01-24 10:34:30 -08:00
event_logger_test.cc
Change RocksDB License
2017-07-15 16:11:23 -07:00
event_logger.cc
Change RocksDB License
2017-07-15 16:11:23 -07:00
event_logger.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
fault_injection_test_env.cc
Atomic ingest (#4895)
2019-02-12 19:16:17 -08:00
fault_injection_test_env.h
Atomic ingest (#4895)
2019-02-12 19:16:17 -08:00
file_reader_writer_test.cc
Update all unique/shared_ptr instances to be qualified with namespace std (#4638)
2018-11-09 11:19:58 -08:00
file_reader_writer.cc
Add a new CPU time counter to compaction report (#4889)
2019-01-29 17:24:00 -08:00
file_reader_writer.h
Add a new CPU time counter to compaction report (#4889)
2019-01-29 17:24:00 -08:00
file_util.cc
Always delete Blob DB files in the background (#4928)
2019-01-29 15:50:03 -08:00
file_util.h
Always delete Blob DB files in the background (#4928)
2019-01-29 15:50:03 -08:00
filelock_test.cc
Per-thread unique test db names (#4135)
2018-07-13 17:27:39 -07:00
filename.cc
Store the return value of Fsync for check
2018-09-14 13:29:56 -07:00
filename.h
BlobDB: GetLiveFiles and GetLiveFilesMetadata return relative path (#4326)
2018-08-31 12:12:49 -07:00
filter_policy.cc
Change RocksDB License
2017-07-15 16:11:23 -07:00
gflags_compat.h
fix gflags namespace
2017-12-01 10:42:05 -08:00
hash_map.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
hash_test.cc
Change RocksDB License
2017-07-15 16:11:23 -07:00
hash.cc
Add GCC 8 to Travis (#3433)
2018-07-13 10:58:06 -07:00
hash.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
heap_test.cc
fix gflags namespace
2017-12-01 10:42:05 -08:00
heap.h
Add compaction logic to RangeDelAggregatorV2 (#4758)
2018-12-17 13:20:51 -08:00
jemalloc_nodump_allocator.cc
Detect if Jemalloc is linked with the binary (#4844)
2019-01-03 16:30:12 -08:00
jemalloc_nodump_allocator.h
Detect if Jemalloc is linked with the binary (#4844)
2019-01-03 16:30:12 -08:00
kv_map.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
log_buffer.cc
Change RocksDB License
2017-07-15 16:11:23 -07:00
log_buffer.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
log_write_bench.cc
Update all unique/shared_ptr instances to be qualified with namespace std (#4638)
2018-11-09 11:19:58 -08:00
logging.h
FIX #3820: shorter file name in logs (#4616)
2018-11-01 16:19:01 -07:00
memory_allocator.h
s/CacheAllocator/MemoryAllocator/g (#4590)
2018-10-26 14:30:30 -07:00
memory_usage.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
mock_time_env.h
Fix RepeatableThreadTest::MockEnvTest hang (#4560)
2018-10-21 20:17:18 -07:00
murmurhash.cc
Add GCC 8 to Travis (#3433)
2018-07-13 10:58:06 -07:00
murmurhash.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
mutexlock.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
ppc-opcode.h
Support pragma once in all header files and cleanup some warnings (#4339)
2018-09-05 18:13:31 -07:00
random.cc
Change RocksDB License
2017-07-15 16:11:23 -07:00
random.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
rate_limiter_test.cc
comment unused parameters to turn on -Wunused-parameter flag
2018-04-12 17:59:16 -07:00
rate_limiter.cc
rate limit auto-tuning
2017-10-04 19:15:01 -07:00
rate_limiter.h
rate limit auto-tuning
2017-10-04 19:15:01 -07:00
repeatable_thread_test.cc
Utility to run task periodically in a thread (#4423)
2018-09-27 15:28:00 -07:00
repeatable_thread.h
Fix RepeatableThreadTest::MockEnvTest hang (#4560)
2018-10-21 20:17:18 -07:00
set_comparator.h
WritePrepared Txn: Move DuplicateDetector to util
2018-03-05 23:57:12 -08:00
slice_transform_test.cc
Update all unique/shared_ptr instances to be qualified with namespace std (#4638)
2018-11-09 11:19:58 -08:00
slice.cc
use user_key and iterate_upper_bound to determine compatibility of bloom filters (#3899)
2018-06-26 15:57:26 -07:00
sst_file_manager_impl.cc
Always delete Blob DB files in the background (#4928)
2019-01-29 15:50:03 -08:00
sst_file_manager_impl.h
Always delete Blob DB files in the background (#4928)
2019-01-29 15:50:03 -08:00
status.cc
move static msgs out of Status class (#4144)
2018-07-23 15:44:16 -07:00
stderr_logger.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
stop_watch.h
Exclude time waiting for rate limiter from rocksdb.sst.read.micros (#4102)
2018-07-13 18:44:14 -07:00
string_util.cc
Several small "fixes"
2018-02-15 16:57:37 -08:00
string_util.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
sync_point_impl.cc
Avoid acquiring SyncPoint mutex when it is disabled (#3991)
2018-06-13 13:13:18 -07:00
sync_point_impl.h
Avoid acquiring SyncPoint mutex when it is disabled (#3991)
2018-06-13 13:13:18 -07:00
sync_point.cc
Add read retry support to log reader (#4394)
2018-10-19 11:53:00 -07:00
sync_point.h
Fix singleton destruction order of PosixEnv and SyncPoint (#3951)
2018-06-04 15:58:46 -07:00
testharness.cc
Per-thread unique test db names (#4135)
2018-07-13 17:27:39 -07:00
testharness.h
Per-thread unique test db names (#4135)
2018-07-13 17:27:39 -07:00
testutil.cc
Backup engine support for direct I/O reads (#4640)
2018-11-13 11:17:25 -08:00
testutil.h
Backup engine support for direct I/O reads (#4640)
2018-11-13 11:17:25 -08:00
thread_list_test.cc
Use nullptr instead of NULL / 0 more consistently.
2018-03-07 12:42:12 -08:00
thread_local_test.cc
Comment out unused variables
2018-03-05 13:13:41 -08:00
thread_local.cc
Enable building of ARM32 (#4349)
2018-10-09 16:58:25 -07:00
thread_local.h
Provide a way to override windows memory allocator with jemalloc for ZSTD
2018-06-04 12:12:48 -07:00
thread_operation.h
Add inline comments to flush job (#4464)
2018-10-05 15:41:17 -07:00
threadpool_imp.cc
Small issues (#4564)
2018-10-23 10:35:57 -07:00
threadpool_imp.h
Support lowering CPU priority of background threads
2018-04-24 08:41:51 -07:00
timer_queue_test.cc
Change RocksDB License
2017-07-15 16:11:23 -07:00
timer_queue.h
Change RocksDB License
2017-07-15 16:11:23 -07:00
trace_replay.cc
Implement trace sampling (#4963)
2019-02-08 18:08:18 -08:00
trace_replay.h
Implement trace sampling (#4963)
2019-02-08 18:08:18 -08:00
transaction_test_util.cc
Fix issues found by Clang Analyzer (#4976)
2019-02-12 13:59:44 -08:00
transaction_test_util.h
Enhance transaction_test_util with delays (#4970)
2019-02-11 16:02:37 -08:00
util.h
Add GCC 8 to Travis (#3433)
2018-07-13 10:58:06 -07:00
vector_iterator.h
Use only "local" range tombstones during Get (#4449)
2018-10-24 12:31:12 -07:00
xxhash.cc
xxhash 64 support
2018-11-01 15:44:06 -07:00
xxhash.h
Move #include outside of namespace (#4629)
2018-11-06 17:18:28 -08:00