rocksdb/utilities
Sagar Vemuri 89ad9f3adb Allow ignoring unknown options when loading options from a file
Summary:
Added a flag, `ignore_unknown_options`, to skip unknown options when loading an options file (using `LoadLatestOptions`/`LoadOptionsFromFile`) or while verifying options (using `CheckOptionsCompatibility`). This will help in downgrading the db to an older version.

Also added `--ignore_unknown_options` flag to ldb

**Example Use case:**
In MyRocks, if copying from newer version to older version, it is often impossible to start because of new RocksDB options that don't exist in older version, even though data format is compatible.
MyRocks uses these load and verify functions in [ha_rocksdb.cc::check_rocksdb_options_compatibility](e004fd9f41/storage/rocksdb/ha_rocksdb.cc (L3348-L3401)).

**Test Plan:**
Updated the unit tests.
`make check`

ldb:
$ ./ldb --db=/tmp/test_db --create_if_missing put a1 b1
OK

Now edit /tmp/test_db/<OPTIONS-file> and add an unknown option.

Try loading the options now, and it fails:
$ ./ldb --db=/tmp/test_db --try_load_options get a1
Failed: Invalid argument: Unrecognized option DBOptions:: abcd

Passes with the new --ignore_unknown_options flag
$ ./ldb --db=/tmp/test_db --try_load_options --ignore_unknown_options get a1
b1
Closes https://github.com/facebook/rocksdb/pull/2423

Differential Revision: D5212091

Pulled By: sagar0

fbshipit-source-id: 2ec17636feb47dc0351b53a77e5f15ef7cbf2ca7
2017-06-13 16:58:01 -07:00
..
backupable Call RateLimiter for compaction reads 2017-06-13 14:56:46 -07:00
blob_db write exact sequence number for each put in write batch 2017-06-13 12:42:36 -07:00
checkpoint fixed typo 2017-05-17 16:41:49 -07:00
compaction_filters Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
convenience Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
date_tiered Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
document fixed typo 2017-06-05 11:27:34 -07:00
geodb Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
leveldb_options Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
lua Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
memory Disable auto compactions in memory_test and re-enable the test (#1408) 2016-10-19 18:18:42 -07:00
merge_operators Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
option_change_migration Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
options Allow ignoring unknown options when loading options from a file 2017-06-13 16:58:01 -07:00
persistent_cache Fix data races caught by tsan 2017-05-22 10:27:23 -07:00
redis Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
simulator_cache Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
spatialdb Suppress clang-analyzer false positive 2017-05-19 10:56:28 -07:00
table_properties_collectors Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
transactions Suppress clang-analyzer false positive 2017-05-19 10:56:28 -07:00
ttl Move various string utility functions into string_util 2017-04-06 14:54:12 -07:00
write_batch_with_index support PopSavePoint for WriteBatch 2017-05-03 10:57:45 -07:00
col_buf_decoder.cc fix non-portable behavior in encoder 2017-01-20 16:39:22 -08:00
col_buf_decoder.h Fix clang build failure and refactor unit test 2016-08-02 15:16:39 -07:00
col_buf_encoder.cc Avoid unsupported attributes when not building with UBSAN 2017-05-30 11:13:01 -07:00
col_buf_encoder.h Fix clang build failure and refactor unit test 2016-08-02 15:16:39 -07:00
column_aware_encoding_exp.cc Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
column_aware_encoding_test.cc Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
column_aware_encoding_util.cc Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
column_aware_encoding_util.h Move some files under util/ to separate dirs 2017-04-05 19:09:16 -07:00
debug.cc Add GetAllKeyVersions API 2017-05-12 15:54:06 -07:00
env_librados_test.cc Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
env_librados.cc Remove double buffering on RandomRead on Windows. 2017-04-27 12:30:05 -07:00
env_librados.md Add EnvLibrados - RocksDB Env of RADOS (#1222) 2016-07-21 11:16:34 -07:00
env_mirror_test.cc Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
env_mirror.cc Fixed some spelling mistakes 2017-05-17 23:12:36 -07:00
env_timed_test.cc using ThreadLocalPtr to hide ROCKSDB_SUPPORT_THREAD_LOCAL from public… 2017-06-02 17:26:19 -07:00
env_timed.cc Move some files under util/ to separate dirs 2017-04-05 19:09:16 -07:00
merge_operators.h Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00
object_registry_test.cc Generalize Env registration framework 2017-01-25 16:09:14 -08:00
util_merge_operators_test.cc Add GPLv2 as an alternative license. 2017-04-27 18:06:12 -07:00