sdong
c3ff14e2c1
Hint temperature of bottommost level files to FileSystem ( #8222 )
...
Summary:
As the first part of the effort of having placing different files on different storage types, this change introduces several things:
(1) An experimental interface in FileSystem that specify temperature to a new file created.
(2) A test FileSystemWrapper, SimulatedHybridFileSystem, that simulates HDD for a file of "warm" temperature.
(3) A simple experimental feature ColumnFamilyOptions.bottommost_temperature. RocksDB would pass this value to FileSystem when creating any bottommost file.
(4) A db_bench parameter that applies the (2) and (3) to db_bench.
The motivation of the change is to introduce minimal changes that allow us to evolve tiered storage development.
Pull Request resolved: https://github.com/facebook/rocksdb/pull/8222
Test Plan:
./db_bench --benchmarks=fillrandom --write_buffer_size=2000000 -max_bytes_for_level_base=20000000 -level_compaction_dynamic_level_bytes --reads=100 -compaction_readahead_size=20000000 --reads=100000 -num=10000000
followed by
./db_bench --benchmarks=readrandom,stats --write_buffer_size=2000000 -max_bytes_for_level_base=20000000 -simulate_hybrid_fs_file=/tmp/warm_file_list -level_compaction_dynamic_level_bytes -compaction_readahead_size=20000000 --reads=500 --threads=16 -use_existing_db --num=10000000
and see results as expected.
Reviewed By: ajkr
Differential Revision: D28003028
fbshipit-source-id: 4724896d5205730227ba2f17c3fecb11261744ce
2021-05-03 13:34:04 -07:00
..
2021-04-26 12:43:45 -07:00
2021-05-03 13:34:04 -07:00
2021-04-30 13:50:13 -07:00
2020-12-04 21:29:38 -08:00
2020-12-04 21:29:38 -08:00
2021-04-30 13:50:13 -07:00
2021-04-30 13:50:13 -07:00
2021-04-28 12:29:33 -07:00
2021-04-27 14:56:23 -07:00
2021-01-15 16:56:41 -08:00
2021-04-26 12:43:45 -07:00
2021-03-25 21:18:08 -07:00
2021-03-29 17:10:42 -07:00
2020-10-28 23:22:27 -07:00
2020-05-12 18:23:33 -07:00
2021-02-22 22:09:22 -08:00
2021-02-06 22:34:30 -08:00
2021-01-06 10:49:32 -08:00
2020-12-09 21:21:16 -08:00
2021-04-30 13:50:13 -07:00
2021-01-06 14:15:02 -08:00
2021-03-17 20:44:49 -07:00
2021-01-25 22:09:11 -08:00
2021-01-09 09:44:34 -08:00
2020-09-10 22:35:25 -07:00
2021-03-30 18:35:20 -07:00
2021-01-19 13:47:48 -08:00
2020-06-15 10:47:02 -07:00
2020-08-17 18:42:25 -07:00
2021-01-06 14:15:02 -08:00
2020-12-04 21:29:38 -08:00
2020-12-22 23:45:58 -08:00
2021-04-26 12:43:45 -07:00
2021-03-25 21:18:08 -07:00
2021-03-12 12:31:29 -08:00
2021-01-29 12:18:58 -08:00
2021-01-25 22:09:11 -08:00
2020-12-09 21:21:16 -08:00
2021-01-29 12:18:58 -08:00
2020-12-08 15:55:04 -08:00
2020-12-08 15:55:04 -08:00
2021-02-19 10:29:02 -08:00
2021-04-14 12:05:47 -07:00
2021-04-01 05:08:17 -07:00
2021-04-22 13:02:28 -07:00
2021-04-15 20:18:57 -07:00
2020-12-22 23:45:58 -08:00
2020-12-22 23:45:58 -08:00
2021-01-06 14:15:02 -08:00
2021-04-22 10:28:37 -07:00
2021-04-19 18:11:13 -07:00
2021-04-22 10:28:37 -07:00
2021-04-19 16:38:02 -07:00
2021-02-06 22:34:30 -08:00
2021-04-07 23:18:37 -07:00
2021-03-15 17:44:52 -07:00
2020-08-17 18:42:25 -07:00
2021-04-21 13:54:02 -07:00
2020-12-22 15:09:39 -08:00
2020-10-28 23:22:27 -07:00
2020-12-02 13:00:53 -08:00
2021-03-25 21:18:08 -07:00
2020-12-22 15:09:39 -08:00
2021-03-30 21:44:44 -07:00
2021-03-17 22:38:13 -07:00
2021-03-25 21:18:08 -07:00
2021-03-31 18:21:50 -07:00
2020-08-25 10:46:11 -07:00
2020-02-20 12:09:57 -08:00
2021-04-20 14:00:21 -07:00
2021-04-20 14:00:21 -07:00
2021-03-15 04:34:11 -07:00
2021-03-25 22:08:58 -07:00
2020-12-22 23:45:58 -08:00
2020-02-20 12:09:57 -08:00
2020-02-20 12:09:57 -08:00
2020-02-20 12:09:57 -08:00
2020-10-28 23:22:27 -07:00
2021-02-23 14:35:06 -08:00
2021-04-30 13:50:13 -07:00
2021-03-17 20:44:49 -07:00
2020-02-20 12:09:57 -08:00
2021-03-19 12:09:47 -07:00
2020-02-20 12:09:57 -08:00
2021-03-25 21:18:08 -07:00
2020-04-15 17:40:44 -07:00
2021-01-25 22:09:11 -08:00
2021-03-15 04:34:11 -07:00
2020-12-23 16:55:53 -08:00
2021-04-22 20:43:54 -07:00
2021-03-15 04:34:11 -07:00
2020-05-04 15:08:13 -07:00
2021-01-29 12:18:58 -08:00
2020-12-22 23:45:58 -08:00
2020-02-20 12:09:57 -08:00
2020-11-30 18:11:38 -08:00
2020-08-26 10:39:20 -07:00
2021-01-04 16:01:01 -08:00
2020-12-23 16:55:53 -08:00
2021-03-19 12:09:47 -07:00
2020-02-20 12:09:57 -08:00
2021-03-19 12:09:47 -07:00
2020-02-20 12:09:57 -08:00
2020-02-20 12:09:57 -08:00
2020-02-20 12:09:57 -08:00
2020-12-22 23:45:58 -08:00
2021-02-06 22:34:30 -08:00
2021-03-25 21:18:08 -07:00
2020-12-14 13:48:22 -08:00
2021-04-26 12:43:45 -07:00
2021-03-25 21:18:08 -07:00
2020-02-20 12:09:57 -08:00
2020-02-20 12:09:57 -08:00
2021-03-15 04:34:11 -07:00
2021-03-15 04:34:11 -07:00
2020-02-20 12:09:57 -08:00
2021-01-21 13:13:02 -08:00
2021-03-12 16:44:35 -08:00
2020-12-23 16:55:53 -08:00
2020-11-10 23:42:13 -08:00
2021-04-22 13:02:28 -07:00
2021-03-15 04:34:11 -07:00
2021-01-25 22:09:11 -08:00
2021-03-15 04:34:11 -07:00
2021-01-25 22:09:11 -08:00
2020-02-20 12:09:57 -08:00
2021-01-04 16:01:01 -08:00
2020-02-20 12:09:57 -08:00
2021-03-15 04:34:11 -07:00
2021-03-15 04:34:11 -07:00
2020-02-20 12:09:57 -08:00
2020-10-28 10:12:58 -07:00
2021-03-25 21:18:08 -07:00
2020-02-20 12:09:57 -08:00
2021-03-19 12:09:47 -07:00
2020-02-20 12:09:57 -08:00
2020-08-14 19:20:58 -07:00
2021-03-17 20:44:49 -07:00
2021-04-30 13:50:13 -07:00
2020-02-20 12:09:57 -08:00
2020-02-20 12:09:57 -08:00
2021-03-25 21:18:08 -07:00
2021-04-26 12:43:45 -07:00
2021-03-25 21:18:08 -07:00
2021-04-30 13:50:13 -07:00
2021-03-25 15:00:45 -07:00
2021-03-25 15:00:45 -07:00
2020-12-22 23:45:58 -08:00
2020-08-12 17:31:23 -07:00
2020-02-20 12:09:57 -08:00
2020-02-20 12:09:57 -08:00
2020-10-28 23:22:27 -07:00
2021-04-19 11:56:14 -07:00
2021-04-19 11:56:14 -07:00
2021-04-21 20:43:10 -07:00
2021-04-21 20:43:10 -07:00
2021-01-19 19:27:53 -08:00
2021-01-20 20:29:04 -08:00
2021-03-25 21:18:08 -07:00
2021-04-30 13:50:13 -07:00
2021-04-26 12:43:45 -07:00
2021-04-19 11:56:14 -07:00
2020-12-09 16:02:12 -08:00
2020-12-09 16:02:12 -08:00
2020-12-09 16:02:12 -08:00
2021-04-22 20:43:54 -07:00
2021-04-22 20:43:54 -07:00
2020-08-12 17:31:23 -07:00
2020-02-20 12:09:57 -08:00
2021-01-29 12:18:58 -08:00
2020-12-08 15:55:04 -08:00
2021-03-15 04:34:11 -07:00
2020-12-22 23:45:58 -08:00
2020-02-20 12:09:57 -08:00
2021-03-18 09:47:31 -07:00
2021-03-18 09:47:31 -07:00
2021-03-18 09:47:31 -07:00
2021-04-21 13:54:02 -07:00
2021-03-19 12:09:47 -07:00