Commit Graph

698 Commits

Author SHA1 Message Date
Andrea Cavalli
7f52339a6a Code cleanup 2022-05-21 15:28:52 +02:00
Andrea Cavalli
5c4519552d Fix more possible leaks 2022-05-21 01:06:55 +02:00
Andrea Cavalli
18d5ddf6e1 Remove some leaks 2022-05-20 23:59:56 +02:00
Andrea Cavalli
d253111233 Fix some memory leaks 2022-05-20 18:31:05 +02:00
Andrea Cavalli
82f8e91e99 Fix double-free 2022-05-20 13:16:26 +02:00
Andrea Cavalli
a720a12701 Bugfix 2022-05-20 10:44:00 +02:00
Andrea Cavalli
0e7df84c38 Remove RocksObj, add BufSupplier, remove sends 2022-05-20 10:20:03 +02:00
Andrea Cavalli
84c9a2c3cc Update netty 2022-05-18 01:38:04 +02:00
Andrea Cavalli
c9a12760bc Trace leaks 2022-05-12 19:14:27 +02:00
Andrea Cavalli
6a5a9a3e94 Fix more leaks 2022-05-11 20:32:56 +02:00
Andrea Cavalli
fab06db239 Fixed more leaks 2022-05-11 00:29:42 +02:00
Andrea Cavalli
99e101914d Fix some possible leaks 2022-05-10 16:57:41 +02:00
Andrea Cavalli
f89c3ff707 Update dependencies 2022-05-10 00:31:16 +02:00
Andrea Cavalli
cc69ec3063 Add statistics 2022-05-09 22:08:54 +02:00
Andrea Cavalli
02f1276181 Bugfixes 2022-05-04 12:36:32 +02:00
Andrea Cavalli
a1c0e19adc Add readable rocksdb stats 2022-05-04 01:21:56 +02:00
Andrea Cavalli
549a3bd178 Fix some defaults 2022-05-03 19:47:32 +02:00
Andrea Cavalli
614d24ac8d Code cleanup 2022-05-02 19:05:40 +02:00
Andrea Cavalli
19bb638f20 Follow rocksdb optimizations 2022-05-02 18:48:44 +02:00
Andrea Cavalli
404fe03c14 Reduce L0 files 2022-05-02 01:16:46 +02:00
Andrea Cavalli
22f0711ab8 Configurable log path, configurable wal path 2022-05-02 00:42:38 +02:00
Andrea Cavalli
3a7b1498ff Change log levels 2022-05-01 17:36:29 +02:00
Andrea Cavalli
87d000968a Automatic wal ttls and sync sizes 2022-05-01 17:25:22 +02:00
Andrea Cavalli
f63b70ab9d Set target file size multiplier to 2, to reduce write amplification 2022-05-01 15:48:08 +02:00
Andrea Cavalli
d9c2e8a5f9 Code cleanup, bigger compaction trigger l0 2022-05-01 15:42:51 +02:00
Andrea Cavalli
c72e4d5a83 Code cleanup 2022-05-01 15:35:12 +02:00
Andrea Cavalli
59e980f356 Fix closed status 2022-04-30 23:50:22 +02:00
Andrea Cavalli
04623b754c Update luene, update rocksdb 2022-04-30 21:56:42 +02:00
Andrea Cavalli
e03afafcee Safer access to database elements 2022-04-30 14:21:20 +02:00
Andrea Cavalli
88a1add102 Bugfixes 2022-04-30 02:14:44 +02:00
Andrea Cavalli
654a62d7b8 Bugfix 2022-04-30 01:50:24 +02:00
Andrea Cavalli
e962ae6336 Secure database shutdown, deduplicate compaction script 2022-04-30 01:49:44 +02:00
Andrea Cavalli
9d16ccdd9e Flush API, accessibility lock, better manual compaction 2022-04-28 23:23:26 +02:00
Andrea Cavalli
e7718a8370 Fix crash 2022-04-28 11:35:01 +02:00
Andrea Cavalli
f854ce1253 Temporarily disable compactfiles 2022-04-27 09:56:07 +02:00
Andrea Cavalli
1bd3b8a945 Implement compact API 2022-04-26 17:30:31 +02:00
Andrea Cavalli
ec5bf1c5cc Compaction API and configurable write buffer size 2022-04-26 17:12:22 +02:00
Andrea Cavalli
116fc88311 Bugfix 2022-04-20 23:29:39 +02:00
Andrea Cavalli
f5cb2d8895 Improve point lookup speed 2022-04-19 23:23:32 +02:00
Andrea Cavalli
735be8ecb8 Add mayExist 2022-04-19 23:23:12 +02:00
Andrea Cavalli
94cdaaedef Bugfix 2022-04-15 22:40:47 +02:00
Andrea Cavalli
4b627664aa Bugfixes 2022-04-15 16:49:01 +02:00
Andrea Cavalli
80ef0394b1 Use crc32c, it seems that there are problems with checksums 2022-04-15 02:56:03 +02:00
Andrea Cavalli
046c08e5bf Support persistent cache, ensure that all snapshots are closed in time 2022-04-15 02:41:06 +02:00
Andrea Cavalli
e038b41d17 Adjust parameter for spinning disk
Based on the default document storage of arangodb
2022-04-13 19:44:44 +02:00
Andrea Cavalli
0ad5a15792 Fix putmulti 2022-04-12 00:25:18 +02:00
Andrea Cavalli
1b150dcbaf configurable partition filters 2022-04-11 20:04:27 +02:00
Andrea Cavalli
d35840ec03 Configurable write buffer manager 2022-04-11 16:53:17 +02:00
Andrea Cavalli
4448947cfd Fix shared caching size 2022-04-11 16:41:13 +02:00
Andrea Cavalli
0ca6f4c2c5 Re-create allocations tester 2022-04-11 16:40:55 +02:00
Andrea Cavalli
851f73481a Bugfixes 2022-04-11 12:42:01 +02:00
Andrea Cavalli
1cac7cb0c9 Custom block size, fix cache stats, fix db close, disable clock cache 2022-04-11 01:27:09 +02:00
Andrea Cavalli
eb5792bbe0 bugfixes 2022-04-10 20:15:05 +02:00
Andrea Cavalli
e86965efa7 Avoid closing things that have already been closed 2022-04-09 16:31:32 +02:00
Andrea Cavalli
6315175dc4 Java modules 2022-04-09 02:45:42 +02:00
Andrea Cavalli
95d436860f Update options 2022-04-08 14:32:47 +02:00
Andrea Cavalli
29210cca80 More stats 2022-04-07 22:19:11 +02:00
Andrea Cavalli
f9fb679f9b Bloom stats, fix thread caps 2022-04-07 20:03:29 +02:00
Andrea Cavalli
5c6e6411f5 Experiment with different options 2022-04-06 14:53:08 +02:00
Andrea Cavalli
6c6263e1d0 Fix lucene hugepq searcher 2022-04-06 14:25:53 +02:00
Andrea Cavalli
dc69bf8e25 Reimplement LMDB PriorityQueue using RocksDB 2022-04-06 02:41:32 +02:00
Andrea Cavalli
6ac9505653 Separate write and read schedulers 2022-04-05 13:58:12 +02:00
Andrea Cavalli
02cd99a963 Reduce bloom filter size 2022-04-05 01:07:50 +02:00
Andrea Cavalli
24cf7ea58d Add dedicated scheduler 2022-04-05 00:37:44 +02:00
Andrea Cavalli
1cd5fc8eed Adjust default compaction size 2022-04-04 22:55:28 +02:00
Andrea Cavalli
1dfe0d5a77 Use the right scheduler 2022-04-04 20:12:29 +02:00
Andrea Cavalli
a45f357bca Group threads 2022-04-04 17:52:49 +02:00
Andrea Cavalli
c711bbc5ad Explain the hard-coded rocksdb settings 2022-04-04 11:16:20 +02:00
Andrea Cavalli
32dc615f88 Default to 256KiB block size 2022-04-04 10:27:38 +02:00
Andrea Cavalli
c4e696f359 Subscribe correctly 2022-04-01 20:06:06 +02:00
Andrea Cavalli
c2d3f79a08 Subscribe to the correct scheduler 2022-04-01 15:15:06 +02:00
Andrea Cavalli
cd26cf61b7 More update statistics, avoid send in updates 2022-04-01 01:30:56 +02:00
Andrea Cavalli
7891b0b9e0 Optimizations 2022-03-30 23:44:57 +02:00
Andrea Cavalli
cb83c17811 Bugfixes 2022-03-30 18:36:07 +02:00
Andrea Cavalli
7d0951956d Add more metrics about payload sizes, and iteration times 2022-03-30 15:15:53 +02:00
Andrea Cavalli
6bd3fdb677 Add utility method to lazyhitentry 2022-03-29 21:27:56 +02:00
Andrea Cavalli
87c031fe71 Update to rocksdb 7 2022-03-27 01:22:20 +01:00
Andrea Cavalli
39811dc3f3 Add the possibility to iterate only a slice of the database 2022-03-25 00:27:44 +01:00
Andrea Cavalli
81b26eed82 Add smallRange parameter 2022-03-24 23:56:23 +01:00
Andrea Cavalli
388b79c6d1 Allow reverse iteration 2022-03-24 21:14:17 +01:00
Andrea Cavalli
8e88c78ce7 Improve query parsing 2022-03-23 23:58:30 +01:00
Andrea Cavalli
bafe5a1fe8 Add more term queries 2022-03-23 23:05:11 +01:00
Andrea Cavalli
2bed1d4d51 Remove unsupported code 2022-03-22 19:40:15 +01:00
Andrea Cavalli
6443e75ebd Allow reading the column families 2022-03-22 12:59:22 +01:00
Andrea Cavalli
8e6ea58823 Update options 2022-03-22 11:50:30 +01:00
Andrea Cavalli
372c45220c Update rocksdb options, don't delete logs manually 2022-03-22 00:23:32 +01:00
Andrea Cavalli
5f6dfac1da Respect limit 2022-03-21 15:25:26 +01:00
Andrea Cavalli
da3e7fdf33 Restore default scheduler 2022-03-21 15:22:55 +01:00
Andrea Cavalli
b163260702 Fix db options 2022-03-21 15:19:17 +01:00
Andrea Cavalli
b1d8e3e48e Re-enable dedicated schedulers 2022-03-20 16:14:31 +01:00
Andrea Cavalli
e34e1e5852 Optimize singleton 2022-03-20 14:45:48 +01:00
Andrea Cavalli
de5be6564e Implement singletons 2022-03-20 14:33:27 +01:00
Andrea Cavalli
e866241ff1 Unify read options 2022-03-19 16:36:59 +01:00
Andrea Cavalli
bbc77df56b Update dependencies 2022-03-19 00:08:23 +01:00
Andrea Cavalli
aad7195acb Don't use arrays 2022-03-18 19:16:06 +01:00
Andrea Cavalli
28b4fdee50 Better errors logging, avoid zero-bytes bug in keyMayExist 2022-03-18 15:33:54 +01:00
Andrea Cavalli
59c37c0fc9 Improve suffix performance 2022-03-16 22:41:51 +01:00
Andrea Cavalli
ba3765eece Improve direct buffer support 2022-03-16 19:19:26 +01:00
Andrea Cavalli
0a6a0657a3 Use official netty 5 package 2022-03-16 13:47:56 +01:00
Andrea Cavalli
8999102038 add fast path 2022-03-16 00:32:00 +01:00