andreacavalli/CavalliumDBEngine
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
874 Commits 5 Branches 0 Tags 9 MiB
024c4ee226
Commit Graph

758 Commits

Author SHA1 Message Date
Andrea Cavalli
0bc7b6d659 Skip wrong keys 2022-07-04 20:03:10 +02:00
Andrea Cavalli
4ed382197b Set the max total wal size to 10gb 2022-07-03 22:49:07 +02:00
Andrea Cavalli
8f47adfc44 Fix searchers leak, change method references 
Replace most method references with lambdas to ease debugging
 2022-07-03 01:32:13 +02:00
Andrea Cavalli
409b2985ca Bugfix 2022-07-02 13:32:38 +02:00
Andrea Cavalli
96d19c3e09 Code cleanup 2022-07-02 12:22:16 +02:00
Andrea Cavalli
2a9427f0e4 Reduce the possibility of leaks 2022-07-02 11:44:13 +02:00
Andrea Cavalli
caf55a633e Code cleanup 2022-06-30 17:05:32 +02:00
Andrea Cavalli
8e50976d27 Add discarding closeable 2022-06-30 15:06:10 +02:00
Andrea Cavalli
ab93ede348 Use resource 2022-06-30 13:54:55 +02:00
Andrea Cavalli
831af1ef81 Leak detection 2022-06-29 01:14:05 +02:00
Andrea Cavalli
aee08f3e48 Code cleanup 2022-06-28 13:52:21 +02:00
Andrea Cavalli
4a0710ed9a Force delete unused files 2022-06-23 00:14:36 +02:00
Andrea Cavalli
8c9aca21b3 Implement preClose 2022-06-21 22:52:42 +02:00
Andrea Cavalli
8083364ebf Add waitForMerges, waitForLastMerges, flush, fix #210, fix #209 2022-06-21 14:35:07 +02:00
Andrea Cavalli
ea2065302a Code cleanup 2022-06-20 23:31:42 +02:00
Andrea Cavalli
d2e7c56f06 Use more method references 2022-06-20 12:30:33 +02:00
Andrea Cavalli
a3d1207d76 Implement configurable merge policies 2022-06-20 11:55:41 +02:00
Andrea Cavalli
73b5092785 Fixes 2022-06-20 00:32:56 +02:00
Andrea Cavalli
d2650161fb clockcache is still blocked 2022-06-18 00:27:02 +02:00
Andrea Cavalli
367226480b Use clock cache 2022-06-17 01:00:45 +02:00
Andrea Cavalli
afa159de67 Reduce executors count 2022-06-16 18:40:17 +02:00
Andrea Cavalli
33d8f83933 Add new query 2022-06-16 00:04:50 +02:00
Andrea Cavalli
eb02e0f18d Test huge queries 2022-06-15 18:36:22 +02:00
Andrea Cavalli
4a08a876ca Force huge pq with an option 2022-06-15 13:09:45 +02:00
Andrea Cavalli
86e48eab92 safer count 2022-06-15 10:39:32 +02:00
Andrea Cavalli
62692a1f9a Fix wrong query format 2022-06-15 00:23:55 +02:00
Andrea Cavalli
17c40757ba Share term statistics across shards 2022-06-14 21:58:26 +02:00
Andrea Cavalli
0d830fbd21 Use SimpleResource when possible 2022-06-14 18:05:26 +02:00
Andrea Cavalli
fb0bd092a4 Fix searcher leak 2022-06-14 17:46:49 +02:00
Andrea Cavalli
8e47c15809 Avoid indexsearcher leaks 2022-06-14 13:10:38 +02:00
Andrea Cavalli
cc6071a4de Add statistics about searchers 2022-06-13 23:25:43 +02:00
Andrea Cavalli
9db32dacae Fix write buffer manager null 2022-06-10 16:26:03 +02:00
Andrea Cavalli
d4de13c2ab Create a class for KeyMayExist code 2022-06-09 19:45:03 +02:00
Andrea Cavalli
8578facfe7 Check persistent cache directory 2022-06-09 16:47:42 +02:00
Andrea Cavalli
957866ec99 Add a property to enable mmap writes 2022-06-09 00:49:08 +02:00
Andrea Cavalli
8c2f3b89b6 Use LZ4 compression as fallback 2022-06-09 00:13:44 +02:00
Andrea Cavalli
563defb2ff Implement closeRequested 2022-06-08 18:52:15 +02:00
Andrea Cavalli
3be0d3710c Enable lucene auto io throttle 2022-06-08 16:45:54 +02:00
Andrea Cavalli
cc9306fbde Check if accessible 2022-06-05 16:38:39 +02:00
Andrea Cavalli
956f33fb6c Improve string field 2022-06-04 19:18:51 +02:00
Andrea Cavalli
0e9b45ebf9 Update hitkey 2022-06-04 16:33:45 +02:00
Andrea Cavalli
62c2dabd8c Workaround again fake-zero elements 2022-06-01 23:18:11 +02:00
Andrea Cavalli
a1a509a6cf BlobDB 2022-06-01 17:36:21 +02:00
Andrea Cavalli
6dfc10859f Implement term fields 2022-05-30 01:08:46 +02:00
Andrea Cavalli
e1bd57c837 Fix default options 2022-05-29 23:48:40 +02:00
Andrea Cavalli
23d70e55bd Add more netty stats 2022-05-28 18:55:05 +02:00
Andrea Cavalli
65295dbf03 Implement NettyMetrics 2022-05-28 14:34:35 +02:00
Andrea Cavalli
6056eedd75 Fix some possible leaks 2022-05-26 13:13:14 +02:00
Andrea Cavalli
96de3023a0 Fix double-free, close all properties 2022-05-22 16:48:08 +02:00
Andrea Cavalli
fe31f9b1c7 Code cleanup 2022-05-22 00:56:32 +02:00
Andrea Cavalli
bff4d87164 Code cleanup 2022-05-22 00:32:08 +02:00
Andrea Cavalli
2e58189015 Code cleanup 2022-05-21 23:49:06 +02:00
Andrea Cavalli
52c216c0df Handle discards and drops 2022-05-21 22:41:48 +02:00
Andrea Cavalli
7f52339a6a Code cleanup 2022-05-21 15:28:52 +02:00
Andrea Cavalli
5c4519552d Fix more possible leaks 2022-05-21 01:06:55 +02:00
Andrea Cavalli
18d5ddf6e1 Remove some leaks 2022-05-20 23:59:56 +02:00
Andrea Cavalli
d253111233 Fix some memory leaks 2022-05-20 18:31:05 +02:00
Andrea Cavalli
82f8e91e99 Fix double-free 2022-05-20 13:16:26 +02:00
Andrea Cavalli
a720a12701 Bugfix 2022-05-20 10:44:00 +02:00
Andrea Cavalli
0e7df84c38 Remove RocksObj, add BufSupplier, remove sends 2022-05-20 10:20:03 +02:00
Andrea Cavalli
84c9a2c3cc Update netty 2022-05-18 01:38:04 +02:00
Andrea Cavalli
c9a12760bc Trace leaks 2022-05-12 19:14:27 +02:00
Andrea Cavalli
6a5a9a3e94 Fix more leaks 2022-05-11 20:32:56 +02:00
Andrea Cavalli
bfc78f1465 Update modules 2022-05-11 10:24:23 +02:00
Andrea Cavalli
fab06db239 Fixed more leaks 2022-05-11 00:29:42 +02:00
Andrea Cavalli
99e101914d Fix some possible leaks 2022-05-10 16:57:41 +02:00
Andrea Cavalli
b5b9fc9d0d Fix module 2022-05-10 00:53:07 +02:00
Andrea Cavalli
f89c3ff707 Update dependencies 2022-05-10 00:31:16 +02:00
Andrea Cavalli
cc69ec3063 Add statistics 2022-05-09 22:08:54 +02:00
Andrea Cavalli
b30ce665a0 Require okio 2022-05-09 10:23:48 +02:00
Andrea Cavalli
02f1276181 Bugfixes 2022-05-04 12:36:32 +02:00
Andrea Cavalli
a1c0e19adc Add readable rocksdb stats 2022-05-04 01:21:56 +02:00
Andrea Cavalli
549a3bd178 Fix some defaults 2022-05-03 19:47:32 +02:00
Andrea Cavalli
614d24ac8d Code cleanup 2022-05-02 19:05:40 +02:00
Andrea Cavalli
19bb638f20 Follow rocksdb optimizations 2022-05-02 18:48:44 +02:00
Andrea Cavalli
404fe03c14 Reduce L0 files 2022-05-02 01:16:46 +02:00
Andrea Cavalli
22f0711ab8 Configurable log path, configurable wal path 2022-05-02 00:42:38 +02:00
Andrea Cavalli
3a7b1498ff Change log levels 2022-05-01 17:36:29 +02:00
Andrea Cavalli
87d000968a Automatic wal ttls and sync sizes 2022-05-01 17:25:22 +02:00
Andrea Cavalli
f63b70ab9d Set target file size multiplier to 2, to reduce write amplification 2022-05-01 15:48:08 +02:00
Andrea Cavalli
d9c2e8a5f9 Code cleanup, bigger compaction trigger l0 2022-05-01 15:42:51 +02:00
Andrea Cavalli
c72e4d5a83 Code cleanup 2022-05-01 15:35:12 +02:00
Andrea Cavalli
59e980f356 Fix closed status 2022-04-30 23:50:22 +02:00
Andrea Cavalli
04623b754c Update luene, update rocksdb 2022-04-30 21:56:42 +02:00
Andrea Cavalli
e03afafcee Safer access to database elements 2022-04-30 14:21:20 +02:00
Andrea Cavalli
88a1add102 Bugfixes 2022-04-30 02:14:44 +02:00
Andrea Cavalli
654a62d7b8 Bugfix 2022-04-30 01:50:24 +02:00
Andrea Cavalli
e962ae6336 Secure database shutdown, deduplicate compaction script 2022-04-30 01:49:44 +02:00
Andrea Cavalli
9d16ccdd9e Flush API, accessibility lock, better manual compaction 2022-04-28 23:23:26 +02:00
Andrea Cavalli
e7718a8370 Fix crash 2022-04-28 11:35:01 +02:00
Andrea Cavalli
f854ce1253 Temporarily disable compactfiles 2022-04-27 09:56:07 +02:00
Andrea Cavalli
1bd3b8a945 Implement compact API 2022-04-26 17:30:31 +02:00
Andrea Cavalli
ec5bf1c5cc Compaction API and configurable write buffer size 2022-04-26 17:12:22 +02:00
Andrea Cavalli
116fc88311 Bugfix 2022-04-20 23:29:39 +02:00
Andrea Cavalli
f5cb2d8895 Improve point lookup speed 2022-04-19 23:23:32 +02:00
Andrea Cavalli
735be8ecb8 Add mayExist 2022-04-19 23:23:12 +02:00
Andrea Cavalli
94cdaaedef Bugfix 2022-04-15 22:40:47 +02:00
Andrea Cavalli
4b627664aa Bugfixes 2022-04-15 16:49:01 +02:00
Andrea Cavalli
80ef0394b1 Use crc32c, it seems that there are problems with checksums 2022-04-15 02:56:03 +02:00
Andrea Cavalli
046c08e5bf Support persistent cache, ensure that all snapshots are closed in time 2022-04-15 02:41:06 +02:00