Commit Graph

691 Commits

Author SHA1 Message Date
Andrea Cavalli
1899ef1723 Optimize array 2021-10-25 01:54:37 +02:00
Andrea Cavalli
f9b656986c Clean queues 2021-10-25 01:44:12 +02:00
Andrea Cavalli
7a01b6a2a4 Group writes together to speedup writes 2021-10-25 01:41:02 +02:00
Andrea Cavalli
e48f8b25eb Remove unused constants 2021-10-25 00:44:30 +02:00
Andrea Cavalli
db9b1bb7fb Rename constants 2021-10-25 00:42:48 +02:00
Andrea Cavalli
90aa7a2522 Use in-memory database if the limit is lower than 8192 2021-10-22 01:26:44 +02:00
Andrea Cavalli
a77af5253d Fix performance issue 2021-10-22 00:51:54 +02:00
Andrea Cavalli
213e446ff4 Separate lucene from the rest of the app to avoid thread interruptions 2021-10-21 11:55:59 +02:00
Andrea Cavalli
fb43fa78af Discard transaction data 2021-10-21 10:01:29 +02:00
Andrea Cavalli
1f04241ac6 Use optimistic db 2021-10-21 10:00:39 +02:00
Andrea Cavalli
1625a5c44b RocksDB database abstraction 2021-10-20 01:51:34 +02:00
Andrea Cavalli
80d0ced888 Optimistic transactions, inline codecs 2021-10-19 00:22:05 +02:00
Andrea Cavalli
aad5f8c96c Optimistic updates 2021-10-17 19:52:43 +02:00
Andrea Cavalli
df2b757fdd Remove unused class 2021-10-17 17:15:57 +02:00
Andrea Cavalli
3a591c38f2 Use new netty resource leak detector 2021-10-16 16:56:10 +02:00
Andrea Cavalli
e66efba834 Publish lucene 9 snapshots 2021-10-16 14:59:38 +02:00
Andrea Cavalli
f77784fc50 Improve temporary LMDB database lifecycle 2021-10-16 14:35:04 +02:00
Andrea Cavalli
a441c2fb85 Move comparator 2021-10-16 01:51:07 +02:00
Andrea Cavalli
6f8f70c23b Bugfix in sizeRange 2021-10-16 01:49:41 +02:00
Andrea Cavalli
fd565c80b2 Fix assertions 2021-10-16 01:35:09 +02:00
Andrea Cavalli
f6aab7dafb More tests 2021-10-16 00:50:06 +02:00
Andrea Cavalli
e6c0f14fda Implement some sort codecs 2021-10-15 22:03:53 +02:00
Andrea Cavalli
17a9b49755 Partial sorted implementation 2021-10-15 00:03:41 +02:00
Andrea Cavalli
36df18796b Partial sorted implementation 2021-10-14 23:04:34 +02:00
Andrea Cavalli
e1d1e1fb05 Fix LMDB PriorityQueue 2021-10-14 15:55:58 +02:00
Andrea Cavalli
d6b6a211a8 Replace scoreMode with boolean "complete" 2021-10-14 00:49:21 +02:00
Andrea Cavalli
5817d8a93f Implement more tests 2021-10-13 14:26:54 +02:00
Andrea Cavalli
584115c5cc Rename classes and improve readonly tests performance 2021-10-13 12:25:32 +02:00
Andrea Cavalli
09f60a3a99 Implement memory-mapped sorted searcher for streaming huge query results 2021-10-13 00:23:56 +02:00
Andrea Cavalli
83e98ebce8 Fast implementation of query transformers 2021-10-08 11:50:28 +02:00
Andrea Cavalli
30a14a4aae Add todos 2021-10-08 02:14:34 +02:00
Andrea Cavalli
4d5f8b5b37 Implement MoreLikeThis transformer 2021-10-08 02:13:33 +02:00
Andrea Cavalli
81d8abe72c Add ensureBlocking in blocking method 2021-10-07 00:54:20 +02:00
Andrea Cavalli
013e4c5dd8 Remove publishOn in lucene utils 2021-10-07 00:54:11 +02:00
Andrea Cavalli
33e4cb2f14 Add ensureOpen method to avoid writing to the index when closing 2021-10-07 00:53:38 +02:00
Andrea Cavalli
818bd20ed9 Update netty 2021-10-01 19:17:33 +02:00
Andrea Cavalli
9646ddcb28 Use method references 2021-09-30 18:25:36 +02:00
Andrea Cavalli
5d2ba797eb Cleanup code 2021-09-30 00:25:09 +02:00
Andrea Cavalli
9a6f195b63 Cleanup utils 2021-09-30 00:23:41 +02:00
Andrea Cavalli
dc14192dca Reimplement MultiMoreLikeThis using BigCompositeReader 2021-09-29 13:18:06 +02:00
Andrea Cavalli
6b8c1025d1 Fix ClassCastException 2021-09-29 11:47:17 +02:00
Andrea Cavalli
74d20204ab Avoid using BufferTimeoutPublisher (it kills lucene Async IO) 2021-09-29 11:38:53 +02:00
Andrea Cavalli
2fb96eaf03 Ensure running in a blocking thread 2021-09-29 11:38:36 +02:00
Andrea Cavalli
74f2cce604 Throw error only when needed 2021-09-26 15:10:42 +02:00
Andrea Cavalli
5d7b403e55 Move reactive collector 2021-09-25 18:31:41 +02:00
Andrea Cavalli
f03f7296d4 Separate LeafCollector 2021-09-25 14:09:10 +02:00
Andrea Cavalli
5443e330bb Optimistic emission of results 2021-09-25 13:26:59 +02:00
Andrea Cavalli
8e15020f5b Improve performance of infinite queries 2021-09-25 13:07:52 +02:00
Andrea Cavalli
d06c9184bd Bugfix 2021-09-25 13:07:40 +02:00
Andrea Cavalli
d96b5a168b Execute searches on its own executor 2021-09-25 13:06:24 +02:00
Andrea Cavalli
3742eedd7f Release dropped resource 2021-09-24 04:01:28 +02:00
Andrea Cavalli
996165c3cc Do not release cached searcher 2021-09-24 02:47:52 +02:00
Andrea Cavalli
23fa46c775 Release cached searcher 2021-09-24 02:44:12 +02:00
Andrea Cavalli
20c19f662b Avoid multiple drops 2021-09-24 02:01:45 +02:00
Andrea Cavalli
be1ca997a7 Bugfix 2021-09-23 23:45:41 +02:00
Andrea Cavalli
1a73a5a33f Bugfixes 2021-09-23 22:04:01 +02:00
Andrea Cavalli
3a544d4297 Partial migration to ResourceSupport 2021-09-23 20:57:28 +02:00
Andrea Cavalli
247207febe Temporary 2021-09-23 15:48:27 +02:00
Andrea Cavalli
51ec85abe1 Improve logging 2021-09-23 15:37:13 +02:00
Andrea Cavalli
6c849fae78 Change makeInaccessible visibility 2021-09-23 15:34:56 +02:00
Andrea Cavalli
d4c977047c Allow sorted/scored counting 2021-09-23 14:50:15 +02:00
Andrea Cavalli
b77b441515 Fix all errors 2021-09-23 11:30:44 +02:00
Andrea Cavalli
552b5f78ce Fix size check assertion 2021-09-23 02:22:30 +02:00
Andrea Cavalli
29086b1939 Add some tests for low level dictionary, log tests, pass more tests 2021-09-23 02:15:58 +02:00
Andrea Cavalli
e034f3b778 Support memory segments 2021-09-22 18:33:28 +02:00
Andrea Cavalli
8b73a05177 Bugfixes and upgraded to java 17 2021-09-22 11:03:39 +02:00
Andrea Cavalli
0fee105f0b Bugfixes 2021-09-21 02:01:02 +02:00
Andrea Cavalli
bd97704a0b Better page limits 2021-09-20 18:20:59 +02:00
Andrea Cavalli
b8adbf452e Add resources flux 2021-09-20 16:22:39 +02:00
Andrea Cavalli
3c5edbc06e Finished initial refactoring 2021-09-20 12:51:27 +02:00
Andrea Cavalli
4a883ca8ea Done implementing Local and LocalMulti lucene indices 2021-09-20 11:52:21 +02:00
Andrea Cavalli
ca37d1fb68 Rewrite lucene transformers and implement MoreLikeThis sharding 2021-09-20 11:35:01 +02:00
Andrea Cavalli
5cfb5f49cd Add custom MoreLikeThis with sharding support 2021-09-20 00:22:22 +02:00
Andrea Cavalli
65db1711b5 Missing: moreLikeThis 2021-09-19 19:59:37 +02:00
Andrea Cavalli
31422847c2 Add SimpleUnsortedUnscoredLuceneMultiSearcher 2021-09-19 12:35:48 +02:00
Andrea Cavalli
d1963a1d65 Finish refactoring SimpleLuceneLocalSearcher 2021-09-19 12:01:11 +02:00
Andrea Cavalli
8bc0284f27 First safe search commit 2021-09-18 18:34:21 +02:00
Andrea Cavalli
6782abb66d Use Net5 2021-09-17 16:56:28 +02:00
Andrea Cavalli
7feeb4a9ce Use markers 2021-09-10 12:13:52 +02:00
Andrea Cavalli
0a378bc0f1 Fix negative value 2021-09-10 12:13:46 +02:00
Andrea Cavalli
9e09574517 Don't parallelize here 2021-09-10 01:13:39 +02:00
Andrea Cavalli
36dde3bb5a Set concurrency to 3 2021-09-10 00:05:39 +02:00
Andrea Cavalli
c47f45076a Optimization 2021-09-09 23:27:39 +02:00
Andrea Cavalli
f157e67818 Various searchers optimizations 2021-09-09 23:00:16 +02:00
Andrea Cavalli
6dda099cc1 Fix registration of global allocator 2021-09-09 16:18:47 +02:00
Andrea Cavalli
d9fd4113e0 Fix refactoring 2021-09-09 15:34:31 +02:00
Andrea Cavalli
9c167a322a Extend metric utils 2021-09-09 15:30:28 +02:00
Andrea Cavalli
2fd311f67a Support allocator metrics 2021-09-09 15:21:20 +02:00
Andrea Cavalli
48ba4d15de Bugfix 2021-09-09 12:31:49 +02:00
Andrea Cavalli
cb5a5e36f2 Fix timeout subscription 2021-09-09 11:43:37 +02:00
Andrea Cavalli
48db79359b Use boundedelastic db scheduler 2021-09-08 23:51:05 +02:00
Andrea Cavalli
5293fbe22c Close leaked data 2021-09-08 23:41:18 +02:00
Andrea Cavalli
3a79e5ba6f Undo parallelization of lucene searches 2021-09-08 23:41:05 +02:00
Andrea Cavalli
6926292904 Avoid nesting schedulers inside generators 2021-09-08 22:32:08 +02:00
Andrea Cavalli
2b21e6a864 Use blocking generator instead of Flux.create 2021-09-08 22:16:06 +02:00
Andrea Cavalli
e12e240487 Subscribe on the same thread 2021-09-08 21:35:04 +02:00
Andrea Cavalli
09c7e4f730 Performance bugfix 2021-09-08 21:34:52 +02:00
Andrea Cavalli
047a471bf7 Fix last leaks 2021-09-08 00:22:39 +02:00
Andrea Cavalli
57a0206cf1 Fully implement memory dictionary 2021-09-07 19:32:37 +02:00
Andrea Cavalli
a662033228 Less verbose exception 2021-09-07 11:39:13 +02:00
Andrea Cavalli
dd1ed1d18f Suppress warning 2021-09-07 11:29:28 +02:00
Andrea Cavalli
d4ed99cc24 Fix compilation issue 2021-09-07 11:28:03 +02:00
Andrea Cavalli
717d13ef1f Revert commit 1882e8b300 2021-09-07 11:26:10 +02:00
Andrea Cavalli
66fa853272 Avoid memory leaks 2021-09-07 02:36:11 +02:00
Andrea Cavalli
f5d3474966 Fix possible deadlock 2021-09-07 02:08:29 +02:00
Andrea Cavalli
936c07406e Implement more phasers 2021-09-06 18:52:21 +02:00
Andrea Cavalli
51b60168f7 Implement phaser 2021-09-06 18:29:10 +02:00
Andrea Cavalli
d05994c8ff Rename manager 2021-09-06 18:24:36 +02:00
Andrea Cavalli
5a79d2d7cb Close the CachedIndexSearcher automatically 2021-09-06 18:23:47 +02:00
Andrea Cavalli
7230e96343 Bugfix 2021-09-06 17:42:12 +02:00
Andrea Cavalli
e59705bd0b Better manage cached index searchers 2021-09-06 17:35:02 +02:00
Andrea Cavalli
b7d975ccfb MultiGet window set to 16 to avoid memory problems 2021-09-06 15:54:44 +02:00
Andrea Cavalli
16bd3b263b Limit cached indexwriters 2021-09-06 15:08:07 +02:00
Andrea Cavalli
d5964a7bed Pool searchers 2021-09-06 15:06:51 +02:00
Andrea Cavalli
6c73c1e86d Add memory tests
needs fix
2021-09-06 01:15:13 +02:00
Andrea Cavalli
4c348a6b2f Throw exception if running in a nonblocking scope 2021-09-05 14:23:46 +02:00
Andrea Cavalli
1882e8b300 Optimize performance by removing all superfluous subscribeOn calls 2021-09-04 16:42:47 +02:00
Andrea Cavalli
2fe8063193 Fix composite buffers 2021-09-04 02:35:12 +02:00
Andrea Cavalli
f5f46edbec Use netty5 package 2021-09-04 02:19:10 +02:00
Andrea Cavalli
154086dee2 Fix compilation issues and buffer expansions 2021-09-03 16:11:14 +02:00
Andrea Cavalli
47de651c94 Bugfixes 2021-09-03 02:22:55 +02:00
Andrea Cavalli
a8028024c8 Finish refactoring 2021-09-02 21:14:26 +02:00
Andrea Cavalli
3091b81d34 Fix map tests 2021-09-02 17:15:40 +02:00
Andrea Cavalli
ff7823656e y 2021-09-01 00:01:56 +02:00
Andrea Cavalli
013d26387d (unfinished) Netty 5 refactoring 2021-08-31 15:50:11 +02:00
Andrea Cavalli
0faef5316e (unfinished) Netty 5 refactoring 2021-08-31 09:14:46 +02:00
Andrea Cavalli
3b55e8bd24 (unfinished) Netty 5 refactoring 2021-08-29 23:18:03 +02:00
Andrea Cavalli
9984cfff73 Bugfixes 2021-08-29 01:15:51 +02:00
Andrea Cavalli
8adc8b77b4 Bugfixes 2021-08-28 22:51:05 +02:00
Andrea Cavalli
03b5876001 Bugfixes 2021-08-28 22:42:51 +02:00
Andrea Cavalli
0c17af2ae5 Bugfixes 2021-08-27 02:49:51 +02:00
Andrea Cavalli
6fe9f9c24f Fix hanging on ScoredSimpleLuceneShardSearcher 2021-08-25 10:23:42 +02:00
Andrea Cavalli
6e31aa01f9 Ignore release errors for empty searchers 2021-08-24 14:13:43 +02:00
Andrea Cavalli
2207ae4314 Fix class names 2021-08-24 11:55:33 +02:00
Andrea Cavalli
a0eb80b130 Protect against memory leaks with dropped search results 2021-08-24 11:53:19 +02:00
Andrea Cavalli
a909aaaf52 LLKeyScore is now a regular record 2021-08-24 11:06:25 +02:00
Andrea Cavalli
c5552d2827 Bugfixes 2021-08-22 23:50:50 +02:00
Andrea Cavalli
2a24570512 Add checked serialization exception 2021-08-22 21:23:22 +02:00
Andrea Cavalli
4e71e42d32 Code cleanup 2021-08-22 19:54:23 +02:00
Andrea Cavalli
906379923f Lazy retain generated suffixes 2021-08-22 19:52:19 +02:00
bc759c344d Use a new approach to completely avoid memory leaks 2021-08-22 18:20:05 +02:00
6ed31ab2a6 Code cleanup 2021-08-16 10:36:54 +02:00
435e7d4886 Use a new approach to completely avoid memory leaks 2021-08-16 10:27:47 +02:00
Andrea Cavalli
9d326f5a8b Human readable representation of total hits count 2021-08-04 01:16:17 +02:00
Andrea Cavalli
9734d78839 Total hits with precision 2021-08-04 01:12:39 +02:00
Andrea Cavalli
bcd99f4727 Avoid errors 2021-08-04 00:44:06 +02:00
Andrea Cavalli
328a45f40d Fix unscored-unsorted collectors 2021-07-31 23:12:13 +02:00
Andrea Cavalli
586be8751c Fix compilation issue 2021-07-31 19:18:20 +02:00
Andrea Cavalli
d411675c2b Use flatMapIterable when possible 2021-07-31 18:00:53 +02:00
Andrea Cavalli
7597e54bac Remove unnecessary schedulers 2021-07-31 12:28:53 +02:00
Andrea Cavalli
4e782403f5 Fix results ordering 2021-07-30 14:01:12 +02:00
Andrea Cavalli
db54773cda remove warning 2021-07-28 22:18:33 +02:00
Andrea Cavalli
e738eda331 Performance optimization 2021-07-27 19:34:51 +02:00
Andrea Cavalli
b816e1f9e5 Use buffertimeoutpublisher 2021-07-27 01:31:18 +02:00
Andrea Cavalli
7abcdf05f9 Optimize performance of unscored queries 2021-07-27 00:32:30 +02:00
Andrea Cavalli
ea86bf7a43 Improve performance with UnscoredCollector 2021-07-26 19:21:17 +02:00
Andrea Cavalli
32b514c866 Add max open files option 2021-07-24 23:47:51 +02:00
Andrea Cavalli
1df38022fb Fix max open files with direct I/O 2021-07-23 22:43:24 +02:00
Andrea Cavalli
c5d353e02a Fix discard errors 2021-07-23 22:18:08 +02:00
Andrea Cavalli
abde1d1aab Fix getMulti 2021-07-23 15:20:33 +02:00
Andrea Cavalli
aa1aa7a6fb Test more numbers 2021-07-18 19:37:24 +02:00
Andrea Cavalli
ff9ee54857 Improve performance 2021-07-17 23:06:26 +02:00
Andrea Cavalli
43439c6f10 Optimize performance 2021-07-17 11:52:08 +02:00
Andrea Cavalli
e4bbeeca3a Fix messages query not releasing 2021-07-15 15:54:34 +02:00
Andrea Cavalli
547fa68fe7 use record getters in queries 2021-07-13 23:07:39 +02:00
Andrea Cavalli
2489c50022 Make buckets unmodifiable 2021-07-13 22:58:08 +02:00
Andrea Cavalli
fe5f50be10 Remove deprecated methods 2021-07-13 18:07:19 +02:00
Andrea Cavalli
61d4b00a02 Suppress warning 2021-07-11 00:39:48 +02:00
Andrea Cavalli
d5c42d531f Fix lexicographic order 2021-07-11 00:37:32 +02:00
Andrea Cavalli
58a9121978 Add heap kv database implementation 2021-07-10 20:52:01 +02:00
Andrea Cavalli
5f3c8a2515 Avoid calling reduce() multiple times 2021-07-08 18:54:53 +02:00
Andrea Cavalli
e2b5432b8d Fix npe 2021-07-08 17:04:53 +02:00
Andrea Cavalli
211a0b36cd Search unscored sorted queries using the non-scored shard searcher 2021-07-08 17:01:56 +02:00
Andrea Cavalli
c85dcfb54e Clean rocksdb code 2021-07-06 22:27:03 +02:00
Andrea Cavalli
2a47e6f3fd Add lucene options 2021-07-06 14:33:47 +02:00
Andrea Cavalli
e7e25e646d Fix scheduling 2021-07-06 02:23:06 +02:00
Andrea Cavalli
7cebcd7e92 Sort shards during merge 2021-07-06 01:52:12 +02:00
Andrea Cavalli
6c97b0f068 Bugfixes 2021-07-06 01:30:37 +02:00
Andrea Cavalli
b5ccf315be Implement adaptive multi searcher for shard indexes 2021-07-06 00:30:14 +02:00
Andrea Cavalli
545c7111de Bugfix 2021-07-05 18:55:11 +02:00
Andrea Cavalli
00ff36836e Improve reactive searchers performance 2021-07-05 15:43:19 +02:00
Andrea Cavalli
a5d4584a11 Adaptive reactive lucene search engine, lazy results 2021-07-05 12:05:45 +02:00
Andrea Cavalli
7929f0dc8c Fully reactive lucene queries 2021-07-04 01:34:17 +02:00
Andrea Cavalli
8a1e4028f7 Advanced lucene options 2021-07-01 21:19:52 +02:00
Andrea Cavalli
b80feabb97 Use NIOFSDirectory 2021-06-30 23:43:46 +02:00
Andrea Cavalli
b567f9f320 Copy map before writing to avoid errors 2021-06-30 10:58:49 +02:00
Andrea Cavalli
3758d06853 Configurable direct buffers 2021-06-29 23:31:02 +02:00
Andrea Cavalli
2df2c00e36 Fix unmodifiable read options 2021-06-27 16:52:45 +02:00
Andrea Cavalli
cb8dbf2fa2 Fix direct I/O parameters 2021-06-27 16:47:59 +02:00
Andrea Cavalli
c9e9cb8a01 Bugfix 2021-06-27 16:33:23 +02:00
Andrea Cavalli
e3536cfd01 Remove deprecation 2021-06-27 16:19:56 +02:00
Andrea Cavalli
c6d5beb33b Database options record 2021-06-27 15:40:56 +02:00
Andrea Cavalli
507101e453 Add verifyChecksum method 2021-06-27 15:06:48 +02:00
Andrea Cavalli
1d281d0305 Prevent reading corrupted database parts, reimplement badblocks 2021-06-27 11:58:12 +02:00
Andrea Cavalli
63cdb43644 Fix badblocks memory leak 2021-06-26 23:57:24 +02:00
Andrea Cavalli
bd8755c180 Implement "badblocks" method 2021-06-26 02:35:33 +02:00
Andrea Cavalli
ee05614115 Use Direct I/O when available 2021-06-25 23:47:53 +02:00
Andrea Cavalli
bd62b83d57 Bugfix 2021-06-25 20:25:57 +02:00
Andrea Cavalli
4640d0dfad Better implementation of snapshots in lucene shards 2021-06-25 20:07:19 +02:00
Andrea Cavalli
47f6081cde better parameters for performance 2021-06-25 20:06:58 +02:00
Andrea Cavalli
03d3afa317 Reimplement query serializer 2021-06-20 01:09:06 +02:00
Andrea Cavalli
924dbf6bf6 Add immutable read/write options 2021-06-19 21:55:20 +02:00
Andrea Cavalli
1bd1cb87de Fix compatibility 2021-06-19 16:26:54 +02:00
Andrea Cavalli
92bb13336d Bugfix 2021-06-19 13:27:58 +02:00
Andrea Cavalli
b1d48d36ff Bugfixes 2021-06-19 12:14:14 +02:00
Andrea Cavalli
6039241d2b Update common utils 2021-06-09 02:56:53 +02:00
Andrea Cavalli
dcd7add36f Add lucene delta import 2021-06-07 16:21:12 +02:00
Andrea Cavalli
adf3bef488 Fix bug with map access 2021-06-06 02:23:51 +02:00
Andrea Cavalli
187274071f Bugfix 2021-06-02 13:21:07 +02:00
Andrea Cavalli
f95a46b634 Add delta isModified 2021-06-01 17:08:37 +02:00
Andrea Cavalli
ccf07f4216 Change readahead size 2021-05-29 01:45:03 +02:00
Andrea Cavalli
6eb531e4f1 Add ICU 2021-05-28 16:04:59 +02:00
Andrea Cavalli
4e76073259 Update data-generator 2021-05-25 11:17:24 +02:00
Andrea Cavalli
a293b65b08 Update to lucene 9 2021-05-25 01:12:41 +02:00
Andrea Cavalli
6ccff7646b Update reactor 2021-05-22 14:46:54 +02:00
Andrea Cavalli
2d24436b93 Update to java 16 2021-05-21 00:19:40 +02:00
Andrea Cavalli
211d2fc99e Bugfixes 2021-05-19 22:51:55 +02:00
Andrea Cavalli
c9f64195e7 Performance tuning 2021-05-18 01:10:30 +02:00
Andrea Cavalli
f8377c3e63 Bugfix 2021-05-17 04:10:41 +02:00
Andrea Cavalli
d265abc4d7 Fix syntax 2021-05-15 16:37:09 +02:00
Andrea Cavalli
5ccc531ea6 Bugfix 2021-05-15 16:16:19 +02:00
Andrea Cavalli
8eedc27bba Allow multiple resubscriptions to the same flux 2021-05-12 21:41:47 +02:00
Andrea Cavalli
d29ac00c24 Bugfixes 2021-05-12 19:02:51 +02:00
Andrea Cavalli
f4242218da Handle multi-subscriber refcnt 2021-05-12 01:25:59 +02:00
Andrea Cavalli
2f404c477e Optimized performance and added useful utility classes 2021-05-11 21:59:05 +02:00
Andrea Cavalli
40a80fc54f Fix imports 2021-05-09 19:56:25 +02:00
Andrea Cavalli
1d42057f48 Fix missing import 2021-05-09 19:46:17 +02:00
Andrea Cavalli
3da2fd8979 Bugfixes 2021-05-08 03:09:00 +02:00
Andrea Cavalli
63282767a1 Switch from Gson to Moshi 2021-05-07 12:05:14 +02:00
Andrea Cavalli
a11ce4a646 Add missing methods 2021-05-05 17:31:21 +02:00
Andrea Cavalli
a4deeee6d5 Performance tuning 2021-05-05 15:16:32 +02:00
Andrea Cavalli
63beb1931e More customizable allocators 2021-05-05 00:07:18 +02:00
Andrea Cavalli
5b89be8ee0 Fix memory usage 2021-05-04 01:21:29 +02:00
Andrea Cavalli
f93cae96f3 Allow customized pools 2021-05-03 21:41:51 +02:00
Andrea Cavalli
1dcf5a1a9c Add netty statistics 2021-05-03 18:07:18 +02:00
Andrea Cavalli
bc12b22a4b Bugfix 2021-05-03 13:22:02 +02:00
Andrea Cavalli
bd5cd09b2e Reimplement composite buffers 2021-05-03 12:49:16 +02:00
Andrea Cavalli
91cc7b9291 Bugfix 2021-05-03 12:44:22 +02:00
Andrea Cavalli
7588cd3219 Bugfix 2021-05-03 12:29:15 +02:00
Andrea Cavalli
04df5f4a36 Bugfixes 2021-05-03 02:57:08 +02:00
Andrea Cavalli
4aa18fcd60 bugfixes 2021-05-03 02:45:29 +02:00
Andrea Cavalli
0d3157ec3c Bugfixes 2021-05-03 00:29:26 +02:00
Andrea Cavalli
0c26daba57 Bugfixes 2021-05-02 19:18:15 +02:00
Andrea Cavalli
2e6aceafe6 Converted everything to netty direct buffers 2021-04-30 19:15:04 +02:00
Andrea Cavalli
df84562bb9 Bugfixes and updated reactor 2021-04-15 00:00:42 +02:00
Andrea Cavalli
505de18ecb Fix returning a single result 2021-04-14 02:37:03 +02:00
Andrea Cavalli
c1a7e782f6 Bugfix 2021-04-13 03:07:44 +02:00
Andrea Cavalli
41ba665a54 Bugfixes 2021-04-12 17:53:29 +02:00
Andrea Cavalli
6753db7dbe Add hash maps and sets 2021-04-12 17:09:55 +02:00
Andrea Cavalli
eb0ac6fbb9 Fix all warnings 2021-04-03 19:09:06 +02:00
Andrea Cavalli
65c45756d7 More aggressive low memory mode 2021-04-03 02:22:17 +02:00
Andrea Cavalli
3f508352fc Prefer standard schedulers 2021-04-03 02:20:37 +02:00
Andrea Cavalli
a2bcc07825 Add CountedStream 2021-04-01 23:56:34 +02:00
Andrea Cavalli
20069e7e06 Update SimpleStreamSearcher.java 2021-04-01 22:58:05 +02:00
Andrea Cavalli
918ff71091 Implement offsets in lucene search 2021-04-01 19:48:25 +02:00
Andrea Cavalli
3e6573d955 Safer approach to total hits count in lucene results 2021-03-27 03:35:27 +01:00
Andrea Cavalli
7379a8d8ae Avoid deadlock 2021-03-24 00:02:47 +01:00
Andrea Cavalli
3e7ee104ff Speed optimizations 2021-03-22 20:02:19 +01:00
Andrea Cavalli
62b53c1399 Optimize 2021-03-21 13:06:54 +01:00
Andrea Cavalli
4394c74ad9 Bugfix 2021-03-20 12:41:11 +01:00
Andrea Cavalli
8075694e15 Quick fix 2021-03-19 20:55:38 +01:00
Andrea Cavalli
a80849f241 Parallel size 2021-03-18 19:53:32 +01:00
Andrea Cavalli
aaa203f7ad Add optimization 2021-03-18 16:19:41 +01:00
Andrea Cavalli
1dc14fe179 Allow missing fields 2021-03-18 13:12:40 +01:00
Andrea Cavalli
66bd00b352 Limit db threads to 6 max threads 2021-03-17 02:41:31 +01:00
Andrea Cavalli
9fc58eae2b Improve performance 2021-03-17 01:02:02 +01:00
Andrea Cavalli
fd4f8e77d6 Refactor iterators 2021-03-14 23:06:46 +01:00
Andrea Cavalli
63469c0f89 Fix sigsegv 2021-03-14 19:38:20 +01:00
Andrea Cavalli
1aed618ca5 Update rocksdb 2021-03-14 18:51:42 +01:00
Andrea Cavalli
05e8c87015 Fix iterations 2021-03-14 14:16:07 +01:00
Andrea Cavalli
3d5f987ffd Refactor iterations 2021-03-14 13:24:46 +01:00
Andrea Cavalli
08eb457235 Refactor iterations 2021-03-14 13:08:03 +01:00
Andrea Cavalli
5f3bf768ad Refactor iterations 2021-03-14 03:13:19 +01:00
Andrea Cavalli
32d1d76f69 Exclusive range 2021-03-13 19:01:36 +01:00
Andrea Cavalli
79ba4d8dd2 Bugfix 2021-03-11 15:47:19 +01:00
Andrea Cavalli
e72b2ca93c Update LuceneUtils 2021-03-11 14:45:45 +01:00
Andrea Cavalli
d4784f0434 Update SearchResultKeys.java 2021-03-11 13:01:25 +01:00
Andrea Cavalli
64ff189637 Bugfix in deep map 2021-03-11 02:22:59 +01:00
Andrea Cavalli
d05e6139a0 Bugfix in reactor-core 2021-03-09 00:45:32 +01:00
Andrea Cavalli
99f3686eab Fix deadlock 2021-03-06 17:28:33 +01:00
Andrea Cavalli
08434d475c Avoid multiple subscriptions to the same search query 2021-03-05 16:17:37 +01:00
Andrea Cavalli
2a8bec00d4 Describe errors 2021-03-04 22:01:50 +01:00
Andrea Cavalli
e3fcf7f74f Use better overflow strategy 2021-03-03 21:32:45 +01:00
Andrea Cavalli
b71f3dceed Bugfixes 2021-03-03 20:00:58 +01:00
Andrea Cavalli
a06d448182 Merge totalhitscount in merged streams 2021-03-03 17:29:14 +01:00
Andrea Cavalli
319abeaf30 Refactor lucene results 2021-03-03 15:03:25 +01:00
Andrea Cavalli
7f15a6e099 Optimize lucene schedulers 2021-03-03 10:57:45 +01:00
Andrea Cavalli
07ea61050f Cancellable iteration in lucene 2021-03-03 00:13:57 +01:00
Andrea Cavalli
d9e1d38390 Use correct schedulers for blocking operations 2021-03-02 12:01:03 +01:00
Andrea Cavalli
7a33d8d1d5 Update QueryParser 2021-03-02 02:23:34 +01:00
Andrea Cavalli
1fc6ab2e4a Generated serializable queries 2021-03-02 01:53:36 +01:00
Andrea Cavalli
89f20b449b Update Local Lucene Index 2021-03-01 00:29:59 +01:00
Andrea Cavalli
36a0812237 Sort by score option, bugfixes 2021-02-28 16:50:59 +01:00
Andrea Cavalli
0ee1193632 Disable scoring option in morelikethis 2021-02-28 16:11:50 +01:00
Andrea Cavalli
96a908b833 Enhance morelikethis 2021-02-28 14:52:11 +01:00
Andrea Cavalli
a20dadfb39 Add low memory scheduler in lucene 2021-02-28 10:57:16 +01:00
Andrea Cavalli
8926916f67 Update LocalKeyValueDatabase 2021-02-28 10:21:37 +01:00
Andrea Cavalli
9a4e0d53d3 Add wildcardQuery, optimize parallel queries 2021-02-28 00:29:56 +01:00
Andrea Cavalli
050d77d359 Clean search code 2021-02-27 19:05:13 +01:00
Andrea Cavalli
3c715affcf Allow additional query alongside morelikethis 2021-02-27 17:32:57 +01:00
Andrea Cavalli
2d565c8d17 Add nonblocking method to flux iterable 2021-02-26 23:30:11 +01:00
Andrea Cavalli
9140c7f3d6 Bugfix 2021-02-26 21:21:02 +01:00
Andrea Cavalli
6095f9eba9 Update LLLocalDictionary 2021-02-26 19:14:45 +01:00
Andrea Cavalli
a4340cdd2b Update BlockingFluxIterable 2021-02-26 19:14:33 +01:00
Andrea Cavalli
e854b4252c Update BoundedGroupedRocksFluxIterable 2021-02-26 16:24:03 +01:00
Andrea Cavalli
4e2030dab8 Update BoundedRocksFluxIterable.java 2021-02-26 15:25:01 +01:00
Andrea Cavalli
64b9010e50 Implement backpressure during iteration 2021-02-26 14:06:16 +01:00
Andrea Cavalli
cbcc4df690 Update LLLocalLuceneIndex.java 2021-02-25 00:00:16 +01:00
Andrea Cavalli
c3be27c15b Fix limits 2021-02-24 23:16:56 +01:00
Andrea Cavalli
385e29aee5 Update LLLocalMultiLuceneIndex.java 2021-02-24 18:39:46 +01:00
Andrea Cavalli
c3221a2f46 Update LLLocalLuceneIndex.java 2021-02-24 17:03:42 +01:00
Andrea Cavalli
3366c52b24 Better define count method 2021-02-24 16:43:07 +01:00
Andrea Cavalli
af47584803 Bugfixes 2021-02-22 01:54:25 +01:00
Andrea Cavalli
575bde94f0 Convert limit to long, add new query type. 2021-02-22 01:37:17 +01:00
Andrea Cavalli
5d5d506421 Wrap slf4j implementation 2021-02-20 21:35:09 +01:00
Andrea Cavalli
7654412d20 Bugfix 2021-02-17 15:03:51 +01:00
Andrea Cavalli
01b8b704d0 Bugfix 2021-02-17 13:59:35 +01:00
Andrea Cavalli
c36824699a Bugfix 2021-02-16 23:15:56 +01:00
Andrea Cavalli
787092c6f9 Update LLLocalDictionary.java 2021-02-15 00:15:42 +01:00
Andrea Cavalli
db76fe8c71 Code cleanup 2021-02-14 19:38:01 +01:00
Andrea Cavalli
bb3afd291e Add minCompetitiveScore 2021-02-14 13:46:11 +01:00
Andrea Cavalli
b3e3f2aca4 Keep score order 2021-02-14 03:25:15 +01:00
Andrea Cavalli
ee72401487 Add more examples 2021-02-13 02:16:24 +01:00
Andrea Cavalli
2d82a1c9a5 Add Option to disable update locks 2021-02-13 01:31:24 +01:00
Andrea Cavalli
3f78e5fec9 Update LLLocalDictionary.java 2021-02-13 00:45:16 +01:00
Andrea Cavalli
c796459e1c Use stamped locks 2021-02-13 00:18:57 +01:00
Andrea Cavalli
9df1bda11d Support better queries 2021-02-12 21:55:10 +01:00
Andrea Cavalli
3e36bfe732 Update LuceneIndex.java and SearchResultItem.java 2021-02-12 21:12:10 +01:00
Andrea Cavalli
258e7f7d7c Fixed text query builder 2021-02-12 19:39:02 +01:00
Andrea Cavalli
9111743bd3 Schedule singleton values on correct scheduler 2021-02-11 22:27:43 +01:00
Andrea Cavalli
b4e25c8573 Add logging 2021-02-11 10:43:03 +01:00
Andrea Cavalli
e5081a62cd Bugfixes 2021-02-11 01:09:15 +01:00
Andrea Cavalli
46bd61e817 Return true if update() data changed 2021-02-09 14:14:38 +01:00
Andrea Cavalli
871159641c Update SnapshotException.java 2021-02-07 02:12:43 +01:00
Andrea Cavalli
370197c6e1 Add update method 2021-02-06 19:21:31 +01:00
Andrea Cavalli
2c8bb8a480 Update lucene 2021-02-06 15:53:10 +01:00
Andrea Cavalli
14c2464577 Bugfixes 2021-02-05 20:34:58 +01:00
Andrea Cavalli
527f8afea5 Update CodecsExample.java, Codecs.java, and 2 more files... 2021-02-05 00:13:53 +01:00
Andrea Cavalli
151884b772 Global scores between multiple lucene shards 2021-02-04 22:42:57 +01:00
Andrea Cavalli
059da90ef4 Add sets 2021-02-04 00:48:49 +01:00
Andrea Cavalli
d86c92cb61 Add indicizer 2021-02-03 20:13:17 +01:00
Andrea Cavalli
db5c444b92 Fix all warnings 2021-02-03 14:37:02 +01:00
Andrea Cavalli
09ec134b51 Rewrite README 2021-02-03 14:08:32 +01:00
Andrea Cavalli
5c98465637 Working indicization 2021-02-03 13:48:30 +01:00
Andrea Cavalli
82accc2405 Add codecs 2021-02-02 19:40:37 +01:00
Andrea Cavalli
ae5cda2f70 Update Example.java, SubStageGetterMap.java, and SubStageGetterMapDeep.java 2021-02-02 18:42:18 +01:00
Andrea Cavalli
d9187b70a9 Update pom.xml, Example.java, and 9 more files... 2021-02-02 15:36:11 +01:00
Andrea Cavalli
dbca36b3aa Update Example.java, LLDictionary.java, and 6 more files... 2021-02-02 00:09:46 +01:00
Andrea Cavalli
023bc3b0dd Update Example.java, DatabaseMapDictionary.java, and 9 more files... 2021-02-01 12:19:17 +01:00
Andrea Cavalli
ffc7e3c35a Update DatabaseMapDictionary.java, DatabaseMapDictionaryDeep.java, and 7 more files... 2021-02-01 11:00:27 +01:00