Andrea Cavalli
33e4cb2f14
Add ensureOpen method to avoid writing to the index when closing
2021-10-07 00:53:38 +02:00
Andrea Cavalli
818bd20ed9
Update netty
2021-10-01 19:17:33 +02:00
Andrea Cavalli
9646ddcb28
Use method references
2021-09-30 18:25:36 +02:00
Andrea Cavalli
5d2ba797eb
Cleanup code
2021-09-30 00:25:09 +02:00
Andrea Cavalli
9a6f195b63
Cleanup utils
2021-09-30 00:23:41 +02:00
Andrea Cavalli
dc14192dca
Reimplement MultiMoreLikeThis using BigCompositeReader
2021-09-29 13:18:06 +02:00
Andrea Cavalli
6b8c1025d1
Fix ClassCastException
2021-09-29 11:47:17 +02:00
Andrea Cavalli
74d20204ab
Avoid using BufferTimeoutPublisher (it kills lucene Async IO)
2021-09-29 11:38:53 +02:00
Andrea Cavalli
2fb96eaf03
Ensure running in a blocking thread
2021-09-29 11:38:36 +02:00
Andrea Cavalli
74f2cce604
Throw error only when needed
2021-09-26 15:10:42 +02:00
Andrea Cavalli
5d7b403e55
Move reactive collector
2021-09-25 18:31:41 +02:00
Andrea Cavalli
f03f7296d4
Separate LeafCollector
2021-09-25 14:09:10 +02:00
Andrea Cavalli
5443e330bb
Optimistic emission of results
2021-09-25 13:26:59 +02:00
Andrea Cavalli
8e15020f5b
Improve performance of infinite queries
2021-09-25 13:07:52 +02:00
Andrea Cavalli
d06c9184bd
Bugfix
2021-09-25 13:07:40 +02:00
Andrea Cavalli
d96b5a168b
Execute searches on its own executor
2021-09-25 13:06:24 +02:00
Andrea Cavalli
3742eedd7f
Release dropped resource
2021-09-24 04:01:28 +02:00
Andrea Cavalli
996165c3cc
Do not release cached searcher
2021-09-24 02:47:52 +02:00
Andrea Cavalli
23fa46c775
Release cached searcher
2021-09-24 02:44:12 +02:00
Andrea Cavalli
20c19f662b
Avoid multiple drops
2021-09-24 02:01:45 +02:00
Andrea Cavalli
be1ca997a7
Bugfix
2021-09-23 23:45:41 +02:00
Andrea Cavalli
1a73a5a33f
Bugfixes
2021-09-23 22:04:01 +02:00
Andrea Cavalli
3a544d4297
Partial migration to ResourceSupport
2021-09-23 20:57:28 +02:00
Andrea Cavalli
247207febe
Temporary
2021-09-23 15:48:27 +02:00
Andrea Cavalli
51ec85abe1
Improve logging
2021-09-23 15:37:13 +02:00
Andrea Cavalli
6c849fae78
Change makeInaccessible visibility
2021-09-23 15:34:56 +02:00
Andrea Cavalli
d4c977047c
Allow sorted/scored counting
2021-09-23 14:50:15 +02:00
Andrea Cavalli
b77b441515
Fix all errors
2021-09-23 11:30:44 +02:00
Andrea Cavalli
552b5f78ce
Fix size check assertion
2021-09-23 02:22:30 +02:00
Andrea Cavalli
29086b1939
Add some tests for low level dictionary, log tests, pass more tests
2021-09-23 02:15:58 +02:00
Andrea Cavalli
e034f3b778
Support memory segments
2021-09-22 18:33:28 +02:00
Andrea Cavalli
8b73a05177
Bugfixes and upgraded to java 17
2021-09-22 11:03:39 +02:00
Andrea Cavalli
0fee105f0b
Bugfixes
2021-09-21 02:01:02 +02:00
Andrea Cavalli
bd97704a0b
Better page limits
2021-09-20 18:20:59 +02:00
Andrea Cavalli
b8adbf452e
Add resources flux
2021-09-20 16:22:39 +02:00
Andrea Cavalli
3c5edbc06e
Finished initial refactoring
2021-09-20 12:51:27 +02:00
Andrea Cavalli
4a883ca8ea
Done implementing Local and LocalMulti lucene indices
2021-09-20 11:52:21 +02:00
Andrea Cavalli
ca37d1fb68
Rewrite lucene transformers and implement MoreLikeThis sharding
2021-09-20 11:35:01 +02:00
Andrea Cavalli
5cfb5f49cd
Add custom MoreLikeThis with sharding support
2021-09-20 00:22:22 +02:00
Andrea Cavalli
65db1711b5
Missing: moreLikeThis
2021-09-19 19:59:37 +02:00
Andrea Cavalli
31422847c2
Add SimpleUnsortedUnscoredLuceneMultiSearcher
2021-09-19 12:35:48 +02:00
Andrea Cavalli
d1963a1d65
Finish refactoring SimpleLuceneLocalSearcher
2021-09-19 12:01:11 +02:00
Andrea Cavalli
8bc0284f27
First safe search commit
2021-09-18 18:34:21 +02:00
Andrea Cavalli
26e9c4bbee
Fix package
2021-09-17 20:37:26 +02:00
Andrea Cavalli
6782abb66d
Use Net5
2021-09-17 16:56:28 +02:00
Andrea Cavalli
32300d63ac
Fix ci mode
2021-09-10 13:42:02 +02:00
Andrea Cavalli
c467d5f2ba
Add ci mode
2021-09-10 13:34:26 +02:00
Andrea Cavalli
7feeb4a9ce
Use markers
2021-09-10 12:13:52 +02:00
Andrea Cavalli
0a378bc0f1
Fix negative value
2021-09-10 12:13:46 +02:00
Andrea Cavalli
9e09574517
Don't parallelize here
2021-09-10 01:13:39 +02:00
Andrea Cavalli
36dde3bb5a
Set concurrency to 3
2021-09-10 00:05:39 +02:00
Andrea Cavalli
c47f45076a
Optimization
2021-09-09 23:27:39 +02:00
Andrea Cavalli
f157e67818
Various searchers optimizations
2021-09-09 23:00:16 +02:00
Andrea Cavalli
6dda099cc1
Fix registration of global allocator
2021-09-09 16:18:47 +02:00
Andrea Cavalli
d9fd4113e0
Fix refactoring
2021-09-09 15:34:31 +02:00
Andrea Cavalli
9c167a322a
Extend metric utils
2021-09-09 15:30:28 +02:00
Andrea Cavalli
2fd311f67a
Support allocator metrics
2021-09-09 15:21:20 +02:00
Andrea Cavalli
48ba4d15de
Bugfix
2021-09-09 12:31:49 +02:00
Andrea Cavalli
cb5a5e36f2
Fix timeout subscription
2021-09-09 11:43:37 +02:00
Andrea Cavalli
48db79359b
Use boundedelastic db scheduler
2021-09-08 23:51:05 +02:00
Andrea Cavalli
5293fbe22c
Close leaked data
2021-09-08 23:41:18 +02:00
Andrea Cavalli
3a79e5ba6f
Undo parallelization of lucene searches
2021-09-08 23:41:05 +02:00
Andrea Cavalli
6926292904
Avoid nesting schedulers inside generators
2021-09-08 22:32:08 +02:00
Andrea Cavalli
2b21e6a864
Use blocking generator instead of Flux.create
2021-09-08 22:16:06 +02:00
Andrea Cavalli
e12e240487
Subscribe on the same thread
2021-09-08 21:35:04 +02:00
Andrea Cavalli
09c7e4f730
Performance bugfix
2021-09-08 21:34:52 +02:00
Andrea Cavalli
047a471bf7
Fix last leaks
2021-09-08 00:22:39 +02:00
Andrea Cavalli
46787fa353
Fix untested testing function
...
A test function was not tested, causing the uneffectiveness of some tests that were passing when they should have not.
New tests to test the test function have been written, making sure to avoid false negatives.
Add editorconfig, add documentation of MetricUtils
2021-09-07 19:44:23 +02:00
Andrea Cavalli
57a0206cf1
Fully implement memory dictionary
2021-09-07 19:32:37 +02:00
Andrea Cavalli
a662033228
Less verbose exception
2021-09-07 11:39:13 +02:00
Andrea Cavalli
dd1ed1d18f
Suppress warning
2021-09-07 11:29:28 +02:00
Andrea Cavalli
d4ed99cc24
Fix compilation issue
2021-09-07 11:28:03 +02:00
Andrea Cavalli
717d13ef1f
Revert commit 1882e8b300
2021-09-07 11:26:10 +02:00
Andrea Cavalli
66fa853272
Avoid memory leaks
2021-09-07 02:36:11 +02:00
Andrea Cavalli
f5d3474966
Fix possible deadlock
2021-09-07 02:08:29 +02:00
Andrea Cavalli
936c07406e
Implement more phasers
2021-09-06 18:52:21 +02:00
Andrea Cavalli
51b60168f7
Implement phaser
2021-09-06 18:29:10 +02:00
Andrea Cavalli
d05994c8ff
Rename manager
2021-09-06 18:24:36 +02:00
Andrea Cavalli
5a79d2d7cb
Close the CachedIndexSearcher automatically
2021-09-06 18:23:47 +02:00
Andrea Cavalli
7230e96343
Bugfix
2021-09-06 17:42:12 +02:00
Andrea Cavalli
e59705bd0b
Better manage cached index searchers
2021-09-06 17:35:02 +02:00
Andrea Cavalli
b7d975ccfb
MultiGet window set to 16 to avoid memory problems
2021-09-06 15:54:44 +02:00
Andrea Cavalli
16bd3b263b
Limit cached indexwriters
2021-09-06 15:08:07 +02:00
Andrea Cavalli
d5964a7bed
Pool searchers
2021-09-06 15:06:51 +02:00
Andrea Cavalli
6c73c1e86d
Add memory tests
...
needs fix
2021-09-06 01:15:13 +02:00
Andrea Cavalli
4c348a6b2f
Throw exception if running in a nonblocking scope
2021-09-05 14:23:46 +02:00
Andrea Cavalli
1882e8b300
Optimize performance by removing all superfluous subscribeOn calls
2021-09-04 16:42:47 +02:00
Andrea Cavalli
2fe8063193
Fix composite buffers
2021-09-04 02:35:12 +02:00
Andrea Cavalli
f5f46edbec
Use netty5 package
2021-09-04 02:19:10 +02:00
Andrea Cavalli
154086dee2
Fix compilation issues and buffer expansions
2021-09-03 16:11:14 +02:00
Andrea Cavalli
47de651c94
Bugfixes
2021-09-03 02:22:55 +02:00
Andrea Cavalli
a8028024c8
Finish refactoring
2021-09-02 21:14:26 +02:00
Andrea Cavalli
3091b81d34
Fix map tests
2021-09-02 17:15:40 +02:00
Andrea Cavalli
ff7823656e
y
2021-09-01 00:01:56 +02:00
Andrea Cavalli
013d26387d
(unfinished) Netty 5 refactoring
2021-08-31 15:50:11 +02:00
Andrea Cavalli
0faef5316e
(unfinished) Netty 5 refactoring
2021-08-31 09:14:46 +02:00
Andrea Cavalli
3b55e8bd24
(unfinished) Netty 5 refactoring
2021-08-29 23:18:03 +02:00
Andrea Cavalli
9984cfff73
Bugfixes
2021-08-29 01:15:51 +02:00
Andrea Cavalli
8adc8b77b4
Bugfixes
2021-08-28 22:51:05 +02:00
Andrea Cavalli
03b5876001
Bugfixes
2021-08-28 22:42:51 +02:00
Andrea Cavalli
0c17af2ae5
Bugfixes
2021-08-27 02:49:51 +02:00
Andrea Cavalli
6fe9f9c24f
Fix hanging on ScoredSimpleLuceneShardSearcher
2021-08-25 10:23:42 +02:00
Andrea Cavalli
6e31aa01f9
Ignore release errors for empty searchers
2021-08-24 14:13:43 +02:00
Andrea Cavalli
2207ae4314
Fix class names
2021-08-24 11:55:33 +02:00
Andrea Cavalli
a0eb80b130
Protect against memory leaks with dropped search results
2021-08-24 11:53:19 +02:00
Andrea Cavalli
a909aaaf52
LLKeyScore is now a regular record
2021-08-24 11:06:25 +02:00
Andrea Cavalli
c5552d2827
Bugfixes
2021-08-22 23:50:50 +02:00
Andrea Cavalli
2a24570512
Add checked serialization exception
2021-08-22 21:23:22 +02:00
Andrea Cavalli
4e71e42d32
Code cleanup
2021-08-22 19:54:23 +02:00
Andrea Cavalli
906379923f
Lazy retain generated suffixes
2021-08-22 19:52:19 +02:00
bc759c344d
Use a new approach to completely avoid memory leaks
2021-08-22 18:20:05 +02:00
6ed31ab2a6
Code cleanup
2021-08-16 10:36:54 +02:00
435e7d4886
Use a new approach to completely avoid memory leaks
2021-08-16 10:27:47 +02:00
Andrea Cavalli
9d326f5a8b
Human readable representation of total hits count
2021-08-04 01:16:17 +02:00
Andrea Cavalli
9734d78839
Total hits with precision
2021-08-04 01:12:39 +02:00
Andrea Cavalli
bcd99f4727
Avoid errors
2021-08-04 00:44:06 +02:00
Andrea Cavalli
328a45f40d
Fix unscored-unsorted collectors
2021-07-31 23:12:13 +02:00
Andrea Cavalli
586be8751c
Fix compilation issue
2021-07-31 19:18:20 +02:00
Andrea Cavalli
d411675c2b
Use flatMapIterable when possible
2021-07-31 18:00:53 +02:00
Andrea Cavalli
7597e54bac
Remove unnecessary schedulers
2021-07-31 12:28:53 +02:00
Andrea Cavalli
4e782403f5
Fix results ordering
2021-07-30 14:01:12 +02:00
Andrea Cavalli
db54773cda
remove warning
2021-07-28 22:18:33 +02:00
Andrea Cavalli
e738eda331
Performance optimization
2021-07-27 19:34:51 +02:00
Andrea Cavalli
b816e1f9e5
Use buffertimeoutpublisher
2021-07-27 01:31:18 +02:00
Andrea Cavalli
7abcdf05f9
Optimize performance of unscored queries
2021-07-27 00:32:30 +02:00
Andrea Cavalli
ea86bf7a43
Improve performance with UnscoredCollector
2021-07-26 19:21:17 +02:00
Andrea Cavalli
32b514c866
Add max open files option
2021-07-24 23:47:51 +02:00
Andrea Cavalli
1df38022fb
Fix max open files with direct I/O
2021-07-23 22:43:24 +02:00
Andrea Cavalli
c5d353e02a
Fix discard errors
2021-07-23 22:18:08 +02:00
Andrea Cavalli
abde1d1aab
Fix getMulti
2021-07-23 15:20:33 +02:00
Andrea Cavalli
aa1aa7a6fb
Test more numbers
2021-07-18 19:37:24 +02:00
Andrea Cavalli
ff9ee54857
Improve performance
2021-07-17 23:06:26 +02:00
Andrea Cavalli
43439c6f10
Optimize performance
2021-07-17 11:52:08 +02:00
Andrea Cavalli
e4bbeeca3a
Fix messages query not releasing
2021-07-15 15:54:34 +02:00
Andrea Cavalli
547fa68fe7
use record getters in queries
2021-07-13 23:07:39 +02:00
Andrea Cavalli
2489c50022
Make buckets unmodifiable
2021-07-13 22:58:08 +02:00
Andrea Cavalli
fe5f50be10
Remove deprecated methods
2021-07-13 18:07:19 +02:00
Andrea Cavalli
61d4b00a02
Suppress warning
2021-07-11 00:39:48 +02:00
Andrea Cavalli
d5c42d531f
Fix lexicographic order
2021-07-11 00:37:32 +02:00
Andrea Cavalli
58a9121978
Add heap kv database implementation
2021-07-10 20:52:01 +02:00
Andrea Cavalli
5f3c8a2515
Avoid calling reduce() multiple times
2021-07-08 18:54:53 +02:00
Andrea Cavalli
e2b5432b8d
Fix npe
2021-07-08 17:04:53 +02:00
Andrea Cavalli
211a0b36cd
Search unscored sorted queries using the non-scored shard searcher
2021-07-08 17:01:56 +02:00
Andrea Cavalli
c85dcfb54e
Clean rocksdb code
2021-07-06 22:27:03 +02:00
Andrea Cavalli
2a47e6f3fd
Add lucene options
2021-07-06 14:33:47 +02:00
Andrea Cavalli
e7e25e646d
Fix scheduling
2021-07-06 02:23:06 +02:00
Andrea Cavalli
7cebcd7e92
Sort shards during merge
2021-07-06 01:52:12 +02:00
Andrea Cavalli
6c97b0f068
Bugfixes
2021-07-06 01:30:37 +02:00
Andrea Cavalli
b5ccf315be
Implement adaptive multi searcher for shard indexes
2021-07-06 00:30:14 +02:00
Andrea Cavalli
545c7111de
Bugfix
2021-07-05 18:55:11 +02:00
Andrea Cavalli
00ff36836e
Improve reactive searchers performance
2021-07-05 15:43:19 +02:00
Andrea Cavalli
a5d4584a11
Adaptive reactive lucene search engine, lazy results
2021-07-05 12:05:45 +02:00
Andrea Cavalli
7929f0dc8c
Fully reactive lucene queries
2021-07-04 01:34:17 +02:00
Andrea Cavalli
8a1e4028f7
Advanced lucene options
2021-07-01 21:19:52 +02:00
Andrea Cavalli
b80feabb97
Use NIOFSDirectory
2021-06-30 23:43:46 +02:00
Andrea Cavalli
b567f9f320
Copy map before writing to avoid errors
2021-06-30 10:58:49 +02:00
Andrea Cavalli
3758d06853
Configurable direct buffers
2021-06-29 23:31:02 +02:00
Andrea Cavalli
2df2c00e36
Fix unmodifiable read options
2021-06-27 16:52:45 +02:00
Andrea Cavalli
cb8dbf2fa2
Fix direct I/O parameters
2021-06-27 16:47:59 +02:00
Andrea Cavalli
c9e9cb8a01
Bugfix
2021-06-27 16:33:23 +02:00
Andrea Cavalli
e3536cfd01
Remove deprecation
2021-06-27 16:19:56 +02:00
Andrea Cavalli
c6d5beb33b
Database options record
2021-06-27 15:40:56 +02:00
Andrea Cavalli
507101e453
Add verifyChecksum method
2021-06-27 15:06:48 +02:00
Andrea Cavalli
1d281d0305
Prevent reading corrupted database parts, reimplement badblocks
2021-06-27 11:58:12 +02:00
Andrea Cavalli
63cdb43644
Fix badblocks memory leak
2021-06-26 23:57:24 +02:00
Andrea Cavalli
bd8755c180
Implement "badblocks" method
2021-06-26 02:35:33 +02:00
Andrea Cavalli
ee05614115
Use Direct I/O when available
2021-06-25 23:47:53 +02:00
Andrea Cavalli
bd62b83d57
Bugfix
2021-06-25 20:25:57 +02:00
Andrea Cavalli
4640d0dfad
Better implementation of snapshots in lucene shards
2021-06-25 20:07:19 +02:00
Andrea Cavalli
47f6081cde
better parameters for performance
2021-06-25 20:06:58 +02:00
Andrea Cavalli
03d3afa317
Reimplement query serializer
2021-06-20 01:09:06 +02:00
Andrea Cavalli
924dbf6bf6
Add immutable read/write options
2021-06-19 21:55:20 +02:00
Andrea Cavalli
1bd1cb87de
Fix compatibility
2021-06-19 16:26:54 +02:00
Andrea Cavalli
92bb13336d
Bugfix
2021-06-19 13:27:58 +02:00
Andrea Cavalli
b1d48d36ff
Bugfixes
2021-06-19 12:14:14 +02:00
Andrea Cavalli
6039241d2b
Update common utils
2021-06-09 02:56:53 +02:00
Andrea Cavalli
dcd7add36f
Add lucene delta import
2021-06-07 16:21:12 +02:00
Andrea Cavalli
adf3bef488
Fix bug with map access
2021-06-06 02:23:51 +02:00
Andrea Cavalli
187274071f
Bugfix
2021-06-02 13:21:07 +02:00
Andrea Cavalli
f95a46b634
Add delta isModified
2021-06-01 17:08:37 +02:00
Andrea Cavalli
ccf07f4216
Change readahead size
2021-05-29 01:45:03 +02:00
Andrea Cavalli
6eb531e4f1
Add ICU
2021-05-28 16:04:59 +02:00
Andrea Cavalli
4e76073259
Update data-generator
2021-05-25 11:17:24 +02:00
Andrea Cavalli
a293b65b08
Update to lucene 9
2021-05-25 01:12:41 +02:00
Andrea Cavalli
6ccff7646b
Update reactor
2021-05-22 14:46:54 +02:00
Andrea Cavalli
2d24436b93
Update to java 16
2021-05-21 00:19:40 +02:00
Andrea Cavalli
211d2fc99e
Bugfixes
2021-05-19 22:51:55 +02:00
Andrea Cavalli
c9f64195e7
Performance tuning
2021-05-18 01:10:30 +02:00
Andrea Cavalli
f8377c3e63
Bugfix
2021-05-17 04:10:41 +02:00
Andrea Cavalli
d265abc4d7
Fix syntax
2021-05-15 16:37:09 +02:00
Andrea Cavalli
5ccc531ea6
Bugfix
2021-05-15 16:16:19 +02:00
Andrea Cavalli
8eedc27bba
Allow multiple resubscriptions to the same flux
2021-05-12 21:41:47 +02:00
Andrea Cavalli
d29ac00c24
Bugfixes
2021-05-12 19:02:51 +02:00
Andrea Cavalli
f4242218da
Handle multi-subscriber refcnt
2021-05-12 01:25:59 +02:00
Andrea Cavalli
2f404c477e
Optimized performance and added useful utility classes
2021-05-11 21:59:05 +02:00
Andrea Cavalli
40a80fc54f
Fix imports
2021-05-09 19:56:25 +02:00
Andrea Cavalli
1d42057f48
Fix missing import
2021-05-09 19:46:17 +02:00
Andrea Cavalli
3da2fd8979
Bugfixes
2021-05-08 03:09:00 +02:00
Andrea Cavalli
63282767a1
Switch from Gson to Moshi
2021-05-07 12:05:14 +02:00
Andrea Cavalli
a11ce4a646
Add missing methods
2021-05-05 17:31:21 +02:00
Andrea Cavalli
a4deeee6d5
Performance tuning
2021-05-05 15:16:32 +02:00
Andrea Cavalli
63beb1931e
More customizable allocators
2021-05-05 00:07:18 +02:00
Andrea Cavalli
5b89be8ee0
Fix memory usage
2021-05-04 01:21:29 +02:00
Andrea Cavalli
f93cae96f3
Allow customized pools
2021-05-03 21:41:51 +02:00
Andrea Cavalli
1dcf5a1a9c
Add netty statistics
2021-05-03 18:07:18 +02:00
Andrea Cavalli
bc12b22a4b
Bugfix
2021-05-03 13:22:02 +02:00
Andrea Cavalli
bd5cd09b2e
Reimplement composite buffers
2021-05-03 12:49:16 +02:00
Andrea Cavalli
91cc7b9291
Bugfix
2021-05-03 12:44:22 +02:00
Andrea Cavalli
7588cd3219
Bugfix
2021-05-03 12:29:15 +02:00
Andrea Cavalli
04df5f4a36
Bugfixes
2021-05-03 02:57:08 +02:00
Andrea Cavalli
4aa18fcd60
bugfixes
2021-05-03 02:45:29 +02:00
Andrea Cavalli
0d3157ec3c
Bugfixes
2021-05-03 00:29:26 +02:00
Andrea Cavalli
0c26daba57
Bugfixes
2021-05-02 19:18:15 +02:00
Andrea Cavalli
2e6aceafe6
Converted everything to netty direct buffers
2021-04-30 19:15:04 +02:00
Andrea Cavalli
df84562bb9
Bugfixes and updated reactor
2021-04-15 00:00:42 +02:00
Andrea Cavalli
505de18ecb
Fix returning a single result
2021-04-14 02:37:03 +02:00
Andrea Cavalli
c1a7e782f6
Bugfix
2021-04-13 03:07:44 +02:00
Andrea Cavalli
41ba665a54
Bugfixes
2021-04-12 17:53:29 +02:00
Andrea Cavalli
6753db7dbe
Add hash maps and sets
2021-04-12 17:09:55 +02:00
Andrea Cavalli
eb0ac6fbb9
Fix all warnings
2021-04-03 19:09:06 +02:00
Andrea Cavalli
65c45756d7
More aggressive low memory mode
2021-04-03 02:22:17 +02:00
Andrea Cavalli
3f508352fc
Prefer standard schedulers
2021-04-03 02:20:37 +02:00
Andrea Cavalli
a2bcc07825
Add CountedStream
2021-04-01 23:56:34 +02:00
Andrea Cavalli
20069e7e06
Update SimpleStreamSearcher.java
2021-04-01 22:58:05 +02:00
Andrea Cavalli
918ff71091
Implement offsets in lucene search
2021-04-01 19:48:25 +02:00
Andrea Cavalli
3e6573d955
Safer approach to total hits count in lucene results
2021-03-27 03:35:27 +01:00
Andrea Cavalli
7379a8d8ae
Avoid deadlock
2021-03-24 00:02:47 +01:00
Andrea Cavalli
3e7ee104ff
Speed optimizations
2021-03-22 20:02:19 +01:00
Andrea Cavalli
62b53c1399
Optimize
2021-03-21 13:06:54 +01:00
Andrea Cavalli
4394c74ad9
Bugfix
2021-03-20 12:41:11 +01:00
Andrea Cavalli
8075694e15
Quick fix
2021-03-19 20:55:38 +01:00
Andrea Cavalli
a80849f241
Parallel size
2021-03-18 19:53:32 +01:00
Andrea Cavalli
aaa203f7ad
Add optimization
2021-03-18 16:19:41 +01:00
Andrea Cavalli
1dc14fe179
Allow missing fields
2021-03-18 13:12:40 +01:00
Andrea Cavalli
66bd00b352
Limit db threads to 6 max threads
2021-03-17 02:41:31 +01:00
Andrea Cavalli
9fc58eae2b
Improve performance
2021-03-17 01:02:02 +01:00
Andrea Cavalli
fd4f8e77d6
Refactor iterators
2021-03-14 23:06:46 +01:00
Andrea Cavalli
63469c0f89
Fix sigsegv
2021-03-14 19:38:20 +01:00
Andrea Cavalli
1aed618ca5
Update rocksdb
2021-03-14 18:51:42 +01:00
Andrea Cavalli
05e8c87015
Fix iterations
2021-03-14 14:16:07 +01:00
Andrea Cavalli
3d5f987ffd
Refactor iterations
2021-03-14 13:24:46 +01:00
Andrea Cavalli
08eb457235
Refactor iterations
2021-03-14 13:08:03 +01:00
Andrea Cavalli
5f3bf768ad
Refactor iterations
2021-03-14 03:13:19 +01:00
Andrea Cavalli
32d1d76f69
Exclusive range
2021-03-13 19:01:36 +01:00
Andrea Cavalli
79ba4d8dd2
Bugfix
2021-03-11 15:47:19 +01:00
Andrea Cavalli
e72b2ca93c
Update LuceneUtils
2021-03-11 14:45:45 +01:00
Andrea Cavalli
d4784f0434
Update SearchResultKeys.java
2021-03-11 13:01:25 +01:00
Andrea Cavalli
64ff189637
Bugfix in deep map
2021-03-11 02:22:59 +01:00
Andrea Cavalli
d05e6139a0
Bugfix in reactor-core
2021-03-09 00:45:32 +01:00
Andrea Cavalli
99f3686eab
Fix deadlock
2021-03-06 17:28:33 +01:00
Andrea Cavalli
08434d475c
Avoid multiple subscriptions to the same search query
2021-03-05 16:17:37 +01:00
Andrea Cavalli
2a8bec00d4
Describe errors
2021-03-04 22:01:50 +01:00
Andrea Cavalli
e3fcf7f74f
Use better overflow strategy
2021-03-03 21:32:45 +01:00
Andrea Cavalli
b71f3dceed
Bugfixes
2021-03-03 20:00:58 +01:00
Andrea Cavalli
a06d448182
Merge totalhitscount in merged streams
2021-03-03 17:29:14 +01:00
Andrea Cavalli
319abeaf30
Refactor lucene results
2021-03-03 15:03:25 +01:00
Andrea Cavalli
7f15a6e099
Optimize lucene schedulers
2021-03-03 10:57:45 +01:00
Andrea Cavalli
07ea61050f
Cancellable iteration in lucene
2021-03-03 00:13:57 +01:00
Andrea Cavalli
d9e1d38390
Use correct schedulers for blocking operations
2021-03-02 12:01:03 +01:00
Andrea Cavalli
7a33d8d1d5
Update QueryParser
2021-03-02 02:23:34 +01:00
Andrea Cavalli
1fc6ab2e4a
Generated serializable queries
2021-03-02 01:53:36 +01:00
Andrea Cavalli
89f20b449b
Update Local Lucene Index
2021-03-01 00:29:59 +01:00
Andrea Cavalli
36a0812237
Sort by score option, bugfixes
2021-02-28 16:50:59 +01:00
Andrea Cavalli
0ee1193632
Disable scoring option in morelikethis
2021-02-28 16:11:50 +01:00
Andrea Cavalli
96a908b833
Enhance morelikethis
2021-02-28 14:52:11 +01:00
Andrea Cavalli
a20dadfb39
Add low memory scheduler in lucene
2021-02-28 10:57:16 +01:00
Andrea Cavalli
8926916f67
Update LocalKeyValueDatabase
2021-02-28 10:21:37 +01:00
Andrea Cavalli
9a4e0d53d3
Add wildcardQuery, optimize parallel queries
2021-02-28 00:29:56 +01:00
Andrea Cavalli
050d77d359
Clean search code
2021-02-27 19:05:13 +01:00
Andrea Cavalli
3c715affcf
Allow additional query alongside morelikethis
2021-02-27 17:32:57 +01:00
Andrea Cavalli
2d565c8d17
Add nonblocking method to flux iterable
2021-02-26 23:30:11 +01:00
Andrea Cavalli
9140c7f3d6
Bugfix
2021-02-26 21:21:02 +01:00
Andrea Cavalli
6095f9eba9
Update LLLocalDictionary
2021-02-26 19:14:45 +01:00
Andrea Cavalli
a4340cdd2b
Update BlockingFluxIterable
2021-02-26 19:14:33 +01:00
Andrea Cavalli
e854b4252c
Update BoundedGroupedRocksFluxIterable
2021-02-26 16:24:03 +01:00
Andrea Cavalli
4e2030dab8
Update BoundedRocksFluxIterable.java
2021-02-26 15:25:01 +01:00
Andrea Cavalli
64b9010e50
Implement backpressure during iteration
2021-02-26 14:06:16 +01:00
Andrea Cavalli
cbcc4df690
Update LLLocalLuceneIndex.java
2021-02-25 00:00:16 +01:00
Andrea Cavalli
c3be27c15b
Fix limits
2021-02-24 23:16:56 +01:00
Andrea Cavalli
385e29aee5
Update LLLocalMultiLuceneIndex.java
2021-02-24 18:39:46 +01:00
Andrea Cavalli
c3221a2f46
Update LLLocalLuceneIndex.java
2021-02-24 17:03:42 +01:00
Andrea Cavalli
3366c52b24
Better define count method
2021-02-24 16:43:07 +01:00
Andrea Cavalli
af47584803
Bugfixes
2021-02-22 01:54:25 +01:00
Andrea Cavalli
575bde94f0
Convert limit to long, add new query type.
2021-02-22 01:37:17 +01:00
Andrea Cavalli
5d5d506421
Wrap slf4j implementation
2021-02-20 21:35:09 +01:00
Andrea Cavalli
7654412d20
Bugfix
2021-02-17 15:03:51 +01:00
Andrea Cavalli
01b8b704d0
Bugfix
2021-02-17 13:59:35 +01:00
Andrea Cavalli
c36824699a
Bugfix
2021-02-16 23:15:56 +01:00
Andrea Cavalli
787092c6f9
Update LLLocalDictionary.java
2021-02-15 00:15:42 +01:00
Andrea Cavalli
db76fe8c71
Code cleanup
2021-02-14 19:38:01 +01:00
Andrea Cavalli
bb3afd291e
Add minCompetitiveScore
2021-02-14 13:46:11 +01:00
Andrea Cavalli
b3e3f2aca4
Keep score order
2021-02-14 03:25:15 +01:00
Andrea Cavalli
ee72401487
Add more examples
2021-02-13 02:16:24 +01:00
Andrea Cavalli
92eb6182ae
Update SpeedExample
2021-02-13 01:33:00 +01:00
Andrea Cavalli
9fc631caa1
Update CodecsExample
2021-02-13 01:32:04 +01:00
Andrea Cavalli
2d82a1c9a5
Add Option to disable update locks
2021-02-13 01:31:24 +01:00
Andrea Cavalli
3f78e5fec9
Update LLLocalDictionary.java
2021-02-13 00:45:16 +01:00
Andrea Cavalli
c796459e1c
Use stamped locks
2021-02-13 00:18:57 +01:00
Andrea Cavalli
9df1bda11d
Support better queries
2021-02-12 21:55:10 +01:00
Andrea Cavalli
3e36bfe732
Update LuceneIndex.java and SearchResultItem.java
2021-02-12 21:12:10 +01:00
Andrea Cavalli
258e7f7d7c
Fixed text query builder
2021-02-12 19:39:02 +01:00
Andrea Cavalli
9111743bd3
Schedule singleton values on correct scheduler
2021-02-11 22:27:43 +01:00
Andrea Cavalli
b4e25c8573
Add logging
2021-02-11 10:43:03 +01:00
Andrea Cavalli
e5081a62cd
Bugfixes
2021-02-11 01:09:15 +01:00
Andrea Cavalli
46bd61e817
Return true if update() data changed
2021-02-09 14:14:38 +01:00
Andrea Cavalli
871159641c
Update SnapshotException.java
2021-02-07 02:12:43 +01:00
Andrea Cavalli
370197c6e1
Add update method
2021-02-06 19:21:31 +01:00
Andrea Cavalli
2c8bb8a480
Update lucene
2021-02-06 15:53:10 +01:00
Andrea Cavalli
14c2464577
Bugfixes
2021-02-05 20:34:58 +01:00
Andrea Cavalli
527f8afea5
Update CodecsExample.java, Codecs.java, and 2 more files...
2021-02-05 00:13:53 +01:00
Andrea Cavalli
151884b772
Global scores between multiple lucene shards
2021-02-04 22:42:57 +01:00
Andrea Cavalli
059da90ef4
Add sets
2021-02-04 00:48:49 +01:00
Andrea Cavalli
d86c92cb61
Add indicizer
2021-02-03 20:13:17 +01:00
Andrea Cavalli
db5c444b92
Fix all warnings
2021-02-03 14:37:02 +01:00
Andrea Cavalli
09ec134b51
Rewrite README
2021-02-03 14:08:32 +01:00
Andrea Cavalli
5c98465637
Working indicization
2021-02-03 13:48:30 +01:00
Andrea Cavalli
df3c12f776
Update CodecsExample.java
2021-02-02 21:35:03 +01:00
Andrea Cavalli
2113519e91
Update SpeedExample.java
2021-02-02 20:09:31 +01:00
Andrea Cavalli
591b424a76
Update CodecsExample.java and SpeedExample.java
2021-02-02 20:08:22 +01:00
Andrea Cavalli
0cdb066b19
Update CodecsExample.java
2021-02-02 19:42:37 +01:00
Andrea Cavalli
82accc2405
Add codecs
2021-02-02 19:40:37 +01:00
Andrea Cavalli
ae5cda2f70
Update Example.java, SubStageGetterMap.java, and SubStageGetterMapDeep.java
2021-02-02 18:42:18 +01:00
Andrea Cavalli
d9187b70a9
Update pom.xml, Example.java, and 9 more files...
2021-02-02 15:36:11 +01:00
Andrea Cavalli
dbca36b3aa
Update Example.java, LLDictionary.java, and 6 more files...
2021-02-02 00:09:46 +01:00
Andrea Cavalli
023bc3b0dd
Update Example.java, DatabaseMapDictionary.java, and 9 more files...
2021-02-01 12:19:17 +01:00
Andrea Cavalli
1b9b2b187a
Update pom.xml and Example.java
2021-02-01 12:08:16 +01:00
Andrea Cavalli
ffc7e3c35a
Update DatabaseMapDictionary.java, DatabaseMapDictionaryDeep.java, and 7 more files...
2021-02-01 11:00:27 +01:00
Andrea Cavalli
f537303b90
Update DatabaseMapDictionary.java, DatabaseMapDictionaryDeep.java, and 5 more files...
2021-02-01 10:56:14 +01:00
Andrea Cavalli
a949fcd1de
Update Serializer.java and SerializerFixedBinaryLength.java
2021-02-01 10:54:00 +01:00
Andrea Cavalli
2bd69f0331
Update Example.java, DatabaseMapDictionary.java, and 5 more files...
2021-02-01 10:52:33 +01:00
Andrea Cavalli
554facde13
Update Example.java, DatabaseMapDictionary.java, and 4 more files...
2021-02-01 02:21:53 +01:00
Andrea Cavalli
6d63ff3edf
Update Example.java and FixedLengthSerializer.java
2021-01-31 22:54:26 +01:00
Andrea Cavalli
5ae015b701
Update Example.java, SubStageGetterMap.java, and SubStageGetterMapRange.java
2021-01-31 22:20:00 +01:00
Andrea Cavalli
4776e4062b
Rename tests
2021-01-31 21:25:31 +01:00
Andrea Cavalli
76b6985d4f
Usable
2021-01-31 21:23:43 +01:00
Andrea Cavalli
a97613284c
Reenable map dictionary range
2021-01-31 19:52:47 +01:00
Andrea Cavalli
aabf925f2a
Update Example.java
2021-01-31 15:59:21 +01:00
Andrea Cavalli
cef2c796c0
Add example
2021-01-31 15:47:48 +01:00
Andrea Cavalli
345bc81252
Update Example.java, LLDatabaseConnection.java, and 4 more files...
2021-01-31 12:43:28 +01:00
Andrea Cavalli
da0ba7d6bb
Update DatabaseMapDictionary.java
2021-01-31 12:07:07 +01:00
Andrea Cavalli
9918ef3258
Update pom.xml, DatabaseMapDictionary.java, and 6 more files...
2021-01-31 12:02:02 +01:00
Andrea Cavalli
38e27bd6c1
Update DatabaseMapDictionaryRange.java
2021-01-31 00:43:52 +01:00
Andrea Cavalli
94234d518d
Update LLKeyValueDatabase.java, DatabaseEntry.java, and 15 more files...
2021-01-31 00:36:21 +01:00
Andrea Cavalli
12aa63d615
Remove grpc
2021-01-30 22:29:33 +01:00
Andrea Cavalli
f0f34d89a9
Refactoring
2021-01-30 22:14:48 +01:00
Andrea Cavalli
ef43bbe5fe
Update DatabaseMemoryMode.java, Indicizer.java, and 3 more files...
2021-01-30 22:09:04 +01:00
Andrea Cavalli
490d15413e
Update LLDatabaseConnection.java and LLLocalDatabaseConnection.java
2021-01-30 21:30:18 +01:00
Andrea Cavalli
a1d4731ae3
Update CompositeDatabase.java, CompositeDatabasePartLocation.java, and 13 more files...
2021-01-30 20:16:14 +01:00
Andrea Cavalli
abe1f35544
Update LLLocalMultiLuceneIndex.java
2021-01-30 20:01:22 +01:00
Andrea Cavalli
ad2ac618aa
Update LLLuceneIndex.java and LLLocalLuceneIndex.java
2021-01-30 19:57:50 +01:00
Andrea Cavalli
68bd86567c
Update LLDictionary.java and LLRange.java
2021-01-30 19:27:59 +01:00
Andrea Cavalli
3ad9efe71f
Async LLInt and LLLong
2021-01-30 10:52:14 +01:00
Andrea Cavalli
b1612cb20f
Update LLLocalKeyValueDatabase.java
2021-01-30 01:42:37 +01:00
Andrea Cavalli
52d4f022bd
Update LLLuceneIndex.java, LLSnapshottable.java, and 2 more files...
2021-01-30 01:41:04 +01:00
Andrea Cavalli
74fdb752b4
Deduplicate code
2021-01-30 00:35:03 +01:00
Andrea Cavalli
28614db942
Deduplicate code
2021-01-30 00:33:36 +01:00
Andrea Cavalli
538e5c51ac
Update LLLocalDictionary.java
2021-01-30 00:27:07 +01:00
Andrea Cavalli
723160864f
Update LLLocalDictionary.java
2021-01-30 00:26:58 +01:00
Andrea Cavalli
241b3fbee1
Asynchronous LLDictionary
2021-01-30 00:24:55 +01:00
Andrea Cavalli
dd1fb834b5
Update LLLuceneIndex.java, LLScoreMode.java, and 22 more files...
2021-01-29 17:19:01 +01:00
Andrea Cavalli
fb5febce32
Update LLLocalMultiLuceneIndex.java
2021-01-24 03:15:05 +01:00
Andrea Cavalli
1418821b48
Cancellable iterations
2021-01-17 18:31:25 +01:00
Andrea Cavalli
bfe6af4088
Add count stream searcher
2021-01-16 16:35:11 +01:00
Andrea Cavalli
572684972e
Restore MMap
2020-12-31 20:10:47 +01:00
Andrea Cavalli
84c5fb93a0
Fix missing scheduling locks
2020-12-31 12:05:04 +01:00
Andrea Cavalli
c676fa63a7
Don't use MMap Directory, because maybeRefresh causes very high read IO
2020-12-31 12:04:53 +01:00
Andrea Cavalli
f855949a48
Use single scheduler for lucene scheduled tasks
2020-12-12 23:41:09 +01:00
Andrea Cavalli
68dc7306c6
Update LLLuceneIndex.java
2020-12-08 10:52:15 +01:00
Andrea Cavalli
76657a260d
Documentation
2020-12-08 10:51:21 +01:00
Andrea Cavalli
396d0f9cda
Port code from private repository
2020-12-07 22:15:18 +01:00
