Andrea Cavalli
1a35930909
use a reentrantlock to avoid multiple merges at the same time
2021-12-17 02:19:51 +01:00
Andrea Cavalli
1dffb55572
Use log4j for logging, rewrite some local dictionary parts
2021-12-17 01:48:49 +01:00
Andrea Cavalli
7a712722d7
Code cleanup
2021-12-16 16:34:20 +01:00
Andrea Cavalli
6e312fe102
Use uninterruptible scheduler for lucene searches
2021-12-16 16:14:44 +01:00
Andrea Cavalli
2e1678373c
Bugfix
2021-12-16 03:00:51 +01:00
Andrea Cavalli
01099cc4d1
Fix unscored searcher
2021-12-16 02:38:56 +01:00
Andrea Cavalli
b7ca57a215
Schedule commits and merges
2021-12-15 16:47:59 +01:00
Andrea Cavalli
8ad622db0a
Reduce the number of threads
2021-12-15 16:04:33 +01:00
Andrea Cavalli
d58d696ca4
Bugfixes
2021-12-13 01:57:37 +01:00
Andrea Cavalli
907561d93c
Add requests timeout
2021-12-12 23:40:30 +01:00
Andrea Cavalli
5157656a2c
Don't use official searcher for production queries
2021-12-12 18:52:50 +01:00
Andrea Cavalli
3cdafd748e
Optionally disable LMDB
2021-12-12 16:43:22 +01:00
Andrea Cavalli
297c249243
Code cleanup
2021-12-12 16:19:50 +01:00
Andrea Cavalli
1a64d98697
Bugfixes
2021-12-12 02:40:26 +01:00
Andrea Cavalli
2a5e90d667
Update rocksdb to 6.26.1, Update netty
2021-12-12 02:17:36 +01:00
Andrea Cavalli
6644e040dd
Fix unsorted unscored streaming multi searcher
2021-12-08 11:58:06 +01:00
Andrea Cavalli
b5aa8b4baa
Use a LongSemaphore to avoid using a buffer
2021-11-29 23:27:55 +01:00
Andrea Cavalli
cc368aecc8
Fix deadlock
2021-11-29 14:15:31 +01:00
Andrea Cavalli
d8de969bee
Fix deadlock
2021-11-29 14:01:57 +01:00
Andrea Cavalli
3d9247c969
Optimize unscored streaming searcher
2021-11-24 16:39:22 +01:00
Andrea Cavalli
044d189600
Optimize single-shard indices
2021-11-21 12:31:23 +01:00
Andrea Cavalli
7047b512fc
Add numeric field
2021-11-20 16:09:00 +01:00
Andrea Cavalli
798b8a5288
Update policies
2021-11-20 01:30:06 +01:00
Andrea Cavalli
06d98040b1
Allow to use absolute values
2021-11-20 01:12:17 +01:00
Andrea Cavalli
3810c49fa1
Allow random sampling
2021-11-19 22:15:31 +01:00
Andrea Cavalli
29d9aad8bf
Update buckets
2021-11-19 19:03:31 +01:00
Andrea Cavalli
ed00d474d6
Implement numeric buckets collector
2021-11-18 17:13:53 +01:00
Andrea Cavalli
e014266b8d
Rename unclear parameters
2021-11-16 23:54:23 +01:00
Andrea Cavalli
c1c57388e5
Add standard lucene queries
2021-11-16 23:19:23 +01:00
Andrea Cavalli
3d7e80b4ec
Update comparators
2021-11-16 23:19:13 +01:00
Andrea Cavalli
891255e18e
Add more methods
2021-11-14 22:21:32 +01:00
Andrea Cavalli
f30ad372ed
Bugfix
2021-11-12 02:52:42 +01:00
Andrea Cavalli
23d5f700fb
Add update method to single values
2021-11-12 02:05:44 +01:00
Andrea Cavalli
42c4b6e651
Add a discard hook
2021-11-09 15:57:16 +01:00
Andrea Cavalli
d4dae4667d
Remove stream executor
2021-11-09 02:14:21 +01:00
Andrea Cavalli
7fb8183c63
Update
2021-11-09 01:54:46 +01:00
Andrea Cavalli
adbbbaa646
Optimizations
2021-11-09 01:13:47 +01:00
Andrea Cavalli
50b3c897ff
Add scoring shard multi manager
2021-11-09 00:54:09 +01:00
Andrea Cavalli
47aac33b22
Add count multi searcher
2021-11-09 00:05:26 +01:00
Andrea Cavalli
1ba4a1866f
Reactive collector multi manager
2021-11-08 23:53:53 +01:00
Andrea Cavalli
7c0a4b2af9
Bugfix
2021-11-08 23:46:40 +01:00
Andrea Cavalli
a48bea6c63
Fix wait time
2021-11-08 23:46:02 +01:00
Andrea Cavalli
ef15bf7e8c
Bugfixes
2021-11-08 18:52:52 +01:00
Andrea Cavalli
81b7df8702
Remove sends to improve performance
2021-11-08 16:33:41 +01:00
Andrea Cavalli
232e46bcea
Add more discard handlers
2021-11-08 12:06:32 +01:00
Andrea Cavalli
59aa1ef5c6
Update database
2021-11-08 11:17:52 +01:00
Andrea Cavalli
63cd178988
Use merge operator when possible
2021-11-08 10:49:59 +01:00
Andrea Cavalli
b48ab0b095
Add soft update document
2021-11-07 18:34:34 +01:00
Andrea Cavalli
52be944b5f
Bugfixes
2021-11-07 18:00:11 +01:00
Andrea Cavalli
b34b620082
Allow lucene partial document updates
2021-11-07 17:46:40 +01:00
Andrea Cavalli
d8801b3471
Update loggers
2021-11-07 14:46:03 +01:00
Andrea Cavalli
eba6f92d7f
Remove warning
2021-11-05 16:54:58 +01:00
Andrea Cavalli
c46320cdf7
Adjust database parameters
2021-11-02 13:02:49 +01:00
Andrea Cavalli
e015c9afff
Add todos
2021-10-30 17:43:59 +02:00
Andrea Cavalli
c506a7e71b
Use netty direct memory if possible
2021-10-30 12:39:56 +02:00
Andrea Cavalli
98dcb39ce1
Reformat iterator
2021-10-30 12:21:28 +02:00
Andrea Cavalli
1ea004630e
Use Micrometer registry, better optimistic commit failure logging
2021-10-30 11:13:46 +02:00
Andrea Cavalli
f3c63842c8
Don't close unreleasable buffers
2021-10-29 00:11:25 +02:00
Andrea Cavalli
37de47fd6c
Refactor results
2021-10-28 23:57:23 +02:00
Andrea Cavalli
d861e26a57
Rename sort
2021-10-28 17:18:23 +02:00
Andrea Cavalli
417c174761
Implement ResourceSupport
2021-10-28 11:44:20 +02:00
Andrea Cavalli
e24dc4bece
Update dependencies
2021-10-26 23:59:55 +02:00
Andrea Cavalli
da2b302d1b
Replace sinks with references when needed
2021-10-26 00:02:08 +02:00
Andrea Cavalli
1899ef1723
Optimize array
2021-10-25 01:54:37 +02:00
Andrea Cavalli
f9b656986c
Clean queues
2021-10-25 01:44:12 +02:00
Andrea Cavalli
7a01b6a2a4
Group writes together to speedup writes
2021-10-25 01:41:02 +02:00
Andrea Cavalli
e48f8b25eb
Remove unused constants
2021-10-25 00:44:30 +02:00
Andrea Cavalli
db9b1bb7fb
Rename constants
2021-10-25 00:42:48 +02:00
Andrea Cavalli
90aa7a2522
Use in-memory database if the limit is lower than 8192
2021-10-22 01:26:44 +02:00
Andrea Cavalli
a77af5253d
Fix performance issue
2021-10-22 00:51:54 +02:00
Andrea Cavalli
213e446ff4
Separate lucene from the rest of the app to avoid thread interruptions
2021-10-21 11:55:59 +02:00
Andrea Cavalli
fb43fa78af
Discard transaction data
2021-10-21 10:01:29 +02:00
Andrea Cavalli
1f04241ac6
Use optimistic db
2021-10-21 10:00:39 +02:00
Andrea Cavalli
1625a5c44b
RocksDB database abstraction
2021-10-20 01:51:34 +02:00
Andrea Cavalli
80d0ced888
Optimistic transactions, inline codecs
2021-10-19 00:22:05 +02:00
Andrea Cavalli
aad5f8c96c
Optimistic updates
2021-10-17 19:52:43 +02:00
Andrea Cavalli
df2b757fdd
Remove unused class
2021-10-17 17:15:57 +02:00
Andrea Cavalli
3a591c38f2
Use new netty resource leak detector
2021-10-16 16:56:10 +02:00
Andrea Cavalli
e66efba834
Publish lucene 9 snapshots
2021-10-16 14:59:38 +02:00
Andrea Cavalli
f77784fc50
Improve temporary LMDB database lifecycle
2021-10-16 14:35:04 +02:00
Andrea Cavalli
a441c2fb85
Move comparator
2021-10-16 01:51:07 +02:00
Andrea Cavalli
6f8f70c23b
Bugfix in sizeRange
2021-10-16 01:49:41 +02:00
Andrea Cavalli
fd565c80b2
Fix assertions
2021-10-16 01:35:09 +02:00
Andrea Cavalli
f6aab7dafb
More tests
2021-10-16 00:50:06 +02:00
Andrea Cavalli
e6c0f14fda
Implement some sort codecs
2021-10-15 22:03:53 +02:00
Andrea Cavalli
17a9b49755
Partial sorted implementation
2021-10-15 00:03:41 +02:00
Andrea Cavalli
36df18796b
Partial sorted implementation
2021-10-14 23:04:34 +02:00
Andrea Cavalli
e1d1e1fb05
Fix LMDB PriorityQueue
2021-10-14 15:55:58 +02:00
Andrea Cavalli
d6b6a211a8
Replace scoreMode with boolean "complete"
2021-10-14 00:49:21 +02:00
Andrea Cavalli
5817d8a93f
Implement more tests
2021-10-13 14:26:54 +02:00
Andrea Cavalli
584115c5cc
Rename classes and improve readonly tests performance
2021-10-13 12:25:32 +02:00
Andrea Cavalli
09f60a3a99
Implement memory-mapped sorted searcher for streaming huge query results
2021-10-13 00:23:56 +02:00
Andrea Cavalli
83e98ebce8
Fast implementation of query transformers
2021-10-08 11:50:28 +02:00
Andrea Cavalli
30a14a4aae
Add todos
2021-10-08 02:14:34 +02:00
Andrea Cavalli
4d5f8b5b37
Implement MoreLikeThis transformer
2021-10-08 02:13:33 +02:00
Andrea Cavalli
81d8abe72c
Add ensureBlocking in blocking method
2021-10-07 00:54:20 +02:00
Andrea Cavalli
013e4c5dd8
Remove publishOn in lucene utils
2021-10-07 00:54:11 +02:00
Andrea Cavalli
33e4cb2f14
Add ensureOpen method to avoid writing to the index when closing
2021-10-07 00:53:38 +02:00
Andrea Cavalli
818bd20ed9
Update netty
2021-10-01 19:17:33 +02:00
Andrea Cavalli
9646ddcb28
Use method references
2021-09-30 18:25:36 +02:00
Andrea Cavalli
5d2ba797eb
Cleanup code
2021-09-30 00:25:09 +02:00
Andrea Cavalli
9a6f195b63
Cleanup utils
2021-09-30 00:23:41 +02:00
Andrea Cavalli
dc14192dca
Reimplement MultiMoreLikeThis using BigCompositeReader
2021-09-29 13:18:06 +02:00
Andrea Cavalli
6b8c1025d1
Fix ClassCastException
2021-09-29 11:47:17 +02:00
Andrea Cavalli
74d20204ab
Avoid using BufferTimeoutPublisher (it kills lucene Async IO)
2021-09-29 11:38:53 +02:00
Andrea Cavalli
2fb96eaf03
Ensure running in a blocking thread
2021-09-29 11:38:36 +02:00
Andrea Cavalli
74f2cce604
Throw error only when needed
2021-09-26 15:10:42 +02:00
Andrea Cavalli
5d7b403e55
Move reactive collector
2021-09-25 18:31:41 +02:00
Andrea Cavalli
f03f7296d4
Separate LeafCollector
2021-09-25 14:09:10 +02:00
Andrea Cavalli
5443e330bb
Optimistic emission of results
2021-09-25 13:26:59 +02:00
Andrea Cavalli
8e15020f5b
Improve performance of infinite queries
2021-09-25 13:07:52 +02:00
Andrea Cavalli
d06c9184bd
Bugfix
2021-09-25 13:07:40 +02:00
Andrea Cavalli
d96b5a168b
Execute searches on its own executor
2021-09-25 13:06:24 +02:00
Andrea Cavalli
3742eedd7f
Release dropped resource
2021-09-24 04:01:28 +02:00
Andrea Cavalli
996165c3cc
Do not release cached searcher
2021-09-24 02:47:52 +02:00
Andrea Cavalli
23fa46c775
Release cached searcher
2021-09-24 02:44:12 +02:00
Andrea Cavalli
20c19f662b
Avoid multiple drops
2021-09-24 02:01:45 +02:00
Andrea Cavalli
be1ca997a7
Bugfix
2021-09-23 23:45:41 +02:00
Andrea Cavalli
1a73a5a33f
Bugfixes
2021-09-23 22:04:01 +02:00
Andrea Cavalli
3a544d4297
Partial migration to ResourceSupport
2021-09-23 20:57:28 +02:00
Andrea Cavalli
247207febe
Temporary
2021-09-23 15:48:27 +02:00
Andrea Cavalli
51ec85abe1
Improve logging
2021-09-23 15:37:13 +02:00
Andrea Cavalli
6c849fae78
Change makeInaccessible visibility
2021-09-23 15:34:56 +02:00
Andrea Cavalli
d4c977047c
Allow sorted/scored counting
2021-09-23 14:50:15 +02:00
Andrea Cavalli
b77b441515
Fix all errors
2021-09-23 11:30:44 +02:00
Andrea Cavalli
552b5f78ce
Fix size check assertion
2021-09-23 02:22:30 +02:00
Andrea Cavalli
29086b1939
Add some tests for low level dictionary, log tests, pass more tests
2021-09-23 02:15:58 +02:00
Andrea Cavalli
e034f3b778
Support memory segments
2021-09-22 18:33:28 +02:00
Andrea Cavalli
8b73a05177
Bugfixes and upgraded to java 17
2021-09-22 11:03:39 +02:00
Andrea Cavalli
0fee105f0b
Bugfixes
2021-09-21 02:01:02 +02:00
Andrea Cavalli
bd97704a0b
Better page limits
2021-09-20 18:20:59 +02:00
Andrea Cavalli
b8adbf452e
Add resources flux
2021-09-20 16:22:39 +02:00
Andrea Cavalli
3c5edbc06e
Finished initial refactoring
2021-09-20 12:51:27 +02:00
Andrea Cavalli
4a883ca8ea
Done implementing Local and LocalMulti lucene indices
2021-09-20 11:52:21 +02:00
Andrea Cavalli
ca37d1fb68
Rewrite lucene transformers and implement MoreLikeThis sharding
2021-09-20 11:35:01 +02:00
Andrea Cavalli
5cfb5f49cd
Add custom MoreLikeThis with sharding support
2021-09-20 00:22:22 +02:00
Andrea Cavalli
65db1711b5
Missing: moreLikeThis
2021-09-19 19:59:37 +02:00
Andrea Cavalli
31422847c2
Add SimpleUnsortedUnscoredLuceneMultiSearcher
2021-09-19 12:35:48 +02:00
Andrea Cavalli
d1963a1d65
Finish refactoring SimpleLuceneLocalSearcher
2021-09-19 12:01:11 +02:00
Andrea Cavalli
8bc0284f27
First safe search commit
2021-09-18 18:34:21 +02:00
Andrea Cavalli
26e9c4bbee
Fix package
2021-09-17 20:37:26 +02:00
Andrea Cavalli
6782abb66d
Use Net5
2021-09-17 16:56:28 +02:00
Andrea Cavalli
7feeb4a9ce
Use markers
2021-09-10 12:13:52 +02:00
Andrea Cavalli
0a378bc0f1
Fix negative value
2021-09-10 12:13:46 +02:00
Andrea Cavalli
9e09574517
Don't parallelize here
2021-09-10 01:13:39 +02:00
Andrea Cavalli
36dde3bb5a
Set concurrency to 3
2021-09-10 00:05:39 +02:00
Andrea Cavalli
c47f45076a
Optimization
2021-09-09 23:27:39 +02:00
Andrea Cavalli
f157e67818
Various searchers optimizations
2021-09-09 23:00:16 +02:00
Andrea Cavalli
6dda099cc1
Fix registration of global allocator
2021-09-09 16:18:47 +02:00
Andrea Cavalli
d9fd4113e0
Fix refactoring
2021-09-09 15:34:31 +02:00
Andrea Cavalli
9c167a322a
Extend metric utils
2021-09-09 15:30:28 +02:00
Andrea Cavalli
2fd311f67a
Support allocator metrics
2021-09-09 15:21:20 +02:00
Andrea Cavalli
48ba4d15de
Bugfix
2021-09-09 12:31:49 +02:00
Andrea Cavalli
cb5a5e36f2
Fix timeout subscription
2021-09-09 11:43:37 +02:00
Andrea Cavalli
48db79359b
Use boundedelastic db scheduler
2021-09-08 23:51:05 +02:00
Andrea Cavalli
5293fbe22c
Close leaked data
2021-09-08 23:41:18 +02:00
Andrea Cavalli
3a79e5ba6f
Undo parallelization of lucene searches
2021-09-08 23:41:05 +02:00
Andrea Cavalli
6926292904
Avoid nesting schedulers inside generators
2021-09-08 22:32:08 +02:00
Andrea Cavalli
2b21e6a864
Use blocking generator instead of Flux.create
2021-09-08 22:16:06 +02:00
Andrea Cavalli
e12e240487
Subscribe on the same thread
2021-09-08 21:35:04 +02:00
Andrea Cavalli
09c7e4f730
Performance bugfix
2021-09-08 21:34:52 +02:00
Andrea Cavalli
047a471bf7
Fix last leaks
2021-09-08 00:22:39 +02:00
Andrea Cavalli
46787fa353
Fix untested testing function
...
A test function was not tested, causing the uneffectiveness of some tests that were passing when they should have not.
New tests to test the test function have been written, making sure to avoid false negatives.
Add editorconfig, add documentation of MetricUtils
2021-09-07 19:44:23 +02:00
Andrea Cavalli
57a0206cf1
Fully implement memory dictionary
2021-09-07 19:32:37 +02:00
Andrea Cavalli
a662033228
Less verbose exception
2021-09-07 11:39:13 +02:00
Andrea Cavalli
dd1ed1d18f
Suppress warning
2021-09-07 11:29:28 +02:00
Andrea Cavalli
d4ed99cc24
Fix compilation issue
2021-09-07 11:28:03 +02:00
Andrea Cavalli
717d13ef1f
Revert commit 1882e8b300
2021-09-07 11:26:10 +02:00
Andrea Cavalli
66fa853272
Avoid memory leaks
2021-09-07 02:36:11 +02:00
Andrea Cavalli
f5d3474966
Fix possible deadlock
2021-09-07 02:08:29 +02:00
Andrea Cavalli
936c07406e
Implement more phasers
2021-09-06 18:52:21 +02:00
Andrea Cavalli
51b60168f7
Implement phaser
2021-09-06 18:29:10 +02:00
Andrea Cavalli
d05994c8ff
Rename manager
2021-09-06 18:24:36 +02:00
Andrea Cavalli
5a79d2d7cb
Close the CachedIndexSearcher automatically
2021-09-06 18:23:47 +02:00
Andrea Cavalli
7230e96343
Bugfix
2021-09-06 17:42:12 +02:00
Andrea Cavalli
e59705bd0b
Better manage cached index searchers
2021-09-06 17:35:02 +02:00
Andrea Cavalli
b7d975ccfb
MultiGet window set to 16 to avoid memory problems
2021-09-06 15:54:44 +02:00
Andrea Cavalli
16bd3b263b
Limit cached indexwriters
2021-09-06 15:08:07 +02:00
Andrea Cavalli
d5964a7bed
Pool searchers
2021-09-06 15:06:51 +02:00
Andrea Cavalli
6c73c1e86d
Add memory tests
...
needs fix
2021-09-06 01:15:13 +02:00
Andrea Cavalli
4c348a6b2f
Throw exception if running in a nonblocking scope
2021-09-05 14:23:46 +02:00
Andrea Cavalli
1882e8b300
Optimize performance by removing all superfluous subscribeOn calls
2021-09-04 16:42:47 +02:00
Andrea Cavalli
2fe8063193
Fix composite buffers
2021-09-04 02:35:12 +02:00
Andrea Cavalli
f5f46edbec
Use netty5 package
2021-09-04 02:19:10 +02:00
Andrea Cavalli
154086dee2
Fix compilation issues and buffer expansions
2021-09-03 16:11:14 +02:00
Andrea Cavalli
47de651c94
Bugfixes
2021-09-03 02:22:55 +02:00
Andrea Cavalli
a8028024c8
Finish refactoring
2021-09-02 21:14:26 +02:00
Andrea Cavalli
3091b81d34
Fix map tests
2021-09-02 17:15:40 +02:00
Andrea Cavalli
ff7823656e
y
2021-09-01 00:01:56 +02:00
Andrea Cavalli
013d26387d
(unfinished) Netty 5 refactoring
2021-08-31 15:50:11 +02:00
Andrea Cavalli
0faef5316e
(unfinished) Netty 5 refactoring
2021-08-31 09:14:46 +02:00
Andrea Cavalli
3b55e8bd24
(unfinished) Netty 5 refactoring
2021-08-29 23:18:03 +02:00
Andrea Cavalli
9984cfff73
Bugfixes
2021-08-29 01:15:51 +02:00
Andrea Cavalli
8adc8b77b4
Bugfixes
2021-08-28 22:51:05 +02:00
Andrea Cavalli
03b5876001
Bugfixes
2021-08-28 22:42:51 +02:00
Andrea Cavalli
0c17af2ae5
Bugfixes
2021-08-27 02:49:51 +02:00
Andrea Cavalli
6fe9f9c24f
Fix hanging on ScoredSimpleLuceneShardSearcher
2021-08-25 10:23:42 +02:00
Andrea Cavalli
6e31aa01f9
Ignore release errors for empty searchers
2021-08-24 14:13:43 +02:00
Andrea Cavalli
2207ae4314
Fix class names
2021-08-24 11:55:33 +02:00
Andrea Cavalli
a0eb80b130
Protect against memory leaks with dropped search results
2021-08-24 11:53:19 +02:00
Andrea Cavalli
a909aaaf52
LLKeyScore is now a regular record
2021-08-24 11:06:25 +02:00
Andrea Cavalli
c5552d2827
Bugfixes
2021-08-22 23:50:50 +02:00
Andrea Cavalli
2a24570512
Add checked serialization exception
2021-08-22 21:23:22 +02:00
Andrea Cavalli
4e71e42d32
Code cleanup
2021-08-22 19:54:23 +02:00
Andrea Cavalli
906379923f
Lazy retain generated suffixes
2021-08-22 19:52:19 +02:00
bc759c344d
Use a new approach to completely avoid memory leaks
2021-08-22 18:20:05 +02:00
6ed31ab2a6
Code cleanup
2021-08-16 10:36:54 +02:00
435e7d4886
Use a new approach to completely avoid memory leaks
2021-08-16 10:27:47 +02:00
Andrea Cavalli
9d326f5a8b
Human readable representation of total hits count
2021-08-04 01:16:17 +02:00
Andrea Cavalli
9734d78839
Total hits with precision
2021-08-04 01:12:39 +02:00
Andrea Cavalli
bcd99f4727
Avoid errors
2021-08-04 00:44:06 +02:00
Andrea Cavalli
328a45f40d
Fix unscored-unsorted collectors
2021-07-31 23:12:13 +02:00
Andrea Cavalli
586be8751c
Fix compilation issue
2021-07-31 19:18:20 +02:00
Andrea Cavalli
d411675c2b
Use flatMapIterable when possible
2021-07-31 18:00:53 +02:00
Andrea Cavalli
7597e54bac
Remove unnecessary schedulers
2021-07-31 12:28:53 +02:00
Andrea Cavalli
4e782403f5
Fix results ordering
2021-07-30 14:01:12 +02:00
Andrea Cavalli
db54773cda
remove warning
2021-07-28 22:18:33 +02:00
Andrea Cavalli
e738eda331
Performance optimization
2021-07-27 19:34:51 +02:00
Andrea Cavalli
b816e1f9e5
Use buffertimeoutpublisher
2021-07-27 01:31:18 +02:00
Andrea Cavalli
7abcdf05f9
Optimize performance of unscored queries
2021-07-27 00:32:30 +02:00
Andrea Cavalli
ea86bf7a43
Improve performance with UnscoredCollector
2021-07-26 19:21:17 +02:00
Andrea Cavalli
32b514c866
Add max open files option
2021-07-24 23:47:51 +02:00
Andrea Cavalli
1df38022fb
Fix max open files with direct I/O
2021-07-23 22:43:24 +02:00
Andrea Cavalli
c5d353e02a
Fix discard errors
2021-07-23 22:18:08 +02:00
Andrea Cavalli
abde1d1aab
Fix getMulti
2021-07-23 15:20:33 +02:00
Andrea Cavalli
aa1aa7a6fb
Test more numbers
2021-07-18 19:37:24 +02:00
Andrea Cavalli
ff9ee54857
Improve performance
2021-07-17 23:06:26 +02:00
Andrea Cavalli
43439c6f10
Optimize performance
2021-07-17 11:52:08 +02:00
Andrea Cavalli
e4bbeeca3a
Fix messages query not releasing
2021-07-15 15:54:34 +02:00
Andrea Cavalli
547fa68fe7
use record getters in queries
2021-07-13 23:07:39 +02:00
Andrea Cavalli
2489c50022
Make buckets unmodifiable
2021-07-13 22:58:08 +02:00
Andrea Cavalli
fe5f50be10
Remove deprecated methods
2021-07-13 18:07:19 +02:00
Andrea Cavalli
61d4b00a02
Suppress warning
2021-07-11 00:39:48 +02:00
Andrea Cavalli
d5c42d531f
Fix lexicographic order
2021-07-11 00:37:32 +02:00
Andrea Cavalli
58a9121978
Add heap kv database implementation
2021-07-10 20:52:01 +02:00
Andrea Cavalli
5f3c8a2515
Avoid calling reduce() multiple times
2021-07-08 18:54:53 +02:00
Andrea Cavalli
e2b5432b8d
Fix npe
2021-07-08 17:04:53 +02:00
Andrea Cavalli
211a0b36cd
Search unscored sorted queries using the non-scored shard searcher
2021-07-08 17:01:56 +02:00
Andrea Cavalli
c85dcfb54e
Clean rocksdb code
2021-07-06 22:27:03 +02:00
Andrea Cavalli
2a47e6f3fd
Add lucene options
2021-07-06 14:33:47 +02:00
Andrea Cavalli
e7e25e646d
Fix scheduling
2021-07-06 02:23:06 +02:00
Andrea Cavalli
7cebcd7e92
Sort shards during merge
2021-07-06 01:52:12 +02:00
Andrea Cavalli
6c97b0f068
Bugfixes
2021-07-06 01:30:37 +02:00
Andrea Cavalli
b5ccf315be
Implement adaptive multi searcher for shard indexes
2021-07-06 00:30:14 +02:00
Andrea Cavalli
545c7111de
Bugfix
2021-07-05 18:55:11 +02:00
Andrea Cavalli
00ff36836e
Improve reactive searchers performance
2021-07-05 15:43:19 +02:00
Andrea Cavalli
a5d4584a11
Adaptive reactive lucene search engine, lazy results
2021-07-05 12:05:45 +02:00
Andrea Cavalli
7929f0dc8c
Fully reactive lucene queries
2021-07-04 01:34:17 +02:00
Andrea Cavalli
8a1e4028f7
Advanced lucene options
2021-07-01 21:19:52 +02:00
Andrea Cavalli
b80feabb97
Use NIOFSDirectory
2021-06-30 23:43:46 +02:00
Andrea Cavalli
b567f9f320
Copy map before writing to avoid errors
2021-06-30 10:58:49 +02:00
Andrea Cavalli
3758d06853
Configurable direct buffers
2021-06-29 23:31:02 +02:00
Andrea Cavalli
2df2c00e36
Fix unmodifiable read options
2021-06-27 16:52:45 +02:00
Andrea Cavalli
cb8dbf2fa2
Fix direct I/O parameters
2021-06-27 16:47:59 +02:00
Andrea Cavalli
c9e9cb8a01
Bugfix
2021-06-27 16:33:23 +02:00
Andrea Cavalli
e3536cfd01
Remove deprecation
2021-06-27 16:19:56 +02:00
Andrea Cavalli
c6d5beb33b
Database options record
2021-06-27 15:40:56 +02:00
Andrea Cavalli
507101e453
Add verifyChecksum method
2021-06-27 15:06:48 +02:00
Andrea Cavalli
1d281d0305
Prevent reading corrupted database parts, reimplement badblocks
2021-06-27 11:58:12 +02:00
Andrea Cavalli
63cdb43644
Fix badblocks memory leak
2021-06-26 23:57:24 +02:00
Andrea Cavalli
bd8755c180
Implement "badblocks" method
2021-06-26 02:35:33 +02:00
Andrea Cavalli
ee05614115
Use Direct I/O when available
2021-06-25 23:47:53 +02:00
Andrea Cavalli
bd62b83d57
Bugfix
2021-06-25 20:25:57 +02:00
Andrea Cavalli
4640d0dfad
Better implementation of snapshots in lucene shards
2021-06-25 20:07:19 +02:00
Andrea Cavalli
47f6081cde
better parameters for performance
2021-06-25 20:06:58 +02:00
Andrea Cavalli
03d3afa317
Reimplement query serializer
2021-06-20 01:09:06 +02:00
Andrea Cavalli
924dbf6bf6
Add immutable read/write options
2021-06-19 21:55:20 +02:00
Andrea Cavalli
1bd1cb87de
Fix compatibility
2021-06-19 16:26:54 +02:00
Andrea Cavalli
92bb13336d
Bugfix
2021-06-19 13:27:58 +02:00
Andrea Cavalli
b1d48d36ff
Bugfixes
2021-06-19 12:14:14 +02:00
Andrea Cavalli
6039241d2b
Update common utils
2021-06-09 02:56:53 +02:00
Andrea Cavalli
dcd7add36f
Add lucene delta import
2021-06-07 16:21:12 +02:00
Andrea Cavalli
adf3bef488
Fix bug with map access
2021-06-06 02:23:51 +02:00
Andrea Cavalli
187274071f
Bugfix
2021-06-02 13:21:07 +02:00
Andrea Cavalli
f95a46b634
Add delta isModified
2021-06-01 17:08:37 +02:00
Andrea Cavalli
ccf07f4216
Change readahead size
2021-05-29 01:45:03 +02:00
Andrea Cavalli
6eb531e4f1
Add ICU
2021-05-28 16:04:59 +02:00
Andrea Cavalli
4e76073259
Update data-generator
2021-05-25 11:17:24 +02:00
Andrea Cavalli
a293b65b08
Update to lucene 9
2021-05-25 01:12:41 +02:00
Andrea Cavalli
6ccff7646b
Update reactor
2021-05-22 14:46:54 +02:00
Andrea Cavalli
2d24436b93
Update to java 16
2021-05-21 00:19:40 +02:00
Andrea Cavalli
211d2fc99e
Bugfixes
2021-05-19 22:51:55 +02:00
Andrea Cavalli
c9f64195e7
Performance tuning
2021-05-18 01:10:30 +02:00
Andrea Cavalli
f8377c3e63
Bugfix
2021-05-17 04:10:41 +02:00
Andrea Cavalli
d265abc4d7
Fix syntax
2021-05-15 16:37:09 +02:00
Andrea Cavalli
5ccc531ea6
Bugfix
2021-05-15 16:16:19 +02:00
Andrea Cavalli
8eedc27bba
Allow multiple resubscriptions to the same flux
2021-05-12 21:41:47 +02:00
Andrea Cavalli
d29ac00c24
Bugfixes
2021-05-12 19:02:51 +02:00
Andrea Cavalli
f4242218da
Handle multi-subscriber refcnt
2021-05-12 01:25:59 +02:00
Andrea Cavalli
2f404c477e
Optimized performance and added useful utility classes
2021-05-11 21:59:05 +02:00
Andrea Cavalli
40a80fc54f
Fix imports
2021-05-09 19:56:25 +02:00
Andrea Cavalli
1d42057f48
Fix missing import
2021-05-09 19:46:17 +02:00
Andrea Cavalli
3da2fd8979
Bugfixes
2021-05-08 03:09:00 +02:00
Andrea Cavalli
63282767a1
Switch from Gson to Moshi
2021-05-07 12:05:14 +02:00
Andrea Cavalli
a11ce4a646
Add missing methods
2021-05-05 17:31:21 +02:00
Andrea Cavalli
a4deeee6d5
Performance tuning
2021-05-05 15:16:32 +02:00
Andrea Cavalli
63beb1931e
More customizable allocators
2021-05-05 00:07:18 +02:00
Andrea Cavalli
5b89be8ee0
Fix memory usage
2021-05-04 01:21:29 +02:00
Andrea Cavalli
f93cae96f3
Allow customized pools
2021-05-03 21:41:51 +02:00
Andrea Cavalli
1dcf5a1a9c
Add netty statistics
2021-05-03 18:07:18 +02:00
Andrea Cavalli
bc12b22a4b
Bugfix
2021-05-03 13:22:02 +02:00
Andrea Cavalli
bd5cd09b2e
Reimplement composite buffers
2021-05-03 12:49:16 +02:00
Andrea Cavalli
91cc7b9291
Bugfix
2021-05-03 12:44:22 +02:00
Andrea Cavalli
7588cd3219
Bugfix
2021-05-03 12:29:15 +02:00
Andrea Cavalli
04df5f4a36
Bugfixes
2021-05-03 02:57:08 +02:00
Andrea Cavalli
4aa18fcd60
bugfixes
2021-05-03 02:45:29 +02:00
Andrea Cavalli
0d3157ec3c
Bugfixes
2021-05-03 00:29:26 +02:00
Andrea Cavalli
0c26daba57
Bugfixes
2021-05-02 19:18:15 +02:00
Andrea Cavalli
2e6aceafe6
Converted everything to netty direct buffers
2021-04-30 19:15:04 +02:00
Andrea Cavalli
df84562bb9
Bugfixes and updated reactor
2021-04-15 00:00:42 +02:00
Andrea Cavalli
505de18ecb
Fix returning a single result
2021-04-14 02:37:03 +02:00
Andrea Cavalli
c1a7e782f6
Bugfix
2021-04-13 03:07:44 +02:00
Andrea Cavalli
41ba665a54
Bugfixes
2021-04-12 17:53:29 +02:00
Andrea Cavalli
6753db7dbe
Add hash maps and sets
2021-04-12 17:09:55 +02:00
Andrea Cavalli
eb0ac6fbb9
Fix all warnings
2021-04-03 19:09:06 +02:00
Andrea Cavalli
65c45756d7
More aggressive low memory mode
2021-04-03 02:22:17 +02:00
Andrea Cavalli
3f508352fc
Prefer standard schedulers
2021-04-03 02:20:37 +02:00
Andrea Cavalli
a2bcc07825
Add CountedStream
2021-04-01 23:56:34 +02:00
Andrea Cavalli
20069e7e06
Update SimpleStreamSearcher.java
2021-04-01 22:58:05 +02:00
Andrea Cavalli
918ff71091
Implement offsets in lucene search
2021-04-01 19:48:25 +02:00
Andrea Cavalli
3e6573d955
Safer approach to total hits count in lucene results
2021-03-27 03:35:27 +01:00
Andrea Cavalli
7379a8d8ae
Avoid deadlock
2021-03-24 00:02:47 +01:00
Andrea Cavalli
3e7ee104ff
Speed optimizations
2021-03-22 20:02:19 +01:00
Andrea Cavalli
62b53c1399
Optimize
2021-03-21 13:06:54 +01:00
Andrea Cavalli
4394c74ad9
Bugfix
2021-03-20 12:41:11 +01:00
Andrea Cavalli
8075694e15
Quick fix
2021-03-19 20:55:38 +01:00
Andrea Cavalli
a80849f241
Parallel size
2021-03-18 19:53:32 +01:00
Andrea Cavalli
aaa203f7ad
Add optimization
2021-03-18 16:19:41 +01:00
Andrea Cavalli
1dc14fe179
Allow missing fields
2021-03-18 13:12:40 +01:00
Andrea Cavalli
66bd00b352
Limit db threads to 6 max threads
2021-03-17 02:41:31 +01:00
Andrea Cavalli
9fc58eae2b
Improve performance
2021-03-17 01:02:02 +01:00
Andrea Cavalli
fd4f8e77d6
Refactor iterators
2021-03-14 23:06:46 +01:00
Andrea Cavalli
63469c0f89
Fix sigsegv
2021-03-14 19:38:20 +01:00
Andrea Cavalli
1aed618ca5
Update rocksdb
2021-03-14 18:51:42 +01:00
Andrea Cavalli
05e8c87015
Fix iterations
2021-03-14 14:16:07 +01:00
Andrea Cavalli
3d5f987ffd
Refactor iterations
2021-03-14 13:24:46 +01:00
Andrea Cavalli
08eb457235
Refactor iterations
2021-03-14 13:08:03 +01:00
Andrea Cavalli
5f3bf768ad
Refactor iterations
2021-03-14 03:13:19 +01:00
Andrea Cavalli
32d1d76f69
Exclusive range
2021-03-13 19:01:36 +01:00
Andrea Cavalli
79ba4d8dd2
Bugfix
2021-03-11 15:47:19 +01:00
Andrea Cavalli
e72b2ca93c
Update LuceneUtils
2021-03-11 14:45:45 +01:00
Andrea Cavalli
d4784f0434
Update SearchResultKeys.java
2021-03-11 13:01:25 +01:00
Andrea Cavalli
64ff189637
Bugfix in deep map
2021-03-11 02:22:59 +01:00
Andrea Cavalli
d05e6139a0
Bugfix in reactor-core
2021-03-09 00:45:32 +01:00
Andrea Cavalli
99f3686eab
Fix deadlock
2021-03-06 17:28:33 +01:00
Andrea Cavalli
08434d475c
Avoid multiple subscriptions to the same search query
2021-03-05 16:17:37 +01:00
Andrea Cavalli
2a8bec00d4
Describe errors
2021-03-04 22:01:50 +01:00
Andrea Cavalli
e3fcf7f74f
Use better overflow strategy
2021-03-03 21:32:45 +01:00
Andrea Cavalli
b71f3dceed
Bugfixes
2021-03-03 20:00:58 +01:00
Andrea Cavalli
a06d448182
Merge totalhitscount in merged streams
2021-03-03 17:29:14 +01:00
