Commit Graph

9990 Commits

Author SHA1 Message Date
Norman Maurer
381493999d WIP 2020-09-07 15:47:44 +02:00
Norman Maurer
ddb503f76d Fix checkstyle errors 2020-09-07 10:29:41 +02:00
Josef Grieb
8c465e2f1b
Merge pull request #35 from normanmaurer/jni_constants
Lookup constants via JNI
2020-09-05 11:10:08 +02:00
Josef Grieb
89a2513a38
Merge pull request #36 from normanmaurer/writev_workaround
Add workaround for current kernel bug related to WRITEV and IOSEQ_ASYNC
2020-09-05 11:02:54 +02:00
Norman Maurer
ccd5a6e411 Add workaround for current kernel bug related to WRITEV and IOSEQ_ASYNC
Motivation:

There is currently a bug in the kernel that let WRITEV sometimes fail
when IOSEQ_ASYNC is enabled

Modifications:

Don't use IOSEQ_ASYNC for WRITEV for now

Result:

Tests pass
2020-09-05 10:22:02 +02:00
Norman Maurer
dfca811648 Lookup constants via JNI
Motivation:

We should better use JNI to lookup constants so we are sure we not mess
things up

Modifications:

Use JNI calls to lookup constants once

Result:

Less error prone code
2020-09-05 09:40:02 +02:00
Josef Grieb
c6db51ba1f
Merge pull request #34 from normanmaurer/iosqe_async
Use IOSQE_ASYNC flag when submitting
2020-09-04 20:47:39 +02:00
Norman Maurer
1c42a37f67 Use IOSQE_ASYNC flag when submitting
Motivation:

At least in the throughput benchmarks it has shown that IOSQE_ASYNC
gives a lot of performance improvements. Lets enable it by default for
now and maybe make it configurable in the future

Modifications:

Use IOSEQ_ASYNC

Result:

Better performance
2020-09-04 20:22:28 +02:00
Josef Grieb
55460eea2e
Merge pull request #32 from normanmaurer/submit_batching
Submit IO in batches to reduce overhead
2020-09-04 19:10:25 +02:00
Norman Maurer
61b8eaf263
Update SocketGatheringWriteTest.java 2020-09-04 18:04:46 +02:00
Norman Maurer
fa7f07774f
Update SocketGatheringWriteTest.java 2020-09-04 18:04:33 +02:00
Norman Maurer
6545d80d23 Submit IO in batches to reduce overhead
Motivation:

We should submit multiple IO ops at once to reduce the syscall overhead.

Modifications:

- Submit multiple IO ops in batches
- Adjust default ringsize

Result:

Much better performance
2020-09-04 17:09:46 +02:00
Josef Grieb
9e13c5cfd9
Merge pull request #30 from normanmaurer/handle_complete_cleanup
Call handle.readComplete() before fireChannlReadComplete() and also c…
2020-09-04 06:43:20 +02:00
Josef Grieb
4c294908bf
Merge pull request #29 from normanmaurer/handle_reset
Fix bug related to reset the RecvByteBufAllocator.Handle on each read
2020-09-03 21:09:09 +02:00
Norman Maurer
0631824dcd Call handle.readComplete() before fireChannlReadComplete() and also cleanup some code 2020-09-03 18:40:44 +02:00
Norman Maurer
3b35976559 Fix bug related to reset the RecvByteBufAllocator.Handle on each read
Motivation:

We should only reset the RecvByteBufAllocator.Handle when a new "read
loop" starts. Otherwise the handle will not be able to correctly limit
reads.

Modifications:

- Move reset(...) call into pollIn(...)
- Remove all @Ignore

Result:

The whole testsuite passes
2020-09-03 16:14:24 +02:00
Norman Maurer
1440b4fa0c Add more missing tests 2020-09-03 14:51:54 +02:00
Josef Grieb
a55313ed75
Merge pull request #27 from normanmaurer/close_group
Call IOUringEventLoopGroup.shutdownGracefully() after test is done.
2020-09-03 10:15:12 +02:00
Josef Grieb
865512df49
Merge pull request #26 from normanmaurer/server_config
Do support SO_BACKLOG in io_uring
2020-09-03 10:14:35 +02:00
Norman Maurer
e1c6f111f5 Call IOUringEventLoopGroup.shutdownGracefully() after test is done. 2020-09-03 09:47:36 +02:00
Norman Maurer
f57fcd6c4a Do support SO_BACKLOG in io_uring
Motivation:

Due a bug SO_BACKLOG was not supported via ChannelOption when using io_uring. Be

Modification:

- Add SO_BACKLOG to the supported ChannelOptions.
- Merge IOUringServerChannelConfig into IOUringServerSocketChannelConfig

Result:

SO_BACKLOG is supported
2020-09-03 09:40:55 +02:00
Josef Grieb
5691fe8a44 Fix addTimeout when sqe is full
Motivation:

when sqe is full -> no timeout is added to the sqe

Modifications:

it is called submit() to flush the sqe entries to add timeout

Result:
2020-09-03 07:48:58 +02:00
Josef Grieb
59f77c24b9 Move initAddress to LinuxSocket JNI
Motivation:

we should move the initAddress to LinuxSocket JNI as it is only used there

Modifications:

- cleanup
- move initAddress to linux socket JNI

Result:

it's cleaner
2020-09-03 07:22:02 +02:00
Josef Grieb
66ff2a2e23
Merge pull request #24 from normanmaurer/missing_tests
Add last missing tests
2020-09-02 14:46:47 +02:00
Norman Maurer
c0dc26a2f6 Add last missing tests 2020-09-02 14:45:03 +02:00
Josef Grieb
823eaaffb3
Merge pull request #22 from normanmaurer/static_native
Obtain static fields via JNI and not duplicate their values
2020-09-02 14:32:53 +02:00
Josef Grieb
bcc37d078f
Merge pull request #23 from normanmaurer/ignore_removal
Remove @Ignore from test
2020-09-02 14:26:51 +02:00
Norman Maurer
47f199653f Remove @Ignore from test 2020-09-02 14:18:49 +02:00
Norman Maurer
74fd0c1375 Obtain static fields via JNI and not duplicate their values
Motivation:

To ensure we use the correct values when passing values from Java to C and the other way around it is better to use JNI to lookup the values.

Modifications:

Add NativeStaticallyRefererencedJniMethods and use it (just as we do in kqueue / epoll)

Results:

More robust code
2020-09-02 14:14:29 +02:00
Josef Grieb
44f2cba67a
Merge pull request #21 from normanmaurer/localaddress_fix
Correctly obtain localAddress after connect was complete
2020-09-02 10:28:31 +02:00
Norman Maurer
c0ddac2c83 Correctly obtain localAddress after connect was complete
Motivation:

We need to cache the localAddress after the connect was complete

Modifications:

- Call socket.localAddress() after the connect was complete
- Enable test again

Result:

Correctly set localAddress after connect was successful
2020-09-02 10:25:03 +02:00
Josef Grieb
b4e7f046d5
Merge pull request #20 from normanmaurer/timeout_fix
Correctly implement IOUringSubmissionQueue.addTimeout(...) and ensure…
2020-09-02 10:21:23 +02:00
Norman Maurer
0a0cc8a7c0 Correctly implement IOUringSubmissionQueue.addTimeout(...) and ensure we always call runAllTasks()
Motivation:

We did have a bug in how we calculated the values for the timespec which lead to incorrect wakeups. Beside this we also missed to always call runAllTasks() which is needed to fetch the ready to be executed scheduled tasks.

Modifications:

- Fix timespec setup
- Always call runAllTasks()
- Add extra testcase
- Remove @Ignore from previous failing test

Result:

Timeouts work as expected
2020-09-02 10:16:26 +02:00
Josef Grieb
77a133344f
Merge pull request #19 from normanmaurer/close_forcibly
Fix bug that would case an IllegalStateException when closeForcibly()…
2020-09-02 09:27:01 +02:00
Norman Maurer
5423eb9401 Fix bug that would case an IllegalStateException when closeForcibly() is called and the Channel is not registered yet. 2020-09-02 09:25:27 +02:00
Josef Grieb
c7f6ba0a55
Merge pull request #18 from normanmaurer/bitmask
Use bitmasking to reduce the number of boolean variables and so save …
2020-09-02 09:23:10 +02:00
Norman Maurer
3e8e2cc0eb Use bitmasking to reduce the number of boolean variables and so save some memory per instance 2020-09-02 09:16:26 +02:00
Josef Grieb
75459d7ac7
Merge pull request #17 from normanmaurer/io_uring_tests
Add more tests from the testsuite for io_uring
2020-09-01 21:33:27 +02:00
Norman Maurer
9e6a3d6483 Add more tests from the testsuite for io_uring
Motivation:

We need more testing for io_uring to be consistent with the others transports

Modifications:

Add more tests by extending the testsuite (still some to add) and mark failing tests as ignore. These ignored tests should be fixed one by one in followup commits

Results:

More testing
2020-09-01 21:22:07 +02:00
Josef Grieb
bfc51bffd8
Merge pull request #16 from normanmaurer/composite_fix
Correctly handle CompositeByteBuf when using IOURING
2020-09-01 16:12:37 +02:00
Norman Maurer
5d7d52954b Correctly handle CompositeByteBuf when using IOURING
Motivation:

CompositeByteBuf need some special handling as well as we have multiple buffers wrapped that needs to be written via writev.

Modification:

Also handle ByteBuf with more then one nioBuffer special.

Result:

Writing CompositeByteBuf works
2020-09-01 16:06:01 +02:00
Josef Grieb
c2a10effde
Merge pull request #15 from normanmaurer/accept_active
Fix failure during accept(...)
2020-09-01 14:17:13 +02:00
Norman Maurer
614323e132 Fix failure during accept(...)
Motivation:

Sometimes accept failed as we not correctly set the active variable when constructing the server channel. This lead to the situation that we tried to add POLLIN before the channel become active and so tried to call accept before it was listen.

Modifications:

- Use the correct constructor
- Cleanup

Result:

No more accept failures.
2020-09-01 14:10:39 +02:00
Josef Grieb
51e20ecd3c
Merge pull request #14 from normanmaurer/rdhup_right_queue
Correctly handle POLLRDHUP registration in all cases
2020-09-01 11:01:03 +02:00
Norman Maurer
05d8897025 Correctly handle POLLRDHUP registration in all cases
Motivation:

When accepting a Channel we did register it for POLLRDHUP, but unfortunally we used the IOUringSubmissionQueue that is tied to the IOUringEventLoop that is used for the ServerChannel. This is not correct as the EventLoop used for the accepted Channel may be different.

Modification:

Move logic into doRegister() and so register for POLLRDHUP on the right IOURingSubmissionQueue

Result:

Correct POLLRDHUP handling
2020-09-01 10:57:06 +02:00
Josef Grieb
70682b238f
Merge pull request #13 from normanmaurer/allochandle_read
Correctly respect RecvByteBufAllocator.Handle when reading
2020-09-01 10:54:07 +02:00
Norman Maurer
663c44cd45 Correctly respect RecvByteBufAllocator.Handle when reading
Motivation:

We need to respect RecvByteBufAllocator.Handle.continueReading() so settings like MAX_MESSAGES_PER_READ are respected. This also ensures that AUTO_READ is correctly working in all cases

Modifications:

- Correctly respect continueReading();
- Fix IOUringRecvByteAllocatorHandle
- Cleanup

Result:

Correctly handling reading
2020-09-01 10:49:09 +02:00
Josef Grieb
57884e2e05
Merge pull request #12 from normanmaurer/poll_remove_fix
Correctly build up entry for POLL_REMOVE so we find the right operation
2020-09-01 01:22:19 +02:00
Norman Maurer
8e5b5400e6 Correctly build up entry for POLL_REMOVE so we find the right operation
Motivation:

We did not correctly compute all fields when POLL_REMOVE entry was calculate. Which could lead to not finding the right operation.

Modifications:

- Correctly fill all fields
- Fix unit tests

Result:

Remove IO_POLL operations work again as expected
2020-08-31 21:23:45 +02:00
Josef Grieb
e1a582d798
Merge pull request #11 from normanmaurer/auto_read
Correctly stop reading when AUTO_READ is set to off and also ensure w…
2020-08-31 17:48:05 +02:00