Go to file
Chris Vest 2071086919
Fix alignment handling for pooled direct buffers (#11106)
Motivation:
Alignment handling was broken, and basically turned into a fixed offset into each allocation address regardless of its initial value, instead of ensuring that the allocated address is either aligned or bumped to the nearest alignment offset.
The brokenness of the alignment handling extended so far, that overlapping ByteBuf instances could even be created, as was seen in #11101.

Modification:
Instead of fixing the per-allocation pointer bump, we now ensure that 1) the minimum page size is a whole multiple of the alignment, and 2) the reference memory for each chunk is bumped to the nearest aligned address, and finally 3) ensured that the reservations are whole multiples of the alignment, thus ensuring that the next allocation automatically occurs from an aligned address.

Incidentally, (3) above comes for free because the reservations are in whole pages, and in (1) we ensured that pages are sized in whole multiples of the alignment.

In order to ensure that the memory for a chunk is aligned, we introduce some new PlatformDependent infrastructure.
The PlatformDependent.alignDirectBuffer will produce a slice of the given buffer, and the slice will have an address that is aligned.
This method is plainly available on ByteBuffer in Java 9 onwards, but for pre-9 we have to use Unsafe, which means it can fail and might not be available on all platforms.
Attempts to create a PooledByteBufAllocator that uses alignment, when this is not supported, will throw an exception.
Luckily, I think use of aligned allocations are rare.

Result:
Aligned pooled byte bufs now work correctly, and never have any overlap.

Fixes #11101
2021-03-23 17:07:06 +01:00
.github Github Actions dawidd6/action-download-artifact set workflow_conclusion (#11096) 2021-03-17 12:18:50 -07:00
.mvn Use latest maven release (#9820) 2019-11-27 14:45:28 +01:00
all [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
bom [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
buffer Fix alignment handling for pooled direct buffers (#11106) 2021-03-23 17:07:06 +01:00
codec [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
codec-dns [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
codec-haproxy [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
codec-http Fix exception if Response has content (#11093) 2021-03-21 14:51:56 +01:00
codec-http2 Do not send GOAWAY frame before connection preface (#11107) 2021-03-23 09:04:46 +01:00
codec-memcache [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
codec-mqtt [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
codec-redis [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
codec-smtp [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
codec-socks [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
codec-stomp [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
codec-xml [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
common Fix alignment handling for pooled direct buffers (#11106) 2021-03-23 17:07:06 +01:00
dev-tools [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
docker Try to stabilize docker build by using https (#11070) 2021-03-09 09:10:02 +01:00
example [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
handler Don't bind to a specify port during SSLEngine tests as the port may also be used (#11102) 2021-03-19 21:09:46 +01:00
handler-proxy [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
license Enable nohttp check during the build (#10708) 2020-10-23 14:44:18 +02:00
microbench [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
resolver [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
resolver-dns [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
resolver-dns-native-macos [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
scripts Update timeout to 10 minutes 2021-02-22 08:04:22 +01:00
tarball [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
testsuite SslHandler flushing with TCP Fast Open fix (#11077) 2021-03-14 14:18:27 +01:00
testsuite-autobahn [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
testsuite-http2 [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
testsuite-native [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
testsuite-native-image [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
testsuite-native-image-client [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
testsuite-native-image-client-runtime-init [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
testsuite-osgi [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
testsuite-shading [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
transport Continue reading when the number of bytes is less then the configured… (#11089) 2021-03-17 13:10:57 +01:00
transport-blockhound-tests [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
transport-native-epoll Continue reading when the number of bytes is less then the configured… (#11089) 2021-03-17 13:10:57 +01:00
transport-native-kqueue Continue reading when the number of bytes is less then the configured… (#11089) 2021-03-17 13:10:57 +01:00
transport-native-unix-common SslHandler flushing with TCP Fast Open fix (#11077) 2021-03-14 14:18:27 +01:00
transport-native-unix-common-tests [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
transport-rxtx [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
transport-sctp [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
transport-udt [maven-release-plugin] prepare for next development iteration 2021-03-09 08:18:31 +00:00
.fbprefs Updated Find Bugs configuration 2009-03-04 10:33:09 +00:00
.gitattributes Include mvn wrapper to make setup of development env easier 2018-01-26 08:13:17 +01:00
.gitignore Ignore .shelf/ folder generated by IntelliJ IDEA (#10445) 2020-08-03 07:51:53 +02:00
.lgtm.yml Enables lgtm.com to process this project and create a CodeQL database 2020-01-17 11:05:53 +01:00
CONTRIBUTING.md Change the netty.io homepage scheme(http -> https) (#9344) 2019-07-09 21:09:42 +02:00
LICENSE.txt Enable nohttp check during the build (#10708) 2020-10-23 14:44:18 +02:00
mvnw Enable nohttp check during the build (#10708) 2020-10-23 14:44:18 +02:00
mvnw.cmd Enable nohttp check during the build (#10708) 2020-10-23 14:44:18 +02:00
nohttp-checkstyle-suppressions.xml Ensure Checkstyle suppression for dependency-reduced-pom.xml on Windows (#10899) 2021-01-01 19:30:13 +01:00
nohttp-checkstyle.xml Enable nohttp check during the build (#10708) 2020-10-23 14:44:18 +02:00
NOTICE.txt Fix License type of dnsinfo (#10773) 2020-11-04 10:40:43 +01:00
pom.xml Update netty-build version (#11103) 2021-03-19 21:10:05 +01:00
README.md Fix url in README.md (#10915) 2021-01-11 07:48:58 +01:00
run-example.sh Add DNS client examples for run-example.sh (#10283) 2020-05-14 12:10:32 +02:00
SECURITY.md Added a security policy (#10692) 2020-10-15 20:39:37 +02:00

Build project

Netty Project

Netty is an asynchronous event-driven network application framework for rapid development of maintainable high performance protocol servers & clients.

How to build

For the detailed information about building and developing Netty, please visit the developer guide. This page only gives very basic information.

You require the following to build Netty:

Note that this is build-time requirement. JDK 5 (for 3.x) or 6 (for 4.0+ / 4.1+) is enough to run your Netty-based application.

Branches to look

Development of all versions takes place in each branch whose name is identical to <majorVersion>.<minorVersion>. For example, the development of 3.9 and 4.1 resides in the branch '3.9' and the branch '4.1' respectively.

Usage with JDK 9+

Netty can be used in modular JDK9+ applications as a collection of automatic modules. The module names follow the reverse-DNS style, and are derived from subproject names rather than root packages due to historical reasons. They are listed below:

  • io.netty.all
  • io.netty.buffer
  • io.netty.codec
  • io.netty.codec.dns
  • io.netty.codec.haproxy
  • io.netty.codec.http
  • io.netty.codec.http2
  • io.netty.codec.memcache
  • io.netty.codec.mqtt
  • io.netty.codec.redis
  • io.netty.codec.smtp
  • io.netty.codec.socks
  • io.netty.codec.stomp
  • io.netty.codec.xml
  • io.netty.common
  • io.netty.handler
  • io.netty.handler.proxy
  • io.netty.resolver
  • io.netty.resolver.dns
  • io.netty.transport
  • io.netty.transport.epoll (native omitted - reserved keyword in Java)
  • io.netty.transport.kqueue (native omitted - reserved keyword in Java)
  • io.netty.transport.unix.common (native omitted - reserved keyword in Java)
  • io.netty.transport.rxtx
  • io.netty.transport.sctp
  • io.netty.transport.udt

Automatic modules do not provide any means to declare dependencies, so you need to list each used module separately in your module-info file.