Go to file
Linas Medžiūnas fb5e2cd3aa
Efficient BytBuf search algorithms (#9914) (#9955)
Motivation:

We have found out that ByteBufUtil.indexOf can be inefficient for substring search on
ByteBuf, both in terms of algorithm complexity (worst case O(needle.readableBytes *
haystack.readableBytes)), and in constant factor (esp. on Composite buffers).
With implementation of more performant search algorithms we have seen improvements on
the order of magnitude.

Modifications:

This change introduces three search algorithms:
1. Knuth Morris Pratt - classical textbook algorithm, a good default choice.
2. Bit mask based algorithm - stable performance on any input, but limited to maximum
search substring (the needle) length of 64 bytes.
3. Aho–Corasick - worse performance and higher memory consumption than [1] and [2], but
it supports multiple substring (the needles) search simultaneously, by inspecting every
byte of the haystack only once.

Each algorithm processes every byte of underlying buffer only once, they are implemented
as ByteProcessor.

Result:

Efficient search algorithms with linear time complexity available in Netty (I will share
benchmark results in a comment on a PR).
2020-04-15 10:21:24 +02:00
.github Change the netty.io homepage scheme(http -> https) (#9344) 2019-07-09 21:09:42 +02:00
.mvn Use latest maven release (#9820) 2019-11-27 14:45:28 +01:00
all [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
bom [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
buffer Efficient BytBuf search algorithms (#9914) (#9955) 2020-04-15 10:21:24 +02:00
codec CodecOutputList should be recycled in a finally block (#10186) 2020-04-15 09:08:19 +02:00
codec-dns [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
codec-haproxy [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
codec-http Close the FileChannel in case of an IOException in AbstractDiskHttpData.addContent. (#10188) 2020-04-15 09:24:26 +02:00
codec-http2 [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
codec-memcache [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
codec-mqtt Replace MQTT deprecated API usage 2020-03-30 21:23:23 +02:00
codec-redis [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
codec-smtp [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
codec-socks [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
codec-stomp Fix allocate additional buffer for encoding stompFrame without readab… (#10150) 2020-03-31 16:02:06 +02:00
codec-xml [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
common Efficient BytBuf search algorithms (#9914) (#9955) 2020-04-15 10:21:24 +02:00
dev-tools [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
docker Add JDK 14 and update JDK 13 for builds (#10136) 2020-03-26 10:26:20 +01:00
example Stomp over WebSocket Chat example (#10152) 2020-04-08 12:04:48 +02:00
handler Release the channel attribute--REOPEN_TASK after removing the TrafficShapingHandler from channel pipeline. (#10177) 2020-04-15 08:52:08 +02:00
handler-proxy fix a potential ByteBuf leak in HttpProxyHandler. (#10130) 2020-03-24 11:17:40 +01:00
license Introduce MacOSDnsServerAddressStreamProvider which correctly detect all nameserver configuration on MacOS (#9161) 2019-10-28 15:02:45 +01:00
microbench Efficient BytBuf search algorithms (#9914) (#9955) 2020-04-15 10:21:24 +02:00
resolver [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
resolver-dns Stop sending DNS queries if promise is cancelled (#10171) 2020-04-07 12:25:02 +02:00
resolver-dns-native-macos [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
tarball [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
testsuite [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
testsuite-autobahn [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
testsuite-http2 [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
testsuite-native-image [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
testsuite-osgi [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
testsuite-shading [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
transport Add the unit test of ChannelOutboundBuffer (#10180) 2020-04-15 08:22:51 +02:00
transport-blockhound-tests Hardcode TLS version used during blockhound tests (#10162) 2020-04-03 14:40:15 +02:00
transport-native-epoll [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
transport-native-kqueue [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
transport-native-unix-common [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
transport-native-unix-common-tests [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
transport-rxtx [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
transport-sctp [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
transport-udt [maven-release-plugin] prepare for next development iteration 2020-03-17 09:20:54 +00:00
.fbprefs Updated Find Bugs configuration 2009-03-04 10:33:09 +00:00
.gitattributes Include mvn wrapper to make setup of development env easier 2018-01-26 08:13:17 +01:00
.gitignore Add vscode specific files / directory to .gitignore (#9652) 2019-10-10 09:35:08 +04:00
.lgtm.yml Enables lgtm.com to process this project and create a CodeQL database 2020-01-17 11:05:53 +01:00
CONTRIBUTING.md Change the netty.io homepage scheme(http -> https) (#9344) 2019-07-09 21:09:42 +02:00
LICENSE.txt Relicensed to Apache License v2 2009-08-28 07:15:49 +00:00
mvnw Include mvn wrapper to make setup of development env easier 2018-01-26 08:13:17 +01:00
mvnw.cmd Include mvn wrapper to make setup of development env easier 2018-01-26 08:13:17 +01:00
NOTICE.txt Introduce MacOSDnsServerAddressStreamProvider which correctly detect all nameserver configuration on MacOS (#9161) 2019-10-28 15:02:45 +01:00
pom.xml Update Bouncycastle dependency (#10185) 2020-04-14 14:23:45 +02:00
README.md Change the netty.io homepage scheme(http -> https) (#9344) 2019-07-09 21:09:42 +02:00
run-example.sh Add UptimeServer and adjust UptimeClient's code style. 2017-04-28 07:41:07 +02:00

Netty Project

Netty is an asynchronous event-driven network application framework for rapid development of maintainable high performance protocol servers & clients.

How to build

For the detailed information about building and developing Netty, please visit the developer guide. This page only gives very basic information.

You require the following to build Netty:

Note that this is build-time requirement. JDK 5 (for 3.x) or 6 (for 4.0+) is enough to run your Netty-based application.

Branches to look

Development of all versions takes place in each branch whose name is identical to <majorVersion>.<minorVersion>. For example, the development of 3.9 and 4.0 resides in the branch '3.9' and the branch '4.0' respectively.

Usage with JDK 9

Netty can be used in modular JDK9 applications as a collection of automatic modules. The module names follow the reverse-DNS style, and are derived from subproject names rather than root packages due to historical reasons. They are listed below:

  • io.netty.all
  • io.netty.buffer
  • io.netty.codec
  • io.netty.codec.dns
  • io.netty.codec.haproxy
  • io.netty.codec.http
  • io.netty.codec.http2
  • io.netty.codec.memcache
  • io.netty.codec.mqtt
  • io.netty.codec.redis
  • io.netty.codec.smtp
  • io.netty.codec.socks
  • io.netty.codec.stomp
  • io.netty.codec.xml
  • io.netty.common
  • io.netty.handler
  • io.netty.handler.proxy
  • io.netty.resolver
  • io.netty.resolver.dns
  • io.netty.transport
  • io.netty.transport.epoll (native omitted - reserved keyword in Java)
  • io.netty.transport.kqueue (native omitted - reserved keyword in Java)
  • io.netty.transport.unix.common (native omitted - reserved keyword in Java)
  • io.netty.transport.rxtx
  • io.netty.transport.sctp
  • io.netty.transport.udt

Automatic modules do not provide any means to declare dependencies, so you need to list each used module separately in your module-info file.