Go to file
Carl Mastrangelo ff0045e3e1 Use Table lookup for HPACK decoder (#9307)
Motivation:
Table based decoding is fast.

Modification:
Use table based decoding in HPACK decoder, inspired by
https://github.com/python-hyper/hpack/blob/master/hpack/huffman_table.py

This modifies the table to be based on integers, rather than 3-tuples of
bytes.  This is for two reasons:

1.  It's faster
2.  Using bytes makes the static intializer too big, and doesn't
compile.

Result:
Faster Huffman decoding.  This only seems to help the ascii case, the
other decoding is about the same.

Benchmarks:

```
Before:
Benchmark                     (limitToAscii)  (sensitive)  (size)   Mode  Cnt        Score       Error  Units
HpackDecoderBenchmark.decode            true         true   SMALL  thrpt   20   426293.636 ±  1444.843  ops/s
HpackDecoderBenchmark.decode            true         true  MEDIUM  thrpt   20    57843.738 ±   725.704  ops/s
HpackDecoderBenchmark.decode            true         true   LARGE  thrpt   20     3002.412 ±    16.998  ops/s
HpackDecoderBenchmark.decode            true        false   SMALL  thrpt   20   412339.400 ±  1128.394  ops/s
HpackDecoderBenchmark.decode            true        false  MEDIUM  thrpt   20    58226.870 ±   199.591  ops/s
HpackDecoderBenchmark.decode            true        false   LARGE  thrpt   20     3044.256 ±    10.675  ops/s
HpackDecoderBenchmark.decode           false         true   SMALL  thrpt   20  2082615.030 ±  5929.726  ops/s
HpackDecoderBenchmark.decode           false         true  MEDIUM  thrpt   10   571640.454 ± 26499.229  ops/s
HpackDecoderBenchmark.decode           false         true   LARGE  thrpt   20    92714.555 ±  2292.222  ops/s
HpackDecoderBenchmark.decode           false        false   SMALL  thrpt   20  1745872.421 ±  6788.840  ops/s
HpackDecoderBenchmark.decode           false        false  MEDIUM  thrpt   20   490420.323 ±  2455.431  ops/s
HpackDecoderBenchmark.decode           false        false   LARGE  thrpt   20    84536.200 ±   398.714  ops/s

After(bytes):
Benchmark                     (limitToAscii)  (sensitive)  (size)   Mode  Cnt        Score      Error  Units
HpackDecoderBenchmark.decode            true         true   SMALL  thrpt   20   472649.148 ± 7122.461  ops/s
HpackDecoderBenchmark.decode            true         true  MEDIUM  thrpt   20    66739.638 ±  341.607  ops/s
HpackDecoderBenchmark.decode            true         true   LARGE  thrpt   20     3139.773 ±   24.491  ops/s
HpackDecoderBenchmark.decode            true        false   SMALL  thrpt   20   466933.833 ± 4514.971  ops/s
HpackDecoderBenchmark.decode            true        false  MEDIUM  thrpt   20    66111.778 ±  568.326  ops/s
HpackDecoderBenchmark.decode            true        false   LARGE  thrpt   20     3143.619 ±    3.332  ops/s
HpackDecoderBenchmark.decode           false         true   SMALL  thrpt   20  2109995.177 ± 6203.143  ops/s
HpackDecoderBenchmark.decode           false         true  MEDIUM  thrpt   20   586026.055 ± 1578.550  ops/s
HpackDecoderBenchmark.decode           false        false   SMALL  thrpt   20  1775723.270 ± 4932.057  ops/s
HpackDecoderBenchmark.decode           false        false  MEDIUM  thrpt   20   493316.467 ± 1453.037  ops/s
HpackDecoderBenchmark.decode           false        false   LARGE  thrpt   10    85726.219 ±  402.573  ops/s

After(ints):
Benchmark                     (limitToAscii)  (sensitive)  (size)   Mode  Cnt        Score       Error  Units
HpackDecoderBenchmark.decode            true         true   SMALL  thrpt   20   615549.006 ±  5282.283  ops/s
HpackDecoderBenchmark.decode            true         true  MEDIUM  thrpt   20    86714.630 ±   654.489  ops/s
HpackDecoderBenchmark.decode            true         true   LARGE  thrpt   20     3984.439 ±    61.612  ops/s
HpackDecoderBenchmark.decode            true        false   SMALL  thrpt   20   602489.337 ±  5397.024  ops/s
HpackDecoderBenchmark.decode            true        false  MEDIUM  thrpt   20    88399.109 ±   241.115  ops/s
HpackDecoderBenchmark.decode            true        false   LARGE  thrpt   20     3875.729 ±   103.057  ops/s
HpackDecoderBenchmark.decode           false         true   SMALL  thrpt   20  2092165.454 ± 11918.859  ops/s
HpackDecoderBenchmark.decode           false         true  MEDIUM  thrpt   20   583465.437 ±  5452.115  ops/s
HpackDecoderBenchmark.decode           false         true   LARGE  thrpt   20    93290.061 ±   665.904  ops/s
HpackDecoderBenchmark.decode           false        false   SMALL  thrpt   20  1758402.495 ± 14677.438  ops/s
HpackDecoderBenchmark.decode           false        false  MEDIUM  thrpt   10   491598.099 ±  5029.698  ops/s
HpackDecoderBenchmark.decode           false        false   LARGE  thrpt   20    85834.290 ±   554.915  ops/s
```
2019-07-02 20:09:44 +02:00
.github Use GitHub Issue/PR Template Feature 2016-12-07 11:40:26 -08:00
.mvn support publishing snapshots from docker based ci (#8634) 2018-12-07 05:43:06 +01:00
all [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
bom [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
buffer Correctly take length of ByteBufInputStream into account for readLine… (#9310) 2019-07-01 20:55:23 +02:00
codec optimize some code (#9289) 2019-06-28 13:48:23 +02:00
codec-dns Pre-decompressed DNS record RData that may contain compression pointers (#9311) 2019-07-02 19:38:50 +02:00
codec-haproxy [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
codec-http [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
codec-http2 Use Table lookup for HPACK decoder (#9307) 2019-07-02 20:09:44 +02:00
codec-memcache [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
codec-mqtt [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
codec-redis [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
codec-smtp optimize some code (#9289) 2019-06-28 13:48:23 +02:00
codec-socks [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
codec-stomp [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
codec-xml [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
common optimize some code (#9289) 2019-06-28 13:48:23 +02:00
dev-tools [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
docker Remove deprecated GraalVM native-image flags (#9118) 2019-05-22 19:20:54 +02:00
example [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
handler Don't loop over TLS records for SNI (#7479) 2019-07-01 11:22:55 +02:00
handler-proxy [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
license Use Table lookup for HPACK decoder (#9307) 2019-07-02 20:09:44 +02:00
microbench Use Table lookup for HPACK decoder (#9307) 2019-07-02 20:09:44 +02:00
resolver [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
resolver-dns [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
tarball [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
testsuite [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
testsuite-autobahn [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
testsuite-http2 [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
testsuite-native-image [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
testsuite-osgi [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
testsuite-shading [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
transport #7285 Improved "Discarded inbound message" warning (#9286) 2019-07-01 20:38:58 +02:00
transport-native-epoll Unconditionally initialize sockaddrs in epoll linuxsocket (#9299) 2019-06-29 12:16:58 +02:00
transport-native-kqueue [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
transport-native-unix-common [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
transport-native-unix-common-tests [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
transport-rxtx [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
transport-sctp [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
transport-udt [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
.fbprefs Updated Find Bugs configuration 2009-03-04 10:33:09 +00:00
.gitattributes Include mvn wrapper to make setup of development env easier 2018-01-26 08:13:17 +01:00
.gitignore Add .gitignore for docker-sync stuff 2019-03-19 14:03:15 +01:00
CONTRIBUTING.md Move the pull request guide to the developer guide 2014-03-12 13:13:58 +09:00
LICENSE.txt Relicensed to Apache License v2 2009-08-28 07:15:49 +00:00
mvnw Include mvn wrapper to make setup of development env easier 2018-01-26 08:13:17 +01:00
mvnw.cmd Include mvn wrapper to make setup of development env easier 2018-01-26 08:13:17 +01:00
NOTICE.txt Use Table lookup for HPACK decoder (#9307) 2019-07-02 20:09:44 +02:00
pom.xml [maven-release-plugin] prepare for next development iteration 2019-06-28 05:57:21 +00:00
README.md Provide an Automatic-Module-Name for the netty-all artifact fixes #7644 2018-01-27 20:31:16 +01:00
run-example.sh Add UptimeServer and adjust UptimeClient's code style. 2017-04-28 07:41:07 +02:00

Netty Project

Netty is an asynchronous event-driven network application framework for rapid development of maintainable high performance protocol servers & clients.

How to build

For the detailed information about building and developing Netty, please visit the developer guide. This page only gives very basic information.

You require the following to build Netty:

Note that this is build-time requirement. JDK 5 (for 3.x) or 6 (for 4.0+) is enough to run your Netty-based application.

Branches to look

Development of all versions takes place in each branch whose name is identical to <majorVersion>.<minorVersion>. For example, the development of 3.9 and 4.0 resides in the branch '3.9' and the branch '4.0' respectively.

Usage with JDK 9

Netty can be used in modular JDK9 applications as a collection of automatic modules. The module names follow the reverse-DNS style, and are derived from subproject names rather than root packages due to historical reasons. They are listed below:

  • io.netty.all
  • io.netty.buffer
  • io.netty.codec
  • io.netty.codec.dns
  • io.netty.codec.haproxy
  • io.netty.codec.http
  • io.netty.codec.http2
  • io.netty.codec.memcache
  • io.netty.codec.mqtt
  • io.netty.codec.redis
  • io.netty.codec.smtp
  • io.netty.codec.socks
  • io.netty.codec.stomp
  • io.netty.codec.xml
  • io.netty.common
  • io.netty.handler
  • io.netty.handler.proxy
  • io.netty.resolver
  • io.netty.resolver.dns
  • io.netty.transport
  • io.netty.transport.epoll (native omitted - reserved keyword in Java)
  • io.netty.transport.kqueue (native omitted - reserved keyword in Java)
  • io.netty.transport.unix.common (native omitted - reserved keyword in Java)
  • io.netty.transport.rxtx
  • io.netty.transport.sctp
  • io.netty.transport.udt

Automatic modules do not provide any means to declare dependencies, so you need to list each used module separately in your module-info file.