Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-36729][BUILD] Upgrade Netty from 4.1.63 to 4.1.68 #33970

Closed
wants to merge 1 commit into from

Conversation

sarutak
Copy link
Member

@sarutak sarutak commented Sep 12, 2021

What changes were proposed in this pull request?

This PR upgrades Netty from 4.1.63 to 4.1.68.

All the changes from 4.1.64 to 4.1.68 are as follows.

Why are the changes needed?

Recently Netty 4.1.68 was released, which includes official M1 Mac support.

4.1.65 also includes a critical bug fix which Spark might be affected.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

CIs.

@github-actions github-actions bot added the BUILD label Sep 12, 2021
Copy link
Member

@srowen srowen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good pending tests - if this is a minor upgrade for 3.2.0 could go in there too IMHO

@SparkQA
Copy link

SparkQA commented Sep 12, 2021

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47681/

@SparkQA
Copy link

SparkQA commented Sep 12, 2021

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47681/

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Thank you, @sarutak and @srowen .
Yes, we need this in 3.2.0 for M1 support and https://bugs.openjdk.java.net/browse/JDK-8266310 .

dongjoon-hyun pushed a commit that referenced this pull request Sep 12, 2021
### What changes were proposed in this pull request?

This PR upgrades Netty from `4.1.63` to `4.1.68`.

All the changes from `4.1.64` to `4.1.68` are as follows.

* 4.1.64 and 4.1.65
  * https://netty.io/news/2021/05/19/4-1-65-Final.html
* 4.1.66
  * https://netty.io/news/2021/07/16/4-1-66-Final.html
* 4.1.67
  * https://netty.io/news/2021/08/16/4-1-67-Final.html
* 4.1.68
  * https://netty.io/news/2021/09/09/4-1-68-Final.html

### Why are the changes needed?

Recently Netty `4.1.68` was released, which includes official M1 Mac support.
* Add support for mac m1
  * netty/netty#11666

`4.1.65` also includes a critical bug fix which Spark might be affected.
* JNI classloader deadlock with latest JDK version
  * netty/netty#11209

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

CIs.

Closes #33970 from sarutak/upgrade-netty-4.1.68.

Authored-by: Kousuke Saruta <sarutak@oss.nttdata.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit e1e1961)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@dongjoon-hyun
Copy link
Member

cc @gengliangwang

@SparkQA
Copy link

SparkQA commented Sep 12, 2021

Test build #143178 has finished for PR 33970 at commit e92acf4.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@gengliangwang
Copy link
Member

Late +1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
5 participants