[JDK 21] Build and run Trino on JDK 21

[wendigo]

Known problems:

• extra-enforcer-rules does not recognize JDK 21 with the enforceBytecodeVersion rule (when project.build.targetJdk is set to 21)
  • Recognize JDK 21 class format mojohaus/extra-enforcer-rules#262 Update extra-enforcer-rules to 1.7.0 airlift/airbase#360
• maven-dependency-plugin cannot read JDK 21 classes Unsupported class file major version 65 (old ASM is used)
  • updating plugin ASM dependency works Upgrade bunch of dependencies airlift/airbase#359
• modernizer-maven-plugin cannot read JDK 21 classes Unsupported class file major version 65 (old ASM is used)
  • updating plugin ASM dependency works Upgrade bunch of dependencies airlift/airbase#359
• maven-shade-plugin cannot shade JDK 21 classes
  • updating plugin ASM dependency works Upgrade bunch of dependencies airlift/airbase#359
• guice is shading outdated ASM
• replace synchronized methods and blocks with locks usage
• refactor managed classes that are accepting ThreadPoolExecutors (JMX)
• update Airlift to use Virtual Threads for jetty-client and jetty-server
• update error-prone to version supporting JDK 21 (JDK21 compatibility google/error-prone#3843 & JDK 21 - NoSuchMethodError for TreeMaker.Select typetools/checker-framework#5672)
• fix/update ignite to include fix for JDBC driver doesn't work on JDK 21-ea apache/ignite#10720 (IGNITE-19652 Adapt to DirectByteBuffer ctor changes in JDK 21 apache/ignite#10764 (comment))
• update PMD in airbase to a version that works unders 21 ([java] Support JDK 21 (LTS) pmd/pmd#4583)
• Allow writing to externally provided JDK #18797
• Update Arrow to 13.0.0 #18796

[wendigo]

With the ./mvnw clean install -DskipTests -nsu -T 1C -U -Dair.check.skip-enforcer -Dair.check.skip-modernizer and:

• maven-dependency-plugin with ASM updated to 9.5 works correctly
• maven-shade-plugin with ASM updated to 9.5 works correctly (Bump asmVersion from 9.4 to 9.5 apache/maven-shade-plugin#184)

I was able to compile Trino with JDK 21 as a target.

I'm gonna submit the PR to maven-dependency-plugin and maven-enforcer-plugin

[wendigo]

I've been able to compile and run Trino with mentioned changes on JDK 21:

❯ docker run trino:413-SNAPSHOT-arm64
+ launcher_opts=(--etc-dir /etc/trino)
+ grep -s -q node.id /etc/trino/node.properties
+ launcher_opts+=("-Dnode.id=${HOSTNAME}")
+ exec /usr/lib/trino/bin/launcher run --etc-dir /etc/trino -Dnode.id=f553225d9acc
WARNING: Support for the ARM architecture is experimental
# WARNING: Unable to attach Serviceability Agent. You can try again with escalated privileges. Two options: a) use -Djol.tryWithSudo=true to try with sudo; b) echo 0 | sudo tee /proc/sys/kernel/yama/ptrace_scope
Apr 13, 2023 10:41:20 AM io.airlift.log.Logger info
INFO: Java version: 21-ea

Querying TPCH works just fine :)

[wendigo]

https://github.com/apache/maven-dependency-analyzer was already upgraded to ASM 9.5 and released so I assume that it will soon land in maven-dependency-plugin

[chenjian2664]

OMG, JDK21 is available 😱

[wendigo]

@chenjian2664 it's not ;) Targeted for September but we want to be prepared to switch to it

[chenjian2664]

@wendigo So cool

[wendigo]

Related: #17044

[wendigo]

Related: #17484

[wendigo]

airlift/airbase#359 fixes maven plugins compatibility

[wendigo]

I've just verified that error-prone HEAD works fine with JDK 21 after google/error-prone#3918

[wendigo]

airlift/airbase#359

[wendigo]

#17740

[wendigo]

diff --git a/pom.xml b/pom.xml
index 3e6fdb8d73..e01e285d30 100644
--- a/pom.xml
+++ b/pom.xml
@@ -60,7 +60,7 @@
         <dep.drift.version>1.14</dep.drift.version>
         <dep.tempto.version>196</dep.tempto.version>
         <dep.gcs.version>2.2.8</dep.gcs.version>
-        <dep.errorprone.version>2.19.1</dep.errorprone.version>
+        <dep.errorprone.version>HEAD-SNAPSHOT</dep.errorprone.version>
         <dep.testcontainers.version>1.18.3</dep.testcontainers.version>
         <dep.duct-tape.version>1.0.8</dep.duct-tape.version>
         <dep.coral.version>2.0.153</dep.coral.version>
@@ -206,6 +206,19 @@
         <module>testing/trino-tests</module>
     </modules>

+    <repositories>
+        <repository>
+            <id>oss.sonatype.org-snapshot</id>
+            <url>https://oss.sonatype.org/content/repositories/snapshots</url>
+            <releases>
+                <enabled>false</enabled>
+            </releases>
+            <snapshots>
+                <enabled>true</enabled>
+            </snapshots>
+        </repository>
+    </repositories>
+
     <dependencyManagement>
         <dependencies>
             <!-- Trino -->
@@ -2074,6 +2087,7 @@
                                     <exclude>com.google.guava:guava</exclude>
                                     <exclude>com.fasterxml.jackson.core:jackson-core</exclude>
                                     <exclude>com.google.j2objc:j2objc-annotations</exclude>
+                                    <exclude>com.google.errorprone:error_prone_annotations</exclude>
                                 </excludes>
                             </requireUpperBoundDeps>
                             <bannedDependencies>

error-prone HEAD-SNAPSHOT is working with jdk 21

[wendigo]

#17770

[wendigo]

https://github.com/google/error-prone/releases/tag/v2.20.0

[wendigo]

#17941

[wendigo]

Blocked by #18272 (it's a regression starting with JDK 20)

[wendigo]

Requires #18931 (dropping HDP2.6 images which are based on Centos6 shipped with old glibc. This prevents installing Temurin JDK 21 and other builds)

[mosabua]

Trino 432 now uses Java 21 in the Trino Docker image.

[mosabua]

The 0.14.0 release of the Trino Helm charts https://github.com/trinodb/charts now uses Trino 432 and therefore Java 21.

[mosabua]

The blog post https://trino.io/blog/2023/11/03/java-21 announces our plans to require Java 21 and asks for feedback and testing reports.

[mosabua]

Announced on Trino slack and linkedin
as well https://www.linkedin.com/feed/update/urn:li:activity:7126324119733686272