Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

build fails on AArch64, Fedora 33 #11229

Closed
LutzWeischerFujitsu opened this issue Apr 12, 2021 · 12 comments
Closed

build fails on AArch64, Fedora 33 #11229

LutzWeischerFujitsu opened this issue Apr 12, 2021 · 12 comments

Comments

@LutzWeischerFujitsu
Copy link

Build for x86-64 only?

[jw@cn05 cratedb]$ ./gradlew compileJava

Task :libs:sql-parser:generateGrammarSource FAILED
Task :libs:pgwire:generateGrammarSource FAILED
Task :libs:shared:compileJava FAILED
Task :libs:guice:compileJava FAILED
Task :libs:es-plugin-classloader:compileJava FAILED
Task :libs:cli:compileJava FAILED

FAILURE: Build completed with 6 failures.

1: Task failed with an exception.

  • What went wrong:
    Execution failed for task ':libs:sql-parser:generateGrammarSource'.

Unable to determine version for JDK located at /home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz. Reason: Command returned unexpected result code: 126
Error output:
/home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz/bin/java: /home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz/bin/java: cannot execute binary file

  • Try:
    Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
    ==============================================================================

2: Task failed with an exception.

  • What went wrong:
    Execution failed for task ':libs:pgwire:generateGrammarSource'.

Unable to determine version for JDK located at /home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz. Reason: Command returned unexpected result code: 126
Error output:
/home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz/bin/java: /home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz/bin/java: cannot execute binary file

  • Try:
    Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
    ==============================================================================

3: Task failed with an exception.

  • What went wrong:
    Execution failed for task ':libs:shared:compileJava'.

Unable to determine version for JDK located at /home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz. Reason: Command returned unexpected result code: 126
Error output:
/home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz/bin/java: /home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz/bin/java: cannot execute binary file

  • Try:
    Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
    ==============================================================================

4: Task failed with an exception.

  • What went wrong:
    Execution failed for task ':libs:es-plugin-classloader:compileJava'.

Unable to determine version for JDK located at /home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz. Reason: Command returned unexpected result code: 126
Error output:
/home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz/bin/java: /home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz/bin/java: cannot execute binary file

  • Try:
    Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
    ==============================================================================

5: Task failed with an exception.

  • What went wrong:
    Execution failed for task ':libs:cli:compileJava'.

Unable to determine version for JDK located at /home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz. Reason: Command returned unexpected result code: 126
Error output:
/home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz/bin/java: /home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz/bin/java: cannot execute binary file

  • Try:
    Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
    ==============================================================================

6: Task failed with an exception.

  • What went wrong:
    Execution failed for task ':libs:guice:compileJava'.

Unable to determine version for JDK located at /home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz. Reason: Command returned unexpected result code: 126
Error output:
/home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz/bin/java: /home/jw/.gradle/caches/transforms-3/6b50cfadbcfc254743b9d4bc2277cb6e/transformed/linux-16-x64.tar.gz/bin/java: cannot execute binary file

  • Try:
    Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
    ==============================================================================

  • Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 5s
13 actionable tasks: 9 executed, 4 up-to-date
[jw@cn05 cratedb]$
@LutzWeischerFujitsu LutzWeischerFujitsu added the triage An issue that needs to be triaged by a maintainer label Apr 12, 2021
@mfussenegger
Copy link
Member

See #11048 (comment), you'll need to set -Dbundled_jdk_arch=aarch64 so that it picks up the correct JDK

@LutzWeischerFujitsu
Copy link
Author

Thanks, that does the trick. However, building 'clean communityEditionDistTar' I get

FAILURE: Build failed with an exception.

  • What went wrong:
    Task 'communityEditionDistTar' not found in root project 'cratedb'.

@mfussenegger
Copy link
Member

However, building 'clean communityEditionDistTar' I get

The community edition is gone because the entire code base is Apache 2 licensed again, so we don't have to make that distinction anymore and the task name is distTar.

@mfussenegger mfussenegger added question and removed triage An issue that needs to be triaged by a maintainer labels Apr 13, 2021
@LutzWeischerFujitsu
Copy link
Author

[jw@cn05 cratedb]$ ./gradlew --info -Dbundled_jdk_arch=aarch64 build
...

Task :libs:dex:forbiddenApisTest FAILED
Caching disabled for task ':libs:dex:forbiddenApisTest' because:
Build cache is disabled
Task ':libs:dex:forbiddenApisTest' is not up-to-date because:
Task has failed previously.
:libs:dex:forbiddenApisTest (Thread[Execution worker for ':' Thread 7,5,main]) completed. Took 0.009 secs.
...
Task :libs:shared:forbiddenApisMain
Caching disabled for task ':libs:shared:forbiddenApisMain' because:
Build cache is disabled
Task ':libs:shared:forbiddenApisMain' is not up-to-date because:
No history is available.
Reading bundled API signatures: jdk-unsafe-11
Reading bundled API signatures: jdk-deprecated-11
Reading API signatures: /data/jw/cratedb/gradle/forbidden-signatures.txt
Loading classes to check...
Scanning classes for violations...
Scanned 47 class file(s) for forbidden API invocations (in 0.60s), 0 error(s).
:libs:shared:forbiddenApisMain (Thread[Execution worker for ':' Thread 43,5,main]) completed. Took 0.613 secs.

FAILURE: Build failed with an exception.

  • What went wrong:
    Execution failed for task ':libs:dex:forbiddenApisTest'.

No signatures were added to task; use properties 'signatures', 'bundledSignatures', 'signaturesURLs', and/or 'signaturesFiles' to define those!

  • Try:
    Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.

  • Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7s
45 actionable tasks: 8 executed, 37 up-to-date
Watching 2091 directories to track changes
[jw@cn05 cratedb]$

@mfussenegger
Copy link
Member

We don't really use to build task, please have a look at our docs in https://github.com/crate/crate/blob/master/devs/docs/basics.rst

@LutzWeischerFujitsu
Copy link
Author

On '... app:run' I get:

...
Successfully started process 'command '/home/jw/.gradle/caches/transforms-3/5fea77ae35781efc3f703ca603556dc5/transformed/linux-16-aarch64.tar.gz/bin/java''
Exception in thread "main" java.lang.ExceptionInInitializerError
at java.base/jdk.internal.icu.text.NormalizerBase$NFKDMode.getNormalizer2(NormalizerBase.java:305)
at java.base/jdk.internal.icu.text.NormalizerBase.normalize(NormalizerBase.java:457)
at java.base/jdk.internal.icu.text.NormalizerBase.normalize(NormalizerBase.java:461)
at java.base/java.text.Normalizer.normalize(Normalizer.java:159)
at java.base/sun.security.x509.AVA.toRFC2253CanonicalString(AVA.java:987)
at java.base/sun.security.x509.RDN.toRFC2253StringInternal(RDN.java:437)
at java.base/sun.security.x509.RDN.toRFC2253String(RDN.java:417)
at java.base/sun.security.x509.X500Name.getRFC2253CanonicalName(X500Name.java:724)
at java.base/sun.security.x509.X500Name.equals(X500Name.java:416)
at java.base/sun.security.pkcs.PKCS7.getCertificate(PKCS7.java:683)
at java.base/sun.security.pkcs.SignerInfo.getCertificate(SignerInfo.java:269)
at java.base/sun.security.pkcs.SignerInfo.verify(SignerInfo.java:429)
at java.base/sun.security.pkcs.PKCS7.verify(PKCS7.java:567)
at java.base/sun.security.pkcs.PKCS7.verify(PKCS7.java:584)
at java.base/sun.security.pkcs.SignerInfo.getTimestamp(SignerInfo.java:656)
at java.base/sun.security.pkcs.SignerInfo.verify(SignerInfo.java:340)
at java.base/sun.security.pkcs.PKCS7.verify(PKCS7.java:567)
at java.base/sun.security.pkcs.PKCS7.verify(PKCS7.java:584)
at java.base/sun.security.util.SignatureFileVerifier.processImpl(SignatureFileVerifier.java:315)
at java.base/sun.security.util.SignatureFileVerifier.process(SignatureFileVerifier.java:291)
at java.base/java.util.jar.JarVerifier.processEntry(JarVerifier.java:316)
at java.base/java.util.jar.JarVerifier.update(JarVerifier.java:230)
at java.base/java.util.jar.JarFile.initializeVerifier(JarFile.java:758)
at java.base/java.util.jar.JarFile.ensureInitialization(JarFile.java:1029)
at java.base/java.util.jar.JavaUtilJarAccessImpl.ensureInitialization(JavaUtilJarAccessImpl.java:72)
at java.base/jdk.internal.loader.URLClassPath$JarLoader$2.getManifest(URLClassPath.java:873)
at java.base/jdk.internal.loader.BuiltinClassLoader.defineClass(BuiltinClassLoader.java:841)
at java.base/jdk.internal.loader.BuiltinClassLoader.findClassOnClassPathOrNull(BuiltinClassLoader.java:753)
at java.base/jdk.internal.loader.BuiltinClassLoader.loadClassOrNull(BuiltinClassLoader.java:676)
at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:634)
at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:182)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:519)
at io.crate.types.DataTypes.(DataTypes.java:85)
at org.elasticsearch.common.settings.Setting.simpleString(Setting.java:1186)
at org.elasticsearch.env.Environment.(Environment.java:57)
at org.elasticsearch.node.InternalSettingsPreparer.prepareEnvironment(InternalSettingsPreparer.java:66)
at io.crate.bootstrap.CrateDB.createEnv(CrateDB.java:112)
at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:81)
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124)
at org.elasticsearch.cli.Command.main(Command.java:90)
at io.crate.bootstrap.CrateDB.main(CrateDB.java:91)
at io.crate.bootstrap.CrateDB.main(CrateDB.java:84)
Caused by: java.lang.NullPointerException: Cannot invoke "java.io.InputStream.available()" because "is" is null
at java.base/jdk.internal.icu.impl.ICUBinary.getRequiredData(ICUBinary.java:94)
at java.base/jdk.internal.icu.impl.NormalizerImpl.load(NormalizerImpl.java:431)
at java.base/jdk.internal.icu.impl.Norm2AllModes$Norm2AllModesSingleton.(Norm2AllModes.java:274)
at java.base/jdk.internal.icu.impl.Norm2AllModes$NFKCSingleton.(Norm2AllModes.java:290)
at java.base/jdk.internal.icu.impl.Norm2AllModes.getNFKCInstance(Norm2AllModes.java:263)
at java.base/jdk.internal.icu.text.Normalizer2.getNFKDInstance(Normalizer2.java:123)
at java.base/jdk.internal.icu.text.NormalizerBase$NFKDModeImpl.(NormalizerBase.java:181)
... 42 more
:app:run (Thread[Execution worker for ':' Thread 10,5,main]) completed. Took 1.078 secs.

FAILURE: Build failed with an exception.

  • What went wrong:
    Execution failed for task ':app:run'.

Process 'command '/home/jw/.gradle/caches/transforms-3/5fea77ae35781efc3f703ca603556dc5/transformed/linux-16-aarch64.tar.gz/bin/java'' finished with non-zero exit value 1

  • Try:
    Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.

  • Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 8s
65 actionable tasks: 13 executed, 52 up-to-date
Watching 2016 directories to track changes
(base) [jw@cn05 cratedb]$

'./app/build/install/crate/bin/crate' seems to work.

@mfussenegger
Copy link
Member

mfussenegger commented Apr 14, 2021 •
edited

Which java version are you using?

The run error is related to #11102
I think we've only been able to reproduce it with JDK 14, and with 15 it should work.

@LutzWeischerFujitsu
Copy link
Author

Java 11 is advised, I read.
Trying Java 16 for 'app:run' fails:

  • What went wrong:
    Execution failed for task ':buildSrc:compileJava'.

java.lang.IllegalAccessError: class org.gradle.internal.compiler.java.ClassNameCollector (in unnamed module @0x2e78b24a) cannot access class com.sun.tools.javac.code.Symbol$TypeSymbol (in module jdk.compiler) because module jdk.compiler does not export com.sun.tools.javac.code to unnamed module @0x2e78b24a

@amotl
Copy link
Member

amotl commented Apr 14, 2021 •
edited

Dear Lutz,

Trying Java 16 for 'app:run' fails.

Thank you for your report on Java 16. May I ask which version of Gradle you are using now? Support for Gradle 7 is currently still in the making. In particular, issues like gradle/gradle#13774, gradle/gradle#15538 and gradle/gradle#16641 indicate some problems in this space, specifically with Java 16. To be on the safe side, maybe you can use Java 15 and Gradle 6 instead, as suggested by @mfussenegger?

Java 11 is advised, I read.

We are constantly trying to keep our documentation updated, but sometimes things are slipping through. May I humbly ask where you read this? Then, I will try to update the relevant spot right away.

With kind regards,
Andreas.

Edit:

May I humbly ask where you read that Java 11 is advised?

Ah, it is right here at https://github.com/crate/crate/blob/master/devs/docs/basics.rst. Sorry for the noise.

@amotl amotl mentioned this issue Apr 14, 2021
Closed
@amotl
Copy link
Member

amotl commented Apr 14, 2021 •
edited

Dear Lutz,

as we want to keep the build process compatible with Java 11 (LTS), we will investigate the java.lang.ExceptionInInitializerError issue, see also #11102 (comment) ff. Thanks again for your reports.

With kind regards,
Andreas.

@mfussenegger
Copy link
Member

mfussenegger commented Apr 14, 2021 •
edited

Closing this one so that we have a single issue to track the :app:run issue with #11102

Thank you @LutzWeischerFujitsu for the report.

@amotl amotl mentioned this issue Apr 14, 2021
Closed
@LutzWeischerFujitsu
Copy link
Author

(base) [jw@cn05 cratedb]$ gradle -version

Gradle 6.8.3

Build time: 2021-02-22 16:13:28 UTC
Revision: 9e26b4a9ebb910eaa1b8da8ff8575e514bc61c78

Kotlin: 1.4.20
Groovy: 2.5.12
Ant: Apache Ant(TM) version 1.10.9 compiled on September 27 2020
JVM: 16 (Red Hat, Inc. 16+36)
OS: Linux 5.8.6-301.fc33.aarch64 aarch64

(base) [jw@cn05 cratedb]$

Java 11: https://crate.io/docs/crate/tutorials/en/latest/install.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@mfussenegger @amotl @LutzWeischerFujitsu