lombok-maven-plugin plugin fails with java version >= 20 during delombok

[CodeWeazle]

We are using the lombok-maven-plugin (1.18.20.0) to generate java code during the build phase for the javadoc plugin.
When running the plugin with Java 20 or higher, it fails with

Unable to delombok: InvocationTargetException: java.lang.NoSuchFieldError Class com.sun.tools.javac.tree.JCTree$JCImport
does not have a member field 'com.sun.tools.javac.tree.JCTree qualid' -> [Help 1]

From the error message of the delombok phase I can get that the @builder annotation on one class failed to produce a builder.

Going back to Java 19 solves this issue for now, but it keeps up form upgrading our java to a higher version