Mirror mojo does not seem to work for target platforms #1554

rcspirent · 2021-07-07T12:07:09Z

rcspirent
Jul 7, 2021

Trying to use tycho-p2-extras-plugin:mirror mojo to mirror a targetplatform which should be possible according to https://www.eclipse.org/tycho/sitedocs/tycho-extras/tycho-p2-extras-plugin/mirror-mojo.html#targetPlatformAsSource but I couldn't find an example or further info anywhere.
So I tried around but couldn't figure it out.

Example pom

<project xmlns="http://maven.apache.org/POM/4.0.0"
	xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd">
	<modelVersion>4.0.0</modelVersion>
	<groupId>example.p2mirror</groupId>
	<artifactId>targetplatform.mirror</artifactId>
	<version>0.0.1-SNAPSHOT</version>
	<packaging>eclipse-repository</packaging>
	<name>targetplatform mirror</name>

	<properties>
		<tycho-version>2.3.0</tycho-version>
	</properties>

	<build>
		<plugins>
			<plugin>
				<groupId>org.eclipse.tycho</groupId>
				<artifactId>tycho-maven-plugin</artifactId>
				<version>${tycho-version}</version>
				<extensions>true</extensions>
			</plugin>
			<plugin>
				<groupId>org.eclipse.tycho.extras</groupId>
				<artifactId>tycho-p2-extras-plugin</artifactId>
				<version>${tycho-version}</version>
				<executions>
					<execution>
						<phase>prepare-package</phase>
						<goals>
							<goal>mirror</goal>
						</goals>
					</execution>
				</executions>
				<configuration>
					<ignoreErrors>false</ignoreErrors>
					<includeOptional>true</includeOptional>
					<includeNonGreedy>false</includeNonGreedy>
					<filter>
					</filter>
					<latestVersionOnly>true</latestVersionOnly>
					<mirrorMetadataOnly>false</mirrorMetadataOnly>
					<compress>false</compress>
					<append>false</append>
					<includePacked>true</includePacked>
					<targetPlatformAsSource>true</targetPlatformAsSource>
					<currentModuleAsSource>false</currentModuleAsSource>
					<source>
					</source>
				</configuration>
			</plugin>
			<plugin>
				<groupId>org.eclipse.tycho</groupId>
				<artifactId>tycho-p2-plugin</artifactId>
				<version>${tycho-version}</version>
			</plugin>
			<plugin>
				<groupId>org.eclipse.tycho</groupId>
				<artifactId>target-platform-configuration</artifactId>
				<version>${tycho-version}</version>
				<configuration>
					<allowConflictingDependencies>true</allowConflictingDependencies>
					<target>
						<file>custom.target</file>
					</target>
				</configuration>
			</plugin>
		</plugins>
	</build>
</project>

Execution via mvn package results in a mostly empty p2 repository.
Direct mojo execution results in

[ERROR] Failed to execute goal org.eclipse.tycho.extras:tycho-p2-extras-plugin:2.3.0:mirror (default-cli) on project targetplatform.mirror: Execution default-cli of goal org.eclipse.tycho.extras:tycho-p2-extras-plugin:2.3.0:mirror failed: Tycho build extension not configured for MavenProject: example.p2mirror:targetplatform.mirror:0.0.1-SNAPSHOT @ C:\dev\eclipse_ws\targetplatform.mirror\pom.xml -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.eclipse.tycho.extras:tycho-p2-extras-plugin:2.3.0:mirror (default-cli) on project targetplatform.mirror: Execution default-cli of goal org.eclipse.tycho.extras:tycho-p2-extras-plugin:2.3.0:mirror failed: Tycho build extension not configured for MavenProject: example.p2mirror:targetplatform.mirror:0.0.1-SNAPSHOT @ C:\dev\eclipse_ws\targetplatform.mirror\pom.xml
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:215)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:156)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:148)
	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117)
	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81)
	at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:56)
	at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:305)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:192)
	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:105)
	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:957)
	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:289)
	at org.apache.maven.cli.MavenCli.main(MavenCli.java:193)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:282)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:225)
	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:406)
	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:347)
Caused by: org.apache.maven.plugin.PluginExecutionException: Execution default-cli of goal org.eclipse.tycho.extras:tycho-p2-extras-plugin:2.3.0:mirror failed: Tycho build extension not configured for MavenProject: example.p2mirror:targetplatform.mirror:0.0.1-SNAPSHOT @ C:\dev\eclipse_ws\targetplatform.mirror\pom.xml
	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:148)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:210)
	... 20 more
Caused by: java.lang.IllegalStateException: Tycho build extension not configured for MavenProject: example.p2mirror:targetplatform.mirror:0.0.1-SNAPSHOT @ C:\dev\eclipse_ws\targetplatform.mirror\pom.xml
	at org.eclipse.tycho.core.utils.TychoProjectUtils.getTargetPlatform(TychoProjectUtils.java:70)
	at org.eclipse.tycho.p2.facade.RepositoryReferenceTool.addTargetPlatformRepository(RepositoryReferenceTool.java:118)
	at org.eclipse.tycho.p2.facade.RepositoryReferenceTool.getVisibleRepositories(RepositoryReferenceTool.java:98)
	at org.eclipse.tycho.plugins.p2.extras.MirrorMojo.execute(MirrorMojo.java:234)
	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:137)
	... 21 more

LorenzoBettini · 2021-12-28T09:21:12Z

LorenzoBettini
Dec 28, 2021

I was trying to figure out how to use that option. Any suggestions, please?

0 replies

laeubi · 2021-12-28T10:25:27Z

laeubi
Dec 28, 2021
Maintainer

I was trying to figure out how to use that option. Any suggestions, please?

The best option is to create a small (github) project showing the error then we can discuss/improve on it.

0 replies

LorenzoBettini · 2021-12-28T18:03:02Z

LorenzoBettini
Dec 28, 2021

@laeubi I didn't experience any error: I simply have no idea on how to use that option..

0 replies

mdaloia · 2023-07-29T01:58:13Z

mdaloia
Jul 29, 2023

Hi @laeubi !

I'm bumping this discussion as I faced the same issue.

I'm currently using the mirror-target-to-repo goal from JBoss Tools Maven plugins (source) to mirror the IUs declared in a .target file.
As it seems that it is not updated anymore to newer Tycho versions, I'm trying to replace it with the mirror goal from Tycho.

Based on this documentation and the mirror goal doc, I tried several configurations and I couldn't make it work. Using a target file I always get a empty repository (with just a artifacts.jar and content.jar) as you could see on the first ls of this image:

I used Maven 3.9.3, Tycho 4.0.0 and Java 17 to run it.

It would be really helpful to have a working example that could mirror a target file that contains different kind of declarations (plugins, features, with or without specific versions, with maven coordinates and maybe others).

Below you could find a simple reproducer example with up-to-date versions:

`custom.target`

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<?pde version="3.8"?>

<target name="Custom target" sequenceNumber="1">

    <locations>
        <location includeAllPlatforms="false" includeConfigurePhase="false" includeMode="planner" includeSource="true" type="InstallableUnit">

            <!-- A specific plugin -->
            <unit id="org.eclipse.core.commands" version="3.11.0.v20230317-0802"/>

            <!-- A specific feature -->
            <unit id="org.eclipse.help.feature.group" version="2.3.1400.v20230605-0440"/>

            <!-- Latest version of a plugin (should be 31.1.0.jre) -->
            <unit id="com.google.guava" version="0.0.0"/>

            <repository location="https://download.eclipse.org/releases/2023-06/202306141000/"/>
        </location>
    </locations>

</target>

`pom.xml`

<?xml version="1.0" encoding="UTF-8" ?>

<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>

    <groupId>example</groupId>
    <artifactId>custom-mirror</artifactId>
    <version>1.0.0</version>
    <packaging>eclipse-repository</packaging>

    <properties>
        <tycho.version>4.0.0</tycho.version>
    </properties>

    <dependencies>
        <!-- To test <pomDependencies>consider</pomDependencies> -->
        <dependency>
            <groupId>org.javassist</groupId>
            <artifactId>javassist</artifactId>
            <version>3.25.0-GA</version>
        </dependency>
    </dependencies>

    <build>
        <plugins>
            <plugin>
                <groupId>org.eclipse.tycho</groupId>
                <artifactId>tycho-maven-plugin</artifactId>
                <version>${tycho.version}</version>
                <extensions>true</extensions>
            </plugin>

            <plugin>
                <groupId>org.eclipse.tycho</groupId>
                <artifactId>target-platform-configuration</artifactId>
                <version>${tycho.version}</version>
                <configuration>
                    <executionEnvironment>JavaSE-17</executionEnvironment>
                    <pomDependencies>consider</pomDependencies>
                    <target>
                        <file>custom.target</file>
                    </target>
                    <targetDefinitionIncludeSource>force</targetDefinitionIncludeSource>
                </configuration>
            </plugin>

            <plugin>
                <groupId>org.eclipse.tycho.extras</groupId>
                <artifactId>tycho-p2-extras-plugin</artifactId>
                <version>${tycho.version}</version>
                <executions>
                    <execution>
                        <id>mirror-using-target</id>
                        <phase>prepare-package</phase>
                        <goals>
                            <goal>mirror</goal>
                        </goals>
                        <configuration>
                            <name>Custom Mirror Update Site (using target)</name>
                            <destination>${basedir}/target/repository-target</destination>

                            <targetPlatformAsSource>true</targetPlatformAsSource>
                            <currentModuleAsSource>false</currentModuleAsSource>
                        </configuration>
                    </execution>
                </executions>
            </plugin>

        </plugins>
    </build>

</project>

Thanks in advance

4 replies

laeubi Jul 29, 2023
Maintainer

I think @merks is using mirror goal of Tycho so he can maybe give better advice, beside that I always found it easier to use a category.xml when I want to build a repository with some specific stuff.

It would be really helpful to have a working example that could mirror a target file that contains different kind of declarations (plugins, features, with or without specific versions, with maven coordinates and maybe others).

We have some tests here:
https://github.com/eclipse-tycho/tycho/tree/master/tycho-extras/tycho-p2-extras-plugin/src/test/resources/mirroring

it would be great to also have a demo so if someone likes to contribute one ... just open a PR :-)

merks Jul 29, 2023

I haven't used the mirror goal to try to mirror a target platform's contents. For that purpose, I expect a category.xml definition that pulls in whatever is desired from the target platform would indeed be simpler.

For more complex aggregations (subsets and composition directly from other p2 repositories), I use the CBI p2 aggregator, e.g.,

sbouchet Aug 31, 2023

Hi,
i'm the person who maintain the jbosstools tycho mojos.
i would also like to use the p2 extra mojos for mirroring target platform contents to a p2 repo, and not maintain our own one.

i created a simple use case from the above example : https://github.com/sbouchet/tycho_examples/tree/master/discussions_1554/tycho-extras.mirrorTargetPlatform

when running it, the build fails :

[INFO] Scanning for projects...
[INFO] Tycho Version:  4.0.2 (d1245889ae2522a3057c2300142b212c6c7c60c8)
[INFO] Tycho Mode:     project
[INFO] Tycho Builder:  maven
[WARNING] No explicit target runtime environment configuration. Build is platform dependent.
[WARNING] No explicit target runtime environment configuration. Build is platform dependent.
[INFO] 
[INFO] �[1m-----------------------< �[0;36mexample:custom-mirror�[0;1m >------------------------�[m
[INFO] �[1mBuilding custom-mirror 1.0.0�[m
[INFO]   from pom.xml
[INFO] �[1m-------------------------[ eclipse-repository ]-------------------------�[m
[INFO] Resolving target definition file:/home/sbouchet/git/tycho_examples/discussions_1554/tycho-extras.mirrorTargetPlatform/custom.target for environments=[linux/gtk/x86_64], include source mode=force, referenced repository mode =ignore, execution environment=StandardEEResolutionHints [executionEnvironment=OSGi profile 'JavaSE-17' { source level: 17, target level: 17}], remote p2 repository options=org.eclipse.tycho.p2maven.DefaultProvisioningAgent@5ace2ce3
[INFO] ### Using TychoRepositoryTransport for remote P2 access ###
[INFO]     Cache location:         /home/sbouchet/.m2/repository/.cache/tycho
[INFO]     Transport mode:         online
[INFO]     Http Transport type:    Java11Client
[INFO]     Update mode:            cache first
[INFO]     Minimum cache duration: 60 minutes
[INFO]       (you can configure this with -Dtycho.p2.transport.min-cache-minutes=<desired minimum cache duration>)
[INFO] Resolving dependencies of MavenProject: example:custom-mirror:1.0.0 @ /home/sbouchet/git/tycho_examples/discussions_1554/tycho-extras.mirrorTargetPlatform/pom.xml
[INFO] 
[INFO] �[1m--- �[0;32mtycho-packaging:4.0.2:build-qualifier-aggregator�[m �[1m(default-build-qualifier-aggregator)�[m @ �[36mcustom-mirror�[0;1m ---�[m
[INFO] The project's OSGi version is 1.0.0
[INFO] 
[INFO] �[1m--- �[0;32mclean:3.2.0:clean�[m �[1m(default-clean-1)�[m @ �[36mcustom-mirror�[0;1m ---�[m
[INFO] Deleting /home/sbouchet/git/tycho_examples/discussions_1554/tycho-extras.mirrorTargetPlatform/target
[INFO] 
[INFO] �[1m--- �[0;32mtarget-platform-configuration:4.0.2:target-platform�[m �[1m(default-target-platform)�[m @ �[36mcustom-mirror�[0;1m ---�[m
[INFO] 
[INFO] �[1m--- �[0;32mresources:2.4.3:resources�[m �[1m(default-resources)�[m @ �[36mcustom-mirror�[0;1m ---�[m
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] Copying 0 resource
[INFO] 
[INFO] �[1m--- �[0;32mtycho-p2-publisher:4.0.2:publish-osgi-ee�[m �[1m(default-publish-osgi-ee)�[m @ �[36mcustom-mirror�[0;1m ---�[m
[WARNING]  Parameter 'qualifier' (user property 'buildQualifier') is read-only, must not be used in configuration
[INFO] Published profile IUs: [a.jre.javase 17.0.0]
[INFO] 
[INFO] �[1m--- �[0;32mtycho-p2-publisher:4.0.2:publish-products�[m �[1m(default-publish-products)�[m @ �[36mcustom-mirror�[0;1m ---�[m
[WARNING]  Parameter 'qualifier' (user property 'buildQualifier') is read-only, must not be used in configuration
[INFO] 
[INFO] �[1m--- �[0;32mtycho-p2-publisher:4.0.2:publish-categories�[m �[1m(default-publish-categories)�[m @ �[36mcustom-mirror�[0;1m ---�[m
[WARNING]  Parameter 'qualifier' (user property 'buildQualifier') is read-only, must not be used in configuration
[INFO] 
[INFO] �[1m--- �[0;32mtycho-p2-publisher:4.0.2:attach-artifacts�[m �[1m(default-attach-artifacts)�[m @ �[36mcustom-mirror�[0;1m ---�[m
[WARNING]  Parameter 'qualifier' (user property 'buildQualifier') is read-only, must not be used in configuration
[INFO] 
[INFO] �[1m--- �[0;32mtycho-p2-repository:4.0.2:assemble-repository�[m �[1m(default-assemble-repository)�[m @ �[36mcustom-mirror�[0;1m ---�[m
[WARNING]  Parameter 'qualifier' (user property 'buildQualifier') is read-only, must not be used in configuration
[INFO] Copying resources from /home/sbouchet/git/tycho_examples/discussions_1554/tycho-extras.mirrorTargetPlatform/target/classes to /home/sbouchet/git/tycho_examples/discussions_1554/tycho-extras.mirrorTargetPlatform/target/repository
[INFO] 
[INFO] �[1m--- �[0;32mtycho-p2-extras:4.0.2:mirror�[m �[1m(mirror-using-target)�[m @ �[36mcustom-mirror�[0;1m ---�[m
[INFO] Mirroring to /home/sbouchet/git/tycho_examples/discussions_1554/tycho-extras.mirrorTargetPlatform/target/repository-target
[INFO] �[1m------------------------------------------------------------------------�[m
[INFO] �[1;31mBUILD FAILURE�[m
[INFO] �[1m------------------------------------------------------------------------�[m
[INFO] Total time:  7.038 s
[INFO] Finished at: 2023-08-31T12:34:49+02:00
[INFO] �[1m------------------------------------------------------------------------�[m
[ERROR] Failed to execute goal �[32morg.eclipse.tycho.extras:tycho-p2-extras-plugin:4.0.2:mirror�[m �[1m(mirror-using-target)�[m on project �[36mcustom-mirror�[m: �[1;31mError during mirroring�[m: Could not find IU [org.eclipse.core.commands, 0.0.0] in any of the source repositories [file:/home/sbouchet/git/tycho_examples/discussions_1554/tycho-extras.mirrorTargetPlatform/target/targetPlatformRepository/] -> �[1m[Help 1]�[m
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the �[1m-e�[m switch.
[ERROR] Re-run Maven using the �[1m-X�[m switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] �[1m[Help 1]�[m http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

i explicitely ask to mirror one of the id from the tp that exists.

if i rtemove that specific iu, the build is successfull, but the mirror does not contains anything.

looking closely to the log, i can see prior to mirror goal that tycho publish osgi bundles, products and categories before assemblying a repository in target/repository . and there is noting published in there making the build failling/empty.

laeubi Aug 31, 2023
Maintainer

@mickaelistria @akurtakov any of you are familiar with the mirror-mojo and its usage?

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Mirror mojo does not seem to work for target platforms #1554

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 4 comments 4 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Mirror mojo does not seem to work for target platforms #1554

rcspirent Jul 7, 2021

Replies: 4 comments · 4 replies

LorenzoBettini Dec 28, 2021

laeubi Dec 28, 2021 Maintainer

LorenzoBettini Dec 28, 2021

mdaloia Jul 29, 2023

custom.target

pom.xml

laeubi Jul 29, 2023 Maintainer

merks Jul 29, 2023

sbouchet Aug 31, 2023

laeubi Aug 31, 2023 Maintainer

rcspirent
Jul 7, 2021

Replies: 4 comments 4 replies

LorenzoBettini
Dec 28, 2021

laeubi
Dec 28, 2021
Maintainer

LorenzoBettini
Dec 28, 2021

mdaloia
Jul 29, 2023

`custom.target`

`pom.xml`

laeubi Jul 29, 2023
Maintainer

laeubi Aug 31, 2023
Maintainer