Reduce AZP build to a minimal subset of core, except when running on Windows

[rnorth]

No description provided.

[rnorth]

I think this is right, but obviously want to test it.

[rnorth]

AZP build failed - will investigate in a little while.

[rnorth]

/azp run Windows 10 - Docker for Windows

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[rnorth]

/azp run Windows 10 - Docker for Windows

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[rnorth]

@bsideup I'm not certain, but I think we might need a variable to be set on the Windows build agent.

This conditional:

# Run all tests when running the Windows CI tests
- job: full_build_windows
  condition: eq(variables['Agent.OS'], 'Windows_NT')

seems to be evaluating to:

Expanded: eq(Null, 'Windows_NT')
Result: False

Agent.OS is apparently a standard property, but I wonder if that's only true for Azure-provided build workers.

Any thoughts?

[rnorth]

/azp run Windows 10 - Docker for Windows

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[rnorth]

/azp run Windows 10 - Docker for Windows

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[rnorth]

I think I have a solution to the problem now - Agent.OS is only available within a job. So I've contracted the two different Linux/Windows builds into a single job, with a conditional on each step to decide which scale of build to run.

[rnorth]

/azp run Windows 10 - Docker for Windows

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[bsideup]

IIRC we can change it based on conditions (all on Windows, subset otherwise)

[rnorth]

I thought so too, and have been scouring the documentation to try and find out how to do this, but so far no luck. Have you seen anything concrete?

[bsideup]

try https://docs.microsoft.com/en-us/azure/devops/pipelines/process/expressions?view=azure-devops#conditional-insertion

[rnorth]

Aha, I'd missed that - cheers.

[rnorth]

The Agent.OS variable is not set at the point in time when conditional insertion takes place, so I was unable to set a variable.

For example:

variables:
  ${{ if eq(variables['Agent.OS'], 'Linux') }}:
    # Run minimal core subset of tests on Linux
    tasks: "testcontainers:test --tests GenericContainerRuleTest"
  ${{ if eq(variables['Agent.OS'], 'Windows_NT') }}:
    # Run all checks on Windows
    tasks: "check"

would effectively do nothing, because neither branch is actually true. The tasks variable was unset at the time of use in the Gradle@2 task, and caused an error when trying to use it.

Just in case something else was the problem, I tried:

variables:
  ${{ if eq(variables['Agent.OS'], 'Linux') }}:
    # Run minimal core subset of tests on Linux
    tasks: "testcontainers:test --tests GenericContainerRuleTest"
  ${{ if ne(variables['Agent.OS'], 'Windows_NT') }}:
    # Run all checks on Windows
    tasks: "check"

(the difference is ne, not eq, on the second branch).

With this, the tasks variable was set, but always to "check". So this demonstrates that the conditional insertion is working, and the placeholder resolution is working - the problem is just that Agent.OS is not set when the pipeline file is compiled, which is before it hits a build agent.

I rolled back the branch to get rid of the messy trail of commits that I created while trying to figure this out! 😅

[rnorth]

/azp run Windows 10 - Docker for Windows

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).