Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Migrate CI from azure pipelines to GitHub Actions (#4730)
* Run isort, black, mypy, flake8 checks via pre-commit * Fix line ending * Fix end of line * Fix mypy pre-commit hook. Thanks @keewis * Add main CI * Add additional CI * Fetch all history for all branches and tags * Add windows environment * Import xarray * Add doctests workflow * Add minimum version policy workflow * Simplify if logic * Add flaky and backend-api-v2 settings * Fix if elif else statements * Fix typo * Remove azure pipelines configurations * Fix environment file name * Upload code coverage for additional CI * Cache conda pkgs_dir * Fix cache key * Remove unnecessary cache number variable * Use `runner.os` instead of `matrix.os` * Use RUNNER_OS env variable * Disable name for the time being * Another attempt at setting name * `runner.os` doesn't work. Use `matrix.os` instead * Update env creation guidelines * Add `pre-commit run --all-files` check * Update blackdoc version * Add new pre-commit hooks * Add some of the out-of-the box hooks * Formatting only * Remove bad change * Remove isort and add pre-commit * Fix bad merge * Enable `cfgrib` on windows for the time being * Disable cfgrib on windows * Remove coveralls * Formatting only * Remove remaining reference to azure pipelines * Remove py 3.6 from CI matrix * Use py37 * Remove all references to py36 env file * Add check for skip ci * rename job to `detect ci trigger` * [skip ci] Empty commit * [skip-ci] Test skip CI trigger * Update PR template * Fix typ * GH markdown doesn't like lists in <sub></sub> * Remove the `-OO` flag for consistency
- Loading branch information
1 parent
db6f4be
commit d241aa4
Showing
36 changed files
with
369 additions
and
382 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -56,4 +56,4 @@ limitPerRun: 1 # start with a small number | |
|
|
||
| # issues: | ||
| # exemptLabels: | ||
| # - confirmed | ||
| # - confirmed | ||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,188 @@ | ||
| name: CI Additional | ||
| on: | ||
| push: | ||
| branches: | ||
| - "*" | ||
| pull_request: | ||
| branches: | ||
| - "*" | ||
| workflow_dispatch: # allows you to trigger manually | ||
|
|
||
| jobs: | ||
| detect-ci-trigger: | ||
| name: detect ci trigger | ||
| runs-on: ubuntu-latest | ||
| if: github.event_name == 'push' || github.event_name == 'pull_request' | ||
| outputs: | ||
| triggered: ${{ steps.detect-trigger.outputs.trigger-found }} | ||
| steps: | ||
| - uses: actions/checkout@v2 | ||
| - uses: ./.github/actions/detect-ci-trigger | ||
| id: detect-trigger | ||
| with: | ||
| keyword: "[skip-ci]" | ||
|
|
||
| test: | ||
| name: ${{ matrix.os }} ${{ matrix.env }} | ||
| runs-on: ${{ matrix.os }} | ||
| needs: detect-ci-trigger | ||
| if: needs.detect-ci-trigger.outputs.triggered == 'false' | ||
| defaults: | ||
| run: | ||
| shell: bash -l {0} | ||
| strategy: | ||
| fail-fast: false | ||
| matrix: | ||
| os: ["ubuntu-latest"] | ||
| env: | ||
| [ | ||
| "py37-bare-minimum", | ||
| "py37-min-all-deps", | ||
| "py37-min-nep18", | ||
| "py38-all-but-dask", | ||
| "py38-backend-api-v2", | ||
| "py38-flaky", | ||
| ] | ||
| steps: | ||
| - name: Cancel previous runs | ||
| uses: styfle/cancel-workflow-action@0.6.0 | ||
| with: | ||
| access_token: ${{ github.token }} | ||
| - uses: actions/checkout@v2 | ||
| with: | ||
| fetch-depth: 0 # Fetch all history for all branches and tags. | ||
|
|
||
| - name: Set environment variables | ||
| run: | | ||
| if [[ ${{ matrix.env }} == "py38-backend-api-v2" ]] ; | ||
| then | ||
| echo "CONDA_ENV_FILE=ci/requirements/environment.yml" >> $GITHUB_ENV | ||
| echo "XARRAY_BACKEND_API=v2" >> $GITHUB_ENV | ||
| elif [[ ${{ matrix.env }} == "py38-flaky" ]] ; | ||
| then | ||
| echo "CONDA_ENV_FILE=ci/requirements/environment.yml" >> $GITHUB_ENV | ||
| echo "PYTEST_EXTRA_FLAGS=--run-flaky --run-network-tests" >> $GITHUB_ENV | ||
| else | ||
| echo "CONDA_ENV_FILE=ci/requirements/${{ matrix.env }}.yml" >> $GITHUB_ENV | ||
| fi | ||
| - name: Cache conda | ||
| uses: actions/cache@v2 | ||
| with: | ||
| path: ~/conda_pkgs_dir | ||
| key: | ||
| ${{ runner.os }}-conda-${{ matrix.env }}-${{ | ||
| hashFiles('ci/requirements/**.yml') }} | ||
|
|
||
| - uses: conda-incubator/setup-miniconda@v2 | ||
| with: | ||
| channels: conda-forge | ||
| channel-priority: strict | ||
| mamba-version: "*" | ||
| activate-environment: xarray-tests | ||
| auto-update-conda: false | ||
| python-version: 3.8 | ||
| use-only-tar-bz2: true | ||
|
|
||
| - name: Install conda dependencies | ||
| run: | | ||
| mamba env update -f $CONDA_ENV_FILE | ||
| - name: Install xarray | ||
| run: | | ||
| python -m pip install --no-deps -e . | ||
| - name: Version info | ||
| run: | | ||
| conda info -a | ||
| conda list | ||
| python xarray/util/print_versions.py | ||
| - name: Import xarray | ||
| run: | | ||
| python -c "import xarray" | ||
| - name: Run tests | ||
| run: | | ||
| python -m pytest -n 4 \ | ||
| --cov=xarray \ | ||
| --cov-report=xml \ | ||
| $PYTEST_EXTRA_FLAGS | ||
| - name: Upload code coverage to Codecov | ||
| uses: codecov/codecov-action@v1 | ||
| with: | ||
| file: ./coverage.xml | ||
| flags: unittests,${{ matrix.env }} | ||
| env_vars: RUNNER_OS | ||
| name: codecov-umbrella | ||
| fail_ci_if_error: false | ||
| doctest: | ||
| name: Doctests | ||
| runs-on: "ubuntu-latest" | ||
| needs: detect-ci-trigger | ||
| if: needs.detect-ci-trigger.outputs.triggered == 'false' | ||
| defaults: | ||
| run: | ||
| shell: bash -l {0} | ||
|
|
||
| steps: | ||
| - name: Cancel previous runs | ||
| uses: styfle/cancel-workflow-action@0.6.0 | ||
| with: | ||
| access_token: ${{ github.token }} | ||
| - uses: actions/checkout@v2 | ||
| with: | ||
| fetch-depth: 0 # Fetch all history for all branches and tags. | ||
| - uses: conda-incubator/setup-miniconda@v2 | ||
| with: | ||
| channels: conda-forge | ||
| channel-priority: strict | ||
| mamba-version: "*" | ||
| activate-environment: xarray-tests | ||
| auto-update-conda: false | ||
| python-version: "3.8" | ||
|
|
||
| - name: Install conda dependencies | ||
| run: | | ||
| mamba env update -f ci/requirements/environment.yml | ||
| - name: Install xarray | ||
| run: | | ||
| python -m pip install --no-deps -e . | ||
| - name: Version info | ||
| run: | | ||
| conda info -a | ||
| conda list | ||
| python xarray/util/print_versions.py | ||
| - name: Run doctests | ||
| run: | | ||
| python -m pytest --doctest-modules xarray --ignore xarray/tests | ||
| min-version-policy: | ||
| name: Minimum Version Policy | ||
| runs-on: "ubuntu-latest" | ||
| needs: detect-ci-trigger | ||
| if: needs.detect-ci-trigger.outputs.triggered == 'false' | ||
| defaults: | ||
| run: | ||
| shell: bash -l {0} | ||
|
|
||
| steps: | ||
| - name: Cancel previous runs | ||
| uses: styfle/cancel-workflow-action@0.6.0 | ||
| with: | ||
| access_token: ${{ github.token }} | ||
| - uses: actions/checkout@v2 | ||
| with: | ||
| fetch-depth: 0 # Fetch all history for all branches and tags. | ||
| - uses: conda-incubator/setup-miniconda@v2 | ||
| with: | ||
| channels: conda-forge | ||
| channel-priority: strict | ||
| mamba-version: "*" | ||
| auto-update-conda: false | ||
|
|
||
| - name: minimum versions policy | ||
| run: | | ||
| mamba install -y pyyaml | ||
| python ci/min_deps_check.py ci/requirements/py37-bare-minimum.yml | ||
| python ci/min_deps_check.py ci/requirements/py37-min-all-deps.yml |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,16 @@ | ||
| name: linting | ||
|
|
||
| on: | ||
| push: | ||
| branches: "*" | ||
| pull_request: | ||
| branches: "*" | ||
|
|
||
| jobs: | ||
| linting: | ||
| name: "pre-commit hooks" | ||
| runs-on: ubuntu-latest | ||
| steps: | ||
| - uses: actions/checkout@v2 | ||
| - uses: actions/setup-python@v2 | ||
| - uses: pre-commit/action@v2.0.0 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,102 @@ | ||
| name: CI | ||
| on: | ||
| push: | ||
| branches: | ||
| - "*" | ||
| pull_request: | ||
| branches: | ||
| - "*" | ||
| workflow_dispatch: # allows you to trigger manually | ||
|
|
||
| jobs: | ||
| detect-ci-trigger: | ||
| name: detect ci trigger | ||
| runs-on: ubuntu-latest | ||
| if: github.event_name == 'push' || github.event_name == 'pull_request' | ||
| outputs: | ||
| triggered: ${{ steps.detect-trigger.outputs.trigger-found }} | ||
| steps: | ||
| - uses: actions/checkout@v2 | ||
| - uses: ./.github/actions/detect-ci-trigger | ||
| id: detect-trigger | ||
| with: | ||
| keyword: "[skip-ci]" | ||
| test: | ||
| name: ${{ matrix.os }} py${{ matrix.python-version }} | ||
| runs-on: ${{ matrix.os }} | ||
| needs: detect-ci-trigger | ||
| if: needs.detect-ci-trigger.outputs.triggered == 'false' | ||
| defaults: | ||
| run: | ||
| shell: bash -l {0} | ||
| strategy: | ||
| fail-fast: false | ||
| matrix: | ||
| os: ["ubuntu-latest", "macos-latest", "windows-latest"] | ||
| python-version: ["3.7", "3.8"] | ||
| steps: | ||
| - name: Cancel previous runs | ||
| uses: styfle/cancel-workflow-action@0.6.0 | ||
| with: | ||
| access_token: ${{ github.token }} | ||
| - uses: actions/checkout@v2 | ||
| with: | ||
| fetch-depth: 0 # Fetch all history for all branches and tags. | ||
| - name: Set environment variables | ||
| run: | | ||
| if [[ ${{ matrix.os }} == windows* ]] ; | ||
| then | ||
| echo "CONDA_ENV_FILE=ci/requirements/environment-windows.yml" >> $GITHUB_ENV | ||
| else | ||
| echo "CONDA_ENV_FILE=ci/requirements/environment.yml" >> $GITHUB_ENV | ||
| fi | ||
| echo "PYTHON_VERSION=${{ matrix.python-version }}" >> $GITHUB_ENV | ||
| - name: Cache conda | ||
| uses: actions/cache@v2 | ||
| with: | ||
| path: ~/conda_pkgs_dir | ||
| key: | ||
| ${{ runner.os }}-conda-py${{ matrix.python-version }}-${{ | ||
| hashFiles('ci/requirements/**.yml') }} | ||
| - uses: conda-incubator/setup-miniconda@v2 | ||
| with: | ||
| channels: conda-forge | ||
| channel-priority: strict | ||
| mamba-version: "*" | ||
| activate-environment: xarray-tests | ||
| auto-update-conda: false | ||
| python-version: ${{ matrix.python-version }} | ||
| use-only-tar-bz2: true | ||
|
|
||
| - name: Install conda dependencies | ||
| run: | | ||
| mamba env update -f $CONDA_ENV_FILE | ||
| - name: Install xarray | ||
| run: | | ||
| python -m pip install --no-deps -e . | ||
| - name: Version info | ||
| run: | | ||
| conda info -a | ||
| conda list | ||
| python xarray/util/print_versions.py | ||
| - name: Import xarray | ||
| run: | | ||
| python -c "import xarray" | ||
| - name: Run tests | ||
| run: | | ||
| python -m pytest -n 4 \ | ||
| --cov=xarray \ | ||
| --cov-report=xml | ||
| - name: Upload code coverage to Codecov | ||
| uses: codecov/codecov-action@v1 | ||
| with: | ||
| file: ./coverage.xml | ||
| flags: unittests | ||
| env_vars: RUNNER_OS,PYTHON_VERSION | ||
| name: codecov-umbrella | ||
| fail_ci_if_error: false |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.