[v4] codecov-action gets stuck on Windows runners

[glatterf42]

Thanks for maintaining and offering the codecov-action for GitHub Actions! Unfortunately, some of our CI runs have started failing since they are getting stuck running the action. The link to the whole CI workflow is this: https://github.com/iiasa/ixmp/actions/runs/8136899961?pr=519. Please note that the action is passing fine for the Ubuntu and MacOS runners, but not for Windows.

Version

Here is the output of the "Set up job" step:

Current runner version: '2.313.0'
Operating System
Runner Image
Runner Image Provisioner
GITHUB_TOKEN Permissions
Secret source: None
Prepare workflow directory
Prepare all required actions
Getting action download info
Download action repository 'actions/checkout@v4' (SHA:b4ffde65f46336ab88eb53be808477a3936bae11)
Download action repository 'actions/setup-python@v5' (SHA:0a5c61591373683505ea898e09a3ea4f39ef2b9c)
Download action repository 'ts-graphviz/setup-graphviz@v2' (SHA:d5b2b6b67007094b256f3fd2fa6cf0ac41ceef25)
Download action repository 'r-lib/actions@v2' (SHA:0ed4cdf40958ef43a6b33b9792e07ac76c3239e3)
Download action repository 'actions/cache@v4' (SHA:ab5e6d0c87105b4c9c2047343972218f562e4319)
Download action repository 'iiasa/actions@main' (SHA:5b5c0c2d52073e3bb3fae260b3bc4640a9dae18f)
Download action repository 'codecov/codecov-action@v4' (SHA:54bcd8715eee62d40e33596ef5e8f0f48dbbccab)
Complete job name: windows-latest-py3.12

So we're using the 4.1.0 version.

Workflow file step

The whole workflow is specified here. The codecov.yml can be found in the same directory. The relevant part from the workflow file is this:

    - name: Upload test coverage to Codecov.io
      uses: codecov/codecov-action@v4
      with:
        token: ${{ secrets.CODECOV_TOKEN }} # required

Output of the codecov-action

The following output is taken from the failed run on windows-latest-py3.12:

Run codecov/codecov-action@v4
  with:
  env:
    depth: 100
    pythonLocation: C:\hostedtoolcache\windows\Python\3.12.2\x64
    PKG_CONFIG_PATH: C:\hostedtoolcache\windows\Python\3.12.2\x64/lib/pkgconfig
    Python_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.12.2\x64
    Python2_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.12.2\x64
    Python3_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.12.2\x64
    _R_INSTALL_TIME_PATCHES_: no
    R_LIBS_USER: D:\a\_temp\Library
    TZ: UTC
    _R_CHECK_SYSTEM_CLOCK_: FALSE
    NOT_CRAN: true
    RETICULATE_PYTHON: C:\hostedtoolcache\windows\Python\3.12.2\x64
==> windows OS detected
https://cli.codecov.io/latest/windows/codecov.exe.SHA256SUM
==> Running version latest
==> Running version v0.4.8
==> Running git config --global --add safe.directory D:\a\ixmp\ixmp
"C:\Program Files\Git\bin\git.exe" config --global --add safe.directory D:\a\ixmp\ixmp
==> Running command 'D:\a\_actions\codecov\codecov-action\v4\dist\codecov.exe create-commit'
D:\a\_actions\codecov\codecov-action\v4\dist\codecov.exe create-commit --git-service github -C ba6d7afa5250d85132eabbc8cfa48aa80e1d5057
info - 2024-03-04 09:35:48,377 -- ci service found: github-actions
info - 2024-03-04 09:35:48,769 -- The PR is happening in a forked repo. Using tokenless upload.
info - 2024-03-04 09:35:49,519 -- Process Commit creating complete
==> Running command 'D:\a\_actions\codecov\codecov-action\v4\dist\codecov.exe create-report'
D:\a\_actions\codecov\codecov-action\v4\dist\codecov.exe create-report --git-service github -C ba6d7afa5250d85132eabbc8cfa48aa80e1d5057
info - 2024-03-04 09:35:50,520 -- ci service found: github-actions
info - 2024-03-04 09:35:51,553 -- Process Report creating complete
info - 2024-03-04 09:35:51,553 -- Finished creating report successfully --- {"response": "{\"external_id\":\"18ca7f8e-ed2e-47e8-8fa2-a0e154183c93\",\"created_at\":\"2024-03-04T07:25:30.107380Z\",\"commit_sha\":\"ba6d7afa5250d85132eabbc8cfa48aa80e1d5057\",\"code\":null}"}
==> Running command 'D:\a\_actions\codecov\codecov-action\v4\dist\codecov.exe do-upload'
D:\a\_actions\codecov\codecov-action\v4\dist\codecov.exe do-upload --git-service github -C ba6d7afa5250d85132eabbc8cfa48aa80e1d5057
info - 2024-03-04 09:35:52,582 -- ci service found: github-actions
warning - 2024-03-04 09:35:52,633 -- xcrun is not installed or can't be found.
warning - 2024-03-04 09:35:52,643 -- No gcov data found.
info - 2024-03-04 09:35:52,643 -- Running coverage combine -a in D:\a\ixmp\ixmp
Combined data file .coverage.fv-az742-861.728.XNogrtKx
info - 2024-03-04 09:35:52,792 -- Generating coverage.xml report in D:\a\ixmp\ixmp
info - 2024-03-04 09:35:53,651 -- Wrote XML report to coverage.xml
info - 2024-03-04 09:35:53,698 -- Found 2 coverage files to upload
info - 2024-03-04 09:35:53,698 -- > D:\a\ixmp\ixmp\coverage.xml
info - 2024-03-04 09:35:53,698 -- > D:\a\ixmp\ixmp\ixmp\tests\data\_abort.lst
info - 2024-03-04 09:35:54,738 -- Your upload is now processing. When finished, results will be available at: https://app.codecov.io/github/iiasa/ixmp/commit/ba6d7afa5250d85132eabbc8cfa48aa80e1d5057
info - 2024-03-04 09:35:55,066 -- Process Upload complete
Error: The operation was canceled.

Curiously, this output started with line 17, while on the last successful run and on e.g. Ubuntu, the output started with line 1 as usual.
I canceled the workflow after five minutes since this step usually takes ~5 seconds to complete. Please note that this is already a re-run after having waited more than an hour to avoid a possible rate limitation.

Comparison to last successful run

In the last successful run, v4.1.0 is used, too. There are some differences in the output because it came from within the repo while the current failed run came from a PR from a forked repo; but generally, I don't suspect this to be the issue since everything's still working fine for Ubuntu and MacOS runners. However, these runs finish with this output:

info - 2024-02-28 05:14:58,855 -- Generating coverage.xml report in D:\a\ixmp\ixmp
info - 2024-02-28 05:14:59,699 -- Wrote XML report to coverage.xml
info - 2024-02-28 05:14:59,746 -- Found 2 coverage files to upload
info - 2024-02-28 05:14:59,746 -- > D:\a\ixmp\ixmp\coverage.xml
info - 2024-02-28 05:14:59,746 -- > D:\a\ixmp\ixmp\ixmp\tests\data\_abort.lst
info - 2024-02-28 05:15:00,061 -- Process Upload complete
error - 2024-02-28 05:15:00,061 -- Upload failed: {"detail":"Request was throttled."}

(Please notice the code 061 instead of 066, if that's relevant.)

Please let me know what we can do to get the Windows runners to complete the action step again.

[thomasrockhu-codecov]

@rohan-at-sentry Probably needs some investigation why the CLI is slowing down, but I suspect something in our file searching. I've seen this issue somewhere before as well.