OSX: Not a supported wheel on this platform.

[Fokko]

Description

At pyiceberg we've adopted cibuildwheel and it is really well. Thanks for the amazing work!

We're using Poetry as well, and I think that's causing some issue when running the tests. I've noticed that the wheel is not installable. It looks like the Python versions check out, but I think it has to do with the MacOSX version macosx_11_4 instead of macosx_11_0. I have to double-check this, but wanted to reach out if this is something that others have seen as well.

Relevant stack trace:

+ python -m virtualenv --no-download /private/var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/cibw-run-atq1ry1r/cp38-macosx_x86_64/venv-test
  created virtual environment CPython3.8.10.final.0-64 in 2176ms
    creator CPython3Posix(dest=/private/var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/cibw-run-atq1ry1r/cp38-macosx_x86_64/venv-test, clear=False, no_vcs_ignore=False, global=False)
    seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=/Users/runner/Library/Application Support/virtualenv)
      added seed packages: pip==23.2.1, setuptools==68.0.0, wheel==0.41.0
    activators BashActivator,CShellActivator,FishActivator,NushellActivator,PowerShellActivator,PythonActivator
  + which python
  /private/var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/cibw-run-atq1ry1r/cp38-macosx_x86_64/venv-test/bin/python
  + pip install '/private/var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/cibw-run-atq1ry1r/cp38-macosx_x86_64/repaired_wheel/pyiceberg-0.5.0-cp38-cp38-macosx_11_0_x86_64.whl[s3fs,glue]'
  ERROR: pyiceberg-0.5.0-cp38-cp38-macosx_11_0_x86_64.whl is not a supported wheel on this platform.

Build log

https://github.com/Fokko/incubator-iceberg/actions/runs/6130886860/job/16640407592

CI config

https://github.com/Fokko/incubator-iceberg/blob/master/.github/workflows/python-release.yml

[joerick]

macosx_11_4 isn't a valid platform tag, since macOS 11, packaging only lists 13_0, 12_0, 11_0 etc.

But I don't see that in your build log, I just see macosx_11_0, which is correct.

I just tried pip debug on pip 23.2.1 and Python 3.8 and surprisingly, I got this-

Compatible tags: 1493
  cp38-cp38-macosx_10_16_x86_64
  cp38-cp38-macosx_10_16_intel
  cp38-cp38-macosx_10_16_fat64
  cp38-cp38-macosx_10_16_fat32
  cp38-cp38-macosx_10_16_universal2
  cp38-cp38-macosx_10_16_universal
  cp38-cp38-macosx_10_15_x86_64
  cp38-cp38-macosx_10_15_intel
  cp38-cp38-macosx_10_15_fat64
  cp38-cp38-macosx_10_15_fat32
  ...
  [First 10 tags shown. Pass --verbose to show all.]

This is on a machine running macOS 13.4. So it seems like an issue with pip. The same issue doesn't seem to occur on Python 3.9+.

[joerick]

My memory is terrible - I previously discovered this and reported it back in February!

pypa/pip#11789

[joerick]

Waiting on pypa/pip#11715 .

Not a lot we can do here. You could try running your tests with SYSTEM_VERSION_COMPAT=0, e.g SYSTEM_VERSION_COMPAT=0 pytest <path>. Or just skip the tests on Python 3.8 macOS, other versions aren't affected.

[Fokko]

Got it, thanks @joerick for the context.