New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Test build of 34c0dd5 #90
Conversation
That's the no _loading rasterio PR rasterio/rasterio#2594.
Added a fix related to pyproj4/pyproj#1132 |
@snowman2 not all heroes wear capes 🦸 |
.github/workflows/win-wheels.yaml
Outdated
id: vcpkgcache | ||
with: | ||
path: C:/vcpkg/installed | ||
key: ${{ runner.os }}-vcpkg-${{ hashFiles('.github/workflows/*') }} | ||
key: ${{ runner.os }}-dependencies-${{ hashFiles('.github/workflows/*', 'vcpkg.json') }} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@snowman2 while you're saving my bacon, do you see anything obviously wrong with the above? I'm having the experience of not seeing the cache miss when I change vcpkg.json.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
At a glance, it looks fine. I guess we'll just have to see if it works 🤞.
In case it is helpful, pyproj uses the expected PROJ version in the key to update the cache: https://github.com/pyproj4/pyproj/blob/bc7805ccc813b40ab28099ef305821300f149aad/.github/workflows/release.yaml#L93.
Glad to see the fix worked 🎉 |
.github/workflows/win-wheels.yaml
Outdated
|
||
- name: Install GDAL | ||
run: | | ||
vcpkg install gdal:x64-windows | ||
vcpkg install --feature-flags="versions" gdal:x64-windows |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
So vcpk install gdal
is also what I did originally in the pyogrio wheel builds, but when we moved to use a manifest file (to pin the version, or provide overrides), some more things changed:
gdal
is now listed as package to install in the manifest, so you don't have to (or can't?) mention it here, I think- We are also using
--feature-flags="manifests"
in addition to "versions", although it is not clear from the documentation whether this is needed (if there is a manifest file in the CWD, that might be sufficient. EDIT: based on the comment in --feature-flags command line arg is not documented microsoft/vcpkg#24474, that might indeed be sufficient to be "in manifest mode") - We also pointed to the directory where the manifest file is living with
--x-manifest-root=./ci
(although this probably not needed here since here it lives top-level)
See the full diff of geopandas/pyogrio#69
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@jorisvandenbossche thank you! I'm going to try removing gdal:x64-windows
from the command line. Maybe it's negating the manifest? Hard to say from the vcpkg docs.
vcpkg.json
Outdated
"overrides": [ | ||
{ "name": "gdal", "version": "3.4.3#2" } | ||
{ "name": "proj:x64-windows", "version": "9.0.1" } |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You can specify the default triplet as an Env variable (see eg https://github.com/geopandas/pyogrio/blob/d1714041153416c0358658746a6b95f067c835a5/.github/workflows/release.yml#L165), so you don't need to specify it here (that causes the current error I think)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
And same for gdal above
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
(it's also the default triplet, I assume, so your last commit to just remove it might indeed be sufficient)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
So far so good! 🤞
I just added: |
looks like you already added it and removed it |
@snowman2 yeah, I was using that (following your example) in 1231248, but vcpkg seemed to disregard it and and installed packages to locations like |
It would be really nice if there was a temporary machine to log into and explore after the vcpkg install completed. Would really make this process a lot less painful. |
Not sure if it works well on windows, but with this action it is possible to connect to a workflow session: https://github.com/mxschmitt/action-tmate |
That looks really useful. |
shell: bash | ||
run: | | ||
echo -e "\n[build_ext]" >> setup.cfg | ||
echo "include_dirs = C:/vcpkg/installed/x64-windows/include" >> setup.cfg |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I noticed this used to be capitalized here and it wasn't below. I am wondering if it is case sensitive.
@snowman2 there it is. vcpkg switched on me, it's installing stuff to installed/x86-windows now instead of installed/x64-windows: https://github.com/rasterio/rasterio-wheels/actions/runs/3205013336/jobs/5236997241#step:9:9. What a terrible system. I suspect explicitly specifying the triplet will solve this. |
Good eye 👍
|
Progress! Only 1 failure:
|
Thanks for the assist @snowman2 ! I guess something changed in 3.5.2? We're not current in rasterio's tests: https://github.com/rasterio/rasterio/actions/runs/3206825922. |
Thanks for working on this @sgillies 👍 - this one was definitely interesting to figure out. |
|
@snowman2 @vincentsarago https://github.com/rasterio/rasterio-wheels/actions/runs/3206563664 has two failures on Windows despite all the tests passing with the ubuntu-small-3.5.2 image. I'm inclined to skip these for the 1.3.3 release and go ahead with a little bit of undefined behavior, hopefully resolving the issues before 1.3.4. |
That's the no _loading rasterio PR rasterio/rasterio#2594.