Require CUDA 11.2+ #1708

jakirkham · 2021-07-19T21:59:35Z

This bumps the minimum CUDA version to 11.2. Several providers of GPUs (Kaggle, Colab, etc.) have already upgraded to 11.2+. Some libraries already require CUDA 11.2+ (like RAPIDS). Finally the CUDA 10.x Docker images are now EOL. Given the addition of newer CUDA versions (like 12.0+) and the strain of having so many CUDA versions on CI, this proposes we drop any CUDA pre-11.2 versions to lighten the load. This also makes things easier as 11.2 builds have reasonable CUDA version compatibility. This should also minimize the amount of work we need to do with the legacy CUDA build infrastructure as we increasingly move to the new package structure & infra of CUDA 12.0+.

Checklist

Used a personal fork of the feedstock to propose changes
Bumped the build number (if the version is unchanged)
Reset the build number to 0 (if the version changed)
Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
Ensured the license file is being packaged.

Closes #1053
Closes #1519

conda-forge-linter · 2021-07-19T21:59:40Z

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

jakirkham · 2021-07-19T22:02:13Z

Would be great to get some feedback from @conda-forge/core here 🙂

Not sure if there is anything special we need to do about GCC versions for example.

Also dropped the migrations as those seem to have all been merged and/or created PRs for the migration (with the exception of omniscidb, which is a bit of a special case anyways). So think we are good to mark those as complete.

If anything else sticks out that we need to do here, please let me know

kkraus14 · 2021-07-20T00:59:40Z

recipe/migrations/cuda92_100_101.yaml

-    1
-  build_number:
-    1
-  paused: true


I think this was paused and docs were added to show how to use this file manually to bring in an older CUDA version if needed.

yes. let's leave this file here.

cc @jaimergp IIRC

Do we want to still encourage people to add old versions though? Thought we were concerned about CI getting overwhelmed. No strong feelings personally. Just interested in making the addition of newer CUDA versions easier 🙂

Yes, we need this file for legacy CUDA, even if it's opt-in only and discouraged. If conda-forge/conda-smithy#1494 goes through, CI overusage would be less of a problem.

@isuruf do you have any thoughts here?

Friendly nudge @isuruf 🙂

We should make a smithy release with conda-forge/conda-smithy#1494 and then keep this config. I can do the smithy release today.

I think the challenge with leaving this file here is we want to move to the new compilers as well. If we leave this, it won't work with the new compilers and I'm not exactly sure how we can make it use the old compilers. If someone has a suggestion on that latter point, that would be welcome 🙂 However if we can't come up with anything, I'm not sure it's a good idea to leave a file that doesn't work properly

Some time has passed since the discussion above

As the nvidia/cuda images for these versions no longer exist, keeping this doesn't make sense. So going to go ahead with dropping it

hmaarrfk · 2021-07-25T13:11:05Z

@jakirkham I would be very much in favor of dropping this. The huge build matrix is an increasing strain.

leofang · 2021-08-12T17:00:35Z

This is only applicable to linux64, right? For ppc64le/aarch64, aren't we still blocked by the decision for the base OS (conda-forge/conda-forge.github.io#1432)?

jakirkham · 2021-09-01T05:53:05Z

Yeah we only support CUDA on x86_64 atm. My guess is ppc64le will probably do something similar to this. Though aarch64 has some oddities so may need some special hand-holding.

hmaarrfk · 2021-09-29T20:27:52Z

@jakirkham any news on this push?

jakirkham · 2021-09-29T22:31:37Z

Right now am focused on newer CUDA versions and new architectures.

For new CUDA versions specifically, the plan is to implement those with CUDA Enhanced Compatibility using 11.2 as the base (to support 11.2+). Please see PR ( conda-forge/nvcc-feedstock#71 ) and linked PRs/issues for discussion. This will effectively relax the upper bound for packages built with 11.2 so they can be installed with any 11.2+ version as long as they are still 11.x

We are planning on making 11.0 the new minimum and moving to new compilers, but that is down-prioritized atm.

jakirkham · 2021-10-06T00:17:35Z

JFYI CUDA Enhanced Compatibility is now in use in conda-forge

mariusvniekerk

Given that the migration has run completely I say we merge this one in

mariusvniekerk

Given that the migration has run completely I say we merge this one in

isuruf · 2021-10-13T16:59:18Z

Merging this as it is will make the gcc 9 to be used, which is not what we want.

jakirkham · 2021-10-13T17:05:19Z

Why don't we want that? Know people who have been asking to do exactly that.

isuruf · 2021-10-13T17:14:45Z

Because nvcc doesn't support that? Even if it did, when we change the default to gcc 10, cuda will use gcc 10.

jakirkham · 2021-10-13T17:32:43Z

As of CUDA 11.0, GCC 9 is supported

https://developer.nvidia.com/blog/cuda-11-features-revealed/

jakirkham · 2021-10-14T17:51:34Z

Any thoughts on this Isuru? 🙂

Ideally would like to get beyond managing a bunch of migrators here. Especially since that seems to have caused some recent confusion

isuruf · 2021-10-14T17:54:18Z

We are going to go for GCC 10 in CPU builds. How are you going to enforce GCC 9 if you remove the migrators?

jakirkham · 2021-10-14T17:57:32Z

Can we zip the compiler versions with Docker images or similar?

isuruf · 2021-10-14T17:59:37Z

You've asked this multiple times from me and the answer has always been not without more work in conda-smithy side.

jakirkham · 2021-10-14T18:06:58Z

I'm sorry. Am just struggling with how we can maintain this.

Originally was trying to get us all to align on the same compiler (GCC 9), but it sounds like you want to move ahead, which agree makes things harder.

Do you have a sense of what is needed on conda-smithy? Are there notes from previous errors I can read up on?

isuruf · 2021-10-14T18:48:34Z

Do you have a sense of what is needed on conda-smithy?

I've told you this before too, but here goes anyway. We can look at the meta.yaml and look for compiler('cuda') in it and set an environment variable CF_CUDA_ENABLED=True and use that env variable here as in https://github.com/conda-forge/conda-forge-pinning-feedstock/blob/master/recipe/conda_build_config.yaml#L111

jakirkham · 2021-10-14T19:37:30Z

Thank you Isuru 🙂 I appreciate it. I don't always remember everything 😅

Will give that some more thought

h-vetinari · 2021-11-11T03:42:24Z

In staged-recipes, CUDA 10.2 is now colliding with the default GCC 9:

#error -- unsupported GNU version! gcc versions later than 8 are not supported!

jakirkham · 2023-07-17T16:23:34Z

Planning on merge EOD if no comments

Require CUDA 11.0+

a052040

jakirkham force-pushed the req_cuda_11 branch from acef2be to a052040 Compare July 19, 2021 22:04

kkraus14 reviewed Jul 20, 2021

View reviewed changes

jakirkham mentioned this pull request Jul 20, 2021

torch.distributed support for MacOS conda-forge/pytorch-cpu-feedstock#47

Merged

5 tasks

jaimergp mentioned this pull request Jul 26, 2021

Add CUDA 11.3 / 11.4 conda-forge/cudatoolkit-feedstock#60

Merged

5 tasks

jakirkham mentioned this pull request Oct 4, 2021

nccl v2.11.4-1 conda-forge/nccl-feedstock#53

Merged

3 tasks

This was referenced Oct 12, 2021

Remove cudnn from the global CUDA zipping? #1554

Open

WIP/RFC: Add CUDA support for aarch64/ppc64le #2001

Closed

mariusvniekerk approved these changes Oct 13, 2021

View reviewed changes

jakirkham requested review from mariusvniekerk and isuruf July 12, 2023 17:55

kkraus14 approved these changes Jul 13, 2023

View reviewed changes

leofang approved these changes Jul 13, 2023

View reviewed changes

jakirkham added 3 commits July 17, 2023 14:58

Drop old CUDA GCC versions

ca6abc6

Drop one more cdt_name

23c7d2e

Merge conda-forge/main into jakirkham-feedstocks/req_cuda_11

c3865e8

jakirkham merged commit 2fc059e into conda-forge:main Jul 18, 2023
3 checks passed

jakirkham deleted the req_cuda_11 branch July 18, 2023 05:55

leofang mentioned this pull request Jul 18, 2023

Bump minimal CUDA version to CUDA 11.8? conda-forge/conda-forge.github.io#1981

Closed

This was referenced Jul 21, 2023

Bump CUDA to 11.2+ conda-forge/staged-recipes#23436

Merged

Up 2.0.1 (hmaarrfk's version) conda-forge/pytorch-cpu-feedstock#176

Closed

Cleanup Azure images & use cross-compilation conda-forge/cupy-feedstock#220

Merged

jakirkham mentioned this pull request Aug 12, 2023

Drop old CUDAs (already dropped by conda-forge) conda-forge/ucx-split-feedstock#128

Merged

1 task

h-vetinari mentioned this pull request Nov 23, 2023

Rebuild for CUDA 11.8 w/arch support conda-forge/hdk-feedstock#50

Draft

This was referenced Dec 7, 2023

Rebuild for CUDA 11.8 w/arch support conda-forge/libxc-feedstock#58

Merged

Add a CI job that builds a Docker multi-arch manifest list conda-forge/docker-images#249

Open

jakirkham mentioned this pull request Dec 14, 2023

test CUDA conda-forge/libxc-feedstock#59

Merged

7 tasks

This was referenced Jan 4, 2024

Rebuild for CUDA 12 w/arch + Windows support conda-forge/onnxruntime-feedstock#92

Closed

Additional CUDA 11.2 cleanup conda-forge/staged-recipes#24932

Merged

jakirkham mentioned this pull request Mar 20, 2024

Add CUDA 11.8 builds conda-forge/heavydb-ext-feedstock#69

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Require CUDA 11.2+ #1708

Require CUDA 11.2+ #1708

jakirkham commented Jul 19, 2021 •

edited

conda-forge-linter commented Jul 19, 2021

jakirkham commented Jul 19, 2021

kkraus14 Jul 20, 2021

beckermr Jul 20, 2021

jakirkham Jul 20, 2021

jaimergp Jul 20, 2021

jakirkham Jul 20, 2021

jakirkham Jul 26, 2021

beckermr Jul 26, 2021

jakirkham Sep 20, 2021

jakirkham Jul 18, 2023

hmaarrfk commented Jul 25, 2021

leofang commented Aug 12, 2021

jakirkham commented Sep 1, 2021

hmaarrfk commented Sep 29, 2021

jakirkham commented Sep 29, 2021

jakirkham commented Oct 6, 2021

mariusvniekerk left a comment

mariusvniekerk left a comment

isuruf commented Oct 13, 2021

jakirkham commented Oct 13, 2021

isuruf commented Oct 13, 2021

jakirkham commented Oct 13, 2021

jakirkham commented Oct 14, 2021

isuruf commented Oct 14, 2021

jakirkham commented Oct 14, 2021

isuruf commented Oct 14, 2021

jakirkham commented Oct 14, 2021

isuruf commented Oct 14, 2021

jakirkham commented Oct 14, 2021

h-vetinari commented Nov 11, 2021

jakirkham commented Jul 17, 2023

Require CUDA 11.2+ #1708

Require CUDA 11.2+ #1708

Conversation

jakirkham commented Jul 19, 2021 • edited

conda-forge-linter commented Jul 19, 2021

jakirkham commented Jul 19, 2021

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

hmaarrfk commented Jul 25, 2021

leofang commented Aug 12, 2021

jakirkham commented Sep 1, 2021

hmaarrfk commented Sep 29, 2021

jakirkham commented Sep 29, 2021

jakirkham commented Oct 6, 2021

mariusvniekerk left a comment

Choose a reason for hiding this comment

mariusvniekerk left a comment

Choose a reason for hiding this comment

isuruf commented Oct 13, 2021

jakirkham commented Oct 13, 2021

isuruf commented Oct 13, 2021

jakirkham commented Oct 13, 2021

jakirkham commented Oct 14, 2021

isuruf commented Oct 14, 2021

jakirkham commented Oct 14, 2021

isuruf commented Oct 14, 2021

jakirkham commented Oct 14, 2021

isuruf commented Oct 14, 2021

jakirkham commented Oct 14, 2021

h-vetinari commented Nov 11, 2021

jakirkham commented Jul 17, 2023

jakirkham commented Jul 19, 2021 •

edited