Skip to content

chore: reduce amount of throttling to CodeArtifact #24402

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Mar 1, 2023

Conversation

rix0rrr
Copy link
Contributor

@rix0rrr rix0rrr commented Mar 1, 2023

Our new mechanism of testing candidate packages in our pipeline is by uploading them to CodeArtifact, instead of using hacky local tools that fake being NPM, NuGet, Maven, etc.

For the regression tests, we need access to versions X and X+1 for packages, so we set all packages to upstream: ALLOW (individually, because there is no other way). This giant call volume is causing throttling which is alarming to the CodeArtifact team.

Only enable configuring upstreams for the regression test jobs, which is a lot less than for all tests.


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license

Our new mechanism of testing candidate packages in our pipeline is by
uploading them to CodeArtifact, instead of using hacky local tools that
fake being NPM, NuGet, Maven, etc.

For the regression tests, we need access to versions `X` and `X+1` for
packages, so we set all packages to `upstream: ALLOW` (individually,
because there is no other way). This giant call volume is causing
throttling which is alarming to the CodeArtifact team.

Only enable configuring upstreams for the regression test jobs,
which is a lot less than for all tests.
@rix0rrr rix0rrr requested a review from a team March 1, 2023 17:29
@rix0rrr rix0rrr self-assigned this Mar 1, 2023
@github-actions github-actions bot added the p2 label Mar 1, 2023
@aws-cdk-automation aws-cdk-automation requested a review from a team March 1, 2023 17:30
@mergify mergify bot added the contribution/core This is a PR that came from AWS. label Mar 1, 2023
@aws-cdk-automation
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: AutoBuildv2Project1C6BFA3F-wQm2hXv2jqQv
  • Commit ID: abff03d
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@mergify
Copy link
Contributor

mergify bot commented Mar 1, 2023

Thank you for contributing! Your pull request will be updated from main and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork).

@mergify mergify bot merged commit 4e81599 into main Mar 1, 2023
@mergify mergify bot deleted the huijbers/make-codeartifact-happy branch March 1, 2023 18:20
homakk pushed a commit to homakk/aws-cdk that referenced this pull request Mar 28, 2023
Our new mechanism of testing candidate packages in our pipeline is by uploading them to CodeArtifact, instead of using hacky local tools that fake being NPM, NuGet, Maven, etc.

For the regression tests, we need access to versions `X` and `X+1` for packages, so we set all packages to `upstream: ALLOW` (individually, because there is no other way). This giant call volume is causing throttling which is alarming to the CodeArtifact team.

Only enable configuring upstreams for the regression test jobs, which is a lot less than for all tests.

----

*By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license*
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
contribution/core This is a PR that came from AWS. p2
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants