Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI job failure containerd-e2e-ubuntu] Verify containerd only after installation #107999

Closed
wants to merge 1 commit into from

Conversation

adisky
Copy link
Contributor

@adisky adisky commented Feb 8, 2022

Signed-off-by: Aditi Sharma adi.sky17@gmail.com

What type of PR is this?

/kind failing-test

What this PR does / why we need it:

Skip container runtime check, if not installed via same script

for this job, we install a custom containerd version using containerd scripts and installation is not complete at the point we are checking https://github.com/kubernetes/kubernetes/blob/master/cluster/gce/gci/configure.sh#L584

jobs which require containerd installation from ubuntu repos always set KUBE_UBUNTU_INSTALL_CONTAINERD_VERSION, verifying containerd installation here only if we do installation by same method.

Which issue(s) this PR fixes:

ref ##107800

Special notes for your reviewer:

Does this PR introduce a user-facing change?


Additional documentation e.g., KEPs (Kubernetes Enhancement Proposals), usage docs, etc.:


Signed-off-by: Aditi Sharma <adi.sky17@gmail.com>
@k8s-ci-robot
Copy link
Contributor

@adisky: Adding the "do-not-merge/release-note-label-needed" label because no release-note block was detected, please follow our release note process to remove it.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@k8s-ci-robot k8s-ci-robot added kind/failing-test Categorizes issue or PR as related to a consistently or frequently failing test. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. do-not-merge/release-note-label-needed Indicates that a PR should not merge because it's missing one of the release note labels. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. do-not-merge/needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. labels Feb 8, 2022
@k8s-ci-robot
Copy link
Contributor

@adisky: This issue is currently awaiting triage.

If a SIG or subproject determines this is a relevant issue, they will accept it by applying the triage/accepted label and provide further guidance.

The triage/accepted label can be added by org members by writing /triage accepted in a comment.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@k8s-ci-robot k8s-ci-robot added needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. needs-priority Indicates a PR lacks a `priority/foo` label and requires one. area/provider/gcp Issues or PRs related to gcp provider sig/cloud-provider Categorizes an issue or PR as relevant to SIG Cloud Provider. and removed do-not-merge/needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. labels Feb 8, 2022
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: adisky
To complete the pull request process, please assign dchen1107 after the PR has been reviewed.
You can assign the PR to them by writing /assign @dchen1107 in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@adisky
Copy link
Contributor Author

adisky commented Feb 8, 2022

@adisky
Copy link
Contributor Author

adisky commented Feb 8, 2022

/test pull-kubernetes-integration

@hakman
Copy link
Member

hakman commented Feb 9, 2022

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Feb 9, 2022
@bobbypage
Copy link
Member

bobbypage commented Feb 9, 2022

I think the problem here is there is a race, i.e the cloud-init scripts are running the containerd installation and k8s setup in parallel.

I think the other solution here may be to ensure that the scripts run serially. I think this is what is expected... we should ensure the containerd installation scripts succeeded before attempting to installing k8s. I was testing out a change to do that by modifying the cloudinit- #107800 (comment)

The cloudinit that needs to be modified is in containerd repo - https://github.com/containerd/containerd/blob/main/contrib/gce/cloud-init/node.yaml

@SergeyKanzhelev
Copy link
Member

the cloudinit- #107800 (comment)

Did test succeeed? In containerd I also see

      [Install]
      WantedBy=containerd.target

With your proposed change, this can be removed, correct?

@SergeyKanzhelev
Copy link
Member

/hold

I think @bobbypage proposal would work more reliable.

@k8s-ci-robot k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 9, 2022
@adisky
Copy link
Contributor Author

adisky commented Feb 10, 2022

@bobbypage lets try your patch, keeping this on hold till then, the reason behind I am proposing this is everything is working serially containerd installation & runtime check if goes by this script, problem occurs when we mix the containerd & k/k scripts, if we are not installing above why to check at this point, possibly we can check for the same in containerd script?
https://github.com/kubernetes/kubernetes/blob/master/cluster/gce/gci/configure.sh#L584-#L610

@bobbypage
Copy link
Member

Here is patch on containerd side with adding dependency - containerd/containerd#6544

@adisky
Copy link
Contributor Author

adisky commented Feb 14, 2022

closing this, since it is fixed by containerd/containerd#6544
/close

@k8s-ci-robot
Copy link
Contributor

@adisky: Closed this PR.

In response to this:

closing this, since it is fixed by containerd/containerd#6544
/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@adisky adisky deleted the fix-e2e-ubuntu branch April 4, 2022 07:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/provider/gcp Issues or PRs related to gcp provider cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. do-not-merge/release-note-label-needed Indicates that a PR should not merge because it's missing one of the release note labels. kind/failing-test Categorizes issue or PR as related to a consistently or frequently failing test. lgtm "Looks good to me", indicates that a PR is ready to be merged. needs-priority Indicates a PR lacks a `priority/foo` label and requires one. needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. sig/cloud-provider Categorizes an issue or PR as relevant to SIG Cloud Provider. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants