Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

401 Unauthorized error in e2e tests #1362

Closed
yuzisun opened this issue Feb 5, 2021 · 2 comments
Closed

401 Unauthorized error in e2e tests #1362

yuzisun opened this issue Feb 5, 2021 · 2 comments
Labels

Comments

@yuzisun
Copy link
Member

yuzisun commented Feb 5, 2021

/kind bug

What steps did you take and what happened:

 when make API call

  client = k8s_client.ApiClient()
  crd_api = k8s_client.CustomObjectsApi(client)
  return crd_api.get_namespaced_custom_object(
    GROUP, VERSION, namespace, PLURAL, name)

Every 15 mins, the attached token has to be refreshed otherwise 401 Unauthorized.

E.g, check prow build logs (Not Argo Workflow) and you can see every 15mins, 401 Unauthorized error surfaces, http://prow.kubeflow-testing.com/view/s3/aws-kubeflow-jenkins/pr-logs/pull/kubeflow_kfserving/1315/kubeflow-kfserving-presubmit/1357497548171907072

The way that we handle it is add retry logic to refresh the API call.

https://github.com/kubeflow/testing/blob/master/py/kubeflow/testing/argo_client.py#L87-L105



**What did you expect to happen:**


**Anything else you would like to add:**
[Miscellaneous information that will assist in solving the issue.]


**Environment:**

- Istio Version:
- Knative Version:
- KFServing Version:
- Kubeflow version:
- Kfdef:[k8s_istio/istio_dex/gcp_basic_auth/gcp_iap/aws/aws_cognito/ibm]
- Minikube version:
- Kubernetes version: (use `kubectl version`):
- OS (e.g. from `/etc/os-release`):
@yuzisun
Copy link
Member Author

yuzisun commented Feb 5, 2021

@yuzisun
Copy link
Member Author

yuzisun commented Feb 21, 2021

fixed by recreating the KFServing client every time.

@yuzisun yuzisun closed this as completed Feb 21, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants