Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

InternalError connection reset by peer #595

Open
devthejo opened this issue Sep 3, 2022 · 12 comments
Open

InternalError connection reset by peer #595

devthejo opened this issue Sep 3, 2022 · 12 comments
Assignees
Labels
enhancement This issue is a feature request priority/unprioritized-backlog Higher priority than priority/awaiting-more-evidence but not planned. Contributions are welcome.

Comments

@devthejo
Copy link

devthejo commented Sep 3, 2022

Describe the problem/challenge you have
Hello, sometimes I get this kind of error using kapp deploy

API server says: an error on the server ("error trying to reach service: read tcp x.x.x.x:x->10.0.0.1:443: read: connection reset by peer") has prevented the request from succeeding (reason: InternalError)

Describe the solution you'd like
Maybe this kind of error could be detected and retried automatically because it's a classical network error and rerun almost always solve the problem.

Anything else you would like to add:
I saw that this problem was adressed here
#258
and solved here
#278
But it's not completely solved,
maybe need to resolve at another level ?

cc @revolunet


Vote on this request

This is an invitation to the community to vote on issues, to help us prioritize our backlog. Use the "smiley face" up to the right of this comment to vote.

👍 "I would like to see this addressed as soon as possible"
👎 "There are other more important things to focus on right now"

We are also happy to receive and review Pull Requests if you want to help working on this issue.

@devthejo devthejo added carvel triage This issue has not yet been reviewed for validity enhancement This issue is a feature request labels Sep 3, 2022
@renuy
Copy link
Contributor

renuy commented Sep 5, 2022

@praveenrewar please triage

@praveenrewar
Copy link
Member

praveenrewar commented Sep 5, 2022

Hmm, this definitely seems like an internal error which should have been caught by IsInternalError. I will take a deeper look into it to see why it's being missed. Meanwhile please do let me know if there are any details that you could share which would help me in debugging this (like kapp version, logs, etc,.)

@devthejo
Copy link
Author

devthejo commented Sep 6, 2022

kapp version 0.52 (using the cli, not the kube controller)
long running (jobs, deployment), many rule to make a dependency tree
I no longer have the full logs but there was no relevant things IMHO, but on next incident I will give you the full log

@renuy renuy added priority/awaiting-more-evidence Lowest priority. Possibly useful, but not yet enough support to actually get it done. and removed carvel triage This issue has not yet been reviewed for validity labels Sep 12, 2022
@devthejo
Copy link
Author

here is a full log:

Changes

Namespace                       Name                                                       Kind                   Age  Op      Op st.               Wait to    Rs  Ri  
egapro-975-design-system-setup  api                                                        Deployment             37m  update  fallback on replace  reconcile  ok  -  
^                               api                                                        Ingress                40m  update  -                    reconcile  ok  -  
^                               api                                                        Service                40m  update  -                    reconcile  ok  -  
^                               app                                                        Deployment             -    create  fallback on update   reconcile  -   -  
^                               app                                                        Ingress                40m  update  -                    reconcile  ok  -  
^                               app                                                        Service                40m  update  -                    reconcile  ok  -  
^                               basic-auth                                                 SealedSecret           40m  update  -                    reconcile  ok  -  
^                               declaration                                                Deployment             -    create  fallback on update   reconcile  -   -  
^                               declaration                                                Ingress                40m  update  -                    reconcile  ok  -  
^                               declaration                                                Service                40m  update  -                    reconcile  ok  -  
^                               default                                                    ServiceAccount         40m  update  -                    reconcile  ok  -  
^                               dump-dgt                                                   CronJob                40m  update  fallback on replace  reconcile  ok  -  
^                               export-indexes                                             CronJob                40m  update  fallback on replace  reconcile  ok  -  
^                               export-public-data                                         CronJob                40m  update  fallback on replace  reconcile  ok  -  
^                               files                                                      Deployment             40m  update  fallback on replace  reconcile  ok  -  
^                               files                                                      PersistentVolumeClaim  40m  update  -                    reconcile  ok  -  
^                               files                                                      Service                40m  update  -                    reconcile  ok  -  
^                               files-public                                               Ingress                40m  update  -                    reconcile  ok  -  
^                               files-restricted                                           Ingress                40m  update  -                    reconcile  ok  -  
^                               full                                                       CronJob                40m  update  fallback on replace  reconcile  ok  -  
^                               maildev                                                    Deployment             40m  update  fallback on replace  reconcile  ok  -  
^                               maildev                                                    Ingress                40m  update  -                    reconcile  ok  -  
^                               maildev                                                    Service                40m  update  -                    reconcile  ok  -  
^                               mon-espace                                                 Deployment             -    create  fallback on update   reconcile  -   -  
^                               mon-espace                                                 Ingress                40m  update  -                    reconcile  ok  -  
^                               mon-espace                                                 Service                40m  update  -                    reconcile  ok  -  
^                               netpol-ingress                                             NetworkPolicy          40m  update  -                    reconcile  ok  -  
^                               simulateur                                                 Deployment             -    create  fallback on update   reconcile  -   -  
^                               simulateur                                                 Ingress                40m  update  -                    reconcile  ok  -  
^                               simulateur                                                 Service                40m  update  -                    reconcile  ok  -  
^                               staff                                                      SealedSecret           40m  update  -                    reconcile  ok  -  
egapro-ci                       job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm          Job                    40m  update  fallback on replace  reconcile  ok  Completed  
^                               job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9          Job                    -    create  fallback on update   reconcile  -   -  
^                               job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4  Job                    40m  update  fallback on replace  reconcile  ok  Completed  
^                               job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq   Job                    40m  update  fallback on replace  reconcile  ok  Completed  
^                               job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9       Job                    39m  update  fallback on replace  reconcile  ok  Completed  
^                               job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh   Job                    40m  update  fallback on replace  reconcile  ok  Completed  

Op:      5 create, 0 delete, 32 update, 0 noop, 0 exists
Wait to: 37 reconcile, 0 delete, 0 noop

1:06:19PM: ---- applying 3 changes [0/37 done] ----
1:06:19PM: update networkpolicy/netpol-ingress (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:19PM: update serviceaccount/default (v1) namespace: egapro-975-design-system-setup
1:06:19PM: update persistentvolumeclaim/files (v1) namespace: egapro-975-design-system-setup
1:06:19PM: ---- waiting on 3 changes [0/37 done] ----
1:06:19PM: ok: reconcile serviceaccount/default (v1) namespace: egapro-975-design-system-setup
1:06:19PM: ok: reconcile networkpolicy/netpol-ingress (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:19PM: ok: reconcile persistentvolumeclaim/files (v1) namespace: egapro-975-design-system-setup
1:06:19PM: ---- applying 28 changes [3/37 done] ----
logs | # waiting for 'job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-nc7md > degit-repository' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-p8rc8 > job' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-qshm8 > job' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-bvk47 > job' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-bvk47 > degit-action' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-dr29b > degit-repository' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-qshm8 > degit-action' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-p8rc8 > degit-repository' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-dr29b > job' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-nc7md > job' logs to become available...
1:06:19PM: update service/simulateur (v1) namespace: egapro-975-design-system-setup
Warning: batch/v1beta1 CronJob is deprecated in v1.21+, unavailable in v1.25+; use batch/v1 CronJob
1:06:19PM: update cronjob/full (batch/v1beta1) namespace: egapro-975-design-system-setup
1:06:19PM: update sealedsecret/staff (bitnami.com/v1alpha1) namespace: egapro-975-design-system-setup
1:06:19PM: update service/declaration (v1) namespace: egapro-975-design-system-setup
1:06:19PM: update service/api (v1) namespace: egapro-975-design-system-setup
1:06:19PM: update service/app (v1) namespace: egapro-975-design-system-setup
1:06:19PM: update cronjob/export-public-data (batch/v1beta1) namespace: egapro-975-design-system-setup
1:06:19PM: update job/job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq (batch/v1) namespace: egapro-ci
1:06:19PM: update cronjob/export-indexes (batch/v1beta1) namespace: egapro-975-design-system-setup
logs | # waiting for 'job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > degit-repository' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job' logs to become available...
1:06:19PM: update deployment/files (apps/v1) namespace: egapro-975-design-system-setup
1:06:19PM: update deployment/maildev (apps/v1) namespace: egapro-975-design-system-setup
1:06:19PM: update service/files (v1) namespace: egapro-975-design-system-setup
1:06:19PM: update service/maildev (v1) namespace: egapro-975-design-system-setup
1:06:19PM: update job/job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh (batch/v1) namespace: egapro-ci
logs | # waiting for 'job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj > job' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj > degit-action' logs to become available...
1:06:19PM: update ingress/declaration (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:19PM: update ingress/api (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:20PM: update ingress/simulateur (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:20PM: update sealedsecret/basic-auth (bitnami.com/v1alpha1) namespace: egapro-975-design-system-setup
1:06:20PM: update ingress/app (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:20PM: update ingress/mon-espace (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:20PM: update service/mon-espace (v1) namespace: egapro-975-design-system-setup
1:06:20PM: update cronjob/dump-dgt (batch/v1beta1) namespace: egapro-975-design-system-setup
1:06:20PM: create job/job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9 (batch/v1) namespace: egapro-ci
logs | # waiting for 'job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > degit-repository' logs to become available...
1:06:20PM: update job/job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm (batch/v1) namespace: egapro-ci
1:06:20PM: update ingress/files-restricted (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:20PM: update job/job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4 (batch/v1) namespace: egapro-ci
logs | # waiting for 'job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > degit-repository' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job' logs to become available...
1:06:20PM: update ingress/files-public (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
logs | # waiting for 'job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > degit-repository' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job' logs to become available...
1:06:20PM: update ingress/maildev (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:20PM: ---- waiting on 28 changes [3/37 done] ----
1:06:20PM: ok: reconcile ingress/maildev (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:20PM: ok: reconcile service/simulateur (v1) namespace: egapro-975-design-system-setup
1:06:20PM: ok: reconcile sealedsecret/staff (bitnami.com/v1alpha1) namespace: egapro-975-design-system-setup
1:06:20PM: ok: reconcile cronjob/full (batch/v1beta1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile service/api (v1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile cronjob/export-public-data (batch/v1beta1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile service/app (v1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile cronjob/export-indexes (batch/v1beta1) namespace: egapro-975-design-system-setup
1:06:21PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh (batch/v1) namespace: egapro-ci
1:06:21PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:06:21PM:  L ongoing: waiting on pod/job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj (v1) namespace: egapro-ci
1:06:21PM:     ^ Pending: PodInitializing
1:06:21PM: ok: reconcile service/files (v1) namespace: egapro-975-design-system-setup
1:06:21PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq (batch/v1) namespace: egapro-ci
1:06:21PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:06:21PM:  L ongoing: waiting on pod/job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d (v1) namespace: egapro-ci
1:06:21PM:     ^ Pending: PodInitializing
1:06:21PM: ok: reconcile service/mon-espace (v1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile service/maildev (v1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile ingress/declaration (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile ingress/simulateur (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile deployment/maildev (apps/v1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile sealedsecret/basic-auth (bitnami.com/v1alpha1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile ingress/api (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile ingress/mon-espace (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile ingress/app (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile ingress/files-public (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile ingress/files-restricted (networking.k8s.io/v1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile cronjob/dump-dgt (batch/v1beta1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile deployment/files (apps/v1) namespace: egapro-975-design-system-setup
1:06:21PM: ok: reconcile service/declaration (v1) namespace: egapro-975-design-system-setup
1:06:21PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4 (batch/v1) namespace: egapro-ci
1:06:21PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:06:21PM:  L ongoing: waiting on pod/job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f (v1) namespace: egapro-ci
1:06:21PM:     ^ Pending: PodInitializing
1:06:21PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9 (batch/v1) namespace: egapro-ci
1:06:21PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:06:21PM:  L ongoing: waiting on pod/job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j (v1) namespace: egapro-ci
1:06:21PM:     ^ Pending: PodInitializing
1:06:21PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm (batch/v1) namespace: egapro-ci
1:06:21PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:06:21PM:  L ongoing: waiting on pod/job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 (v1) namespace: egapro-ci
1:06:21PM:     ^ Pending: PodInitializing
1:06:21PM: ---- waiting on 5 changes [26/37 done] ----
logs | # starting tailing 'job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > degit-repository' logs
logs | # starting tailing 'job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > degit-repository' logs
logs | # starting tailing 'job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj > degit-action' logs
logs | # starting tailing 'job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > degit-repository' logs
logs | job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj > degit-action | > cloned SocialGouv/kontinuous#HEAD to /action
logs | # starting tailing 'job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > degit-repository' logs
logs | # container stopped 'job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj > degit-action' logs
logs | # waiting for 'job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj > degit-action' logs to become available...
logs | # starting tailing 'job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj > job' logs
logs | job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj > job | secret named 'pg-user-env-975-design-system-setup-lgky3s' already exists in namespace 'egapro-975-design-system-setup'
logs | job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj > job | copy secret 'pg-user-env-975-design-system-setup-lgky3s' to 'egapro-ci'
1:06:31PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh (batch/v1) namespace: egapro-ci
1:06:31PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:06:31PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj (v1) namespace: egapro-ci
logs | job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj > job | secret/pg-user-env-975-design-system-setup-lgky3s configured
logs | # container stopped 'job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj > job' logs
1:06:34PM: ok: reconcile job/job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh (batch/v1) namespace: egapro-ci
1:06:34PM:  ^ Completed
1:06:34PM: ---- applying 1 changes [31/37 done] ----
logs | # waiting for 'job-egapro-env-975-lgky3s-create-db-create-secret-4zx4kh-rdwnj > job' logs to become available...
1:06:34PM: update job/job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9 (batch/v1) namespace: egapro-ci
1:06:34PM: ---- waiting on 5 changes [27/37 done] ----
logs | # waiting for 'job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job' logs to become available...
logs | # waiting for 'job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > degit-action' logs to become available...
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > degit-repository | > cloned SocialGouv/egapro#975-design-system-setup to /workspace
1:06:34PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9 (batch/v1) namespace: egapro-ci
1:06:34PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:06:34PM:  L ongoing: waiting on pod/job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf (v1) namespace: egapro-ci
1:06:34PM:     ^ Pending: PodInitializing
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > degit-repository | > cloned SocialGouv/egapro#975-design-system-setup to /workspace
logs | # container stopped 'job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > degit-repository' logs
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > degit-repository | > cloned SocialGouv/egapro#975-design-system-setup to /workspace
logs | # starting tailing 'job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job' logs
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0000] Resolved base name jekyll/jekyll:4 to builder 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0000] Retrieving image manifest jekyll/jekyll:4    
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0000] Retrieving image jekyll/jekyll:4 from registry index.docker.io 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0001] Retrieving image manifest jekyll/jekyll:4    
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0001] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > degit-repository | > cloned SocialGouv/egapro#975-design-system-setup to /workspace
1:06:36PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4 (batch/v1) namespace: egapro-ci
1:06:36PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:06:36PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f (v1) namespace: egapro-ci
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0001] Retrieving image manifest ghcr.io/socialgouv/docker/nginx:7.1.0 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0001] Retrieving image ghcr.io/socialgouv/docker/nginx:7.1.0 from registry ghcr.io 
logs | # container stopped 'job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > degit-repository' logs
logs | # starting tailing 'job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > degit-action' logs
logs | # waiting for 'job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > degit-repository' logs to become available...
logs | # container stopped 'job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > degit-repository' logs
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0001] Retrieving image manifest ghcr.io/socialgouv/docker/nginx:7.1.0 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0001] Returning cached image manifest              
logs | # container stopped 'job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > degit-repository' logs
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0002] Built cross stage deps: map[0:[/home/jekyll/_site]] 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0002] Retrieving image manifest jekyll/jekyll:4    
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0002] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0002] Retrieving image manifest jekyll/jekyll:4    
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0002] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0002] Executing 0 build triggers                   
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0002] Building stage 'jekyll/jekyll:4' [idx: '0', base-idx: '-1'] 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0002] Checking for cached layer harbor.fabrique.social.gouv.fr/egapro/egapro/declaration:93091fc09a903f84efd9ea9cb23407eaebf5b9a9dc2456a1aa763fc1969d3e09... 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0002] No cached layer found for cmd RUN chown 1000:1000 -R . 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0002] Unpacking rootfs as cmd COPY . . requires it. 
logs | # waiting for 'job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > degit-repository' logs to become available...
logs | # starting tailing 'job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job' logs
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0000] Resolved base name node:16-alpine to node    
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0000] Resolved base name node to builder           
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0000] Using dockerignore file: /workspace/.dockerignore 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0000] Retrieving image manifest node:16-alpine     
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0000] Retrieving image node:16-alpine from registry index.docker.io 
logs | # starting tailing 'job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job' logs
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0000] Retrieving image manifest python:3.9.7       
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0000] Retrieving image python:3.9.7 from registry index.docker.io 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0001] Retrieving image manifest node:16-alpine     
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0001] Returning cached image manifest              
logs | # waiting for 'job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > degit-repository' logs to become available...
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0001] Retrieving image manifest python:3.9.7       
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0001] Returning cached image manifest              
1:06:37PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm (batch/v1) namespace: egapro-ci
1:06:37PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:06:37PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 (v1) namespace: egapro-ci
1:06:38PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq (batch/v1) namespace: egapro-ci
1:06:38PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:06:38PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d (v1) namespace: egapro-ci
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0001] Retrieving image manifest ghcr.io/socialgouv/docker/nginx4spa:7.1.0 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0001] Retrieving image ghcr.io/socialgouv/docker/nginx4spa:7.1.0 from registry ghcr.io 
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0001] Built cross stage deps: map[]                
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0001] Retrieving image manifest python:3.9.7       
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0001] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0001] Retrieving image manifest python:3.9.7       
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0001] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0001] Executing 0 build triggers                   
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0001] Building stage 'python:3.9.7' [idx: '0', base-idx: '-1'] 
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0001] Checking for cached layer harbor.fabrique.social.gouv.fr/egapro/egapro/api:b855923e58d9b403f64f4afb21152dde186f0041c0361a147c5ca20c9891b595... 
logs | # starting tailing 'job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job' logs
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0000] Resolved base name node:16-alpine to builder 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0000] Resolved base name node:16-alpine to runner  
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0000] Using dockerignore file: /workspace/.dockerignore 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0000] Retrieving image manifest node:16-alpine     
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0000] Retrieving image node:16-alpine from registry index.docker.io 
logs | # waiting for 'job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > degit-repository' logs to become available...
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Retrieving image manifest ghcr.io/socialgouv/docker/nginx4spa:7.1.0 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Retrieving image manifest node:16-alpine     
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Retrieving image manifest node:16-alpine     
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Retrieving image manifest node:16-alpine     
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Built cross stage deps: map[0:[/app/next.config.js /app/package.json /app/.env.production /app/.env.development /app/public /app/node_modules /app/.next]] 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Retrieving image manifest node:16-alpine     
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Retrieving image manifest node:16-alpine     
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Executing 0 build triggers                   
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Building stage 'node:16-alpine' [idx: '0', base-idx: '-1'] 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Checking for cached layer harbor.fabrique.social.gouv.fr/egapro/egapro/app:caa98525e11da86a5488c308fbc53335c000682ec572d4ab30da2287380f7b18... 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] No cached layer found for cmd RUN yarn install --frozen-lockfile 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Built cross stage deps: map[1:[/app/build]]  
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Retrieving image manifest node:16-alpine     
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Retrieving image manifest node:16-alpine     
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Executing 0 build triggers                   
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Building stage 'node:16-alpine' [idx: '0', base-idx: '-1'] 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Skipping unpacking as no commands require it. 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Initializing snapshotter ...                 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Taking snapshot of full filesystem...        
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0001] Unpacking rootfs as cmd COPY packages/app/package.json yarn.lock ./ requires it. 
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0002] Using caching version of cmd: RUN useradd -m myapp 
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0002] Checking for cached layer harbor.fabrique.social.gouv.fr/egapro/egapro/api:6d676f7a5f9b7ab3928a99a1790de3a73f0f2602595709bbb06545468f62e22d... 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] WORKDIR /app                                 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Cmd: workdir                                 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Changed working directory to /app            
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Creating directory /app                      
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Taking snapshot of files...                  
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0002] Storing source image from stage 0 at path /kaniko/stages/0 
1:06:39PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9 (batch/v1) namespace: egapro-ci
1:06:39PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:06:39PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j (v1) namespace: egapro-ci
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0003] Using caching version of cmd: RUN chown myapp:myapp /app 
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0003] Cmd: USER                                    
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0003] Checking for cached layer harbor.fabrique.social.gouv.fr/egapro/egapro/api:7c40caab2a2b50af3c6823f1f92fd8b9095c7ad992a6e8cfc824d50e6a707440... 
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0003] Using caching version of cmd: RUN pip3 install pipenv --user 
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0003] Checking for cached layer harbor.fabrique.social.gouv.fr/egapro/egapro/api:55dd23d960bea5c707b20559faba0c52ed75a05df99d13bac77078e43d26d75b... 
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0003] Using caching version of cmd: RUN	pip install -e .[dev,test,prod] 
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0003] Checking for cached layer harbor.fabrique.social.gouv.fr/egapro/egapro/api:b82d0feac5185cb3fcd7d32ef8e2755894082be5047ad1f3d2e9dd592a11bdc4... 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0003] Deleting filesystem...                       
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0003] Base image from previous stage 0 found, using saved tar at path /kaniko/stages/0 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0003] Executing 0 build triggers                   
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0004] Building stage 'node' [idx: '1', base-idx: '0'] 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0004] Checking for cached layer harbor.fabrique.social.gouv.fr/egapro/egapro/simulateur:e98fd86382f4aca0d2e09c2da00309d8db2fd32c6c8204fd63ae82dcade17425... 
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0004] Using caching version of cmd: RUN cp -r egapro.egg-info /tmp/egapro.egg-info 
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0004] Cmd: EXPOSE                                  
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0004] Adding exposed port: 2626/tcp                
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0004] Unpacking rootfs as cmd COPY setup.py . requires it. 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0004] No cached layer found for cmd RUN yarn --frozen-lockfile 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0004] Unpacking rootfs as cmd COPY packages/simulateur/package.json yarn.lock ./ requires it. 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0004] Initializing snapshotter ...                 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0004] Taking snapshot of full filesystem...        
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0006] Initializing snapshotter ...                 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0006] Taking snapshot of full filesystem...        
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > degit-action | > cloned SocialGouv/kontinuous#HEAD to /action
logs | # container stopped 'job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > degit-action' logs
logs | # waiting for 'job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > degit-action' logs to become available...
logs | # starting tailing 'job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job' logs
1:06:46PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9 (batch/v1) namespace: egapro-ci
1:06:46PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:06:46PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf (v1) namespace: egapro-ci
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | You are now connected to database "autodevops_env-975-design-system-setup-lgky3s" as user "egaproadmin@egaprodevserver".
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | Database already exist, skip creation
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | Creating database extensions autodevops_env-975-design-system-setup-lgky3s
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job |  CREATE EXTENSION IF NOT EXISTS "hstore"; CREATE EXTENSION IF NOT EXISTS "pgcrypto"; CREATE EXTENSION IF NOT EXISTS "citext"; CREATE EXTENSION IF NOT EXISTS "uuid-ossp"; CREATE EXTENSION IF NOT EXISTS "postgis"; CREATE EXTENSION IF NOT EXISTS "pg_trgm"; CREATE EXTENSION IF NOT EXISTS "unaccent";
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | NOTICE:  extension "hstore" already exists, skipping
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | NOTICE:  extension "pgcrypto" already exists, skipping
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | NOTICE:  extension "citext" already exists, skipping
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | NOTICE:  extension "uuid-ossp" already exists, skipping
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | NOTICE:  extension "postgis" already exists, skipping
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | NOTICE:  extension "pg_trgm" already exists, skipping
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | NOTICE:  extension "unaccent" already exists, skipping
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | CREATE EXTENSION
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0011] COPY packages/simulateur/package.json yarn.lock ./ 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0011] Taking snapshot of files...                  
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0011] RUN yarn --frozen-lockfile                   
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] ARG NEXT_PUBLIC_APP_VERSION_COMMIT           
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] ENV NEXT_PUBLIC_APP_VERSION_COMMIT $NEXT_PUBLIC_APP_VERSION_COMMIT 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] ARG NEXT_PUBLIC_IS_PRODUCTION_DEPLOYMENT     
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] ENV NEXT_PUBLIC_IS_PRODUCTION_DEPLOYMENT $NEXT_PUBLIC_IS_PRODUCTION_DEPLOYMENT 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] ARG NEXT_PUBLIC_HOST                         
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] ENV NEXT_PUBLIC_HOST $NEXT_PUBLIC_HOST       
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] WORKDIR /app                                 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] Cmd: workdir                                 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] Changed working directory to /app            
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] Creating directory /app                      
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] Taking snapshot of files...                  
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] COPY packages/app/package.json yarn.lock ./  
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] Taking snapshot of files...                  
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] RUN yarn install --frozen-lockfile           
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0012] Cmd: /bin/sh                                 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0012] Args: [-c yarn --frozen-lockfile]            
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | INFO[0012] Running: [/bin/sh -c yarn --frozen-lockfile] 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] Cmd: /bin/sh                                 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] Args: [-c yarn install --frozen-lockfile]    
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | INFO[0011] Running: [/bin/sh -c yarn install --frozen-lockfile] 
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | yarn install v1.22.19
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | yarn install v1.22.19
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | [1/4] Resolving packages...
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | User already exist, skip creation
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | Set password for user user_env-975-design-system-setup-lgky3s
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | [1/4] Resolving packages...
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | ALTER ROLE
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | Grant user "user_env-975-design-system-setup-lgky3s" to "egaproadmin"
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | [2/4] Fetching packages...
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | 
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job |   GRANT "user_env-975-design-system-setup-lgky3s" to "egaproadmin";
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job |   GRANT ALL PRIVILEGES ON DATABASE "autodevops_env-975-design-system-setup-lgky3s" TO "user_env-975-design-system-setup-lgky3s";
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | 
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job |   GRANT USAGE ON SCHEMA public TO "user_env-975-design-system-setup-lgky3s";
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job |   GRANT ALL ON ALL TABLES IN SCHEMA public TO "user_env-975-design-system-setup-lgky3s";
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job |   GRANT ALL ON ALL SEQUENCES IN SCHEMA public TO "user_env-975-design-system-setup-lgky3s";
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job |   ALTER DEFAULT PRIVILEGES IN SCHEMA public GRANT ALL PRIVILEGES ON TABLES TO "user_env-975-design-system-setup-lgky3s";
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | 
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | NOTICE:  role "egaproadmin" is already a member of role "user_env-975-design-system-setup-lgky3s"
logs | job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job | ALTER DEFAULT PRIVILEGES
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | [2/4] Fetching packages...
logs | # container stopped 'job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job' logs
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0017] Initializing snapshotter ...                 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0017] Taking snapshot of full filesystem...        
logs | # waiting for 'job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9-jxdgf > job' logs to become available...
1:06:54PM: ok: reconcile job/job-egapro-env-975-lgky3s-create-db-create-db-4rzpx9 (batch/v1) namespace: egapro-ci
1:06:54PM:  ^ Completed
1:06:54PM: ---- waiting on 4 changes [28/37 done] ----
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0024] WORKDIR /home/jekyll                         
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0024] Cmd: workdir                                 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0024] Changed working directory to /home/jekyll    
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0024] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0024] COPY . .                                     
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0024] Taking snapshot of files...                  
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0024] RUN chown 1000:1000 -R .                     
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0023] Initializing snapshotter ...                 
logs | job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 > job | INFO[0023] Taking snapshot of full filesystem...        
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0025] Cmd: /bin/sh                                 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0025] Args: [-c chown 1000:1000 -R .]              
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0025] Running: [/bin/sh -c chown 1000:1000 -R .]   
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0026] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0026] ENV GEM_HOME=/home/jekyll/gems               
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0026] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0026] ARG EGAPRO_API_URL                           
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0026] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0026] ENV EGAPRO_API_URL=${EGAPRO_API_URL}         
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0026] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0026] RUN echo "EGAPRO_API_URL: ${EGAPRO_API_URL}" >> _config.yml 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0027] Cmd: /bin/sh                                 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0027] Args: [-c echo "EGAPRO_API_URL: ${EGAPRO_API_URL}" >> _config.yml] 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0027] Running: [/bin/sh -c echo "EGAPRO_API_URL: ${EGAPRO_API_URL}" >> _config.yml] 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0028] Taking snapshot of files...                  
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0028] ARG EGAPRO_SENTRY_DSN                        
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0028] Pushing layer harbor.fabrique.social.gouv.fr/egapro/egapro/declaration:e63952cd1e6d34aef2f8eb557f21512831e69cf9eb90926f72e088e4e57c4055 to cache now 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0028] Pushing image to harbor.fabrique.social.gouv.fr/egapro/egapro/declaration:e63952cd1e6d34aef2f8eb557f21512831e69cf9eb90926f72e088e4e57c4055 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0028] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0028] ENV EGAPRO_SENTRY_DSN=${EGAPRO_SENTRY_DSN}   
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0028] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0028] RUN echo "sentry-dsn: '$EGAPRO_SENTRY_DSN'" >> _config.yml 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0029] Cmd: /bin/sh                                 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0029] Args: [-c echo "sentry-dsn: '$EGAPRO_SENTRY_DSN'" >> _config.yml] 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0029] Running: [/bin/sh -c echo "sentry-dsn: '$EGAPRO_SENTRY_DSN'" >> _config.yml] 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0030] Pushed harbor.fabrique.social.gouv.fr/egapro/egapro/declaration@sha256:1555594cb28f89fea526678d829636b93654082ae00e7c5926db3b2ccc7b086f 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0030] Taking snapshot of files...                  
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0030] RUN echo "version: `date +"%Y.%m.%d"`" >> _config.yml 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0030] Pushing layer harbor.fabrique.social.gouv.fr/egapro/egapro/declaration:10300fc6e8123149595044b0bd069069e68afb6bbfd4282b9c1850ff9ab6328e to cache now 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0030] Pushing image to harbor.fabrique.social.gouv.fr/egapro/egapro/declaration:10300fc6e8123149595044b0bd069069e68afb6bbfd4282b9c1850ff9ab6328e 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0031] Cmd: /bin/sh                                 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0031] Args: [-c echo "version: `date +"%Y.%m.%d"`" >> _config.yml] 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0031] Running: [/bin/sh -c echo "version: `date +"%Y.%m.%d"`" >> _config.yml] 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0032] Pushed harbor.fabrique.social.gouv.fr/egapro/egapro/declaration@sha256:7260f6f68655b329650b760f4846d5d957563ecf5c6a2d1eee063b5d98efecb1 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0032] Taking snapshot of files...                  
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0033] ARG BASE_URL                                 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0033] Pushing layer harbor.fabrique.social.gouv.fr/egapro/egapro/declaration:9f28469250b03ed8d0a8eb8a82ca1edd857b04d95fc6ac8223cd1b7f4048d63a to cache now 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0033] Pushing image to harbor.fabrique.social.gouv.fr/egapro/egapro/declaration:9f28469250b03ed8d0a8eb8a82ca1edd857b04d95fc6ac8223cd1b7f4048d63a 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0033] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0033] ENV BASE_URL=${BASE_URL}                     
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0033] No files changed in this command, skipping snapshotting. 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0033] RUN if [ -z "$BASE_URL" ]; then jekyll build; else jekyll build --baseurl $BASE_URL; fi 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0033] Cmd: /bin/sh                                 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0033] Args: [-c if [ -z "$BASE_URL" ]; then jekyll build; else jekyll build --baseurl $BASE_URL; fi] 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0033] Running: [/bin/sh -c if [ -z "$BASE_URL" ]; then jekyll build; else jekyll build --baseurl $BASE_URL; fi] 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0034] Pushed harbor.fabrique.social.gouv.fr/egapro/egapro/declaration@sha256:810f17e28c5cf0ce1544b0c07dbbeed492947327322a8f4d2f10aaa41c6fdd81 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching gem metadata from https://rubygems.org/............
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Resolving dependencies...
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Using bundler 2.3.22
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching public_suffix 5.0.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching colorator 1.1.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing colorator 1.1.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing public_suffix 5.0.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching concurrent-ruby 1.1.10
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching eventmachine 1.2.7
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing eventmachine 1.2.7 with native extensions
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing concurrent-ruby 1.1.10
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching http_parser.rb 0.8.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing http_parser.rb 0.8.0 with native extensions
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching ffi 1.15.5
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing ffi 1.15.5 with native extensions
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching forwardable-extended 2.6.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing forwardable-extended 2.6.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching rb-fsevent 0.11.2
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing rb-fsevent 0.11.2
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Using rexml 3.2.5
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching liquid 4.0.3
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing liquid 4.0.3
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching mercenary 0.4.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing mercenary 0.4.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching rouge 3.30.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing rouge 3.30.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching safe_yaml 1.0.5
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing safe_yaml 1.0.5
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching unicode-display_width 1.8.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing unicode-display_width 1.8.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching webrick 1.7.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing webrick 1.7.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching addressable 2.8.1
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing addressable 2.8.1
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching i18n 1.12.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing i18n 1.12.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching em-websocket 0.5.3
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing em-websocket 0.5.3
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching pathutil 0.16.2
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing pathutil 0.16.2
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching kramdown 2.4.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing kramdown 2.4.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching terminal-table 2.0.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing terminal-table 2.0.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching kramdown-parser-gfm 1.1.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing kramdown-parser-gfm 1.1.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching rb-inotify 0.10.1
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching sassc 2.4.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing rb-inotify 0.10.1
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching listen 3.7.1
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing sassc 2.4.0 with native extensions
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing listen 3.7.1
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching jekyll-watch 2.2.1
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing jekyll-watch 2.2.1
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | info There appears to be trouble with your network connection. Retrying...
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | info There appears to be trouble with your network connection. Retrying...
1:07:36PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4 (batch/v1) namespace: egapro-ci
1:07:36PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:07:36PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f (v1) namespace: egapro-ci
1:07:38PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq (batch/v1) namespace: egapro-ci
1:07:38PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:07:38PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d (v1) namespace: egapro-ci
1:07:38PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm (batch/v1) namespace: egapro-ci
1:07:38PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:07:38PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 (v1) namespace: egapro-ci
1:07:39PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9 (batch/v1) namespace: egapro-ci
1:07:39PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:07:39PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j (v1) namespace: egapro-ci
1:07:55PM: ---- waiting on 4 changes [28/37 done] ----
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | info There appears to be trouble with your network connection. Retrying...
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | info There appears to be trouble with your network connection. Retrying...
1:08:37PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4 (batch/v1) namespace: egapro-ci
1:08:37PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:08:37PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f (v1) namespace: egapro-ci
1:08:39PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm (batch/v1) namespace: egapro-ci
1:08:39PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:08:39PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 (v1) namespace: egapro-ci
1:08:39PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq (batch/v1) namespace: egapro-ci
1:08:39PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:08:39PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d (v1) namespace: egapro-ci
1:08:40PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9 (batch/v1) namespace: egapro-ci
1:08:40PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:08:40PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j (v1) namespace: egapro-ci
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | info There appears to be trouble with your network connection. Retrying...
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | info There appears to be trouble with your network connection. Retrying...
1:08:55PM: ---- waiting on 4 changes [28/37 done] ----
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | info There appears to be trouble with your network connection. Retrying...
logs | job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d > job | info There appears to be trouble with your network connection. Retrying...
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | info There appears to be trouble with your network connection. Retrying...
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching jekyll-sass-converter 2.2.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing jekyll-sass-converter 2.2.0
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Fetching jekyll 4.2.2
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Installing jekyll 4.2.2
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Bundle complete! 3 Gemfile dependencies, 29 gems now installed.
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Use `bundle info [gemname]` to see where a bundled gem is installed.
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | ruby 3.1.1p18 (2022-02-18 revision 53f5fc4236) [x86_64-linux-musl]
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | Configuration file: /home/jekyll/_config.yml
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job |             Source: /home/jekyll/src
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job |        Destination: /home/jekyll/_site
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job |  Incremental build: disabled. Enable with --incremental
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job |       Generating... 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job |                     done in 0.14 seconds.
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job |  Auto-regeneration: disabled. Use --watch to enable.
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0175] Taking snapshot of files...                  
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0181] Pushing layer harbor.fabrique.social.gouv.fr/egapro/egapro/declaration:0c4daffb261aac85dd1aff72dd0941b1e36554485914535f247d673d81a488bc to cache now 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0181] Pushing image to harbor.fabrique.social.gouv.fr/egapro/egapro/declaration:0c4daffb261aac85dd1aff72dd0941b1e36554485914535f247d673d81a488bc 
1:09:38PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4 (batch/v1) namespace: egapro-ci
1:09:38PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:09:38PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f (v1) namespace: egapro-ci
1:09:39PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm (batch/v1) namespace: egapro-ci
1:09:39PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:09:39PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-api-kaniko-4csjzm-td7h4 (v1) namespace: egapro-ci
1:09:39PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq (batch/v1) namespace: egapro-ci
1:09:39PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:09:39PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-simulateur-kaniko-2jmiaq-dvf6d (v1) namespace: egapro-ci
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0184] Pushed harbor.fabrique.social.gouv.fr/egapro/egapro/declaration@sha256:c0aa86eb5e619b0065e2275ecfbac5e3047dc9a313441dd115ea691ddfd3cf22 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | WARN[0184] Error uploading layer to cache: open : no such file or directory 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0184] Saving file home/jekyll/_site for later use  
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0184] Deleting filesystem...                       
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0185] Retrieving image manifest ghcr.io/socialgouv/docker/nginx:7.1.0 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0185] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0185] Retrieving image manifest ghcr.io/socialgouv/docker/nginx:7.1.0 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0185] Returning cached image manifest              
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0185] Executing 0 build triggers                   
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0185] Building stage 'ghcr.io/socialgouv/docker/nginx:7.1.0' [idx: '1', base-idx: '-1'] 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0185] Unpacking rootfs as cmd COPY --from=builder --chown=nginx:nginx /home/jekyll/_site /usr/share/nginx/html requires it. 
1:09:40PM: ongoing: reconcile job/job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9 (batch/v1) namespace: egapro-ci
1:09:40PM:  ^ Waiting to complete (1 active, 0 failed, 0 succeeded)
1:09:40PM:  L ok: waiting on pod/job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j (v1) namespace: egapro-ci
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0189] Initializing snapshotter ...                 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0189] Taking snapshot of full filesystem...        
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0193] COPY --from=builder --chown=nginx:nginx /home/jekyll/_site /usr/share/nginx/html 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0193] Taking snapshot of files...                  
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0193] Pushing image to harbor.fabrique.social.gouv.fr/egapro/egapro/declaration:sha-5990f2dc4971caf2290747e0ee20c25c67a915f3 
logs | job-egapro-env-975-lgky3s-build-app-kaniko-3zekn9-jb25j > job | info There appears to be trouble with your network connection. Retrying...
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0196] Pushed harbor.fabrique.social.gouv.fr/egapro/egapro/declaration@sha256:3100192ec4c24ec46b5a4c7a9825433c3d22939da035744710946244d73aefb8 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0196] Pushing image to harbor.fabrique.social.gouv.fr/egapro/egapro/declaration:env-975-design-system-setup-lgky3s 
logs | job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job | INFO[0198] Pushed harbor.fabrique.social.gouv.fr/egapro/egapro/declaration@sha256:3100192ec4c24ec46b5a4c7a9825433c3d22939da035744710946244d73aefb8 
logs | # container stopped 'job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job' logs
1:09:55PM: ok: reconcile job/job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4 (batch/v1) namespace: egapro-ci
1:09:55PM:  ^ Completed
1:09:55PM: ---- applying 1 changes [32/37 done] ----
1:09:55PM: create deployment/declaration (apps/v1) namespace: egapro-975-design-system-setup
1:09:55PM: ---- waiting on 4 changes [29/37 done] ----
1:09:55PM: ongoing: reconcile deployment/declaration (apps/v1) namespace: egapro-975-design-system-setup
1:09:55PM:  ^ Waiting for generation 2 to be observed
logs | # waiting for 'job-egapro-env-975-lgky3s-build-declaration-kaniko-5phpp4-7sm8f > job' logs to become available...
1:09:57PM: ongoing: reconcile deployment/declaration (apps/v1) namespace: egapro-975-design-system-setup
1:09:57PM:  ^ Waiting for 1 unavailable replicas
1:10:02PM: error: reconcile deployment/declaration (apps/v1) namespace: egapro-975-design-system-setup

[2022-09-19 13:10:02] WARN: kapp: Error: waiting on reconcile deployment/declaration (apps/v1) namespace: egapro-975-design-system-setup:
  Errored:
    Getting resource deployment/declaration (apps/v1) namespace: egapro-975-design-system-setup:
      API server says: an error on the server ("error trying to reach service: read tcp 10.244.1.184:37834->10.0.0.1:443: read: connection reset by peer") has prevented the request from succeeding (reason: InternalError)

@praveenrewar
Copy link
Member

@devthejo Thank you so much! We will try to figure out why this is not part of retry-able errors.

@devthejo
Copy link
Author

I also have this one:

kapp: Error: waiting on reconcile job/job-egapro-feat-add-5j0rpm-build-app-kaniko-3zekn9 (batch/v1) namespace: egapro-ci:
Errored:
Listing schema.GroupVersionResource{Group:"batch", Version:"v1", Resource:"jobs"}, namespaced: true: an error on the server ("error trying to reach service: dial tcp 10.0.0.1:443: connect: connection refused") has prevented the request from succeeding

@devthejo
Copy link
Author

devthejo commented Oct 6, 2022

And this one today:

Errored:
Listing schema.GroupVersionResource{Group:"", Version:"v1", Resource:"pods"}, namespaced: true: an error on the server ("error trying to reach service: read tcp 10.244.12.200:52952->10.0.0.1:443: read: connection reset by peer") has prevented the request from succeeding

@praveenrewar
Copy link
Member

I think I know why you are still seeing these. isGeneralRetryableErr is used only while creating, updating or patching resources, but not while getting/listing them which is where you are getting this error.
Adding this retry logic in waiting stage would solve the issue (We will try to think if it can have any side effects)

@renuy
Copy link
Contributor

renuy commented Oct 10, 2022

cc: @cppforlife

@100mik
Copy link
Contributor

100mik commented Oct 11, 2022

One potential risk of retrying GET and LIST calls (especially GET calls) might be that we might make the cause of failure worse. Since we poll the cluster using GET requests repeatedly (unlike updates/creates), there is a higher risk of this happening.

@revolunet
Copy link

revolunet commented Dec 12, 2022

Hello, here's an example of requests that are not retried :

In my case i sometimes get error trying to reach service: dial tcp 10.0.0.1:443: connect: connection refused from the cluster which stops kapp

@praveenrewar
Copy link
Member

@revolunet Thanks for sharing these. This probably is an indication that we should add the retries in the waiting stage as well. Another reason to do so would be that the default wait-check-interval is now increased to 3s (from 1s), so the retries shouldn't cause much of an issue. We will discuss this one more time and come to a conclusion.

@praveenrewar praveenrewar added priority/unprioritized-backlog Higher priority than priority/awaiting-more-evidence but not planned. Contributions are welcome. and removed priority/awaiting-more-evidence Lowest priority. Possibly useful, but not yet enough support to actually get it done. labels May 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement This issue is a feature request priority/unprioritized-backlog Higher priority than priority/awaiting-more-evidence but not planned. Contributions are welcome.
Projects
Status: Unprioritized
Development

No branches or pull requests

5 participants