Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scale down pods on the previous stack after switching #443

Open
2 tasks
sampaccoud opened this issue Jan 21, 2020 · 3 comments
Open
2 tasks

Scale down pods on the previous stack after switching #443

sampaccoud opened this issue Jan 21, 2020 · 3 comments

Comments

@sampaccoud
Copy link
Contributor

sampaccoud commented Jan 21, 2020

Feature Request

Is your feature request related to a problem or unsupported use case? Please describe.
After a blue/green deployment, keeping the previous stack for a few days is important in case we need to quickly rollback the code. However, on projects that are scaled up with many replica pods, keeping a stack with all its pods mobilizes a lot of resources for nothing.

Describe the solution you'd like

  • Automatically scale down a stack after switching it to previous e.g all pods set to x1 replica
  • Automatically scale up the previous stack before initiating a rollback ie all pods set to the number of replica specified in their intial specification.
@jmaupetit
Copy link
Contributor

@madmatah
Copy link
Contributor

good idea

@sampaccoud
Copy link
Contributor Author

sampaccoud commented Jan 22, 2020

To go a bit further in our brainstorming:

  • the next stack should also be deployed with a limited number of pods and only scaled up just before switching,
  • when scaling down the previous stack, we should not scale down celery workers because they still have tasks to handle after switching (can take up to a few hours to finish them so maybe we should also find a way to forbid deleting the previous stack before its workers have finished handling their tasks...)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants