-
Notifications
You must be signed in to change notification settings - Fork 39
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
All jobs should be run with --rm now which makes this not necessary. #80
Conversation
@dirk-thomas please review |
If after numerous builds no containers accumulate on the host machine it looks good to me. |
We still leak the occasional container. Introspecting one of our active slaves there are well over 100 leaked in the last 48 hours. https://gist.github.com/tfoote/ba1e8d608e98df9f1af7 I think it's worth leaving this cleanup. We just have to be sure that the minimum cleanup age is longer than any timeouts. I haven't seen any failures recently since we added the minimum age. |
While fixing the symptom with the cleanup script might work currently I think we should investigate why these containers remain i the first place and try to fix the source of the problem. |
This is removing the cleanup script which is dealing with a synptom. @esteve is looking into the underlying issue. I'm going to close this removal of the cleanup, as this symptom is important to clean up in case it happens again as it can be catastrophic. (aka slaves run out of disk space) |
If we do fix the actual problem I would recommend to merge this. Even if the result would be "catastrophic" otherwise any problem in the future in this area would go unnoticed. I think a hard failure is better then hiding a problem. |
I'm not sure I completely agree, but we can do that. reopened |
Merging this to let container leakage be apparent and the hoped fix resolve it: ros-infrastructure/ros_buildfarm#124 |
All jobs should be run with --rm now which makes this not necessary.
Fixes ros-infrastructure/ros_buildfarm#120