Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CASSANDRA-15439] Add option to override the FatClient timeout for Bootstrapping nodes #483

Open
wants to merge 3 commits into
base: palantir-cassandra-2.2.18
Choose a base branch
from

Conversation

rhuffy
Copy link
Contributor

@rhuffy rhuffy commented Apr 23, 2024

Backport of CASSANDRA-15439

This allows us to override the timeout for node removal while a node is bootstrapping. We know that we never want a bootstrapping node that has been removed by other nodes while streaming to succeed bootstrapping, and have already implemented safeguards to prevent that node from joining the ring after completing streaming.

Setting this parameter to a higher value makes this error state less likely to occur. This change takes the default set in 5.0, which is 5 minutes. We could consider making this higher.

We also had success reducing the frequency of this issue by vertically upsizing nodes and throttling streaming.

@rhuffy rhuffy force-pushed the rh/bootstrapping-fatclient-timeout branch from 0c44e64 to 5d8efda Compare May 8, 2024 18:15
@rhuffy
Copy link
Contributor Author

rhuffy commented May 8, 2024

committed to trunk here: apache/cassandra@057d082

@rhuffy rhuffy marked this pull request as ready for review May 8, 2024 18:19
@rhuffy rhuffy force-pushed the rh/bootstrapping-fatclient-timeout branch 3 times, most recently from 4d1e42c to 73b7187 Compare May 8, 2024 21:38
@rhuffy rhuffy force-pushed the rh/bootstrapping-fatclient-timeout branch from 73b7187 to fc73cbc Compare May 8, 2024 21:39
@@ -79,6 +81,8 @@ public class VersionedValue implements Comparable<VersionedValue>

// values for ApplicationState.REMOVAL_COORDINATOR
public final static String REMOVAL_COORDINATOR = "REMOVER";
public final static List<String> BOOTSTRAPPING_STATES = Arrays.asList(VersionedValue.STATUS_BOOTSTRAPPING,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: status to match the upstream patch?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants