Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support double write to avoid io spike #342

Open
Connor1996 opened this issue Oct 23, 2023 · 0 comments · May be fixed by #323
Open

Support double write to avoid io spike #342

Connor1996 opened this issue Oct 23, 2023 · 0 comments · May be fixed by #323

Comments

@Connor1996
Copy link
Member

In cloud environment, cloud disk IO may get stuck for a while due to cloud vendor infrastructure issues. This may affect the foreground latency dramatically. Raft log apply doesn't sync mostly, so it wouldn't be a problem. While raft log append is synced every time. To alleviate that, we can hedge raft log to two different cloud disks. If either one of them is synced, the raft log append is considered finished. Thus when one of the cloud disk IO is stuck, the other one can still work and doesn't affect foreground write flow.

@Connor1996 Connor1996 changed the title Support hedged file system to avoid io spike Support double write to avoid io spike Oct 23, 2023
@Connor1996 Connor1996 linked a pull request Oct 23, 2023 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant