Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multi threaded rocksdb cf #16227

Closed
wants to merge 2 commits into from

Conversation

ryoqun
Copy link
Member

@ryoqun ryoqun commented Mar 30, 2021

Problem

upstream: rust-rocksdb/rust-rocksdb#506

Summary of Changes

context: #14586

default-features = false
features = ["lz4"]
rev = "61f323bedab7c12a1db2dcfad943761d1eb4fc64"
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@CriesofCarrots @carllin this api change will be required for multi-threaded cf alternations. Under the hood, DB::drop_cf() now takes &self. Could you direct me to the branch for the rocksdb stall patch or use this branch at that branch?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the branch for the rocksdb stall test and fix POC: https://github.com/CriesofCarrots/solana/tree/drop-cf-and-destroy-rocks-bench
The commit that adds a drop_cf method is this one, but I imagine it will need some tweaking: CriesofCarrots@c89b335
I'll work on updating the branch to your patch later today!

@codecov
Copy link

codecov bot commented Mar 30, 2021

Codecov Report

Merging #16227 (481f2d4) into master (92f4018) will increase coverage by 0.0%.
The diff coverage is 55.5%.

@@           Coverage Diff           @@
##           master   #16227   +/-   ##
=======================================
  Coverage    80.1%    80.1%           
=======================================
  Files         413      413           
  Lines      110490   110495    +5     
=======================================
+ Hits        88558    88565    +7     
+ Misses      21932    21930    -2     

@ryoqun ryoqun force-pushed the multi-threaded-rocksdb-cf branch from d17bb0c to 481f2d4 Compare April 6, 2021 14:21
Comment on lines +62 to +65
git = "https://github.com/rust-rocksdb/rust-rocksdb"
default-features = false
features = ["lz4"]
rev = "0b700fe70da8ee30483fde79f44df549f8fe11ec"
features = ["lz4", "multi-threaded-cf"]
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is it. :)

@stale
Copy link

stale bot commented Apr 19, 2021

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

@stale stale bot added the stale [bot only] Added to stale content; results in auto-close after a week. label Apr 19, 2021
@stale
Copy link

stale bot commented Jun 2, 2021

This stale pull request has been automatically closed. Thank you for your contributions.

@stale stale bot closed this Jun 2, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
stale [bot only] Added to stale content; results in auto-close after a week.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants