Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Auto Benchmarks] - Faster auto benchmarking by re-examine the time of each run #3185

Open
dailinsubjam opened this issue May 17, 2024 · 0 comments

Comments

@dailinsubjam
Copy link
Contributor

What is this task and why do we need to work on it?

This is to make the auto benchmarking faster by changing the sleep time in the scripts. Now we have to sleep for enough time to wait each run complete and then shut down all nodes by ecs scale back to 0. The way to measure the sleep time now is to calculate a formula correlated to total_nodes, rounds, transaction_size and transactions_per_round. However this is far more longer than it actually needed.

What work will need to be done to complete this task?

  • re-examine the formula we want for a more precise estimation of elapsed time for each run
  • would be best if we can have a signal when the runs are finished, so that we shut down all the nodes right after the benchmark results are output.

Are there any other details to include?

No response

What are the acceptance criteria to close this issue?

We could finish a bunch of runs with different parameters we want within 8 hours (basically like if we start it at night, we can see the results next morning when wake up).

Branch work will be merged to (if not the default branch)

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant