Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Do not merge][For Framework Upgrade Test] Update release.yaml #13299

Closed

Conversation

junkil-park
Copy link
Contributor

Description

Type of Change

  • New feature
  • Bug fix
  • Breaking change
  • Performance improvement
  • Refactoring
  • Dependency update
  • Documentation update
  • Tests

Which Components or Systems Does This Change Impact?

  • Validator Node
  • Full Node (API, Indexer, etc.)
  • Move/Aptos Virtual Machine
  • Aptos Framework
  • Aptos CLI/SDK
  • Developer Infrastructure
  • Other (specify)

How Has This Been Tested?

Key Areas to Review

Checklist

  • I have read and followed the CONTRIBUTING doc
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I identified and added all stakeholders and component owners affected by this change as reviewers
  • I tested both happy and unhappy path of the functionality
  • I have made corresponding changes to the documentation

Copy link

trunk-io bot commented May 16, 2024

@junkil-park junkil-park added CICD:run-e2e-tests when this label is present github actions will run all land-blocking e2e tests from the PR CICD:run-framework-upgrade-test labels May 16, 2024
@junkil-park junkil-park changed the title Update release.yaml [Do not merge][For Framework Upgrade Test] Update release.yaml May 16, 2024

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

Copy link
Contributor

✅ Forge suite compat success on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8

Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8 (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 5651 txn/s, latency: 5652 ms, (p50: 4800 ms, p90: 9900 ms, p99: 11100 ms), latency samples: 237360
2. Upgrading first Validator to new version: 0a4009abef98a1c61e089fb01257c3b937c406a8
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1553 txn/s, latency: 18303 ms, (p50: 22700 ms, p90: 29200 ms, p99: 29900 ms), latency samples: 74560
3. Upgrading rest of first batch to new version: 0a4009abef98a1c61e089fb01257c3b937c406a8
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1609 txn/s, latency: 16874 ms, (p50: 19500 ms, p90: 22600 ms, p99: 24700 ms), latency samples: 86900
4. upgrading second batch to new version: 0a4009abef98a1c61e089fb01257c3b937c406a8
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3269 txn/s, latency: 9540 ms, (p50: 9900 ms, p90: 12500 ms, p99: 13900 ms), latency samples: 130780
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8 passed
Test Ok

Copy link
Contributor

✅ Forge suite realistic_env_max_load success on 0a4009abef98a1c61e089fb01257c3b937c406a8

two traffics test: inner traffic : committed: 7760 txn/s, latency: 5030 ms, (p50: 4800 ms, p90: 6000 ms, p99: 10200 ms), latency samples: 3367900
two traffics test : committed: 100 txn/s, latency: 1911 ms, (p50: 1800 ms, p90: 2100 ms, p99: 4400 ms), latency samples: 1840
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.208, avg: 0.202", "QsPosToProposal: max: 0.249, avg: 0.228", "ConsensusProposalToOrdered: max: 0.461, avg: 0.414", "ConsensusOrderedToCommit: max: 0.393, avg: 0.377", "ConsensusProposalToCommit: max: 0.805, avg: 0.791"]
Max round gap was 1 [limit 4] at version 1525615. Max no progress secs was 4.4573298 [limit 15] at version 1525615.
Test Ok

Copy link
Contributor

✅ Forge suite framework_upgrade success on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8

Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8 (PR)
Upgrade the nodes to version: 0a4009abef98a1c61e089fb01257c3b937c406a8
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1141 txn/s, submitted: 1143 txn/s, failed submission: 2 txn/s, expired: 2 txn/s, latency: 2722 ms, (p50: 2100 ms, p90: 4800 ms, p99: 7100 ms), latency samples: 102720
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1170 txn/s, submitted: 1173 txn/s, failed submission: 2 txn/s, expired: 2 txn/s, latency: 2722 ms, (p50: 2100 ms, p90: 4800 ms, p99: 8100 ms), latency samples: 106540
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8 passed
Upgrade the remaining nodes to version: 0a4009abef98a1c61e089fb01257c3b937c406a8
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1214 txn/s, submitted: 1215 txn/s, failed submission: 1 txn/s, expired: 1 txn/s, latency: 2679 ms, (p50: 2100 ms, p90: 4800 ms, p99: 7400 ms), latency samples: 100780
Test Ok

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CICD:run-e2e-tests when this label is present github actions will run all land-blocking e2e tests from the PR CICD:run-framework-upgrade-test
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant