Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(driver): fix integration test retry configuration #18643

Merged
merged 24 commits into from
Nov 9, 2021
Merged
Changes from 1 commit
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
d243a15
test(driver): fix integration test retry configuration
emilyrohrbough Oct 26, 2021
973f354
add assetions
emilyrohrbough Oct 26, 2021
f24ec80
Merge branch 'develop' into fix-driver-retries
emilyrohrbough Oct 26, 2021
66c2fd8
move debug code to running test.
emilyrohrbough Oct 26, 2021
2eb8ef1
Merge branch 'develop' into fix-driver-retries
emilyrohrbough Oct 28, 2021
e1cdde4
Merge branch 'develop' into fix-driver-retries
emilyrohrbough Oct 29, 2021
891567a
pr feedback
emilyrohrbough Oct 29, 2021
15ffd2f
add log context when failures occur
emilyrohrbough Nov 2, 2021
f741ecb
revert change
emilyrohrbough Nov 2, 2021
55e70e1
.
emilyrohrbough Nov 2, 2021
f987fac
try increasing retry just to see
emilyrohrbough Nov 3, 2021
14cc8a6
Update navigation_spec.js
emilyrohrbough Nov 4, 2021
f6bb5df
fix this test
emilyrohrbough Nov 4, 2021
358b844
for fun, lets try these flaky tests
emilyrohrbough Nov 4, 2021
717c8dc
Merge branch 'develop' into fix-driver-retries
emilyrohrbough Nov 4, 2021
5edf0ee
Update navigation_spec.js
emilyrohrbough Nov 4, 2021
e89ab54
lint
emilyrohrbough Nov 4, 2021
a9d0d81
lint
emilyrohrbough Nov 5, 2021
37b8892
Merge branch 'develop' into fix-driver-retries
emilyrohrbough Nov 8, 2021
952dda3
Merge branch 'develop' into fix-driver-retries
emilyrohrbough Nov 9, 2021
c1f9ae1
Merge branch 'develop' into fix-driver-retries
emilyrohrbough Nov 9, 2021
6c25eb5
Apply suggestions from code review
emilyrohrbough Nov 9, 2021
e19d176
don't timeout passing tests
flotwig Nov 9, 2021
11f5c14
Merge branch 'develop' into fix-driver-retries
emilyrohrbough Nov 9, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
7 changes: 7 additions & 0 deletions packages/driver/src/cypress/mocha.ts
Original file line number Diff line number Diff line change
Expand Up @@ -416,6 +416,13 @@ const patchRunnableResetTimeout = () => {
}

this.timer = setTimeout(() => {
if (runnable.state === 'passed') {
// this timeout can be reached at the same time that a
// user does an asynchronous `done`, so double-check
// that the test has not already passed before timing out
return
}
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For anyone curious to reproduce this issue, you can comment this out and runt his test to consistently see the error shown in the video Zach linked:

      it('should not be true', { defaultCommandTimeout: 1 }, (done) => {
        cy.on('fail', (err) => {
          expect(err.message).to.eq('expected false to be true')

          done()
        })

        cy.noop(false).should('be.true')
      })


const err = $errUtils.errByPath(getErrPath(), { ms })

runnable.callback(err)
Expand Down