Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: add CI reporter for previous tests on worker #30243

Conversation

mxschmitt
Copy link
Member

No description provided.

@mxschmitt mxschmitt added the CQ1 label Apr 4, 2024
Copy link
Contributor

github-actions bot commented Apr 4, 2024

Test results for "tests 1"

1 failed
❌ [playwright-test] › playwright.artifacts.spec.ts:306:5 › should work with trace: on-all-retries

5 flaky ⚠️ [firefox-page] › page/page-click.spec.ts:445:3 › should wait for stable position
⚠️ [playwright-test] › ui-mode-trace.spec.ts:76:5 › should merge screenshot assertions
⚠️ [playwright-test] › ui-mode-trace.spec.ts:76:5 › should merge screenshot assertions
⚠️ [playwright-test] › ui-mode-test-ct.spec.ts:252:5 › should watch component when editing util
⚠️ [webkit-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks

26903 passed, 618 skipped
✔️✔️✔️

Merge workflow run.

Copy link
Contributor

github-actions bot commented Apr 4, 2024

Test results for "tests 2"

2 fatal errors, not part of any test
11 failed
❌ [chromium-library] › library/capabilities.spec.ts:99:3 › should play audio @smoke
❌ [firefox-library] › library/inspector/cli-codegen-2.spec.ts:340:7 › cli codegen › should record open in a new tab with url
❌ [firefox-library] › library/inspector/cli-codegen-2.spec.ts:340:7 › cli codegen › should record open in a new tab with url
❌ [firefox-library] › library/inspector/cli-codegen-2.spec.ts:340:7 › cli codegen › should record open in a new tab with url
❌ [firefox-library] › library/capabilities.spec.ts:99:3 › should play audio @smoke
❌ [firefox-library] › library/inspector/cli-codegen-2.spec.ts:340:7 › cli codegen › should record open in a new tab with url
❌ [webkit-library] › library/browsercontext-viewport.spec.ts:94:3 › should not have touch by default
❌ [webkit-library] › library/capabilities.spec.ts:67:3 › should play video @smoke
❌ [webkit-library] › library/capabilities.spec.ts:99:3 › should play audio @smoke
❌ [webkit-library] › library/capabilities.spec.ts:133:3 › should not crash on page with mp4 @smoke
❌ [webkit-library] › library/signals.spec.ts:62:7 › signals › should report browser close signal 2

82 flaky ⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [chromium-library] › library/inspector/cli-codegen-1.spec.ts:22:7 › cli codegen › should click
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [chromium-library] › library/browsercontext-credentials.spec.ts:55:1 › should work with correct credentials @smoke
⚠️ [chromium-library] › library/browsercontext-credentials.spec.ts:55:1 › should work with correct credentials @smoke
⚠️ [chromium-page] › page/page-drag.spec.ts:330:5 › Drag and drop › should work with locators
⚠️ [chromium-library] › library/browsercontext-credentials.spec.ts:55:1 › should work with correct credentials @smoke
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [chromium-page] › page/page-add-locator-handler.spec.ts:88:5 › should work with locator.hover()
⚠️ [chromium-page] › page/page-drag.spec.ts:70:5 › Drag and drop › should work inside iframe
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [chromium-library] › library/inspector/cli-codegen-1.spec.ts:22:7 › cli codegen › should click
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [firefox-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [firefox-page] › page/page-click.spec.ts:445:3 › should wait for stable position
⚠️ [firefox-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [firefox-page] › page/page-click.spec.ts:848:3 › should not hang when frame is detached
⚠️ [firefox-library] › library/capabilities.spec.ts:260:3 › requestFullscreen
⚠️ [firefox-library] › library/video.spec.ts:351:5 › screencast › should capture navigation
⚠️ [firefox-page] › page/elementhandle-wait-for-element-state.spec.ts:117:3 › should wait for stable position
⚠️ [firefox-page] › page/page-click-timeout-4.spec.ts:20:3 › should timeout waiting for stable position
⚠️ [firefox-page] › page/page-click-scroll.spec.ts:19:3 › should not hit scroll bar
⚠️ [firefox-page] › page/page-click-timeout-4.spec.ts:20:3 › should timeout waiting for stable position
⚠️ [firefox-library] › library/browsercontext-basic.spec.ts:34:3 › should be able to click across browser contexts
⚠️ [firefox-library] › library/browsercontext-route.spec.ts:82:3 › should yield to page.route
⚠️ [firefox-library] › library/browsertype-connect.spec.ts:711:5 › run-server › setInputFiles should preserve lastModified timestamp
⚠️ [firefox-library] › library/capabilities.spec.ts:22:3 › SharedArrayBuffer should work @smoke
⚠️ [firefox-library] › library/capabilities.spec.ts:180:3 › should set CloseEvent.wasClean to false when the server terminates a WebSocket connection
⚠️ [firefox-library] › library/capabilities.spec.ts:243:3 › loading in HTMLImageElement.prototype
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:257:7 › cli codegen › should fill japanese text
⚠️ [firefox-library] › library/inspector/cli-codegen-2.spec.ts:200:7 › cli codegen › should download files
⚠️ [firefox-library] › library/tracing.spec.ts:525:5 › should export trace concurrently to second navigation
⚠️ [firefox-page] › page/frame-goto.spec.ts:46:3 › should continue after client redirect
⚠️ [firefox-page] › page/page-click.spec.ts:99:3 › should click the 1x1 div
⚠️ [firefox-page] › page/page-dialog.spec.ts:30:3 › should allow accepting prompts @smoke
⚠️ [firefox-page] › page/elementhandle-wait-for-element-state.spec.ts:117:3 › should wait for stable position
⚠️ [firefox-page] › page/page-click-timeout-4.spec.ts:20:3 › should timeout waiting for stable position
⚠️ [firefox-page] › page/page-click.spec.ts:445:3 › should wait for stable position
⚠️ [firefox-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [firefox-page] › page/page-click-timeout-4.spec.ts:20:3 › should timeout waiting for stable position
⚠️ [firefox-library] › library/tracing.spec.ts:412:14 › should produce screencast frames crop
⚠️ [firefox-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [firefox-page] › page/page-goto.spec.ts:81:3 › should work with Cross-Origin-Opener-Policy
⚠️ [firefox-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [firefox-page] › page/page-click.spec.ts:445:3 › should wait for stable position
⚠️ [firefox-page] › page/page-click.spec.ts:848:3 › should not hang when frame is detached
⚠️ [chromium-library] › library/browsercontext-credentials.spec.ts:55:1 › should work with correct credentials @smoke
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [chromium-page] › page/workers.spec.ts:25:3 › Page.workers @smoke
⚠️ [chromium-page] › page/page-drag.spec.ts💯5 › Drag and drop › should cancel on escape
⚠️ [chromium-page] › page/page-mouse.spec.ts:193:3 › should trigger hover state with removed window.Node
⚠️ [chromium-library] › library/emulation-focus.spec.ts:190:12 › should trigger hover state concurrently
⚠️ [chromium-page] › page/page-leaks.spec.ts:92:5 › fill should not leak
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [chromium-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [firefox-page] › page/frame-goto.spec.ts:46:3 › should continue after client redirect
⚠️ [webkit-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks
⚠️ [webkit-page] › page/page-add-locator-handler.spec.ts:88:5 › should work with locator.hover()
⚠️ [webkit-page] › page/page-drag.spec.ts:34:5 › Drag and drop › should send the right events
⚠️ [webkit-page] › page/page-drag.spec.ts💯5 › Drag and drop › should cancel on escape
⚠️ [webkit-page] › page/page-drag.spec.ts:246:5 › Drag and drop › should work if the drag event is captured but not canceled
⚠️ [webkit-library] › library/inspector/cli-codegen-1.spec.ts:257:7 › cli codegen › should fill japanese text
⚠️ [webkit-library] › library/inspector/cli-codegen-1.spec.ts:520:7 › cli codegen › should uncheck
⚠️ [webkit-page] › page/page-drag.spec.ts:70:5 › Drag and drop › should work inside iframe
⚠️ [webkit-library] › library/browsercontext-viewport.spec.ts:143:12 › should drag with high dpi
⚠️ [webkit-library] › library/emulation-focus.spec.ts:190:12 › should trigger hover state concurrently
⚠️ [webkit-library] › library/inspector/cli-codegen-2.spec.ts:276:7 › cli codegen › should handle dialogs
⚠️ [webkit-library] › library/inspector/cli-codegen-3.spec.ts:562:7 › cli codegen › should assert value
⚠️ [webkit-page] › page/page-drag.spec.ts:272:5 › Drag and drop › should work if a frame is stalled
⚠️ [webkit-page] › page/page-drag.spec.ts:289:5 › Drag and drop › should work with the helper method
⚠️ [webkit-page] › page/page-drag.spec.ts:330:5 › Drag and drop › should work with locators
⚠️ [webkit-library] › library/browsercontext-viewport-mobile.spec.ts:66:5 › mobile viewport › should detect touch when applying viewport with touches
⚠️ [webkit-library] › library/modernizr.spec.ts:33:3 › safari-14-1
⚠️ [webkit-library] › library/modernizr.spec.ts:82:3 › mobile-safari-14-1
⚠️ [webkit-library] › library/tracing.spec.ts:243:5 › should not include trace resources from the previous chunks

182354 passed, 8013 skipped, 1296 did not run
✔️✔️✔️

Merge workflow run.

@mxschmitt mxschmitt marked this pull request as draft April 4, 2024 14:47
@dgozman dgozman closed this May 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants