Added fullscreen feature with command alt f #24387
galata.yml
on: pull_request
Visual Regression Tests
38m 41s
Matrix: Visual Regression Documentation
Annotations
20 errors, 2 warnings, and 2 notices
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals:
core/galata/test/documentation/general.test.ts#L581
1) [documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ──
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('.jp-RunningSessions-item.jp-mod-kernel')
Expected: 2
Received: 4
Call log:
- expect.soft.toHaveCount with timeout 5000ms
- waiting for locator('.jp-RunningSessions-item.jp-mod-kernel')
- locator resolved to 3 elements
- unexpected value "3"
- locator resolved to 3 elements
- unexpected value "3"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
579 | await expect
580 | .soft(page.locator('.jp-RunningSessions-item.jp-mod-kernel'))
> 581 | .toHaveCount(2, { timeout: 5000 });
| ^
582 |
583 | const freeezeKernelIds = async () => {
584 | return page.evaluate(() => {
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:581:8
|
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals:
core/galata/test/documentation/general.test.ts#L601
1) [documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ──
Error: Screenshot comparison failed:
948 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts-snapshots/running-layout-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Kernels-and-Terminals-documentation/running-layout-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Kernels-and-Terminals-documentation/running-layout-diff.png
599 | })
600 | )
> 601 | .toMatchSnapshot('running_layout.png');
| ^
602 |
603 | await page.click('jp-button[data-command="running:show-modal"]');
604 | await freeezeKernelIds();
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:601:8
|
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals:
core/galata/test/documentation/general.test.ts#L581
1) [documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ──
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('.jp-RunningSessions-item.jp-mod-kernel')
Expected: 2
Received: 4
Call log:
- expect.soft.toHaveCount with timeout 5000ms
- waiting for locator('.jp-RunningSessions-item.jp-mod-kernel')
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
579 | await expect
580 | .soft(page.locator('.jp-RunningSessions-item.jp-mod-kernel'))
> 581 | .toHaveCount(2, { timeout: 5000 });
| ^
582 |
583 | const freeezeKernelIds = async () => {
584 | return page.evaluate(() => {
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:581:8
|
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals:
core/galata/test/documentation/general.test.ts#L601
1) [documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ──
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
948 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts-snapshots/running-layout-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Kernels-and-Terminals-documentation-retry1/running-layout-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Kernels-and-Terminals-documentation-retry1/running-layout-diff.png
599 | })
600 | )
> 601 | .toMatchSnapshot('running_layout.png');
| ^
602 |
603 | await page.click('jp-button[data-command="running:show-modal"]');
604 | await freeezeKernelIds();
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:601:8
|
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals:
core/galata/test/documentation/general.test.ts#L581
1) [documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ──
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('.jp-RunningSessions-item.jp-mod-kernel')
Expected: 2
Received: 4
Call log:
- expect.soft.toHaveCount with timeout 5000ms
- waiting for locator('.jp-RunningSessions-item.jp-mod-kernel')
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
- locator resolved to 4 elements
- unexpected value "4"
579 | await expect
580 | .soft(page.locator('.jp-RunningSessions-item.jp-mod-kernel'))
> 581 | .toHaveCount(2, { timeout: 5000 });
| ^
582 |
583 | const freeezeKernelIds = async () => {
584 | return page.evaluate(() => {
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:581:8
|
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals:
core/galata/test/documentation/general.test.ts#L601
1) [documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ──
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
948 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts-snapshots/running-layout-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Kernels-and-Terminals-documentation-retry2/running-layout-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-general-General-Kernels-and-Terminals-documentation-retry2/running-layout-diff.png
599 | })
600 | )
> 601 | .toMatchSnapshot('running_layout.png');
| ^
602 |
603 | await page.click('jp-button[data-command="running:show-modal"]');
604 | await freeezeKernelIds();
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:601:8
|
[documentation] › test/documentation/workspaces.test.ts:36:7 › Workspaces sidebar › Workspaces context menu:
core/galata/test/documentation/workspaces.test.ts#L27
2) [documentation] › test/documentation/workspaces.test.ts:36:7 › Workspaces sidebar › Workspaces context menu
Test timeout of 90000ms exceeded while running "beforeEach" hook.
25 | });
26 |
> 27 | test.beforeEach(async ({ page, tmpPath }) => {
| ^
28 | await page.filebrowser.openDirectory(tmpPath);
29 | });
30 |
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/workspaces.test.ts:27:8
|
[documentation] › test/documentation/workspaces.test.ts:36:7 › Workspaces sidebar › Workspaces context menu:
core/galata/src/helpers/activity.ts#L54
2) [documentation] › test/documentation/workspaces.test.ts:36:7 › Workspaces sidebar › Workspaces context menu
Error: locator.count: Test timeout of 90000ms exceeded.
at src/helpers/activity.ts:54
52 | } else {
53 | const tab = this.getTabLocator(name);
> 54 | if (!(await tab.count())) {
| ^
55 | return false;
56 | }
57 | const classes = await Utils.getLocatorClassList(tab);
at ActivityHelper.isTabActive (/home/runner/work/jupyterlab/jupyterlab/core/galata/src/helpers/activity.ts:54:23)
at Timeout.check (/home/runner/work/jupyterlab/jupyterlab/core/galata/src/utils.ts:183:11)
|
[documentation] › test/documentation/workspaces.test.ts:36:7 › Workspaces sidebar › Workspaces context menu:
core/galata/test/documentation/workspaces.test.ts#L27
2) [documentation] › test/documentation/workspaces.test.ts:36:7 › Workspaces sidebar › Workspaces context menu
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 90000ms exceeded while running "beforeEach" hook.
25 | });
26 |
> 27 | test.beforeEach(async ({ page, tmpPath }) => {
| ^
28 | await page.filebrowser.openDirectory(tmpPath);
29 | });
30 |
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/workspaces.test.ts:27:8
|
[documentation] › test/documentation/workspaces.test.ts:36:7 › Workspaces sidebar › Workspaces context menu:
core/galata/src/helpers/activity.ts#L54
2) [documentation] › test/documentation/workspaces.test.ts:36:7 › Workspaces sidebar › Workspaces context menu
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.count: Test timeout of 90000ms exceeded.
at src/helpers/activity.ts:54
52 | } else {
53 | const tab = this.getTabLocator(name);
> 54 | if (!(await tab.count())) {
| ^
55 | return false;
56 | }
57 | const classes = await Utils.getLocatorClassList(tab);
at ActivityHelper.isTabActive (/home/runner/work/jupyterlab/jupyterlab/core/galata/src/helpers/activity.ts:54:23)
at Timeout.check (/home/runner/work/jupyterlab/jupyterlab/core/galata/src/utils.ts:183:11)
|
[jupyterlab] › test/jupyterlab/menus.test.ts:30:9 › General Tests › Open menu item View>Appearance:
galata/test/jupyterlab/menus.test.ts#L36
1) [jupyterlab] › test/jupyterlab/menus.test.ts:30:9 › General Tests › Open menu item View>Appearance
Error: Screenshot comparison failed:
Expected an image 321px by 210px, received 321px by 234px. 2368 pixels (ratio 0.04 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/menus.test.ts-snapshots/opened-menu-view-appearance-jupyterlab-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/galata/test-results/test-jupyterlab-menus-Gene-25223-n-menu-item-View-Appearance-jupyterlab/opened-menu-view-appearance-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/galata/test-results/test-jupyterlab-menus-Gene-25223-n-menu-item-View-Appearance-jupyterlab/opened-menu-view-appearance-diff.png
34 | const imageName = `opened-menu-${menuPath.replace(/>/g, '-')}.png`;
35 | const menu = await page.menu.getOpenMenuLocator();
> 36 | expect(await menu.screenshot()).toMatchSnapshot(imageName.toLowerCase());
| ^
37 | });
38 | });
39 |
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/menus.test.ts:36:39
|
[jupyterlab] › test/jupyterlab/menus.test.ts:30:9 › General Tests › Open menu item View>Appearance:
galata/test/jupyterlab/menus.test.ts#L36
1) [jupyterlab] › test/jupyterlab/menus.test.ts:30:9 › General Tests › Open menu item View>Appearance
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 321px by 210px, received 321px by 234px. 2368 pixels (ratio 0.04 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/menus.test.ts-snapshots/opened-menu-view-appearance-jupyterlab-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/galata/test-results/test-jupyterlab-menus-Gene-25223-n-menu-item-View-Appearance-jupyterlab-retry1/opened-menu-view-appearance-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/galata/test-results/test-jupyterlab-menus-Gene-25223-n-menu-item-View-Appearance-jupyterlab-retry1/opened-menu-view-appearance-diff.png
34 | const imageName = `opened-menu-${menuPath.replace(/>/g, '-')}.png`;
35 | const menu = await page.menu.getOpenMenuLocator();
> 36 | expect(await menu.screenshot()).toMatchSnapshot(imageName.toLowerCase());
| ^
37 | });
38 | });
39 |
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/menus.test.ts:36:39
|
[jupyterlab] › test/jupyterlab/settings.test.ts:147:7 › change font-size › should Decrease Content Font Size:
galata/test/jupyterlab/settings.test.ts#L150
2) [jupyterlab] › test/jupyterlab/settings.test.ts:147:7 › change font-size › should Decrease Content Font Size
Error: proxy.evaluate: Execution context was destroyed, most likely because of a navigation.
148 | const markdownFile = await createMarkdownFile(page);
149 | await inputMarkdownFile(page, markdownFile);
> 150 | await page.evaluate(() => {
| ^
151 | return window.galata.app.commands.execute('fileeditor:markdown-preview');
152 | });
153 | const fontSize = await getMarkdownFontSize(page);
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/settings.test.ts:150:16
|
[jupyterlab] › test/jupyterlab/settings.test.ts:147:7 › change font-size › should Decrease Content Font Size:
galata/test/jupyterlab/settings.test.ts#L150
2) [jupyterlab] › test/jupyterlab/settings.test.ts:147:7 › change font-size › should Decrease Content Font Size
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: proxy.evaluate: Execution context was destroyed, most likely because of a navigation.
148 | const markdownFile = await createMarkdownFile(page);
149 | await inputMarkdownFile(page, markdownFile);
> 150 | await page.evaluate(() => {
| ^
151 | return window.galata.app.commands.execute('fileeditor:markdown-preview');
152 | });
153 | const fontSize = await getMarkdownFontSize(page);
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/settings.test.ts:150:16
|
[jupyterlab] › test/jupyterlab/windowed-notebook.test.ts:474:5 › should rendered injected HTML scripts of out-of-viewport cells:
galata/test/jupyterlab/windowed-notebook.test.ts#L489
3) [jupyterlab] › test/jupyterlab/windowed-notebook.test.ts:474:5 › should rendered injected HTML scripts of out-of-viewport cells
Error: expect(received).toBeGreaterThan(expected)
Expected: > 1
Received: 0
487 | expect(
488 | await page.getByText('JavaScript injected from HTML').count()
> 489 | ).toBeGreaterThan(1);
| ^
490 | });
491 |
492 | test('should rendered injected JavaScript snippets of out-of-viewport cells', async ({
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/windowed-notebook.test.ts:489:5
|
[jupyterlab] › test/jupyterlab/windowed-notebook.test.ts:474:5 › should rendered injected HTML scripts of out-of-viewport cells:
galata/test/jupyterlab/windowed-notebook.test.ts#L489
3) [jupyterlab] › test/jupyterlab/windowed-notebook.test.ts:474:5 › should rendered injected HTML scripts of out-of-viewport cells
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toBeGreaterThan(expected)
Expected: > 1
Received: 0
487 | expect(
488 | await page.getByText('JavaScript injected from HTML').count()
> 489 | ).toBeGreaterThan(1);
| ^
490 | });
491 |
492 | test('should rendered injected JavaScript snippets of out-of-viewport cells', async ({
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/windowed-notebook.test.ts:489:5
|
[jupyterlab] › test/jupyterlab/cells.test.ts:41:7 › Run Cells With Keyboard › Run code cell with Ctrl + Enter:
galata/test/jupyterlab/cells.test.ts#L1
4) [jupyterlab] › test/jupyterlab/cells.test.ts:41:7 › Run Cells With Keyboard › Run code cell with Ctrl + Enter
Test timeout of 60000ms exceeded.
|
[jupyterlab] › test/jupyterlab/cells.test.ts:41:7 › Run Cells With Keyboard › Run code cell with Ctrl + Enter:
galata/src/helpers/notebook.ts#L1269
4) [jupyterlab] › test/jupyterlab/cells.test.ts:41:7 › Run Cells With Keyboard › Run code cell with Ctrl + Enter
Error: locator.evaluate: Test timeout of 60000ms exceeded.
at src/helpers/notebook.ts:1269
1267 | // Wait until the CodeMirror highlighting is stable
1268 | // over 10 consecutive animation frames.
> 1269 | await cell.evaluate((cell: HTMLElement) => {
| ^
1270 | let _resolve: () => void;
1271 | const promise = new Promise<void>(resolve => {
1272 | _resolve = resolve;
at NotebookHelper.setCell (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/notebook.ts:1269:18)
at /home/runner/work/jupyterlab/jupyterlab/galata/test/jupyterlab/cells.test.ts:42:5
|
[jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script):
galata/test/jupyterlab/debugger.test.ts#L1
5) [jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script)
Test timeout of 60000ms exceeded.
|
[jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script):
galata/src/helpers/activity.ts#L158
5) [jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script)
Error: locator.getAttribute: Test timeout of 60000ms exceeded.
Call log:
- waiting for getByRole('main').locator('.jp-mod-current[role="tab"]')
at src/helpers/activity.ts:158
156 | locator = this.page.getByRole('main').getByRole('tabpanel', { name });
157 | } else {
> 158 | const id = await this.getTabLocator().getAttribute('data-id');
| ^
159 | if (!id) {
160 | return null;
161 | }
at ActivityHelper.getPanelLocator (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/activity.ts:158:45)
at NotebookHelper.getToolbarLocator (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/notebook.ts:150:28)
at DebuggerHelper.isOn (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/debuggerpanel.ts:27:41)
at fn (/home/runner/work/jupyterlab/jupyterlab/galata/src/helpers/debuggerpanel.ts:55:51)
at Timeout.check (/home/runner/work/jupyterlab/jupyterlab/galata/src/utils.ts:183:33)
|
🎭 Playwright Run Summary
2 failed
[documentation] › test/documentation/general.test.ts:555:7 › General › Kernels and Terminals ───
[documentation] › test/documentation/workspaces.test.ts:36:7 › Workspaces sidebar › Workspaces context menu
3 flaky
[documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception
[documentation] › test/documentation/general.test.ts:20:7 › General › Welcome ──────────────────
[documentation] › test/documentation/general.test.ts:115:7 › General › Right Sidebar ───────────
58 passed (8.7m)
|
🎭 Playwright Run Summary
3 failed
[jupyterlab] › test/jupyterlab/menus.test.ts:30:9 › General Tests › Open menu item View>Appearance
[jupyterlab] › test/jupyterlab/settings.test.ts:147:7 › change font-size › should Decrease Content Font Size
[jupyterlab] › test/jupyterlab/windowed-notebook.test.ts:474:5 › should rendered injected HTML scripts of out-of-viewport cells
4 flaky
[jupyterlab] › test/jupyterlab/cells.test.ts:41:7 › Run Cells With Keyboard › Run code cell with Ctrl + Enter
[jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script)
[jupyterlab] › test/jupyterlab/notebook-markdown.test.ts:92:7 › Notebook Markdown › Render a MermaidJS error
[jupyterlab] › test/jupyterlab/settings.test.ts:129:7 › change font-size › should Increase Content Font Size
470 passed (32.5m)
|
Visual Regression Documentation (3.10.6)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4, actions/cache@v3, actions/setup-node@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Visual Regression Tests
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4, actions/cache@v3, actions/setup-node@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
jupyterlab-documentation-report
|
9.45 MB |
|
jupyterlab-documentation-test-assets
|
8.64 MB |
|
jupyterlab-galata-report
|
10 MB |
|
jupyterlab-galata-test-assets
|
6.9 MB |
|