Fix more flaky playwright tests #4166
Annotations
3 errors, 5 warnings, and 1 notice
Run Playwright tests:
playwright/e2e/messages/messages.spec.ts#L99
1) [Chrome] › messages/messages.spec.ts:95:17 › Message rendering › with ltr display name › should render an LTR rich text emote @screenshot
Error: expect(locator).toHaveScreenshot(expected)
18 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/messages/messages.spec.ts/emote-rich-ltr-ltrdisplayname-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/messages-messages-Message--c2c09-nder-an-LTR-rich-text-emote-Chrome/emote-rich-ltr-ltrdisplayname-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/messages-messages-Message--c2c09-nder-an-LTR-rich-text-emote-Chrome/emote-rich-ltr-ltrdisplayname-diff.png
Call log:
- expect.toHaveScreenshot(emote-rich-ltr-ltrdisplayname.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$yFCSJe65R8wCzN988YLiPxjNbIJzG8SDVLnzHCcEml0" data-scroll-tokens="$yFCSJe65R8wCzN988YLiPxjNbIJzG8SDVLnzHCcEml0" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection mx_EventTile_emote mx_EventTile_noBubble">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 18 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$yFCSJe65R8wCzN988YLiPxjNbIJzG8SDVLnzHCcEml0" data-scroll-tokens="$yFCSJe65R8wCzN988YLiPxjNbIJzG8SDVLnzHCcEml0" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection mx_EventTile_emote mx_EventTile_noBubble">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 18 pixels (ratio 0.01 of all image pixels) are different.
97 |
98 | const msgTile = await sendMessage(page, "/me lays a *free range* egg");
> 99 | await expect(msgTile).toMatchScreenshot(`emote-rich-ltr-${direction}displayname.png`);
| ^
100 | });
101 |
102 | test("should render an edited LTR message", async ({ page, user, app, room }) => {
at /home/runner/work/element-web/element-web/playwright/e2e/messages/messages.spec.ts:99:39
|
Run Playwright tests:
playwright/e2e/read-receipts/editing-messages-main-timeline.spec.ts#L1
2) [Chrome] › read-receipts/editing-messages-main-timeline.spec.ts:75:17 › Read receipts › editing messages › in the main timeline › Editing a reply after reading it makes the room unread @mergequeue
Test timeout of 30000ms exceeded.
|
Run Playwright tests:
playwright/e2e/read-receipts/index.ts#L88
2) [Chrome] › read-receipts/editing-messages-main-timeline.spec.ts:75:17 › Read receipts › editing messages › in the main timeline › Editing a reply after reading it makes the room unread @mergequeue
Error: jsHandle.evaluateHandle: Test timeout of 30000ms exceeded.
at read-receipts/index.ts:88
86 | }
87 |
> 88 | const promise = room.evaluateHandle(
| ^
89 | async (room, { message, includeThreads }) => {
90 | let ev = room.timeline.find((e) => e.getContent().body === message);
91 | if (!ev && includeThreads) {
at MessageBuilder.getMessage (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:88:30)
at MessageContentSpec.getContent (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:154:53)
at Helpers.sendMessageAsClient (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:348:61)
at Helpers.receiveMessages (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:585:9)
at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/editing-messages-main-timeline.spec.ts:83:17
|
Run Playwright tests:
[Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 56.8s
|
Run Playwright tests:
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts took 38.2s
|
Run Playwright tests:
[Chrome] › read-receipts/editing-messages-thread-roots.spec.ts#L1
[Chrome] › read-receipts/editing-messages-thread-roots.spec.ts took 30.1s
|
Run Playwright tests:
[Chrome] › invite/invite-dialog.spec.ts#L1
[Chrome] › invite/invite-dialog.spec.ts took 25.2s
|
Run Playwright tests:
[Chrome] › knock/knock-into-room.spec.ts#L1
[Chrome] › knock/knock-into-room.spec.ts took 19.9s
|
Run Playwright tests
2 flaky
[Chrome] › messages/messages.spec.ts:95:17 › Message rendering › with ltr display name › should render an LTR rich text emote @screenshot
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts:75:17 › Read receipts › editing messages › in the main timeline › Editing a reply after reading it makes the room unread @mergequeue
2 skipped
77 passed (6.8m)
|
Loading