Fix more flaky playwright tests #4159
Annotations
1 error, 26 warnings, and 6 notices
[Chrome] › timeline/timeline.spec.ts:1228:17 › Timeline › message sending › MSC3916 - Authenticated Media › should render authenticated images in the timeline @no-firefox @no-webkit @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L1210
1) [Chrome] › timeline/timeline.spec.ts:1228:17 › Timeline › message sending › MSC3916 - Authenticated Media › should render authenticated images in the timeline @no-firefox @no-webkit @screenshot
Error: expect(locator).toHaveScreenshot(expected)
88732 pixels (ratio 0.18 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/image-in-timeline-default-layout-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-08ffd-ated-images-in-the-timeline-Chrome/image-in-timeline-default-layout-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-08ffd-ated-images-in-the-timeline-Chrome/image-in-timeline-default-layout-diff.png
Call log:
- expect.toHaveScreenshot(image-in-timeline-default-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_ScrollPanel')
- locator resolved to <div tabindex="-1" class="mx_AutoHideScrollbar mx_ScrollPanel mx_RoomView_messagePanel">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 88732 pixels (ratio 0.18 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_ScrollPanel')
- locator resolved to <div tabindex="-1" class="mx_AutoHideScrollbar mx_ScrollPanel mx_RoomView_messagePanel">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 88732 pixels (ratio 0.18 of all image pixels) are different.
1208 | };
1209 |
> 1210 | await expect(page.locator(".mx_ScrollPanel")).toMatchScreenshot(
| ^
1211 | "image-in-timeline-default-layout.png",
1212 | screenshotOptions,
1213 | );
at testImageRendering (/home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:1210:59)
at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:1273:21
|
Slow Test:
[Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 56.3s
|
Slow Test:
[Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 24.2s
|
Slow Test:
[Chrome] › right-panel/file-panel.spec.ts#L1
[Chrome] › right-panel/file-panel.spec.ts took 19.1s
|
Slow Test:
[Chrome] › polls/polls.spec.ts#L1
[Chrome] › polls/polls.spec.ts took 19.0s
|
Slow Test:
[Chrome] › one-to-one-chat/one-to-one-chat.spec.ts#L1
[Chrome] › one-to-one-chat/one-to-one-chat.spec.ts took 17.8s
|
Slow Test:
[Chrome] › sliding-sync/sliding-sync.spec.ts#L1
[Chrome] › sliding-sync/sliding-sync.spec.ts took 54.4s
|
Slow Test:
[Chrome] › settings/encryption-user-tab/recovery.spec.ts#L1
[Chrome] › settings/encryption-user-tab/recovery.spec.ts took 30.3s
|
Slow Test:
[Chrome] › room/room-header.spec.ts#L1
[Chrome] › room/room-header.spec.ts took 25.7s
|
Slow Test:
[Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 17.3s
|
Slow Test:
[Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 56.2s
|
Slow Test:
[Chrome] › integration-manager/kick.spec.ts#L1
[Chrome] › integration-manager/kick.spec.ts took 23.3s
|
Slow Test:
[Chrome] › crypto/invisible-crypto.spec.ts#L1
[Chrome] › crypto/invisible-crypto.spec.ts took 22.7s
|
Slow Test:
[Chrome] › knock/knock-into-room.spec.ts#L1
[Chrome] › knock/knock-into-room.spec.ts took 18.6s
|
Slow Test:
[Chrome] › editing/editing.spec.ts#L1
[Chrome] › editing/editing.spec.ts took 15.5s
|
Slow Test:
[Chrome] › login/login-consent.spec.ts#L1
[Chrome] › login/login-consent.spec.ts took 1.2m
|
Slow Test:
[Chrome] › crypto/backups-mas.spec.ts#L1
[Chrome] › crypto/backups-mas.spec.ts took 39.5s
|
Slow Test:
[Chrome] › app-loading/guest-registration.spec.ts#L1
[Chrome] › app-loading/guest-registration.spec.ts took 16.2s
|
Slow Test:
[Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 53.6s
|
Slow Test:
[Chrome] › audio-player/audio-player.spec.ts#L1
[Chrome] › audio-player/audio-player.spec.ts took 38.3s
|
Slow Test:
[Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 35.7s
|
Slow Test:
[Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 33.9s
|
Slow Test:
[Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 28.8s
|
Slow Test:
[Chrome] › spotlight/spotlight.spec.ts#L1
[Chrome] › spotlight/spotlight.spec.ts took 2.2m
|
Slow Test:
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 50.4s
|
Slow Test:
[Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 47.5s
|
Slow Test:
[Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 27.5s
|
🎭 Playwright Run Summary
1 skipped
35 passed (2.8m)
|
🎭 Playwright Run Summary
1 skipped
53 passed (3.8m)
|
🎭 Playwright Run Summary
1 skipped
65 passed (4.4m)
|
🎭 Playwright Run Summary
5 skipped
35 passed (4.7m)
|
🎭 Playwright Run Summary
56 passed (4.7m)
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › timeline/timeline.spec.ts:1228:17 › Timeline › message sending › MSC3916 - Authenticated Media › should render authenticated images in the timeline @no-firefox @no-webkit @screenshot
1 skipped
58 passed (6.0m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-Chrome-1
Expired
|
198 KB |
|
all-blob-reports-Chrome-2
Expired
|
584 KB |
|
all-blob-reports-Chrome-3
Expired
|
125 KB |
|
all-blob-reports-Chrome-4
Expired
|
168 KB |
|
all-blob-reports-Chrome-5
Expired
|
3.88 MB |
|
all-blob-reports-Chrome-6
Expired
|
416 KB |
|
html-report
|
4.9 MB |
|
webapp
Expired
|
27.2 MB |
|