Skip to content

Fix more flaky playwright tests #4159

Fix more flaky playwright tests

Fix more flaky playwright tests #4159

Triggered via pull request January 15, 2025 14:19
Status Success
Total duration 10m 23s
Artifacts 8

end-to-end-tests.yaml

on: pull_request
Build Element-Web
1m 54s
Build Element-Web
Matrix: playwright
end-to-end-tests
53s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

1 error, 26 warnings, and 6 notices
[Chrome] › timeline/timeline.spec.ts:1228:17 › Timeline › message sending › MSC3916 - Authenticated Media › should render authenticated images in the timeline @no-firefox @no-webkit @screenshot: playwright/e2e/timeline/timeline.spec.ts#L1210
1) [Chrome] › timeline/timeline.spec.ts:1228:17 › Timeline › message sending › MSC3916 - Authenticated Media › should render authenticated images in the timeline @no-firefox @no-webkit @screenshot Error: expect(locator).toHaveScreenshot(expected) 88732 pixels (ratio 0.18 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/image-in-timeline-default-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-08ffd-ated-images-in-the-timeline-Chrome/image-in-timeline-default-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-08ffd-ated-images-in-the-timeline-Chrome/image-in-timeline-default-layout-diff.png Call log: - expect.toHaveScreenshot(image-in-timeline-default-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_ScrollPanel') - locator resolved to <div tabindex="-1" class="mx_AutoHideScrollbar mx_ScrollPanel mx_RoomView_messagePanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 88732 pixels (ratio 0.18 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_ScrollPanel') - locator resolved to <div tabindex="-1" class="mx_AutoHideScrollbar mx_ScrollPanel mx_RoomView_messagePanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 88732 pixels (ratio 0.18 of all image pixels) are different. 1208 | }; 1209 | > 1210 | await expect(page.locator(".mx_ScrollPanel")).toMatchScreenshot( | ^ 1211 | "image-in-timeline-default-layout.png", 1212 | screenshotOptions, 1213 | ); at testImageRendering (/home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:1210:59) at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:1273:21
Slow Test: [Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 56.3s
Slow Test: [Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 24.2s
Slow Test: [Chrome] › right-panel/file-panel.spec.ts#L1
[Chrome] › right-panel/file-panel.spec.ts took 19.1s
Slow Test: [Chrome] › polls/polls.spec.ts#L1
[Chrome] › polls/polls.spec.ts took 19.0s
Slow Test: [Chrome] › one-to-one-chat/one-to-one-chat.spec.ts#L1
[Chrome] › one-to-one-chat/one-to-one-chat.spec.ts took 17.8s
Slow Test: [Chrome] › sliding-sync/sliding-sync.spec.ts#L1
[Chrome] › sliding-sync/sliding-sync.spec.ts took 54.4s
Slow Test: [Chrome] › settings/encryption-user-tab/recovery.spec.ts#L1
[Chrome] › settings/encryption-user-tab/recovery.spec.ts took 30.3s
Slow Test: [Chrome] › room/room-header.spec.ts#L1
[Chrome] › room/room-header.spec.ts took 25.7s
Slow Test: [Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 17.3s
Slow Test: [Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 56.2s
Slow Test: [Chrome] › integration-manager/kick.spec.ts#L1
[Chrome] › integration-manager/kick.spec.ts took 23.3s
Slow Test: [Chrome] › crypto/invisible-crypto.spec.ts#L1
[Chrome] › crypto/invisible-crypto.spec.ts took 22.7s
Slow Test: [Chrome] › knock/knock-into-room.spec.ts#L1
[Chrome] › knock/knock-into-room.spec.ts took 18.6s
Slow Test: [Chrome] › editing/editing.spec.ts#L1
[Chrome] › editing/editing.spec.ts took 15.5s
Slow Test: [Chrome] › login/login-consent.spec.ts#L1
[Chrome] › login/login-consent.spec.ts took 1.2m
Slow Test: [Chrome] › crypto/backups-mas.spec.ts#L1
[Chrome] › crypto/backups-mas.spec.ts took 39.5s
Slow Test: [Chrome] › app-loading/guest-registration.spec.ts#L1
[Chrome] › app-loading/guest-registration.spec.ts took 16.2s
Slow Test: [Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 53.6s
Slow Test: [Chrome] › audio-player/audio-player.spec.ts#L1
[Chrome] › audio-player/audio-player.spec.ts took 38.3s
Slow Test: [Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 35.7s
Slow Test: [Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 33.9s
Slow Test: [Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 28.8s
Slow Test: [Chrome] › spotlight/spotlight.spec.ts#L1
[Chrome] › spotlight/spotlight.spec.ts took 2.2m
Slow Test: [Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 50.4s
Slow Test: [Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 47.5s
Slow Test: [Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 27.5s
🎭 Playwright Run Summary
1 skipped 35 passed (2.8m)
🎭 Playwright Run Summary
1 skipped 53 passed (3.8m)
🎭 Playwright Run Summary
1 skipped 65 passed (4.4m)
🎭 Playwright Run Summary
5 skipped 35 passed (4.7m)
🎭 Playwright Run Summary
56 passed (4.7m)
🎭 Playwright Run Summary
1 flaky [Chrome] › timeline/timeline.spec.ts:1228:17 › Timeline › message sending › MSC3916 - Authenticated Media › should render authenticated images in the timeline @no-firefox @no-webkit @screenshot 1 skipped 58 passed (6.0m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-Chrome-1 Expired
198 KB
all-blob-reports-Chrome-2 Expired
584 KB
all-blob-reports-Chrome-3 Expired
125 KB
all-blob-reports-Chrome-4 Expired
168 KB
all-blob-reports-Chrome-5 Expired
3.88 MB
all-blob-reports-Chrome-6 Expired
416 KB
html-report
4.9 MB
webapp Expired
27.2 MB