Flaky tests reporting #4041
pr-automation.yml
on: pull_request
Annotations
8 errors and 9 notices
[e2e] › translations.spec.ts:30:5 › TC: SALEOR_122 Should be able to edit translation @e2e @translations:
playwright/pages/basePage.ts#L117
1) [e2e] › translations.spec.ts:30:5 › TC: SALEOR_122 Should be able to edit translation @e2e @translations
TimeoutError: locator.waitFor: Timeout 20000ms exceeded.
Call log:
- waiting for locator('[data-test-type="success"]').first() to be visible
at ../pages/basePage.ts:117
115 | .waitFor({ state: "visible", timeout: options.timeout });
116 | } else {
> 117 | await this.successBanner.first().waitFor({ state: "visible", timeout: options.timeout });
| ^
118 | }
119 |
120 | await expect(this.errorBanner, "No error banner should be visible").not.toBeVisible();
at TranslationsPage.expectSuccessBanner (/home/runner/work/saleor-dashboard/saleor-dashboard/playwright/pages/basePage.ts:117:40)
at /home/runner/work/saleor-dashboard/saleor-dashboard/playwright/tests/translations.spec.ts:51:26
|
run-tests (2/2)
Process completed with exit code 1.
|
[e2e] › navigation.spec.ts:54:5 › TC: SALEOR_198 Should update existing menu @navigation @e2e:
playwright/pages/dialogs/addNavigationMenuItemDialog.ts#L32
1) [e2e] › navigation.spec.ts:54:5 › TC: SALEOR_198 Should update existing menu @navigation @e2e ─
Error: Expected link type "Categories" but found ""
at ../pages/dialogs/addNavigationMenuItemDialog.ts:32
30 |
31 | if (selectedLinkType !== linkType) {
> 32 | throw new Error(`Expected link type "${linkType}" but found "${selectedLinkType}"`);
| ^
33 | }
34 | }
35 |
at AddNavigationMenuItemDialog.selectLinkTypeOption (/home/runner/work/saleor-dashboard/saleor-dashboard/playwright/pages/dialogs/addNavigationMenuItemDialog.ts:32:13)
at /home/runner/work/saleor-dashboard/saleor-dashboard/playwright/tests/navigation.spec.ts:74:3
|
run-tests (1/2)
Process completed with exit code 1.
|
merge-reports
/home/runner/work/saleor-dashboard/saleor-dashboard/./.github/actions/flaky-tests-report/action.yml (Line: 23, Col: 7): Unexpected value 'shell'
|
merge-reports
/home/runner/work/saleor-dashboard/saleor-dashboard/./.github/actions/flaky-tests-report/action.yml (Line: 24, Col: 7): Unexpected value 'run'
|
merge-reports
GitHub.DistributedTask.ObjectTemplating.TemplateValidationException: The template is not valid. /home/runner/work/saleor-dashboard/saleor-dashboard/./.github/actions/flaky-tests-report/action.yml (Line: 23, Col: 7): Unexpected value 'shell',/home/runner/work/saleor-dashboard/saleor-dashboard/./.github/actions/flaky-tests-report/action.yml (Line: 24, Col: 7): Unexpected value 'run'
at GitHub.DistributedTask.ObjectTemplating.TemplateValidationErrors.Check()
at GitHub.Runner.Worker.ActionManifestManager.ConvertRuns(IExecutionContext executionContext, TemplateContext templateContext, TemplateToken inputsToken, String fileRelativePath, MappingToken outputs)
at GitHub.Runner.Worker.ActionManifestManager.Load(IExecutionContext executionContext, String manifestFile)
|
merge-reports
Failed to load /home/runner/work/saleor-dashboard/saleor-dashboard/./.github/actions/flaky-tests-report/action.yml
|
BASE_URL
https://pr-5356.dashboard.saleor.rocks
|
API_URL
https://pr-5356.staging.saleor.cloud/graphql/
|
POOL_NAME
pr-5356
|
POOL_INSTANCE
https://pr-5356.staging.saleor.cloud
|
BACKUP_NAMESPACE
snapshot-automation-tests
|
SNAPSHOT
backup_id=Ag5xJXHh, version=3.21.0a0, name=snapshot-automation-tests
|
SALEOR_CLOUD_SERVICE
saleor-master-staging
|
🎭 Playwright Run Summary
1 failed
[e2e] › translations.spec.ts:30:5 › TC: SALEOR_122 Should be able to edit translation @e2e @translations
116 passed (4.3m)
|
🎭 Playwright Run Summary
1 failed
[e2e] › navigation.spec.ts:54:5 › TC: SALEOR_198 Should update existing menu @navigation @e2e ──
117 passed (4.6m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-1
Expired
|
2.58 MB |
|
all-blob-reports-2
Expired
|
2.44 MB |
|
ctrf-reports-1
Expired
|
3.93 KB |
|
ctrf-reports-2
Expired
|
4.56 KB |
|
html-report--attempt-1
|
5.44 MB |
|