Skip to content

Flaky tests reporting #4041

Flaky tests reporting

Flaky tests reporting #4041

Triggered via pull request January 17, 2025 15:18
@szczechaszczecha
synchronize #5356
qag-270
Status Failure
Total duration 14m 8s
Artifacts 5

pr-automation.yml

on: pull_request
initialize-cloud
3m 11s
initialize-cloud
deploy-dashboard
2m 57s
deploy-dashboard
Matrix: run-tests
merge-reports
52s
merge-reports
Fit to window
Zoom out
Zoom in

Annotations

8 errors and 9 notices
[e2e] › translations.spec.ts:30:5 › TC: SALEOR_122 Should be able to edit translation @e2e @translations: playwright/pages/basePage.ts#L117
1) [e2e] › translations.spec.ts:30:5 › TC: SALEOR_122 Should be able to edit translation @e2e @translations TimeoutError: locator.waitFor: Timeout 20000ms exceeded. Call log: - waiting for locator('[data-test-type="success"]').first() to be visible at ../pages/basePage.ts:117 115 | .waitFor({ state: "visible", timeout: options.timeout }); 116 | } else { > 117 | await this.successBanner.first().waitFor({ state: "visible", timeout: options.timeout }); | ^ 118 | } 119 | 120 | await expect(this.errorBanner, "No error banner should be visible").not.toBeVisible(); at TranslationsPage.expectSuccessBanner (/home/runner/work/saleor-dashboard/saleor-dashboard/playwright/pages/basePage.ts:117:40) at /home/runner/work/saleor-dashboard/saleor-dashboard/playwright/tests/translations.spec.ts:51:26
run-tests (2/2)
Process completed with exit code 1.
[e2e] › navigation.spec.ts:54:5 › TC: SALEOR_198 Should update existing menu @navigation @e2e: playwright/pages/dialogs/addNavigationMenuItemDialog.ts#L32
1) [e2e] › navigation.spec.ts:54:5 › TC: SALEOR_198 Should update existing menu @navigation @e2e ─ Error: Expected link type "Categories" but found "" at ../pages/dialogs/addNavigationMenuItemDialog.ts:32 30 | 31 | if (selectedLinkType !== linkType) { > 32 | throw new Error(`Expected link type "${linkType}" but found "${selectedLinkType}"`); | ^ 33 | } 34 | } 35 | at AddNavigationMenuItemDialog.selectLinkTypeOption (/home/runner/work/saleor-dashboard/saleor-dashboard/playwright/pages/dialogs/addNavigationMenuItemDialog.ts:32:13) at /home/runner/work/saleor-dashboard/saleor-dashboard/playwright/tests/navigation.spec.ts:74:3
run-tests (1/2)
Process completed with exit code 1.
merge-reports
/home/runner/work/saleor-dashboard/saleor-dashboard/./.github/actions/flaky-tests-report/action.yml (Line: 23, Col: 7): Unexpected value 'shell'
merge-reports
/home/runner/work/saleor-dashboard/saleor-dashboard/./.github/actions/flaky-tests-report/action.yml (Line: 24, Col: 7): Unexpected value 'run'
merge-reports
GitHub.DistributedTask.ObjectTemplating.TemplateValidationException: The template is not valid. /home/runner/work/saleor-dashboard/saleor-dashboard/./.github/actions/flaky-tests-report/action.yml (Line: 23, Col: 7): Unexpected value 'shell',/home/runner/work/saleor-dashboard/saleor-dashboard/./.github/actions/flaky-tests-report/action.yml (Line: 24, Col: 7): Unexpected value 'run' at GitHub.DistributedTask.ObjectTemplating.TemplateValidationErrors.Check() at GitHub.Runner.Worker.ActionManifestManager.ConvertRuns(IExecutionContext executionContext, TemplateContext templateContext, TemplateToken inputsToken, String fileRelativePath, MappingToken outputs) at GitHub.Runner.Worker.ActionManifestManager.Load(IExecutionContext executionContext, String manifestFile)
merge-reports
Failed to load /home/runner/work/saleor-dashboard/saleor-dashboard/./.github/actions/flaky-tests-report/action.yml
BASE_URL
https://pr-5356.dashboard.saleor.rocks
API_URL
https://pr-5356.staging.saleor.cloud/graphql/
POOL_NAME
pr-5356
POOL_INSTANCE
https://pr-5356.staging.saleor.cloud
BACKUP_NAMESPACE
snapshot-automation-tests
SNAPSHOT
backup_id=Ag5xJXHh, version=3.21.0a0, name=snapshot-automation-tests
SALEOR_CLOUD_SERVICE
saleor-master-staging
🎭 Playwright Run Summary
1 failed [e2e] › translations.spec.ts:30:5 › TC: SALEOR_122 Should be able to edit translation @e2e @translations 116 passed (4.3m)
🎭 Playwright Run Summary
1 failed [e2e] › navigation.spec.ts:54:5 › TC: SALEOR_198 Should update existing menu @navigation @e2e ── 117 passed (4.6m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-1 Expired
2.58 MB
all-blob-reports-2 Expired
2.44 MB
ctrf-reports-1 Expired
3.93 KB
ctrf-reports-2 Expired
4.56 KB
html-report--attempt-1
5.44 MB