Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create new FD frequent pipeline to isolate unstable pgm benchmark tests #16010

Merged
merged 4 commits into from
Dec 13, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
59 changes: 59 additions & 0 deletions .github/workflows/fast-dispatch-frequent-tests-impl.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,59 @@
name: "[internal] Fast dispatch frequent tests impl"

on:
workflow_call:
inputs:
os:
required: false
type: string
default: "ubuntu-20.04"

jobs:
fd-frequent:
strategy:
# Do not fail-fast because we need to ensure all tests go to completion
# so we try not to get hanging machines
fail-fast: false
matrix:
test-group:
[
{
name: "WH N300 pgm dispatch nightly",
arch: wormhole_b0,
runs-on: ["cloud-virtual-machine", "N300", "in-service"],
cmd: ./tests/tt_metal/tt_metal/perf_microbenchmark/dispatch/compare_pgm_dispatch_perf_ci.sh,
timeout: 10
},
]
name: ${{ matrix.test-group.name }}
env:
LOGURU_LEVEL: INFO
runs-on: ${{ matrix.test-group.runs-on }}
steps:
- uses: tenstorrent/tt-metal/.github/actions/checkout-with-submodule-lfs@main
- uses: ./.github/actions/prepare-metal-run
with:
arch: ${{ matrix.test-group.arch }}
- name: ${{ matrix.test-group.name }} tests
timeout-minutes: ${{ matrix.test-group.timeout }}
uses: ./.github/actions/docker-run
with:
docker_os_arch: tt-metalium/${{ inputs.os }}-amd64
docker_password: ${{ secrets.GITHUB_TOKEN }}
docker_opts: |
-e TT_METAL_HOME=${{ github.workspace }}
-e ARCH_NAME=${{ matrix.test-group.arch }}
-e LD_LIBRARY_PATH=${{ github.workspace }}/build/lib
run_args: |
${{ matrix.test-group.cmd }}
- uses: ./.github/actions/slack-report
if: ${{ failure() }}
with:
slack_webhook_url: ${{ secrets.SLACK_WEBHOOK_URL }}
owner: U01Q0T3J3D0 # Paul Keller
- uses: ./.github/actions/upload-artifact-with-job-uuid
if: ${{ !cancelled() }}
with:
path: |
generated/test_reports/
prefix: "test_reports_"
19 changes: 19 additions & 0 deletions .github/workflows/fast-dispatch-frequent-tests.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
name: "(Single-card) Fast dispatch frequent tests"

on:
workflow_dispatch:
workflow_call:
schedule:
- cron: "0 */4 * * *"
push:
branches:
- "rkim/0-new-fd-frequent"

jobs:
build-artifact:
uses: ./.github/workflows/build-artifact.yaml
secrets: inherit
fd-nightly:
needs: build-artifact
uses: ./.github/workflows/fast-dispatch-frequent-tests-impl.yaml
secrets: inherit
Loading