Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Simple tests that demonstrate "tensor" parallel and "batch" parallel #211

Open
nsmithtt opened this issue Jan 29, 2025 · 0 comments
Open

Simple tests that demonstrate "tensor" parallel and "batch" parallel #211

nsmithtt opened this issue Jan 29, 2025 · 0 comments
Labels
multichip Multichip issues
Milestone
[Multi Device 1]

Comments

@nsmithtt
Copy link
Contributor

That is:

  • some tests that demonstrate how to cut tensors on XY dims, i.e. tensor parallel
  • some tests that demonstrate how to cut tensors on batch dim, i.e. batch parallel
  • Potentially some combination of both
@nsmithtt nsmithtt added the multichip Multichip issues label Jan 29, 2025
@nsmithtt nsmithtt added this to the [Multi Device 1] milestone Jan 29, 2025
@ajakovljevicTT ajakovljevicTT mentioned this issue Feb 4, 2025
Merged
ajakovljevicTT added a commit that referenced this issue Feb 25, 2025
@ajakovljevicTT
Adding infrastructure for multichip tests (#231)
a8769d7 
### Ticket
Part of issue #211

### Problem description
Integrating new tester class, called `MultichipTester`, into our testing
infrastructure in`tt-xla`. It will receive the input and output
shardings from the user, the function to be tested, and the golden
function which will run on CPU, in a non-sharded mode. It runs the
received data and compared the results.
ajakovljevicTT added a commit that referenced this issue Feb 26, 2025
@ajakovljevicTT
Adding infrastructure for multichip tests (#231)
f472f4d 
Part of issue #211

Integrating new tester class, called `MultichipTester`, into our testing
infrastructure in`tt-xla`. It will receive the input and output
shardings from the user, the function to be tested, and the golden
function which will run on CPU, in a non-sharded mode. It runs the
received data and compared the results.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
multichip Multichip issues
Projects
None yet
Milestone
[Multi Device 1]
Development

No branches or pull requests
1 participant
@nsmithtt