Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Simple tests that demonstrate "tensor" parallel and "batch" parallel #2022

Open
nsmithtt opened this issue Jan 29, 2025 · 0 comments · May be fixed by #2339
Open

Simple tests that demonstrate "tensor" parallel and "batch" parallel #2022

nsmithtt opened this issue Jan 29, 2025 · 0 comments · May be fixed by #2339
Assignees
@tapspatel
Milestone
[Multi Device 1]

Comments

@nsmithtt
Copy link
Contributor

I think we already have some tests that demonstrate "tensor parallel", we need to add some that shard on the batch dim.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tapspatel tapspatel

Labels
None yet
Projects
None yet
Milestone
[Multi Device 1]
2 participants
@nsmithtt @tapspatel