Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DeepSpeed Test Suite #724

Closed
lvwerra opened this issue Sep 1, 2023 · 5 comments
Closed

DeepSpeed Test Suite #724

lvwerra opened this issue Sep 1, 2023 · 5 comments

Comments

@lvwerra
Copy link
Member

lvwerra commented Sep 1, 2023

Since a lot of people are interested in training their models with DeepSpeed and we have several issues related to this, we should add a DS Test Suite in my opinion to really map out which use-cases work and which don't and to notice when we break something.

cc @vwxyzjn @younesbelkada

Copy link

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

@lvwerra
Copy link
Member Author

lvwerra commented Dec 1, 2023

Keep open.

@NamrataRShivagunde
Copy link

NamrataRShivagunde commented Dec 20, 2023

Does deepspeed works for sft?

@lvwerra
Copy link
Member Author

lvwerra commented Dec 21, 2023

It should, yes!

Copy link

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants