Replies: 1 comment 1 reply
-
I think it is nice that torchrun automatically modifies the system setting for better performance and creates a warning message to notify the user. what's not working with multi-node? |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Describe the bug
Running Auto3d I get warning of
we should smartly export this variable before the torchrun
I tired exporting it myself but this doesn't work with multiple nodes. I think this parameter needs to be set in the python code itself
Beta Was this translation helpful? Give feedback.
All reactions