Hyperparameters for efficientnetv2_rw_m #712
Answered
by
rwightman
benihime91
asked this question in
Q&A
-
|
Could you share your hyperparameter of |
Beta Was this translation helpful? Give feedback.
Answered by
rwightman
Jun 24, 2021
Replies: 1 comment 1 reply
-
|
@benihime91 I was trying out some hparams that I've been using more on NFNets, I have a gist w/ both the variant I used for this model and also for nfnet at the following link, remember to scale the LR for your global batch size, this one was for 4 GPUs so 4x the batch size in the yaml file. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Thanks |
Beta Was this translation helpful? Give feedback.
Answer selected by
benihime91
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
@benihime91 I was trying out some hparams that I've been using more on NFNets, I have a gist w/ both the variant I used for this model and also for nfnet at the following link, remember to scale the LR for your global batch size, this one was for 4 GPUs so 4x the batch size in the yaml file.
https://gist.github.com/rwightman/e69d5f456047c16773a77182cea68c3c