New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

To do NLP 7/4 #13

Open

xuanyuzhou98 opened this issue Jul 4, 2019 · 0 comments

Owner

xuanyuzhou98 commented Jul 4, 2019 •

edited

Loading

ODT Todo:

Train in GPU with batch norms and then delete batch norm to finetune, check accuracy. (@tianrengao )
Implement model weights loading from PyTorch (@xuanyuzhou98 )
2, 2, 2. Train on android phone, reduce 200 to 20. Find a quick training recipe, better optimizer? (@floraxue )
Check 18 18 18, default gc frequency vs "decreased "gc frequency (@floraxue @tianrengao )

NLP Todo:

Engineering Todo:

把waveglow的layers一层层转写到deeplearning4j
在gpu上复现waveglow (@BohanZhai )

Research Todo:

把sample efficient 和 waveglow merge起来
Design sample efficient training pipeline
Hopefully, we can directly delete text

xuanyuzhou98 changed the title ~~To do~~ To do NLP

xuanyuzhou98 changed the title ~~To do NLP~~ To do NLP 7/4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment