Code

For review#9

Code

Open

strutive07 wants to merge 104 commits intofor_reviewstrutive07/transformer-tensorflow2.0:for_reviewfrom masterstrutive07/transformer-tensorflow2.0:masterCopy head branch name to clipboard

+11,584-2

Commits

Commits on Aug 26, 2019

• create data loader

  strutive07

  committed
  a37e5ed

  Copy full SHA for a37e5ed

Commits on Aug 27, 2019

• add word2idx, idx2word, tokenizer typo fix

  strutive07

  committed
  75c0ba4

  Copy full SHA for 75c0ba4

Commits on Aug 31, 2019

• transformer model implementation. not tested

  Show description for 956fcc5
  strutive07

  authored
  956fcc5

  Copy full SHA for 956fcc5

• fix typo

  strutive07

  authored
  a65d7e6

  Copy full SHA for a65d7e6

Commits on Sep 2, 2019

• fix typo: scaled dot product attention shape typo, Embedding parameter typo

  strutive07

  authored
  54248f1

  Copy full SHA for 54248f1

Commits on Sep 5, 2019

• Update greetings.yml

  strutive07

  authored
  5aca0b5

  Copy full SHA for 5aca0b5

Commits on Sep 8, 2019

• fix typo, add training mode to dropout layer

  strutive07

  authored
  77292e7

  Copy full SHA for 77292e7

• add sequence save/load to pickle

  strutive07

  authored
  8e7eae7

  Copy full SHA for 8e7eae7

• Create utils.py

  strutive07

  authored
  c691957

  Copy full SHA for c691957

• Create train.py

  strutive07

  authored
  888897f

  Copy full SHA for 888897f

Commits on Sep 9, 2019

• change dir to Relative path

  strutive07

  authored
  3c6aac7

  Copy full SHA for 3c6aac7

• remove f string to run in python 3.5

  strutive07

  committed
  f4942c2

  Copy full SHA for f4942c2

• move Trainer class to utils

  strutive07

  committed
  02044fc

  Copy full SHA for 02044fc

• fix typo

  strutive07

  committed
  7c7311e

  Copy full SHA for 7c7311e

• env install script

  strutive07

  committed
  d9e7dc5

  Copy full SHA for d9e7dc5

• fix imports

  strutive07

  committed
  d121fb6

  Copy full SHA for d121fb6

• fix imports

  strutive07

  committed
  d9e8cfc

  Copy full SHA for d9e8cfc

Commits on Sep 10, 2019

• add distributed training

  strutive07

  committed
  391e9dc

  Copy full SHA for 391e9dc

Commits on Sep 11, 2019

• distributed dataset config

  strutive07

  committed
  5c755c4

  Copy full SHA for 5c755c4

• fix typo

  strutive07

  committed
  a7470b8

  Copy full SHA for a7470b8

• add reducemean to distributed loss

  strutive07

  committed
  b0502bf

  Copy full SHA for b0502bf

• disable warning message

  strutive07

  committed
  5024d3f

  Copy full SHA for 5024d3f

• add print global batch size

  strutive07

  committed
  e8fc019

  Copy full SHA for e8fc019

• change function to tf.function

  strutive07

  committed
  7ef9e38

  Copy full SHA for 7ef9e38

• remove tf.function

  strutive07

  committed
  fb0165b

  Copy full SHA for fb0165b

Commits on Sep 12, 2019

• change loss

  strutive07

  committed
  1e02598

  Copy full SHA for 1e02598

• fix import error

  strutive07

  committed
  cf8e7fd

  Copy full SHA for cf8e7fd

Commits on Sep 13, 2019

• Update train.py

  strutive07

  authored
  55a947d

  Copy full SHA for 55a947d

• Update distributed_train.py

  strutive07

  authored
  b6f3055

  Copy full SHA for b6f3055

Commits on Sep 23, 2019

• Update README.md

  strutive07

  authored
  e305ddf

  Copy full SHA for e305ddf

Commits on Sep 28, 2019

• Change preprocess from word tokenizing to byte pair encoding

  strutive07

  authored
  977b556

  Copy full SHA for 977b556

• Update distributed_train.py

  strutive07

  authored
  931f187

  Copy full SHA for 931f187

• Update distributed_train.py

  strutive07

  authored
  cdbcd7d

  Copy full SHA for cdbcd7d

• remove f string

  strutive07

  authored
  b28cce8

  Copy full SHA for b28cce8

• remove deprecated variables - vocab size

  strutive07

  authored
  ca150e7

  Copy full SHA for ca150e7

• typo fix

  strutive07

  authored
  b321751

  Copy full SHA for b321751

• move create dataset to data loader

  strutive07

  committed
  2e74357

  Copy full SHA for 2e74357

• fix typo

  strutive07

  committed
  b1dafa0

  Copy full SHA for b1dafa0

• move dataset to data loader in single gpu train

  strutive07

  committed
  0f2761d

  Copy full SHA for 0f2761d

Commits on Sep 29, 2019

• tmp py

  strutive07

  committed
  0cd882d

  Copy full SHA for 0cd882d

• add batch option to dataset

  strutive07

  committed
  d1cbce2

  Copy full SHA for d1cbce2

Commits on Oct 3, 2019

• delete tmp files

  strutive07

  committed
  196be99

  Copy full SHA for 196be99

• Merge branch 'feature/change_preprocessing_from_word_tokenize_to_bpe'

  strutive07

  committed
  43235f9

  Copy full SHA for 43235f9

• add test codes

  strutive07

  committed
  d07ad2a

  Copy full SHA for d07ad2a

• fix paths

  strutive07

  committed
  370dae5

  Copy full SHA for 370dae5

• fix dataset ranges

  strutive07

  committed
  830c705

  Copy full SHA for 830c705

• load checkpoint from None optimizer

  strutive07

  committed
  cef536d

  Copy full SHA for cef536d

• add data encoder

  strutive07

  committed
  2fef613

  Copy full SHA for 2fef613

• fix typo

  strutive07

  committed
  b03194a

  Copy full SHA for b03194a

• add multiprocessing

  strutive07

  committed
  e36c015

  Copy full SHA for e36c015

• remove multiprocess

  strutive07

  committed
  bc6d1f6

  Copy full SHA for bc6d1f6

Commits on Oct 4, 2019

• Add paper review as pdf file

  strutive07

  authored
  c300569

  Copy full SHA for c300569

• Update README.md

  strutive07

  authored
  fbc575e

  Copy full SHA for fbc575e

• Update README.md

  strutive07

  authored
  60a9c8f

  Copy full SHA for 60a9c8f

Commits on Oct 13, 2019

• add label smoothing, refactoring trainer

  strutive07

  committed
  1950cd9

  Copy full SHA for 1950cd9

Commits on Oct 20, 2019

• transformer tf 2.0 colab guide

  strutive07

  authored
  87f83a1

  Copy full SHA for 87f83a1

• Merge pull request #6 from strutive07/feature/test_and_evaluation

  Show description for ff20dbd
  strutive07

  authored
  ff20dbd

  Copy full SHA for ff20dbd

• Update README.md

  strutive07

  authored
  643b77f

  Copy full SHA for 643b77f

• add BLEU score

  strutive07

  committed
  8e7a902

  Copy full SHA for 8e7a902

• Merge remote-tracking branch 'origin/master'

  strutive07

  committed
  76e8ad6

  Copy full SHA for 76e8ad6

• add requriments

  strutive07

  committed
  3ad8d10

  Copy full SHA for 3ad8d10

• Add custom dataset option to data loader. Change README

  strutive07

  committed
  f03526e

  Copy full SHA for f03526e

• Update README.md

  strutive07

  authored
  ae2f13f

  Copy full SHA for ae2f13f

Commits on Oct 21, 2019

• Update README.md

  strutive07

  authored
  100260a

  Copy full SHA for 100260a

Commits on Dec 1, 2019

• bleu score calculator

  strutive07

  authored
  3b1ced1

  Copy full SHA for 3b1ced1

Commits on Dec 15, 2019

• change tensorflwo version

  strutive07

  committed
  c0be89a

  Copy full SHA for c0be89a

• add train all dataset mode

  strutive07

  committed
  00c3e67

  Copy full SHA for 00c3e67

• change cuda, tensorflow version

  Show description for 4c75d9c
  strutive07

  authored
  4c75d9c

  Copy full SHA for 4c75d9c

Commits on Jan 19, 2020

• fix: trainer util option 변경

  strutive07

  committed
  f50cbdc

  Copy full SHA for f50cbdc

• fix bpe data loader 추가

  strutive07

  committed
  76a3601

  Copy full SHA for 76a3601

• fix: move sequence to text to translate util

  strutive07

  committed
  72f5267

  Copy full SHA for 72f5267

• Merge pull request #8 from strutive07/test_in_tf-2.1rc1

  Show description for 1c5b08b
  strutive07

  authored
  1c5b08b

  Copy full SHA for 1c5b08b

Commits on Jan 20, 2020

• Create .deepsource.toml

  strutive07

  authored
  7a01d40

  Copy full SHA for 7a01d40

Commits on Jan 27, 2020

• remove wild card import

  strutive07

  committed
  df9bace

  Copy full SHA for df9bace

• sort imports

  strutive07

  committed
  4b6272d

  Copy full SHA for 4b6272d

• bleu calculator wrap to python funciton

  strutive07

  committed
  56d64bb

  Copy full SHA for 56d64bb

• clean unused imports

  strutive07

  committed
  8b81080

  Copy full SHA for 8b81080

• remove unused variables

  strutive07

  committed
  98f8a29

  Copy full SHA for 98f8a29

• solve: File opened without the with statement PTC-W0010

  strutive07

  committed
  41d5e0d

  Copy full SHA for 41d5e0d

• solve: Unnecessary else / elif PYL-R1705

  strutive07

  committed
  1b522b7

  Copy full SHA for 1b522b7

• solve: Unnecessary else / elif PYL-R1705

  strutive07

  committed
  915400b

  Copy full SHA for 915400b

• reformat model file

  strutive07

  committed
  a9b396f

  Copy full SHA for a9b396f

• solve: Re-defined variable from outer scope PYL-W0621

  strutive07

  committed
  6b29c8d

  Copy full SHA for 6b29c8d

• convert class name to camelcase

  strutive07

  committed
  7c9f727

  Copy full SHA for 7c9f727

• remove unused parameters

  strutive07

  committed
  54493c4

  Copy full SHA for 54493c4

• solve: Module imported but unused PYL-W0611

  strutive07

  committed
  1cf4f97

  Copy full SHA for 1cf4f97

• solve: Consider using in PYL-R1714

  strutive07

  committed
  f506400

  Copy full SHA for f506400

• solve: Trailing comma tuple detected PYL-R1707

  strutive07

  committed
  f634ae6

  Copy full SHA for f634ae6

• solve: Multiple spaces found after operator FLK-E222

  strutive07

  committed
  87fe30b

  Copy full SHA for 87fe30b

• solve: Expected 2 blank lines, found 0 FLK-E302

  strutive07

  committed
  9c73654

  Copy full SHA for 9c73654

• remove unused docs

  strutive07

  committed
  9896785

  Copy full SHA for 9896785

• remove variable name 'input'

  strutive07

  committed
  aed3b8b

  Copy full SHA for aed3b8b

• remove variable name 'input'

  strutive07

  committed
  0e96fef

  Copy full SHA for 0e96fef

• solve: Blank line contains whitespace FLK-W293

  strutive07

  committed
  58c68d6

  Copy full SHA for 58c68d6

• fix too long lines

  strutive07

  committed
  54ebd5f

  Copy full SHA for 54ebd5f

• add deepsource icon to readme

  strutive07

  committed
  a8b4fda

  Copy full SHA for a8b4fda

• change model parameter name

  strutive07

  committed
  454e3b0

  Copy full SHA for 454e3b0

• Merge pull request #10 from strutive07/clean_code

  Show description for d8036f8
  strutive07

  authored
  d8036f8

  Copy full SHA for d8036f8

Commits on Feb 7, 2020

• add bpe download link to README

  strutive07

  authored
  b4d88f1

  Copy full SHA for b4d88f1

• fix: typo in readme

  strutive07

  authored
  9502c8e

  Copy full SHA for 9502c8e

• fix: move standard download method

  strutive07

  authored
  d9d836e

  Copy full SHA for d9d836e

• Merge pull request #12 from strutive07/feature/add_bpe_model_file_to_readme

  Show description for fef066d
  strutive07

  authored
  fef066d

  Copy full SHA for fef066d

• add new line to download links

  strutive07

  authored
  5011b77

  Copy full SHA for 5011b77

Commits on Apr 30, 2021

• change encoder residual connection error

  strutive07

  authored
  436c4db

  Copy full SHA for 436c4db