Code

Introducing the Iterative Trainer#737

Code

Merged

younesbelkada merged 39 commits intohuggingface:mainhuggingface/trl:mainfrom gaetanlop:iterativetrainergaetanlop/trl:iterativetrainerCopy head branch name to clipboardNov 2, 2023

+535

Commits

Commits on Sep 4, 2023

• initial skeleton

  gaetanlop

  committed
  7827003

  Copy full SHA for 7827003

• iterative trainer for decoder only

  gaetanlop

  committed
  0442b6b

  Copy full SHA for 0442b6b

• iterative trainer unittest

  gaetanlop

  committed
  4255b0b

  Copy full SHA for 4255b0b

• encoder_decoder support

  gaetanlop

  committed
  5648602

  Copy full SHA for 5648602

• fix typo in unittest

  gaetanlop

  committed
  faaae0a

  Copy full SHA for faaae0a

• init

  gaetanlop

  committed
  2836807

  Copy full SHA for 2836807

• fix typo

  gaetanlop

  committed
  3063a2f

  Copy full SHA for 3063a2f

Commits on Sep 5, 2023

• fix init typo

  gaetanlop

  committed
  23888e1

  Copy full SHA for 23888e1

Commits on Sep 6, 2023

• Merge branch 'main' into iterativetrainer

  gaetanlop

  authored
  ddc573a

  Copy full SHA for ddc573a

Commits on Sep 15, 2023

• adding loggings and safety checker

  gaetanlop

  committed
  3705578

  Copy full SHA for 3705578

• fixed minor issues

  gaetanlop

  committed
  aa842c3

  Copy full SHA for aa842c3

• doc

  gaetanlop

  committed
  f2673e7

  Copy full SHA for f2673e7

• table of contents update

  gaetanlop

  committed
  2de2388

  Copy full SHA for 2de2388

Commits on Sep 18, 2023

• add test for seq2seq2 models

  gaetanlop

  committed
  b61cc9a

  Copy full SHA for b61cc9a

• change year

  gaetanlop

  committed
  a8eee4b

  Copy full SHA for a8eee4b

Commits on Oct 8, 2023

• adding text as step input

  gaetanlop

  committed
  917c2eb

  Copy full SHA for 917c2eb

• precommit

  gaetanlop

  committed
  bae3ca3

  Copy full SHA for bae3ca3

• fixing typo

  gaetanlop

  committed
  173a34b

  Copy full SHA for 173a34b

• run precommit

  gaetanlop

  committed
  f6e188e

  Copy full SHA for f6e188e

• fixing typo in safety checker

  gaetanlop

  committed
  cfd835f

  Copy full SHA for cfd835f

• fix text tokenization issue

  gaetanlop

  committed
  ede0ccc

  Copy full SHA for ede0ccc

Commits on Nov 1, 2023

• add truncate and inherit from trainer

  gaetanlop

  committed
  11c69e2

  Copy full SHA for 11c69e2

• remove iterative config from tests

  gaetanlop

  committed
  57622f8

  Copy full SHA for 57622f8

• remove iterative config from init

  gaetanlop

  committed
  c21091b

  Copy full SHA for c21091b

• fix peft model

  gaetanlop

  committed
  b4600fc

  Copy full SHA for b4600fc

• change truncation side based on truncation_mode

  gaetanlop

  committed
  4121cbe

  Copy full SHA for 4121cbe

• removed iterativeconfig autodoc

  gaetanlop

  committed
  441b05c

  Copy full SHA for 441b05c

• fixed typo in trainer.mdx

  gaetanlop

  committed
  3b28163

  Copy full SHA for 3b28163

• remove mention of iterative config in docs

  gaetanlop

  committed
  3907102

  Copy full SHA for 3907102

• make sure optimizer and scheduler are created

  gaetanlop

  committed
  e31c3a5

  Copy full SHA for e31c3a5

• adding max_steps to test

  gaetanlop

  committed
  c4cd798

  Copy full SHA for c4cd798

• remove log_stats fn

  gaetanlop

  committed
  78d5879

  Copy full SHA for 78d5879

• remove compute loss

  gaetanlop

  committed
  5b2da4e

  Copy full SHA for 5b2da4e

• fixing encoder decoder detection

  gaetanlop

  committed
  5de3ddf

  Copy full SHA for 5de3ddf

• fix PPODecorator

  gaetanlop

  committed
  4e68b76

  Copy full SHA for 4e68b76

• run precommit

  gaetanlop

  committed
  122494e

  Copy full SHA for 122494e

Commits on Nov 2, 2023

• fix testing

  gaetanlop

  committed
  71c28fd

  Copy full SHA for 71c28fd

• fix small typos in iterative trainer

  gaetanlop

  committed
  00a89ca

  Copy full SHA for 00a89ca

• adapted function log and eval

  gaetanlop

  committed
  aa70ca3

  Copy full SHA for aa70ca3