Code

feat: Add support for DPO#556

Code

Open

sandeepchittilla wants to merge 11 commits intoCarperAI:mainCarperAI/trlx:mainfrom sandeepchittilla:504-dpo-trainersandeepchittilla/trlx:504-dpo-trainerCopy head branch name to clipboard

+677-8

Commits

Commits on Sep 12, 2023

• Initial commit DPO support

  sandeepchittilla

  committed
  a34219c

  Copy full SHA for a34219c

• Add default config for DPO and trainer functionality

  sandeepchittilla

  committed
  cd923c1

  Copy full SHA for cd923c1

• Add DPO training example and fix minor bugs

  sandeepchittilla

  committed
  deb71c1

  Copy full SHA for deb71c1

Commits on Sep 13, 2023

• Update .gitignore and minor refactor

  sandeepchittilla

  committed
  ca7a828

  Copy full SHA for ca7a828

• Add type hinting and minor refactor

  sandeepchittilla

  committed
  02bd944

  Copy full SHA for 02bd944

Commits on Sep 14, 2023

• Update docstrings

  sandeepchittilla

  committed
  00d0f2c

  Copy full SHA for 00d0f2c

Commits on Sep 27, 2023

• Add Deepspeed init support when using stage 3

  sandeepchittilla

  committed
  9b43dd5

  Copy full SHA for 9b43dd5

Commits on Nov 14, 2023

• Add dpo example

  sandeepchittilla

  committed
  737a496

  Copy full SHA for 737a496

Commits on Nov 15, 2023

• Update hyperparementers

  sandeepchittilla

  committed
  dfa814d

  Copy full SHA for dfa814d

Commits on Nov 20, 2023

• Fix prompt truncation bug and handle deepspeed preparation

  sandeepchittilla

  committed
  6d63004

  Copy full SHA for 6d63004

Commits on Nov 23, 2023

• Use slower training parameters

  sandeepchittilla

  committed
  4a24603

  Copy full SHA for 4a24603