Code

Pr/eliebak/220#231

Code

Merged

xrsrke merged 10 commits intomainhuggingface/nanotron:mainfrom pr/eliebak/220huggingface/nanotron:pr/eliebak/220Copy head branch name to clipboardSep 9, 2024

+750-56

Commits

Commits on Aug 22, 2024

• add support for s3 checkpoint: need a fix on check_path_is_local

  eliebak

  committed
  5fd1c07

  Copy full SHA for 5fd1c07

• fix path to xpath, delete debugging print, working on 1 gpu

  eliebak

  committed
  e24cce1

  Copy full SHA for e24cce1

Commits on Aug 23, 2024

• fixing comment

  eliebak

  authored
  d5a3650

  Copy full SHA for d5a3650

• fixing comment

  eliebak

  authored
  a62daad

  Copy full SHA for a62daad

• no need for check_path_is_s3 anymore

  eliebak

  authored
  17468b2

  Copy full SHA for 17468b2

• no need for check_path_is_s3 anymore

  eliebak

  authored
  5f95a4f

  Copy full SHA for 5f95a4f

Commits on Aug 24, 2024

• remove debugging print

  eliebak

  authored
  2651a17

  Copy full SHA for 2651a17

Commits on Sep 3, 2024

• Merge branch 'main' into add-s3-uploader

  eliebak

  authored
  8c15d3b

  Copy full SHA for 8c15d3b

Commits on Sep 4, 2024

• add datasets by default + s3 flavor

  eliebak

  committed
  ab04877

  Copy full SHA for ab04877

Commits on Sep 9, 2024

• minor changes and add an example config for s3

  xrsrke

  committed
  b17daf3

  Copy full SHA for b17daf3