Code

Add GPU CI/CD#253

Code

Merged

sarahyurick merged 34 commits intoNVIDIA:mainNVIDIA/NeMo-Curator:mainfrom sarahyurick:gpucisarahyurick/NeMo-Curator:gpuciCopy head branch name to clipboardOct 9, 2024

+208-4

Commits

Commits on Sep 18, 2024

• add yaml files to gh workflows

  Show description for d560fe1
  sarahyurick

  committed
  d560fe1

  Copy full SHA for d560fe1

• edit spacing

  Show description for a5f5da8
  sarahyurick

  committed
  a5f5da8

  Copy full SHA for a5f5da8

Commits on Sep 19, 2024

• no cache dir

  Show description for fe8ba83
  sarahyurick

  committed
  fe8ba83

  Copy full SHA for fe8ba83

• cmake

  Show description for a1bfd97
  sarahyurick

  committed
  a1bfd97

  Copy full SHA for a1bfd97

• fasttext wheel

  Show description for e1a47e4
  sarahyurick

  committed
  e1a47e4

  Copy full SHA for e1a47e4

• python3 dev

  Show description for da6d552
  sarahyurick

  committed
  da6d552

  Copy full SHA for da6d552

• get update

  Show description for 24ba153
  sarahyurick

  committed
  24ba153

  Copy full SHA for 24ba153

• c installs

  Show description for 167cefc
  sarahyurick

  committed
  167cefc

  Copy full SHA for 167cefc

• setuptools pip upgrade

  Show description for a729c2c
  sarahyurick

  committed
  a729c2c

  Copy full SHA for a729c2c

• use stable rapids

  Show description for db2e12d
  sarahyurick

  committed
  db2e12d

  Copy full SHA for db2e12d

Commits on Sep 20, 2024

• remove wheel see what happens

  Show description for 59f3854
  sarahyurick

  committed
  59f3854

  Copy full SHA for 59f3854

• edit readme and remove autolabel for now

  Show description for a0478b7
  sarahyurick

  committed
  a0478b7

  Copy full SHA for a0478b7

Commits on Sep 24, 2024

• add container logic

  Show description for 507db24
  sarahyurick

  committed
  507db24

  Copy full SHA for 507db24

Commits on Sep 25, 2024

• add dockerfile and oliver's other suggestions

  Show description for b1e10d6
  sarahyurick

  committed
  b1e10d6

  Copy full SHA for b1e10d6

• fix run format

  Show description for cfb50f3
  sarahyurick

  committed
  cfb50f3

  Copy full SHA for cfb50f3

• forked repo url

  Show description for 12e2b08
  sarahyurick

  committed
  12e2b08

  Copy full SHA for 12e2b08

• docker run with all gpus

  Show description for 2e913bb
  sarahyurick

  committed
  2e913bb

  Copy full SHA for 2e913bb

• remove running container

  Show description for e9dc600
  sarahyurick

  committed
  e9dc600

  Copy full SHA for e9dc600

Commits on Oct 1, 2024

• Update .github/workflows/gpuci.yml

  Show description for f74d503
  

  sarahyurick

  and

  ko3n1g

  authored
  f74d503

  Copy full SHA for f74d503

• re add test

  Show description for 4a2f305
  sarahyurick

  committed
  4a2f305

  Copy full SHA for 4a2f305

Commits on Oct 2, 2024

• debug attempt

  Show description for 4baf3c7
  sarahyurick

  committed
  4baf3c7

  Copy full SHA for 4baf3c7

• Merge branch 'NVIDIA:main' into gpuci

  sarahyurick

  authored
  0756c10

  Copy full SHA for 0756c10

• remove it

  Show description for 927046c
  sarahyurick

  committed
  927046c

  Copy full SHA for 927046c

Commits on Oct 3, 2024

• add library path

  Show description for dad4a62
  sarahyurick

  committed
  dad4a62

  Copy full SHA for dad4a62

• remove nvcc check

  Show description for 23d9ae5
  sarahyurick

  committed
  23d9ae5

  Copy full SHA for 23d9ae5

• more debugging

  Show description for 74a556d
  sarahyurick

  committed
  74a556d

  Copy full SHA for 74a556d

• specify curator dir

  Show description for cf8bfea
  sarahyurick

  committed
  cf8bfea

  Copy full SHA for cf8bfea

• more debugging

  Show description for 11230f4
  sarahyurick

  committed
  11230f4

  Copy full SHA for 11230f4

Commits on Oct 4, 2024

• try pytorch container

  Show description for 2964bd7
  sarahyurick

  committed
  2964bd7

  Copy full SHA for 2964bd7

Commits on Oct 7, 2024

• use rapids container

  Show description for 51ba582
  sarahyurick

  committed
  51ba582

  Copy full SHA for 51ba582

• fix RUN instructions

  Show description for 06a2def
  sarahyurick

  committed
  06a2def

  Copy full SHA for 06a2def

• add comments and review suggestions

  Show description for 8b5acff
  sarahyurick

  committed
  8b5acff

  Copy full SHA for 8b5acff

Commits on Oct 8, 2024

• update runners

  Show description for 8f50714
  sarahyurick

  committed
  8f50714

  Copy full SHA for 8f50714

Commits on Oct 9, 2024

• move args

  Show description for a9dd8e5
  sarahyurick

  committed
  a9dd8e5

  Copy full SHA for a9dd8e5