Code

Add AEGIS classifier#172

Code

Merged

ryantwolf merged 16 commits intomainNVIDIA/NeMo-Curator:mainfrom rywolf/aegisNVIDIA/NeMo-Curator:rywolf/aegisCopy head branch name to clipboardAug 7, 2024

+1,164-444

Commits

Commits on Jul 30, 2024

• Add aegis classifier

  Show description for 733535b
  ryantwolf

  committed
  733535b

  Copy full SHA for 733535b

• Add init file

  Show description for 8e4c0d5
  ryantwolf

  committed
  8e4c0d5

  Copy full SHA for 8e4c0d5

• Fix metadata

  Show description for 3a3041a
  ryantwolf

  committed
  3a3041a

  Copy full SHA for 3a3041a

Commits on Aug 1, 2024

• Merge branch 'main' into rywolf/aegis

  ryantwolf

  committed
  58ce05b

  Copy full SHA for 58ce05b

Commits on Aug 2, 2024

• Remove autocast

  Show description for 551bf90
  ryantwolf

  committed
  551bf90

  Copy full SHA for 551bf90

• Reorganize distributed classifiers

  Show description for f85d2ac
  ryantwolf

  committed
  f85d2ac

  Copy full SHA for f85d2ac

• Add script for aegis inference

  Show description for 8ce6891
  ryantwolf

  committed
  8ce6891

  Copy full SHA for 8ce6891

Commits on Aug 4, 2024

• Change name in logging

  Show description for d96ef0a
  ryantwolf

  committed
  d96ef0a

  Copy full SHA for d96ef0a

• Include aegis in setup.py

  Show description for 01b276d
  ryantwolf

  committed
  01b276d

  Copy full SHA for 01b276d

• Fix bugs

  Show description for c35ba52
  ryantwolf

  committed
  c35ba52

  Copy full SHA for c35ba52

Commits on Aug 5, 2024

• Add example script

  Show description for af67855
  ryantwolf

  committed
  af67855

  Copy full SHA for af67855

• Fix logging name

  Show description for 076f1da
  ryantwolf

  committed
  076f1da

  Copy full SHA for 076f1da

Commits on Aug 6, 2024

• Address Sarah's Review

  Show description for 49e51db
  ryantwolf

  committed
  49e51db

  Copy full SHA for 49e51db

• Address Vibhu's Review

  Show description for 15d89b0
  ryantwolf

  committed
  15d89b0

  Copy full SHA for 15d89b0

• Fix load_cfg

  Show description for 6fd46c9
  ryantwolf

  committed
  6fd46c9

  Copy full SHA for 6fd46c9

• Create more descriptive error message

  Show description for d496afa
  ryantwolf

  committed
  d496afa

  Copy full SHA for d496afa