Skip to content

Commit

Permalink
Fix minor bug in max_mem_gb_classifier scripts.py
Browse files Browse the repository at this point in the history
Signed-off-by: Vibhu Jawa <[email protected]>
  • Loading branch information
VibhuJawa committed Aug 20, 2024
1 parent 3ecff45 commit 3eacf8f
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions nemo_curator/utils/script_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -450,6 +450,7 @@ def add_distributed_classifier_cluster_args(self):
self.add_distributed_args()
self.add_arg_enable_spilling()
self.add_arg_set_torch_to_use_rmm()
self.add_arg_max_mem_gb_classifier()

# Set low default RMM pool size for classifier
# to allow pytorch to grow its memory usage
Expand Down

0 comments on commit 3eacf8f

Please sign in to comment.