Skip to content

Commit

Permalink
Update tutorials/distributed_data_classification/fineweb-edu-ensebmle…
Browse files Browse the repository at this point in the history
…-classification.ipynb

Co-authored-by: Sarah Yurick <[email protected]>
Signed-off-by: Vibhu Jawa <[email protected]>
  • Loading branch information
VibhuJawa and sarahyurick authored Feb 10, 2025
1 parent 2eaf955 commit 64d25fe
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -253,7 +253,7 @@
" output_dataset = classifier(dataset=output_dataset)\n",
"\n",
"# Dropping int columns\n",
"# As we add new based on a threshold (in the following columns0\n",
"# As we add new based on a threshold (in the following columns)\n",
"output_dataset.df = output_dataset.df.drop(columns=[v[\"int_score\"] for v in classifier_scores.values()])\n",
"output_dataset.to_parquet(output_path=OUTPUT_CLASSIFICATION_RESULTS)"
]
Expand Down

0 comments on commit 64d25fe

Please sign in to comment.