Code

Add TrafilaturaExtractor class#431

Code

Open

sarahyurick wants to merge 7 commits intoNVIDIA:mainNVIDIA/NeMo-Curator:mainfrom sarahyurick:trafilatura_extractorsarahyurick/NeMo-Curator:trafilatura_extractorCopy head branch name to clipboard

+184-54

Commits

Commits on Dec 13, 2024

• first commit

  Show description for 632df99
  sarahyurick

  committed
  632df99

  Copy full SHA for 632df99

• add implementation and pytest

  Show description for 51b1145
  sarahyurick

  committed
  51b1145

  Copy full SHA for 51b1145

Commits on Dec 23, 2024

• allow editing trafilatura config params

  Show description for db8c5b2
  sarahyurick

  committed
  db8c5b2

  Copy full SHA for db8c5b2

• Merge branch 'main' into trafilatura_extractor

  sarahyurick

  authored
  877d6ae

  Copy full SHA for 877d6ae

Commits on Dec 24, 2024

• Merge branch 'main' into trafilatura_extractor

  Show description for b85cb56
  sarahyurick

  authored
  b85cb56

  Copy full SHA for b85cb56

Commits on Feb 13, 2025

• Merge branch 'main' into trafilatura_extractor

  Show description for 4d447a1
  sarahyurick

  authored
  4d447a1

  Copy full SHA for 4d447a1

Commits on Feb 19, 2025

• Merge branch 'main' into trafilatura_extractor

  Show description for b3fb664
  sarahyurick

  authored
  b3fb664

  Copy full SHA for b3fb664