fix: modify header_cleanser and doc_id to minimum size import without…

… DPK lib pip Signed-off-by: aavarghese <[email protected]>
IBM · Dec 18, 2024 · 1cbfac4 · 1cbfac4
1 parent e720a42
commit 1cbfac4
Show file tree

Hide file tree

Showing 11 changed files with 325 additions and 588 deletions.
diff --git a/demos/data-prep-kit/code/header-cleanser/requirements.txt b/demos/data-prep-kit/code/header-cleanser/requirements.txt
@@ -1,4 +1,3 @@
-data-prep-toolkit==0.2.2.dev1
 scancode-toolkit-mini
 
 # we can probably update to 18+, but we will have to re-generate expected output as pyarrow 18 seems to have resulted in a binary format change

diff --git a/demos/data-prep-kit/code/header-cleanser/src/header_cleanser_transform.py b/demos/data-prep-kit/code/header-cleanser/src/header_cleanser_transform.py