fix: modify header_cleanser to minimum size import without DPK lib pip

Signed-off-by: aavarghese <[email protected]>
IBM · Dec 12, 2024 · 56e72cf · 56e72cf
1 parent 4ee6eab
commit 56e72cf
Show file tree

Hide file tree

Showing 9 changed files with 320 additions and 585 deletions.
diff --git a/demos/data-prep-kit/code/header-cleanser/requirements.txt b/demos/data-prep-kit/code/header-cleanser/requirements.txt
@@ -1,4 +1,3 @@
-data-prep-toolkit==0.2.2.dev1
 scancode-toolkit-mini
 
 # we can probably update to 18+, but we will have to re-generate expected output as pyarrow 18 seems to have resulted in a binary format change

diff --git a/demos/data-prep-kit/code/header-cleanser/src/header_cleanser_transform.py b/demos/data-prep-kit/code/header-cleanser/src/header_cleanser_transform.py