You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
shallownlp.ner.NER.predict processes lists of sentences in batches resulting in faster predictions
batch_size argument added to shallownlp.ner.NER.predict
added verbose parameter to ktrain.text.textutils.extract_copy to optionally see why each skipped document was skipped
Fixed:
Changed TextPredictor.save to save Hugging Face tokenizer files locally to ensure they can be easily reloaded when text.Transformer is supplied with local path.
For transformers models, the predictor.preproc.model_name variable is automatically updated to be new Predictor folder to avoid having users manually update model_name. Applies
when a local path is supplied to text.Transformer and resultant Predictor is moved to new machine.