Code

Deprecate tokenizeSentences#254

Code

Merged

mh-northlander merged 5 commits intodevelop-v0.8WorksApplications/Sudachi:develop-v0.8from feature/251-deprecate-tokenize-sentencesWorksApplications/Sudachi:feature/251-deprecate-tokenize-sentencesCopy head branch name to clipboardDec 2, 2024

+209-290

Commits

Commits on Nov 28, 2024

• deprecate old tokenizeSentences and replace it by lazyTokenizeSentences

  mh-northlander

  committed
  8abf97e

  Copy full SHA for 8abf97e

• use more specific return type

  mh-northlander

  committed
  4a9822e

  Copy full SHA for 4a9822e

• remove SentenceSplittingAnalysis

  mh-northlander

  committed
  99617fa

  Copy full SHA for 99617fa

• Add Tokenizer.split deprecating MorphemeList.split

  mh-northlander

  committed
  a204c42

  Copy full SHA for a204c42

• return List<Morpheme> instead of MorphemeList

  mh-northlander

  committed
  1d24e46

  Copy full SHA for 1d24e46