Code

Added cyrillic support to tokenizer#7

Code

Open

alexfilatov wants to merge 3 commits intofredwu:masterfredwu/simple_bayes:masterfrom alexfilatov:masteralexfilatov/simple_bayes:masterCopy head branch name to clipboard

+24-1

Commits

Commits on May 3, 2017

• added cyrillic tokenizer

  alexfilatov

  committed
  0df179d

  Copy full SHA for 0df179d

• added tests

  alexfilatov

  committed
  b798785

  Copy full SHA for b798785

• actually joined cyrillic with main tokenizer

  alexfilatov

  committed
  3da3cc8

  Copy full SHA for 3da3cc8