Release v3.2.1
Highlights
- Fix OOM issue with a huge input by @kenmasumitsu in #132
- Huge input now split into relatively small (1M char) chunks now.
- Analysis maybe broken around the edge of chunks (open issue, see #131).
- Add documentation about Sudachi synonym dict by @sorami in #65
Breaking Changes
- Huge (>1M char) input now split into chunks to avoid OOM and the analysis may be broken around the edge of chunks (open issue, see #131).