Commit graph

2 commits

Author SHA1 Message Date
haiping008@gmail.com 1c22206fe0 Fix tokenizer compile issue in unit test.
Add Jieba tokenizer for Chinese chabot.
2018-09-19 23:13:12 -05:00
Oceania2018 3e55192606 Added Penn Treebank Tokenizer. 2018-09-05 13:53:58 -05:00
Renamed from BotSharp.NLP.UnitTest/RegexTokenizerTest.cs (Browse further)