SemianiakaVY/BotSharp
1
0
Fork 0
Code Issues Pull requests Actions Packages Projects Releases Wiki Activity
277 commits 1 branch 0 tags 41 MiB
Commit graph

3 commits

Author SHA1 Message Date
haiping008@gmail.com 1c22206fe0 Fix tokenizer compile issue in unit test. 
Add Jieba tokenizer for Chinese chabot.
 2018-09-19 23:13:12 -05:00
Oceania2018 f61859e5a4 Add CorrectTokenPosition to modify token start position. 2018-09-05 17:33:42 -05:00
Oceania2018 3e55192606 Added Penn Treebank Tokenizer. 2018-09-05 13:53:58 -05:00