2 commits

Author	SHA1	Message	Date
Bo Peng	343a300680	optimised the SpaCyTokenizer API . Right now it will post a list of sentence and call spacy provider once to get all the tokens and poses.	2018-08-13 16:52:17 -05:00
Bolo	97d644e5fe	intergrate nltk tokenizerin pipeline	2018-08-13 14:30:30 -05:00