diff --git a/BotSharp.NLP/BotSharp.NLP.csproj b/BotSharp.NLP/BotSharp.NLP.csproj index 669148b2..264517e1 100644 --- a/BotSharp.NLP/BotSharp.NLP.csproj +++ b/BotSharp.NLP/BotSharp.NLP.csproj @@ -3,6 +3,18 @@ netstandard2.0 AnyCPU;x64 + true + 0.1.0 + Botsharp NLP is a platform for building C# programs to work with human language data. It is the NLP low-level processing library of the BotSharp robot construction platform. It provides a separate installation package for downloading. It can be used as a common POS, NER and text classification service in the NLP field, providing a variety of machine learning algorithms to switch freely. + MIT + https://github.com/Oceania2018/BotSharp + git + https://github.com/Oceania2018/BotSharp + Haiping Chen, Bo Peng + Personal + RegexTokenizer and RegexStemmer. + https://raw.githubusercontent.com/Oceania2018/BotSharp/master/BotSharp.WebHost/wwwroot/images/BotSharp.png + BotSharp, NLP, NLU, POS, CRS, NER, LSTM, CRF diff --git a/BotSharp.NLP/README.md b/BotSharp.NLP/README.md new file mode 100644 index 00000000..572511df --- /dev/null +++ b/BotSharp.NLP/README.md @@ -0,0 +1,33 @@ +BotSharp NLP +=== +Botsharp NLP is a platform for building C# programs to work with human language data. It is the NLP low-level processing library of the BotSharp robot construction platform. It provides a separate installation package for downloading. It can be used as a common POS, NER and text classification service in the NLP field, providing a variety of machine learning algorithms to switch freely. + + +## How to install +#### Download source code +````sh +git clone https://github.com/Oceania2018/BotSharp +```` +#### Start to use +````sh +public void TokenizeInWhiteSpace() +{ + // use RegexTokenizer + var tokenizer = new TokenizerFactory(); + + // tokenize and return tokens + var tokens = tokenizer.Tokenize("Chop into pieces, isn't it?", + new TokenizationOptions + { + // use built-in regex pattern + Pattern = RegexTokenizer.WHITE_SPACE + }); + + // test result + Assert.IsTrue(tokens[0].Offset == 0); + Assert.IsTrue(tokens[0].Text == "Chop"); + + Assert.IsTrue(tokens[1].Offset == 5); + Assert.IsTrue(tokens[1].Text == "into"); +} +```` \ No newline at end of file