Bug#939860: ITP: sentencepiece/0.1.83

[Kentaro Hayashi <hayashi@clear-code.com>]

Package: wnpp
Severity: wishlist

* Package name    : sentencepiece
  Version         : 0.1.83
  Upstream Author : Google Inc.
* URL             : https://github.com/google/sentencepiece
* License         : Apache 2.0
  Programming Lang: C++
  Description     : unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems

 SentencePiece is an unsupervised text tokenizer and detokenizer mainly
 for Neural Network-based text generation systems where the vocabulary size is
 predetermined prior to the neural model training.
 .
 SentencePiece implements subword units and unigram language model with the extension
 of direct training from raw sentences. SentencePiece allows us to make a purely
 end-to-end system that does not depend on language-specific pre/postprocessing.