Skip to content

SentencePiece

Unsupervised text tokenizer for Neural Network-based text generation.

homepage: https://github.com/google/sentencepiece

version versionsuffix toolchain
0.1.85 -Python-3.7.4 GCC/8.3.0
0.1.94 -Python-3.8.2 GCC/9.3.0
0.1.96 GCC/10.2.0
0.1.96 GCC/10.3.0
0.1.97 GCC/11.3.0
0.1.99 GCC/12.2.0
0.2.0 GCC/12.3.0
0.2.0 GCC/13.2.0

(quick links: (all) - 0 - a - b - c - d - e - f - g - h - i - j - k - l - m - n - o - p - q - r - s - t - u - v - w - x - y - z)