YouTokenToMe Versions Save

Unsupervised text tokenizer focused on computational efficiency

v1.0.6

4 years ago

v1.0.5

4 years ago

v1.0.4

4 years ago

  • Add support of dropout in encoding

  • Add support of IDs ignoring for decoding

  • Fix unhandled exception on unknown --output_type

v1.0.3

4 years ago

Fix https://github.com/VKCOM/YouTokenToMe/issues/33