SimpleT5 Versions Save

simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.

v0.1.4

2 years ago

SimpleT5 v0.1.4

  • Added support for all the pytorch-lightning supported loggers #11
  • Added support to save model only at last epoch #21
  • Added dataloader_num_workers parameter to .train( ) method to specify number of worker in train/test/val dataloader #19
  • fixed warnings and made compatible with latest transformers and pytorch-lightning

v0.1.3

2 years ago

byt5 support, transformers upgrade, dropping ONNX support

v0.1.2

2 years ago

v0.1.1

2 years ago

version-0.1.0

2 years ago

SimpleT5 - version 0.1.0

  • Supports ByT5 model - Thanks to @mapmeld for his contribution
from simplet5 import SimpleT5
model = SimpleT5()
model.from_pretrained("byt5", "google/byt5-small")
  • Added precision flag to support mixed precision training
# train
model.train(train_df=train_df, # pandas dataframe with 2 columns: source_text & target_text
            eval_df=eval_df, # pandas dataframe with 2 columns: source_text & target_text
            source_max_token_len = 512, 
            target_max_token_len = 128,
            batch_size = 8,
            max_epochs = 5,
            use_gpu = True,
            outputdir = "outputs",
            early_stopping_patience_epochs = 0,
            precision = 32
            )