simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.
SimpleT5 v0.1.4
dataloader_num_workers
parameter to .train( )
method to specify number of worker in train/test/val dataloader #19byt5 support, transformers upgrade, dropping ONNX support
SimpleT5 - version 0.1.0
from simplet5 import SimpleT5
model = SimpleT5()
model.from_pretrained("byt5", "google/byt5-small")
# train
model.train(train_df=train_df, # pandas dataframe with 2 columns: source_text & target_text
eval_df=eval_df, # pandas dataframe with 2 columns: source_text & target_text
source_max_token_len = 512,
target_max_token_len = 128,
batch_size = 8,
max_epochs = 5,
use_gpu = True,
outputdir = "outputs",
early_stopping_patience_epochs = 0,
precision = 32
)