A PyTorch-based model pruning toolkit for pre-trained language models
Added vocabulary pruning for XLM, BART, T5 and mT5
Added support for self-supervised pruning via use_logits option in TransformerPruningConfig.
use_logits
TransformerPruningConfig
First release.