torch-optimizer -- collection of optimizers for Pytorch
optimizer & lr scheduler & loss function collections in PyTorch
AdaBound optimizer in Keras
An optimizer that trains as fast as Adam and as good as SGD in Tensorflow