🧑🏫 60 Implementations/tutorials of deep learning papers with side-by-...
🦁 Lion, new optimizer discovered by Google Brain using genetic algorith...
Nx-powered Neural Networks
🐦 Opytimizer is a Python library consisting of meta-heuristic optimizat...
A New Optimization Technique for Deep Neural Networks
RAdam implemented in Keras & TensorFlow
Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learn...
FrostNet: Towards Quantization-Aware Network Architecture Search
Instantly improve your training performance of TensorFlow models with ju...
Accelerated tensor operations and dynamic neural networks based on rever...
Code for the paper "Facial Emotion Recognition: State of the Art Perform...
Neutron: A pytorch based implementation of Transformer and its variants.
Lookahead mechanism for optimizers in Keras.
Neural Network optimizers implemented from scratch in numpy (Adam, Adade...
Toy implementations of some popular ML optimizers using Python/JAX