Pytorch notebook with One Cycle Policy implementation (https://arxiv.org/abs/1803.09820)
This notebook contains some of the experiments mentioned in papers Cyclical Learning Rates for Training Neural Networks and A disciplined approach to neural network hyper-parameters: Part 1 - learning rate, batch size, momentum, and weight decay. My blog related to the same can be found here
This notebook works with: