🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
Full Changelog: https://github.com/lucidrains/lion-pytorch/compare/0.1.2...0.1.4