torch-optimizer -- collection of optimizers for Pytorch
4357dcf Better deploy workflow 9dfd2fc Add deploy workflow (#230) 31f60c9 Move to GitHub actions (#228) 7276b69 More test coverage for params validation. Add weight decay validaiotn for SWATS (#225) 2e013a0 Better test of lr value validation. ccc920d Bump sphinx from 3.3.0 to 3.3.1 788d1e8 Bump matplotlib from 3.3.2 to 3.3.3 3adf578 Add optimizer selection warning (#222) 5b2b59e Bump numpy from 1.19.3 to 1.19.4 9123897 Bump sphinx from 3.2.1 to 3.3.0 cc8acc8 Add apollo optimizer to the readme (#218) 1dcec1d Add apollo optimizer test 03e6dad Add apollo optimizer implemenation 15cc6da (add-apollo-optimizer) Merge branch 'master' of github.com:jettify/pytorch-optimizer ce7b51c Bump mypy from 0.782 to 0.790 3da1672 Bump numpy from 1.19.2 to 1.19.3 (#216) 6a1f550 Bump pytest from 6.1.1 to 6.1.2 3327ebb Bump torchvision from 0.7.0 to 0.8.1 40a7ba5 Bump torch from 1.6.0 to 1.7.0 a61c8ad Correct links to the A2Grad paper (#211) 8ce32cf bump version
efeea8f Add adabelief to the readme. (#210) 9c72aa0 Add adabelief optimizer (#209) 0d94e4e Update CONTRIBUTING.rst (#207) 3a4abcd Bump sphinx-autodoc-typehints from 1.11.0 to 1.11.1 f08f793 Update readme with a2grad optimizers (#204) 9003a68 Add A2GradInc and A2GradExp optimizers. (#203) d221899 Bump hyperopt from 0.2.4 to 0.2.5 35f14f6 Bump ipdb from 0.13.3 to 0.13.4 1005b6b Bump flake8 from 3.8.3 to 3.8.4 9ad5102 Bump pytest from 6.1.0 to 6.1.1 bd71c05 Add a2grad optimizer (#199) ba60ddb Bump pytest from 6.0.2 to 6.1.0 (#197) 1e142d4 Bump matplotlib from 3.3.1 to 3.3.2 02f0d90 Bump pytest from 6.0.1 to 6.0.2 1ba47a8 Bump numpy from 1.19.1 to 1.19.2 be69ae7 Add adafactor test case. (#192) db002c6 Merge pull request #191 from matech96/patch-1 7edf138 yogi doc fix a2905c5 Merge pull request #190 from jettify/update-dock-with-new-optimizers d31dbc9 (origin/update-dock-with-new-optimizers, update-dock-with-new-optimizers) Update docs with new optimizers. 2308555 Merge pull request #189 from jettify/add-adafactor-optimizer ae0118b (origin/add-adafactor-optimizer, add-adafactor-optimizer) Add adafactor to the readme. f7237ee Add adafactor tests dcaa63f Add adafactor implementation b6fdd4e Merge pull request #186 from jettify/fix-warning-in-sgdp-and-adamp e1c2d2d (origin/fix-warning-in-sgdp-and-adamp, fix-warning-in-sgdp-and-adamp) Fix warnign in adamp 7eaa2f3 Fix warnings in sgdp 75d625a Fix warnings in adabound (#184) 30ef850 Bump black from 19.10b0 to 20.8b1 a149682 Fix warnings in qhadam (#182) 8787b6b Add swats to the readme (#181) c7bb0fd Add SWATS optimizer (#178) 5835261 Bump pytest-cov from 2.10.0 to 2.10.1 519473d Bump sphinx from 3.2.0 to 3.2.1 1b705d0 Fix missed warnings in case weight_decay specified (#177) 17c754e Fix warnings in shampoo (#176) 13db710 Fix warnings in accsgd (#175) 51ffdc6 Bump matplotlib from 3.3.0 to 3.3.1 913543a Fix warnings in yogi optimizer. (#173) ce54a95 Fix warnings in adamod (#172) a144f4b bump version
279d420 Bump sphinx from 3.1.2 to 3.2.0 e345295 Fix warnings in sgdw (#168) 077c72d Fix warnings in qhm (#167) b6d87b2 Fix warning in radam (#166) 03ee2a4 Fix warning in novograd optimizer. (#165) 19026f5 Resolve warnings in pid optimizer (#164) 92ac42e Fix warnings in lamb optimizer (#163) 0df1686 Fix pytorch 1.6.0 compatibility (#162) 6a74cee Reformat code and sort imports (#160) 33a8bbe Add aggmo to the readme (#159) b4cc233 Bump pytest from 6.0.0 to 6.0.1 a48e955 More robust setup.py and bump numpy version (#157) a2749e2 Bump torchvision from 0.6.1 to 0.7.0 b20d9b3 Bump pytest from 5.4.3 to 6.0.0 a545011 Add aggmo optimizer (#153) 1552465 Bump matplotlib from 3.2.2 to 3.3.0 72d4e35 Bump dev version
e90a185 Bump version e21b422 Bump sphinx from 3.1.1 to 3.1.2 1b70e4e Fix numpy version (#148) 9a9d233 Add SGDP optimizer (#145) 8452433 Bump numpy from 1.18.5 to 1.19.0 40c0723 Bump ipython from 7.15.0 to 7.16.1 a891371 Bump ipdb from 0.13.2 to 0.13.3 8f5c382 Add AdamP optimizer (#133) cae9bde Bump mypy from 0.781 to 0.782 17da984 Bump sphinx-autodoc-typehints from 1.10.3 to 1.11.0 387581d Bump mypy from 0.780 to 0.781 a291360 Bump torchvision from 0.6.0 to 0.6.1 fd5badc Bump torch from 1.5.0 to 1.5.1 144e72e Bump matplotlib from 3.2.1 to 3.2.2
3c0dd77 Add documentation reference to the README. 4e5548e Bump pytest-cov from 2.9.0 to 2.10.0 861aa98 Bump sphinx from 3.1.0 to 3.1.1 219ae8a Bump flake8 from 3.8.2 to 3.8.3 81107ab Bump sphinx from 3.0.4 to 3.1.0 e3b059c Add lookagead optimizer to the README. (#128) 8ab662a Prepare lookahead optimizer for release. 29bd821 Bump ipython from 7.14.0 to 7.15.0 5f7e4e8 Bump mypy from 0.770 to 0.780 982a052 Bump numpy from 1.18.4 to 1.18.5 1e41844 Bump pytest from 5.4.2 to 5.4.3 96f7257 Add doc string and reformat code. da9e0f3 Fix linter. 8fda937 Add project URLs ba33395 Expose shampoo properly 6d194c1 Bump sphinx from 3.0.3 to 3.0.4 b3adae7 Refresh docs (#122) bfa8358 Bump flake8 from 3.8.1 to 3.8.2 2fd60a8 Bump pytest-cov from 2.8.1 to 2.9.0 542dd46 Add read the docs badge c77f808 Make tests less flaky (#119) 18742bf Bump flake8-quotes from 3.0.0 to 3.2.0 267b8c5 Add python3.8 to setup.py d14a85c Bump flake8 from 3.7.9 to 3.8.1 2d9da19 Update diffgrad.py (#118) ed84071 Bump pytest from 5.4.1 to 5.4.2 690ad22 Add Shampoo optimizer to the readme. (#114) 590b288 Bump ipython from 7.13.0 to 7.14.0 096b021 Bump numpy from 1.18.3 to 1.18.4 7875299 Add shampoo optimizer. (#110) fff339d Bump sphinx from 3.0.2 to 3.0.3 86664f5 Try py3.8 (#109) 87d9ccf Bump dev version
63393ae Bump hyperopt from 0.2.3 to 0.2.4 bfc46c4 Bump torchvision from 0.5.0 to 0.6.0 660d831 Bump torch from 1.4.0 to 1.5.0 f21c85a Bump numpy from 1.18.2 to 1.18.3 e8d4866 Bump sphinx from 3.0.1 to 3.0.2 2cfbf20 RAdam fix for issue #96. (#103) df65965 Bump sphinx from 3.0.0 to 3.0.1 19408f5 Return type hint fixed for torch_optimizer.get (#101) 243509b Bump sphinx from 2.4.4 to 3.0.0 0320faa Raise exception if optimizer not found. Fix few mypy types. (#98) 05b2da5 Bump dev version
e2425ec Rework get optimizer function (#97) 4376be1 Add torch_optimizer.get() method (#95) fd4f0a9 Add ranger optimizer to the readme (#94) f0e1f7c Add Rangers (#93) 40b832c Add keywords to setup.py af6d6e1 Add reference code links in doc strings 1bd385d Bump flake8-quotes from 2.1.1 to 3.0.0 4997fa3 Documentation update and README fixes. a7e330e Minor doc string cleanup and fix constant for QHM cb7bdb9 Add QHAdam to the readme (#91) 5155f0b Update docs with new optimizers. (#90) 3ef2b4f Bump matplotlib from 3.2.0 to 3.2.1 7aaaafa Better test coverage for QHAdam optimizer (#88) 7ab6b72 Add QHAdam optimizer (#87) ad59d3f Bump pytest from 5.4.0 to 5.4.1 a5e0fdc Bump version