A course on Optimization Methods
This repository contains seminars resources for the course "Optimization methods" for the 3-rd year students of Department of Control and Applied Mathematics. Every seminar presents brief review of necessary part of theory covered in lectures and examples of standard tasks for considered topic.
The main tool in development of efficient optimization methods is numerical linear algebra. To refresh your knowledge, you can use the crash course (ru, en).
Almost all numerical tests in this repository are performed with liboptpy library, where you can find easy to use implementations of different optimization methods. Also we use CVXPY 1.0 for comparison purpose.
The minimum list of questions (ru) on the topics in Fall term.
Preliminary
The minimum list of questions (ru) on topics of Spring term.
Y.E. Nesterov. Introductory lectures on convex optimization: A basic course
Lecture notes on Modern Convex Optimization by A. Nemirovski
Introductory Lectures on Stochastic Optimization by J. Duchi
Practical optimization by P. E. Gill, W. Murray, M. H. Wright
Advanced Optimization and Randomized Methods by A. Smola and S. Sra at CMU
Convex Optimization and Approximation by M. Hardt at UC Berkeley
If you want to send pull-request, please read the following instruction