Selection of methods for optimizing mathematical functions

Due to the increasing importance of machine learning and approximate methods for optimizing loss functions, I would like to have a list of different options for optimization algorithms.

If you want to add another optimization method, edit the answer

Author: hedgehogues, 2020-04-19

1 answers