General • Optimization • 62 methods
Stochastic Optimization methods are used to optimize neural networks. We typically take a mini-batch of data, hence 'stochastic', and perform a type of gradient descent with this minibatch. Below you can find a continuously updating list of stochastic optimization algorithms.
Subcategories
Method | Year | Papers |
---|---|---|
2014 | 17201 | |
1951 | 1732 | |
2018 | 572 | |
2013 | 426 | |
2019 | 178 | |
2011 | 164 | |
2017 | 145 | |
1999 | 141 | |
2016 | 138 | |
2021 | 131 | |
2020 | 92 | |
2014 | 91 | |
2017 | 66 | |
2018 | 58 | |
2019 | 49 | |
2019 | 47 | |
2016 | 41 | |
2020 | 38 | |
2018 | 36 | |
2017 | 30 | |
2021 | 29 | |
1983 | 27 | |
2019 | 25 | |
2020 | 18 | |
2019 | 16 | |
2000 | 15 | |
2012 | 15 | |
2019 | 11 | |
2000 | 10 | |
2016 | 10 | |
2019 | 10 | |
2022 | 9 | |
2021 | 9 | |
2014 | 8 | |
2017 | 6 | |
2019 | 5 | |
2021 | 4 | |
2015 | 4 | |
2018 | 3 | |
2019 | 3 | |
2022 | 2 | |
2021 | 2 | |
2018 | 2 | |
1991 | 2 | |
2020 | 2 | |
2019 | 1 | |
2019 | 1 | |
2023 | 1 | |
2022 | 1 | |
2019 | 1 | |
2019 | 1 | |
2022 | 1 | |
2021 | 1 | |
2017 | 1 | |
2019 | 1 | |
2017 | 1 | |
2018 | 1 | |
2021 | 1 | |
2021 | 1 | |
2018 | 1 | |
2000 | 0 |