Back to Search Start Over

A UNIFIED ANALYSIS OF DESCENT SEQUENCES IN WEAKLY CONVEX OPTIMIZATION, INCLUDING CONVERGENCE RATES FOR BUNDLE METHODS.

Authors :
ATENAS, FELIPE
SAGASTIZÁBAL, CLAUDIA
SILVA, PAULO J. S.
SOLODOV, MIKHAIL
Source :
SIAM Journal on Optimization. 2023, Vol. 33 Issue 1, p89-115. 27p.
Publication Year :
2023

Abstract

We present a framework for analyzing convergence and local rates of convergence of a class of descent algorithms, assuming the objective function is weakly convex. The framework is general, in the sense that it combines the possibility of explicit iterations (based on the gradient or a subgradient at the current iterate), implicit iterations (using a subgradient at the next iteration, like in the proximal schemes), as well as iterations when the associated subgradient is specially constructed and does not correspond either to the current or the next point (this is the case of descent steps in bundle methods). Under the subdifferential-based error bound on the distance to critical points, linear rates of convergence are established. Our analysis applies, among other techniques, to prox-descent for decomposable functions, the proximal-gradient method for a sum of functions, redistributed bundle methods, and a class of algorithms that can be cast in the feasible descent framework for constrained optimization. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
10526234
Volume :
33
Issue :
1
Database :
Academic Search Index
Journal :
SIAM Journal on Optimization
Publication Type :
Academic Journal
Accession number :
164097236
Full Text :
https://doi.org/10.1137/21M1465445