Back to Search Start Over

CONVERGENCE OF A CLASS OF NONMONOTONE DESCENT METHODS FOR KURDYKA-ŁOJASIEWICZ OPTIMIZATION PROBLEMS.

Authors :
YITIAN QIAN
SHAOHUA PAN
Source :
SIAM Journal on Optimization. 2023, Vol. 33 Issue 2, p638-651. 14p.
Publication Year :
2023

Abstract

This note is concerned with a class of nonmonotone descent methods for minimizing a proper lower semicontinuous Kurdyka-Łojasiewicz (KL) function Φ, which generates a sequence satisfying a nonmonotone decrease condition and a relative error tolerance. Under suitable assumptions, we prove that the whole sequence converges to a limiting critical point of Φ, and, when Φ is a KL function of exponent θ∈[0,1), the convergence admits a linear rate if θ∈[0,1/2] and a sublinear rate associated to θ if θ∈(1/2,1). These assumptions are shown to be sufficient and necessary if in addition Φ is weakly convex on a neighborhood of the set of critical points. Our results not only extend the convergence results of monotone descent methods for KL optimization problems but also resolve the convergence problem on the iterate sequence generated by a class of nonmonotone line search algorithms for nonconvex and nonsmooth problems. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
10526234
Volume :
33
Issue :
2
Database :
Academic Search Index
Journal :
SIAM Journal on Optimization
Publication Type :
Academic Journal
Accession number :
164895927
Full Text :
https://doi.org/10.1137/22M1469663