Back to Search Start Over

A DYNAMIC SMOOTHING TECHNIQUE FOR A CLASS OF NONSMOOTH OPTIMIZATION PROBLEMS ON MANIFOLDS.

Authors :
BECK, AMIR
ROSSET, ISRAEL
Source :
SIAM Journal on Optimization; 2023, Vol. 33 Issue 3, p1473-1493, 21p
Publication Year :
2023

Abstract

We consider the problem of minimizing the sum of a smooth nonconvex function and a nonsmooth convex function over a compact embedded submanifold. We describe an algorithm, which we refer to as "dynamic smoothing gradient descent on manifolds" (DSGM), that is based on applying Riemmanian gradient steps on a series of smooth approximations of the objective function that are determined by a diminishing sequence of smoothing parameters. The DSGM algorithm is simple and can be easily employed for a broad class of problems without any complex adjustments. We show that all accumulation points of the sequence generated by the method are stationary. We devise a convergence rate of O(1<subscript>k1/3</subscript>) in terms of an optimality measure that can be easily computed. Numerical experiments illustrate the potential of the DSGM method. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
10526234
Volume :
33
Issue :
3
Database :
Complementary Index
Journal :
SIAM Journal on Optimization
Publication Type :
Academic Journal
Accession number :
173676815
Full Text :
https://doi.org/10.1137/22M1489447