1. Block coordinate descentwith time perturbation for nonconvex nonsmooth problems in real-world studies
- Author
-
Wei-chu Sun, Chun-hong Hu, Rui Liu, Linbo Qiao, and Tao Hou
- Subjects
Mathematical optimization ,021103 operations research ,Optimization problem ,Computer Networks and Communications ,business.industry ,Computer science ,Big data ,0211 other engineering and technologies ,02 engineering and technology ,01 natural sciences ,010101 applied mathematics ,Nonlinear system ,Shared memory ,Hardware and Architecture ,Asynchronous communication ,Saddle point ,Signal Processing ,Scalability ,0101 mathematics ,Electrical and Electronic Engineering ,business ,Coordinate descent - Abstract
The era of big data in healthcare is here, and this era will significantly improve medicine and especially oncology. However, traditional machine learning algorithms need to be promoted to solve such large-scale realworld problems due to a large amount of data that needs to be analyzed and the difficulty in solving problems with nonconvex nonlinear settings. We aim to minimize the composite of a smooth nonlinear function and a block-separable nonconvex function on a large number of block variables with inequality constraints. We propose a novel parallel first-order optimization method, called asynchronous block coordinate descent with time perturbation (ATP), which adopts a time perturbation technique that escapes from saddle points and sub-optimal local points. The details of the proposed method are presented with analyses of convergence and iteration complexity properties. Experiments conducted on real-world machine learning problems validate the efficacy of our proposed method. The experimental results demonstrate that time perturbation enables ATP to escape from saddle points and sub-optimal points, providing a promising way to handle nonconvex optimization problems with inequality constraints employing asynchronous block coordinate descent. The asynchronous parallel implementation on shared memory multi-core platforms indicates that the proposed algorithm, ATP, has strong scalability.
- Published
- 2019
- Full Text
- View/download PDF