Back to Search
Start Over
On two recent nonconvex penalties for regularization in machine learning
- Source :
- Results in Applied Mathematics, Vol 14, Iss , Pp 100256- (2022)
- Publication Year :
- 2022
- Publisher :
- Elsevier, 2022.
-
Abstract
- Regularization methods are often employed to reduce overfitting of machine learning models. Nonconvex penalty functions are often considered for regularization because of their near-unbiasedness properties. In this paper, we consider two relatively new penalty functions: Laplace and arctan, and show how they fit into certain recently introduced statistical and optimization frameworks. We also compare empirically the performance of the two new penalty functions with existing penalty functions utilized as regularizers of deep neural networks and convolutional neural networks on seven different datasets.
Details
- Language :
- English
- ISSN :
- 25900374
- Volume :
- 14
- Issue :
- 100256-
- Database :
- Directory of Open Access Journals
- Journal :
- Results in Applied Mathematics
- Publication Type :
- Academic Journal
- Accession number :
- edsdoj.04f0158613d44a62a34cda172cf56c76
- Document Type :
- article
- Full Text :
- https://doi.org/10.1016/j.rinam.2022.100256