Back to Search
Start Over
On Sensitive Minima in Margin-Based Deep Distance Learning
- Publication Year :
- 2020
-
Abstract
- This paper investigates sensitive minima in popular deep distance learning techniques such as Siamese and Triplet networks. We demonstrate that standard formulations may find solutions that are sensitive to small changes and thus do not generalize well. To alleviate sensitive minima we propose a new approach to regularize margin-based deep distance learning by introducing stochasticity in the loss that encourages robust solutions. Our experimental results on HPatches show promise compared to common regularization techniques including weight decay and dropout, especially for small sample sizes.<br />Pattern Recognition and Bioinformatics
Details
- Database :
- OAIster
- Notes :
- English
- Publication Type :
- Electronic Resource
- Accession number :
- edsoai.on1199588866
- Document Type :
- Electronic Resource
- Full Text :
- https://doi.org/10.1109.ACCESS.2020.3013560