Back to Search
Start Over
Recent Advances in Large Margin Learning
- Source :
- IEEE Transactions on Pattern Analysis and Machine Intelligence. 44:7167-7174
- Publication Year :
- 2022
- Publisher :
- Institute of Electrical and Electronics Engineers (IEEE), 2022.
-
Abstract
- This paper serves as a survey of recent advances in large margin training and its theoretical foundations, mostly for (nonlinear) deep neural networks (DNNs) that are probably the most prominent machine learning models for large-scale data in the community over the past decade. We generalize the formulation of classification margins from classical research to latest DNNs, summarize theoretical connections between the margin, network generalization, and robustness, and introduce recent efforts in enlarging the margins for DNNs comprehensively. Since the viewpoint of different methods is discrepant, we categorize them into groups for ease of comparison and discussion in the paper. Hopefully, our discussions and overview inspire new research work in the community that aim to improve the performance of DNNs, and we also point to directions where the large margin principle can be verified to provide theoretical evidence why certain regularizations for DNNs function well in practice. We managed to shorten the paper such that the crucial spirit of large margin learning and related methods are better emphasized.<br />Accepted by TPAMI, 8 pages, 3 figures
- Subjects :
- FOS: Computer and information sciences
Computer Science - Machine Learning
Computer Science - Cryptography and Security
Computer science
Generalization
Computer Vision and Pattern Recognition (cs.CV)
media_common.quotation_subject
Computer Science - Computer Vision and Pattern Recognition
Machine learning
computer.software_genre
Machine Learning (cs.LG)
Machine Learning
Artificial Intelligence
Margin (machine learning)
Robustness (computer science)
Neural and Evolutionary Computing (cs.NE)
Function (engineering)
media_common
Point (typography)
Artificial neural network
business.industry
Applied Mathematics
Computer Science - Neural and Evolutionary Computing
Support vector machine
Computational Theory and Mathematics
Categorization
Neural Networks, Computer
Computer Vision and Pattern Recognition
Artificial intelligence
business
Cryptography and Security (cs.CR)
computer
Algorithms
Software
Subjects
Details
- ISSN :
- 19393539 and 01628828
- Volume :
- 44
- Database :
- OpenAIRE
- Journal :
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Accession number :
- edsair.doi.dedup.....aaec8c59c92d6c252b42c3a2702c6e93