Back to Search Start Over

A New Angle on L2 Regularization

Authors :
Tanay, Thomas
Griffin, Lewis D
Publication Year :
2018

Abstract

Imagine two high-dimensional clusters and a hyperplane separating them. Consider in particular the angle between: the direction joining the two clusters' centroids and the normal to the hyperplane. In linear classification, this angle depends on the level of L2 regularization used. Can you explain why?<br />Comment: An explorable explanation on the phenomenon of adversarial examples in linear classification and its relation to L2 regularization. Interactive version available at: https://thomas-tanay.github.io/post--L2-regularization/

Details

Database :
arXiv
Publication Type :
Report
Accession number :
edsarx.1806.11186
Document Type :
Working Paper