1. Quantifying the Alignment of Graph and Features in Deep Learning
- Author
-
Pietro Panzarasa, Tom Rieu, Yifan Qian, Paul Expert, Mauricio Barahona, and Engineering & Physical Science Research Council (EPSRC)
- Subjects
FOS: Computer and information sciences ,principal angles ,Computer Science - Machine Learning ,Technology ,Data alignment ,Computer science ,cs.LG ,02 engineering and technology ,Computer Science, Artificial Intelligence ,Machine Learning (cs.LG) ,Engineering ,Statistics - Machine Learning ,Chordal graph ,0202 electrical engineering, electronic engineering, information engineering ,Artificial Intelligence & Image Processing ,physics.soc-ph ,Computer Science - Neural and Evolutionary Computing ,Computer Science - Social and Information Networks ,SCIENCE ,stat.ML ,Linear subspace ,Graph ,Computer Science Applications ,Task analysis ,Graph (abstract data type) ,020201 artificial intelligence & image processing ,graph subspaces ,cs.SI ,Subspace topology ,Physics - Physics and Society ,Computer Networks and Communications ,Matrix norm ,FOS: Physical sciences ,Machine Learning (stat.ML) ,Physics and Society (physics.soc-ph) ,Measure (mathematics) ,Symmetric matrices ,Deep Learning ,Computer Science, Theory & Methods ,Artificial Intelligence ,Training ,Neural and Evolutionary Computing (cs.NE) ,cs.NE ,Computer Science, Hardware & Architecture ,Social and Information Networks (cs.SI) ,Science & Technology ,Nonhomogeneous media ,Learning systems ,business.industry ,Deep learning ,Engineering, Electrical & Electronic ,Pattern recognition ,Convolution ,graph convolutional networks (GCNs) ,Computer Science ,Neural Networks, Computer ,Artificial intelligence ,business ,Software - Abstract
We show that the classification performance of graph convolutional networks (GCNs) is related to the alignment between features, graph, and ground truth, which we quantify using a subspace alignment measure (SAM) corresponding to the Frobenius norm of the matrix of pairwise chordal distances between three subspaces associated with features, graph, and ground truth. The proposed measure is based on the principal angles between subspaces and has both spectral and geometrical interpretations. We showcase the relationship between the SAM and the classification performance through the study of limiting cases of GCNs and systematic randomizations of both features and graph structure applied to a constructive example and several examples of citation networks of different origins. The analysis also reveals the relative importance of the graph and features for classification purposes., Comment: Published in IEEE Transactions on Neural Networks and Learning Systems; Date of Publication: 11 January 2021
- Published
- 2022
- Full Text
- View/download PDF