1. A Deep Neural Information Fusion Architecture for Textual Network Embeddings
- Author
-
Xiaojun Quan, Qinliang Su, Weijia Zhang, and Zenan Xu
- Subjects
Social and Information Networks (cs.SI) ,FOS: Computer and information sciences ,Computer Science - Machine Learning ,Computer Science - Computation and Language ,business.industry ,Computer science ,Node (networking) ,Feature extraction ,Computer Science - Social and Information Networks ,02 engineering and technology ,010501 environmental sciences ,computer.software_genre ,01 natural sciences ,Machine Learning (cs.LG) ,Information fusion ,0202 electrical engineering, electronic engineering, information engineering ,020201 artificial intelligence & image processing ,Artificial intelligence ,Architecture ,business ,Representation (mathematics) ,computer ,Computation and Language (cs.CL) ,Natural language processing ,0105 earth and related environmental sciences - Abstract
Textual network embeddings aim to learn a low-dimensional representation for every node in the network so that both the structural and textual information from the networks can be well preserved in the representations. Traditionally, the structural and textual embeddings were learned by models that rarely take the mutual influences between them into account. In this paper, a deep neural architecture is proposed to effectively fuse the two kinds of informations into one representation. The novelties of the proposed architecture are manifested in the aspects of a newly defined objective function, the complementary information fusion method for structural and textual features, and the mutual gate mechanism for textual feature extraction. Experimental results show that the proposed model outperforms the comparing methods on all three datasets., Comment: To appear at EMNLP-IJCNLP 2019 (Conference on Empirical Methods in Natural Language Processing & International Joint Conference on Natural Language Processing 2019)
- Published
- 2019
- Full Text
- View/download PDF