1. On improving knowledge graph facilitated simple question answering system
- Author
-
Hongyu Zang, Wu Hao, Jiamou Liu, Zijian Zhang, Xin Li, Mingzhong Wang, and Yu Xiaoyun
- Subjects
0209 industrial biotechnology ,Computer science ,business.industry ,02 engineering and technology ,Predicate (mathematical logic) ,Machine learning ,computer.software_genre ,Convolutional neural network ,020901 industrial engineering & automation ,Recurrent neural network ,Artificial Intelligence ,0202 electrical engineering, electronic engineering, information engineering ,Feature (machine learning) ,Question answering ,Benchmark (computing) ,020201 artificial intelligence & image processing ,Artificial intelligence ,Representation (mathematics) ,business ,computer ,Software - Abstract
Leveraging knowledge graph will benefit question answering tasks, as KG contains well-structured informative data. However, training knowledge graph-based simple question answering systems is known computationally expensive due to the complex predicate extraction and candidate pool generation. Moreover, the existing methods based on convolutional neural network (CNN) or recurrent neural network (RNN) overestimate the importance of predicate features thus reduce performance. To address these challenges, we propose a time-efficient and resource-effective framework. We use leaky n-gram to balance recall and candidate pool size in candidate pool generation. For predicate extraction, we propose a soft-histogram and self-attention (SHSA) module which serves the role of preserving the global information of questions via feature matrices. And this leads to reduce the RNN module as the simple feedforward network in predicate representation. We also designed a Hamming lower-bound label encoding algorithm to encode the label representations in lower dimensions. Experiments on benchmark datasets show that our method outperforms the competitive work for end-tasks and achieves better recall with a significantly pruned candidate space.
- Published
- 2021
- Full Text
- View/download PDF