1. 融合高低层语义信息的自然语言句子匹配方法.
- Author
-
姜克鑫, 赵亚慧, and 崔荣一
- Subjects
- *
CONVOLUTIONAL neural networks , *NATURAL languages , *PROBLEM solving , *SURGICAL gloves , *TEMPORAL lobe , *HEURISTIC , *ALGORITHMS - Abstract
This paper proposed a natural language sentence matching method that combined high-level and low-level semantic information to solve the problems about current natural language sentence matching method fail to integrate common semantic information and it is difficult to capture deep-semantic information. First of all, the method used pre-trained word vector GloVe and character-level word vector to obtained the word embedding representation of sentence P and sentence Q. Secondly, this paper encode red P and Q with bidirectional LSTM, then it contained low-level semantic information through preliminary fusion of P and Q. Thirdly, this paper calculated bidirectional attention between P and Q, then spliced them together to get semantic representation, afterwards it calculated its self-attention to obtained high-level semantic information. Finally, this paper used a heuristic fusion function to fuse the low-level semantic information with the high-level semantic information to obtain the final semantic representation, and it used a convolutional neural network to prediction answers. This paper evaluated the proposed model on two tasks, such as recognition textual entailment, paraphrase recognition. This paper conducted experiments on the SNLI dataset and the Quora dataset. The results show that the accuracy of the proposed algorithm on the SNLI test set is 87. 1%, and the accuracy of the Quora test set is 86. 8%, which verifies the effectiveness of the algorithm in the task of natural language sentence matching. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF