Search

The traditional Encoder-Decoder model with attention mechanism has such problems as text redundancy, inconsistent representation and out of vocabulary (OOV) in the application of the summary task, resulting in low accuracy of the generated summary. The transformer model with ambeddable text location information was improved, pointer network was introduced to help with decoding, and take advantage of pointer network to generated text to generate summary. The effectiveness of the transformer model was verified on the LCSTS Chinese short text summary data set. The results show that the model outperforms the benchmark model by an average of two points in ROUGE scores, and the prominence of the generated content and the fluency of the language are significantly improved while ensuring the consistency of the summary with the input text. [ABSTRACT FROM AUTHOR]

According to the problem that the model in the generative text summarization doesn’t fully understand the semantics of the text and the generated summary lacks key information, this paper proposed a Key-BERT-Pen model that integrated keywords in Chinese abstract generation. The KBPM first used the TextRank method to extract the keywords in the text, and then obtained a more accurate contextual representation through the BERT pre-training model using the extracted keywords and the original text. Finally, it input the obtained word vector into a pointer model with a dual attention mechanism, and the pointer model took vocabularies from the vocabulary or original text to generate the final abstract. Experimental results show that the KBPM can generate text summaries with better readability and higher ROUGE scores. The comparative analysis also verifies that the KBPM effectively solves the problem of the lack of key information in the generated abstract. [ABSTRACT FROM AUTHOR]