Back to Search Start Over

A Multimodal Approach to Assessing Document Quality.

Authors :
Shen, Aili
Salehi, Bahar
Jianzhong Qi
Baldwin, Timothy
Source :
Journal of Artificial Intelligence Research; 2020, Vol. 68, p607-632, 26p
Publication Year :
2020

Abstract

The perceived quality of a document is affected by various factors, including grammaticality, readability, stylistics, and expertise depth, making the task of document quality assessment a complex one. In this paper, we explore this task in the context of assessing the quality of Wikipedia articles and academic papers. Observing that the visual rendering of a document can capture implicit quality indicators that are not present in the document text -- such as images, font choices, and visual layout -- we propose a joint model that combines the text content with a visual rendering of the document for document quality assessment. Our joint model achieves state-of-the-art results over five datasets in two domains (Wikipedia and academic papers), which demonstrates the complementarity of textual and visual features, and the general applicability of our model. To examine what kinds of features our model has learned, we further train our model in a multi-task learning setting, where document quality assessment is the primary task and feature learning is an auxiliary task. Experimental results show that visual embeddings are better at learning structural features while textual embeddings are better at learning readability scores, which further verifies the complementarity of visual and textual features. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
10769757
Volume :
68
Database :
Supplemental Index
Journal :
Journal of Artificial Intelligence Research
Publication Type :
Academic Journal
Accession number :
145749075
Full Text :
https://doi.org/10.1613/jair.1.11647