How status of research papers affects the way they are read and cited

Keywords Metrics; Citations; Influence; Science; Status Highlights * More than half of citations to academic papers reflect little-to-no intellectual influence on the authors citing them. * Citations to already highly cited papers are 2--3 more likely to reflect substantial intellectual influence. * A key mechanism is citations change perceptions of quality: displaying low citation counts makes papers appear to be of lower quality. * Papers with poor perceived quality are read more superficially and discovered later in the projects. Abstract Although citations are widely used to measure the influence of scientific works, research shows that many citations serve rhetorical functions and reflect little-to-no influence on the citing authors. If highly cited papers disproportionately attract rhetorical citations then their citation counts may reflect rhetorical usefulness more than influence. Alternatively, researchers may perceive highly cited papers to be of higher quality and invest more effort into reading them, leading to disproportionately substantive citations. We test these arguments using data on 17,154 randomly sampled citations collected via surveys from 9,380 corresponding authors in 15 fields. We find that most citations (54%) had little-to-no influence on the citing authors. However, citations to the most highly cited papers were 2--3 times more likely to denote substantial influence. Experimental and correlational data show a key mechanism: displaying low citation counts lowers perceptions of a paper's quality, and papers with poor perceived quality are read more superficially. The results suggest that higher citation counts lead to more meaningful engagement from readers and, consequently, the most highly cited papers influence the research frontier much more than their raw citation counts imply. Author Affiliation: (a) University of Michigan School of Information, Ann Arbor, MI, 48109, USA (b) Dept. of Philosophy, University of Chicago, Chicago, IL, 60637, USA (c) Committee on Conceptual and Historical Studies of Science, University of Chicago, Chicago, IL, 60637 (d) Harvard Business School, Harvard University, Boston, MA, 02163, USA (e) Laboratory for Innovation Science at Harvard, Harvard University, Boston, MA, 02163, USA (f) Institute for Quantitative Social Science, Harvard University, Cambridge, MA, 02138, USA (g) Knowledge Lab, University of Chicago, Chicago, IL, 60637, USA * Corresponding author. Article History: Received 14 August 2021; Revised 11 January 2022; Accepted 12 January 2022 Byline: Misha Teplitskiy [tepl@umich.edu] (a,e,*), Eamon Duede [eduede@uchicago.edu] (b,c,g), Michael Menietti [mmenietti@hbs.edu] (d,e), Karim R. Lakhani [klakhani@hbs.edu] (d,e,f)