Back to Search Start Over

How well does I3 perform for impact measurement compared to other bibliometric indicators? The convergent validity of several (field-normalized) indicators.

Authors :
Bornmann, Lutz
Tekles, Alexander
Leydesdorff, Loet
Source :
Scientometrics; May2019, Vol. 119 Issue 2, p1187-1205, 19p
Publication Year :
2019

Abstract

Recently, the integrated impact indicator (I3) was introduced where citations are weighted in accordance with the percentile rank class of each publication in a set of publications. I3 can also be used as a field-normalized indicator. Field-normalization is common practice in bibliometrics, especially when institutions and countries are compared. Publication and citation practices are so different among fields that citation impact is normalized for cross-field comparisons. In this study, we test the ability of the indicator to discriminate between quality levels of papers as defined by Faculty members at F1000Prime. F1000Prime is a post-publication peer review system for assessing papers in the biomedical area. Thus, we test the convergent validity of I3 (in this study, we test I3/N—the size-independent variant of I3 where I3 is divided by the number of papers) using assessments by peers as baseline and compare its validity with several other (field-normalized) indicators: the mean-normalized citation score, relative-citation ratio, citation score normalized by cited references, characteristic scores and scales, source-normalized citation score, citation percentile, and proportion of papers which belong to the x% most frequently cited papers (PP<subscript>top x%</subscript>). The results show that the PP<subscript>top 1%</subscript> indicator discriminates best among different quality levels. I3 performs similar as (slightly better than) most of the other field-normalized indicators. Thus, the results point out that the indicator could be a valuable alternative to other indicators in bibliometrics. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
01389130
Volume :
119
Issue :
2
Database :
Complementary Index
Journal :
Scientometrics
Publication Type :
Academic Journal
Accession number :
135910555
Full Text :
https://doi.org/10.1007/s11192-019-03071-6