Back to Search
Start Over
Interrater Reliability and Convergent Validity of F1000Prime Peer Review.
- Source :
- Journal of the Association for Information Science & Technology; Dec2015, Vol. 66 Issue 12, p2415-2426, 12p, 6 Charts, 2 Graphs
- Publication Year :
- 2015
-
Abstract
- Peer review is the backbone of modern science. F1000Prime is a postpublication peer review system of the biomedical literature (papers from medical and biological journals). This study is concerned with the interrater reliability and convergent validity of the peer recommendations formulated in the F1000Prime peer review system. The study is based on about 100,000 papers with recommendations from faculty members. Even if intersubjectivity plays a fundamental role in science, the analyses of the reliability of the F1000Prime peer review system show a rather low level of agreement between faculty members. This result is in agreement with most other studies that have been published on the journal peer review system. Logistic regression models are used to investigate the convergent validity of the F1000Prime peer review system. As the results show, the proportion of highly cited papers among those selected by the faculty members is significantly higher than expected. In addition, better recommendation scores are also associated with higher performing papers. [ABSTRACT FROM AUTHOR]
- Subjects :
- CONFIDENCE intervals
DATABASES
MEDICAL literature
PROFESSIONAL peer review
RESEARCH evaluation
STATISTICS
LOGISTIC regression analysis
BIBLIOGRAPHIC databases
INTER-observer reliability
PERIODICAL articles
CITATION analysis
IMPACT factor (Citation analysis)
DATA analysis software
STATISTICAL models
INTRACLASS correlation
Subjects
Details
- Language :
- English
- ISSN :
- 23301635
- Volume :
- 66
- Issue :
- 12
- Database :
- Complementary Index
- Journal :
- Journal of the Association for Information Science & Technology
- Publication Type :
- Academic Journal
- Accession number :
- 111519781
- Full Text :
- https://doi.org/10.1002/asi.23334