Search

ObjectivePeer reviewers of biomedical journals are expected to perform a large number of roles and tasks, some of which are seemingly contradictory or demonstrate incongruities between the respective positions of peer reviewers and journal editors. Our aim was to explore the perspectives, expectations and understanding of the roles and tasks of peer reviewers of journal editors from general and specialty biomedical journals.DesignQualitative study.SettingWorldwide.Participants56 journal editors from biomedical journals, most of whom were editors-in-chief (n=39), male (n=40) and worked part-time (n=50) at journals from 22 different publishers.MethodsSemistructured interviews with journal editors were conducted. Recruitment was based on purposive maximum variation sampling. Data were analysed thematically following the methodology by Braun and Clarke.ResultsJournal editors’ understanding of the roles and partly of tasks of peer reviewers are profoundly shaped by each journal’s unique context and characteristics, including financial and human resources and journal reputation or prestige. There was a broad agreement among journal editors on expected technical tasks of peer reviewers related to scientific aspects, but there were different expectations in the level of depth. We also found that most journal editors support the perspective that authorship experience is key to high-quality reviews, while formal training in peer reviewing is not.ConclusionThese journal editors’ accounts reveal issues of a social nature within the peer-review process related to missed opportunities for journal editors to engage with peer reviewers to clarify the expected roles and tasks.Further research is needed on actual performance of peer reviewers looking into the content of peer-reviewer reports to inform meaningful training interventions, journal policies and guidelines.

Introduction Systematic reviews evaluating the impact of interventions to improve the quality of peer review for biomedical publications highlighted that interventions were limited and have little impact. This study aims to compare the accuracy of early career peer reviewers who use an innovative online tool to the usual peer reviewer process in evaluating the completeness of reporting and switched primary outcomes in completed reports. Methods and analysis This is a cross-sectional study of individual two-arm parallel-group randomised controlled trials (RCTs) published in the BioMed Central series medical journals, BMJ, BMJ Open and Annals of Emergency Medicine and indexed with the publication type ‘Randomised Controlled Trial’. First, we will develop an online tool and training module based (a) on the Consolidated Standards of Reporting Trials (CONSORT) 2010 checklist and the Explanation and Elaboration document that would be dedicated to junior peer reviewers for assessing the completeness of reporting of key items and (b) the Centre for Evidence-Based Medicine Outcome Monitoring Project process used to identify switched outcomes in completed reports of the primary results of RCTs when initially submitted. Then, we will compare the performance of early career peer reviewers who use the online tool to the usual peer review process in identifying inadequate reporting and switched outcomes in completed reports of RCTs at initial journal submission. The primary outcome will be the mean number of items accurately classified per manuscript. The secondary outcomes will be the mean number of items accurately classified per manuscript for the CONSORT items and the sensitivity, specificity and likelihood ratio to detect the item as adequately reported and to identify a switch in outcomes. We aim to include 120 RCTs and 120 early career peer reviewers. Ethics and dissemination The research protocol was approved by the ethics committee of the INSERM Institutional Review Board (21 January 2016). The study is based on voluntary participation and informed written consent. Trial registration number NCT03119376.