1. Beware performative reproducibility
- Author
-
Stuart Buck
- Subjects
Medical Journals ,Science Policy ,Conflicts of Interest ,Performative utterance ,Research and Analysis Methods ,Research management ,Research Funding ,Open Science ,Medicine and Health Sciences ,Government Funding of Science ,Research Integrity ,Scientific Publishing ,Multidisciplinary ,Applied Mathematics ,Simulation and Modeling ,Reproducibility of Results ,Research Assessment ,Reproducibility ,Aesthetics ,Citation Analysis ,Physical Sciences ,Psychology ,Medical Humanities ,Mathematics ,Algorithms ,Research Article ,Gesture - Abstract
Recent concerns about the reproducibility of science have led to several calls for more open and transparent research practices and for the monitoring of potential improvements over time. However, with tens of thousands of new biomedical articles published per week, manually mapping and monitoring changes in transparency is unrealistic. We present an open-source, automated approach to identify 5 indicators of transparency (data sharing, code sharing, conflicts of interest disclosures, funding disclosures, and protocol registration) and apply it across the entire open access biomedical literature of 2.75 million articles on PubMed Central (PMC). Our results indicate remarkable improvements in some (e.g., conflict of interest [COI] disclosures and funding disclosures), but not other (e.g., protocol registration and code sharing) areas of transparency over time, and map transparency across fields of science, countries, journals, and publishers. This work has enabled the creation of a large, integrated, and openly available database to expedite further efforts to monitor, understand, and promote transparency and reproducibility in science., This study uses novel open source automated tools to monitor transparency across all 2.75 million open access articles on PubMed Central, discovering that different disciplines, journals and publishers abide by principles of transparency to varying degrees over time.
- Published
- 2021
- Full Text
- View/download PDF