Back to Search Start Over

Responsible Research Assessment Should Prioritize Theory Development and Testing Over Ticking Open Science Boxes

Authors :
Dames, Hannah; https://orcid.org/0000-0001-5800-9401
Musfeld, Philipp
Popov, Vencislav; https://orcid.org/0000-0002-8073-4199
Oberauer, Klaus; https://orcid.org/0000-0003-3902-7318
Frischkorn, Gidon T; https://orcid.org/0000-0002-5055-9764
Dames, Hannah; https://orcid.org/0000-0001-5800-9401
Musfeld, Philipp
Popov, Vencislav; https://orcid.org/0000-0002-8073-4199
Oberauer, Klaus; https://orcid.org/0000-0003-3902-7318
Frischkorn, Gidon T; https://orcid.org/0000-0002-5055-9764
Source :
Dames, Hannah; Musfeld, Philipp; Popov, Vencislav; Oberauer, Klaus; Frischkorn, Gidon T (2023). Responsible Research Assessment Should Prioritize Theory Development and Testing Over Ticking Open Science Boxes. PsyArXiv Preprints ad74m, Cornell University.
Publication Year :
2023

Abstract

We appreciate the initiative to seek for ways to improve academic assessment by broadening the range of relevant research contributions and by considering a candidate’s scientific rigor. Evaluating a candidate's ability to contribute to science is a complex process that cannot be captured through one metric alone. While the proposed changes have some advantages, such as an increased focus on quality over quantity, the proposal's focus on adherence to open science practices is not sufficient, as it undervalues theory building and formal modelling: A narrow focus on open science conventions is neither a sufficient nor valid indicator for a “good scientist” and may even encourage researchers to choose easy, pre-registerable studies rather than engage in time-intensive theory building. Further, when in a first step only a minimum standard for following easily achievable open science goals is set, most applicants will soon pass this threshold. At this point, one may ask if the additional benefit of such a low bar outweighs the potential costs of such an endeavour. We conclude that a reformed assessment system should put at least equal emphasis on theory building and adherence to open science principles and should not completely disregard traditional performance metrices.

Details

Database :
OAIster
Journal :
Dames, Hannah; Musfeld, Philipp; Popov, Vencislav; Oberauer, Klaus; Frischkorn, Gidon T (2023). Responsible Research Assessment Should Prioritize Theory Development and Testing Over Ticking Open Science Boxes. PsyArXiv Preprints ad74m, Cornell University.
Notes :
application/pdf, info:doi/10.5167/uzh-233460, English, English
Publication Type :
Electronic Resource
Accession number :
edsoai.on1443051809
Document Type :
Electronic Resource