1. Reproducibility Certification in Economics Research
- Author
-
Christophe Pérignon, Christophe Hurlin, Jean-Edouard Colliard, Laboratoire d'économie d'Orleans (LEO), Université d'Orléans (UO)-Centre National de la Recherche Scientifique (CNRS), Groupement de Recherche et d'Etudes en Gestion à HEC (GREGH), Ecole des Hautes Etudes Commerciales (HEC Paris)-Centre National de la Recherche Scientifique (CNRS), and HEC Research Paper Series
- Subjects
History ,Polymers and Plastics ,Computer science ,Process (engineering) ,Certification ,Industrial and Manufacturing Engineering ,confidential data ,0502 economics and business ,Agency (sociology) ,open science ,JEL: C - Mathematical and Quantitative Methods/C.C8 - Data Collection and Data Estimation Methodology • Computer Programs/C.C8.C88 - Other Computer Software ,replicability ,Confidentiality ,050207 economics ,Business and International Management ,Publication process ,050205 econometrics ,Reproducibility ,05 social sciences ,Trusted third party ,peer-review process ,Risk analysis (engineering) ,JEL: C - Mathematical and Quantitative Methods/C.C8 - Data Collection and Data Estimation Methodology • Computer Programs/C.C8.C81 - Methodology for Collecting, Estimating, and Organizing Microeconomic Data • Data Access ,Key (cryptography) ,JEL: C - Mathematical and Quantitative Methods/C.C8 - Data Collection and Data Estimation Methodology • Computer Programs/C.C8.C80 - General ,[SHS.GESTION]Humanities and Social Sciences/Business administration ,data availability policy - Abstract
Reproducibility is key for building trust in research, yet it is not widespread in economics. We show how external certification can improve reproducibility in economics research. Such certification can be conducted by a trusted third party or agency, which formally tests whether a given result is indeed generated by the code and data used by a researcher. This additional validation step significantly enriches the peer-review process, without adding an extra burden on journals or unduly lengthening the publication process. We show that external certification can accommodate research based on confidential data. Lastly, we present an actual example of external certification.
- Published
- 2020