Back to Search Start Over

Computational Reproducibility in Finance: Evidence from 1,000 Tests.

Authors :
Pérignon, Christophe
Akmansoy, Olivier
Hurlin, Christophe
Dreber, Anna
Holzmeister, Felix
Huber, Jürgen
Johannesson, Magnus
Kirchler, Michael
Menkveld, Albert J
Razen, Michael
Weitzel, Utz
Source :
Review of Financial Studies; Nov2024, Vol. 37 Issue 11, p3558-3593, 36p
Publication Year :
2024

Abstract

We analyze the computational reproducibility of more than 1,000 empirical answers to 6 research questions in finance provided by 168 research teams. Running the researchers' code on the same raw data regenerates exactly the same results only 52% of the time. Reproducibility is higher for researchers with better coding skills and those exerting more effort. It is lower for more technical research questions, more complex code, and results lying in the tails of the distribution. Researchers exhibit overconfidence when assessing the reproducibility of their own research. We provide guidelines for finance researchers and discuss implementable reproducibility policies for academic journals. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
08939454
Volume :
37
Issue :
11
Database :
Complementary Index
Journal :
Review of Financial Studies
Publication Type :
Academic Journal
Accession number :
180336219
Full Text :
https://doi.org/10.1093/rfs/hhae029