Back to Search Start Over

Developing expert political judgment: The impact of training and practice on judgmental accuracy in geopolitical forecasting tournaments.

Authors :
Chang, Welton
Chen, Eva
Mellers, Barbara
Tetlock, Philip
Source :
Judgment & Decision Making; Sep2016, Vol. 11 Issue 5, p509-526, 18p
Publication Year :
2016

Abstract

The heuristics-and-biases research program highlights reasons for expecting people to be poor intuitive forecasters. This article tests the power of a cognitive-debiasing training module ("CHAMPS KNOW") to improve probability judgments in a four-year series of geopolitical forecasting tournaments sponsored by the U.S. intelligence community. Although the training lasted less than one hour, it consistently improved accuracy (Brier scores) by 6 to 11% over the control condition. Cognitive ability and practice also made largely independent contributions to predictive accuracy. Given the brevity of the training tutorials and the heterogeneity of the problems posed, the observed effects are likely to be lower-bound estimates of what could be achieved by more intensive interventions. Future work should isolate which prongs of the multipronged CHAMPS KNOW training were most effective in improving judgment on which categories of problems. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
19302975
Volume :
11
Issue :
5
Database :
Complementary Index
Journal :
Judgment & Decision Making
Publication Type :
Academic Journal
Accession number :
118664059
Full Text :
https://doi.org/10.1017/s1930297500004599