Search

Dijksterhuis and van Knippenberg (1998) reported that participants primed with a category associated with intelligence ("professor") subsequently performed 13% better on a trivia test than participants primed with a category associated with a lack of intelligence ("soccer hooligans"). In two unpublished replications of this study designed to verify the appropriate testing procedures, Dijksterhuis, van Knippenberg, and Holland observed a smaller difference between conditions (2%-3%) as well as a gender difference: Men showed the effect (9.3% and 7.6%), but women did not (0.3% and -0.3%). The procedure used in those replications served as the basis for this multilab Registered Replication Report. A total of 40 laboratories collected data for this project, and 23 of these laboratories met all inclusion criteria. Here we report the meta-analytic results for those 23 direct replications (total N = 4,493), which tested whether performance on a 30-item general-knowledge trivia task differed between these two priming conditions (results of supplementary analyses of the data from all 40 labs, N = 6,454, are also reported). We observed no overall difference in trivia performance between participants primed with the "professor" category and those primed with the "hooligan" category (0.14%) and no moderation by gender.

People often fail to solve deceptively simple mathematical problems, a tendency popularly demonstrated by the bat-and-ball problem. The most prominent explanation of this finding is that, to spare cognitive effort, people substitute the difficult task with an easier one, without being aware of the substitution. Despite this latter assumption, recent studies have found decreased levels of post-decision confidence ratings when people gave the answer of an easier calculation, suggesting that people are sensitive to their errors. In the current study, we investigated a mechanism that might be responsible for such a decrease in people's confidence ratings when they make errors: their attempts to make certain that their answer is correct (verification) and the perceived level of task difficulty (verifiability). We found that these two factors predicted people's confidence, suggesting that people's self-assessment of the perceived task difficulty and of their attempt to verify their response might determine their confidence. Implication for current models of post-decision confidence on reasoning problems is discussed., (Copyright © 2017 Elsevier B.V. All rights reserved.)

Quantifying evidence is an inherent aim of empirical science, yet the customary statistical methods in psychology do not communicate the degree to which the collected data serve as evidence for the tested hypothesis. In order to estimate the distribution of the strength of evidence that individual significant results offer in psychology, we calculated Bayes factors (BF) for 287,424 findings of 35,515 articles published in 293 psychological journals between 1985 and 2016. Overall, 55% of all analyzed results were found to provide BF > 10 (often labeled as strong evidence) for the alternative hypothesis, while more than half of the remaining results do not pass the level of BF = 3 (labeled as anecdotal evidence). The results estimate that at least 82% of all published psychological articles contain one or more significant results that do not provide BF > 10 for the hypothesis. We conclude that due to the threshold of acceptance having been set too low for psychological findings, a substantial proportion of the published results have weak evidential support.