Search

Your search keyword '"van der Hulst, Marije"' showing total 127 results
Start Over Author "van der Hulst, Marije"
127 results on '"van der Hulst, Marije"'

6. ONLINE MONITORING OF FOCAL SPASTICITY TREATMENT WITH BOTULINUM TOXIN IN PEOPLE WITH CHRONIC STROKE OR HEREDITARY SPASTIC PARAPLEGIA: A FEASIBILITY STUDY

Author

Kerstens, C.J.W., Nijkrake, M.J., de Swart, B.J., Nijhuis-van der Sanden, M.W.G., Vos-van der Hulst, Marije, Bos, G., Geurts, A.C.H., Wees, P.J. van der, Kerstens, C.J.W., Nijkrake, M.J., de Swart, B.J., Nijhuis-van der Sanden, M.W.G., Vos-van der Hulst, Marije, Bos, G., Geurts, A.C.H., and Wees, P.J. van der

Abstract

Item does not contain fulltext

Published
2023

7. Examining the role of intrinsic and reflexive contributions to ankle joint hyper-resistance treated with botulinum toxin-A

Author

van’t Veld, Ronald C. (author), Flux, Eline (author), van Oorschot, Wieneke (author), Schouten, A.C. (author), van der Krogt, Marjolein M. (author), van der Kooij, H. (author), Vos-van der Hulst, Marije (author), Keijsers, Noël L.W. (author), van Asseldonk, Edwin H.F. (author), van’t Veld, Ronald C. (author), Flux, Eline (author), van Oorschot, Wieneke (author), Schouten, A.C. (author), van der Krogt, Marjolein M. (author), van der Kooij, H. (author), Vos-van der Hulst, Marije (author), Keijsers, Noël L.W. (author), and van Asseldonk, Edwin H.F. (author)

Abstract

Background: Spasticity, i.e. stretch hyperreflexia, increases joint resistance similar to symptoms like hypertonia and contractures. Botulinum neurotoxin-A (BoNT-A) injections are a widely used intervention to reduce spasticity. BoNT-A effects on spasticity are poorly understood, because clinical measures, e.g. modified Ashworth scale (MAS), cannot differentiate between the symptoms affecting joint resistance. This paper distinguishes the contributions of the reflexive and intrinsic pathways to ankle joint hyper-resistance for participants treated with BoNT-A injections. We hypothesized that the overall joint resistance and reflexive contribution decrease 6 weeks after injection, while returning close to baseline after 12 weeks. Methods: Nine participants with spasticity after spinal cord injury or after stroke were evaluated across three sessions: 0, 6 and 12 weeks after BoNT-A injection in the calf muscles. Evaluation included clinical measures (MAS, Tardieu Scale) and motorized instrumented assessment using the instrumented spasticity test (SPAT) and parallel-cascade (PC) system identification. Assessments included measures for: (1) overall resistance from MAS and fast velocity SPAT; (2) reflexive resistance contribution from Tardieu Scale, difference between fast and slow velocity SPAT and PC reflexive gain; and (3) intrinsic resistance contribution from slow velocity SPAT and PC intrinsic stiffness/damping. Results: Individually, the hypothesized BoNT-A effect, the combination of a reduced resistance (week 6) and return towards baseline (week 12), was observed in the MAS (5 participants), fast velocity SPAT (2 participants), Tardieu Scale (2 participants), SPAT (1 participant) and reflexive gain (4 participants). On group-level, the hypothesis was only confirmed for the MAS, which showed a significant resistance reduction at week 6. All instrumented measures were strongly correlated when quantifying the same resistance contribution. Conclusion: At group-leve, Biomechanical Engineering, Support Biomechanical Engineering

Published
2023
Full Text
View/download PDF

10. Data

Author

Neijenhuijs, Koen, Luteijn, Ilse, Bosch, Annick, van der Hulst, Marije, Dorsthorst, Anniek, van de Ven, Mathijs, and Weerdmeester, Johanna

Published
2022
Full Text
View/download PDF

11. Materials

Author

Neijenhuijs, Koen, van de Ven, Mathijs, Weerdmeester, Johanna, Dorsthorst, Anniek, van der Hulst, Marije, Bosch, Annick, and Luteijn, Ilse

Published
2022
Full Text
View/download PDF

12. The association between breastfeeding and maternal bonding, maternal sensitivity and infant attachment security: A systematic review and meta-analysis

Author

Tharner, Anne, Kok, Rianne, van der Hulst, Marije, and Bertens, Loes

Subjects
Medicine and Health Sciences, Social and Behavioral Sciences
Abstract

In this study, we aim to systematically review the scientific literature with regard to the association between breastfeeding and several aspects of the mother-infant relationship, i.e. maternal sensitivity, maternal bonding, and mother-infant attachment security. This preregistration is an update of a preregistration started in Prospero: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=91027 The preregistration is updated for the following reasons: (1) new authors have been added; (2) the systematic review has been picked up again after a period of inactivity. Because the original preregistration could not be changed in Prospero, a new preregistration was started. The objectives and methods have not been changed, only elaborated on. This work was supported by “Stichting de Verre Bergen”, a philanthropic foundation that supports innovative ideas and research that have a positive impact on the municipality of Rotterdam.

Published
2022
Full Text
View/download PDF

14. Reproducibility Project: Psychology

Author

Anderson, Christopher, Anderson, Joanna, van Assen, Marcel, Attridge, Peter, Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, van den Bergh, Don, Beyan, Leah, den Bezemer, Bobby, Borsboom, Denny, Bosch, Annick, Bosco, Frank, Bowman, Sara, Brandt, Mark, Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin, Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon, Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher, Cheung, Felix, Chu, Phuonguyen, Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark, Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Costantini, Giulio, Cramblet Alvarez, Leslie, Cremata, Edward, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle, Della Penna, Nicolás, Deserno, Marie, Devitt, Olivia, Dewitte, Laura, DiGiacomo, Philip, Dobolyi, David, Dodson, Geneva, Donnellan, Brent, Donohue, Ryan, van Dooren, Roel, van Doorn, Johnny, Dore, Rebecca, Dorrough, Angela, Dorsthorst, Anniek, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth, Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy, Estel, Vivien, Farach, Frank, Feather, Jenelle, Fedor, Anna, Fernández, Belén, Fiedler, Susann, Field, James, Fitneva, Stanka, Flagan, Taru, Forest, Amanda, Forsell, Eskil, Foster, Joshua, Frank, Michael, Frazier, Rebecca, Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin, Goldberg, Rebecca, Goldinger, Stephen, Goodbourn, Patrick, Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Gray, Jeremy, Hartgerink, Chris, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hicks, Grace, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Geertje, van der Hulst, Marije, Humphries, Denise, Hung, Cathy, Immelman, Nathali, Irsik, Vanessa, Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, David, Johnson-Grey, Kate, Johnson, Larissa, Johnston, William, Jonas, Kai, Joy-Gaba, Jennifer, Kappes, Heather, Kelso, Kim, Kidwell, Mallory, Kim, Seung, Kirkhart, Matthew, Kleinberg, Bennett, Knezevic, Goran, Kolorz, Franziska, Krause, Robert, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram, Kyc, Megan, Lai, Calvin, Laique, Aamir, Lakens, Daniel, Lane, Kristin, Lassetter, Bethany, Lazarevic, Ljiljana, LeBel, Etienne, Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel, Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Lumian, Daniel, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather, Marigold, Denise, Martin, Daniel, Martinez, Tylar, Masicampo, E.J., Matacotta, Joshua, Mathur, Maya, May, Michael, McRae, Kateri, McElroy, Todd, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy, Smith, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie, Munafo, Marcus, Muñoz, Alisa, Neijenhuijs, Koen, Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian, Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason, Ratliff, Kate, Reinhard, David, Renkewitz, Frank, van Renswoude, Daan, Ricker, Ashley, Rigney, Anastasia, van Rijn, Hedderik, Rivers, Andrew, Roebke, Mark, Rutchick, Abraham, Ryan, Robert, Sahin, Onur, Saide, Anondah, Sandstrom, Gillian, Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan, Shaki, Samuel, Simpson, William, Sinclair, H., Skorinko, Jeanine, Slowik, Agnieszka, Snyder, Joel, Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nicholas, Spies, Jeffrey, Staples, Angela, steegen, sara, Steinberg, Mia, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin, Talhelm, Thomas, Tapia, Megan, Thomae, Manuela, Toton, Sarah, Tibboel, Helen, Tio, Pia, Traets, Frits, Tsang, Steve, tuerlinckx, francis, Tullett, Alexa, Turchan, Paul, vanpaemel, wolf, Vásquez-Echeverría, Alejandro, van 't Veer, Anna, Vélez, Natalia, van de Ven, Mathijs, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Johanna, Welsh, Ashlee, Westgate, Erin, Wissink, Joeri, Wood, Michael, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Hartshorne, Joshua, and Grange, James

Subjects
reproduction, metascience, replication, psychological science, open science, psychology, crowdsource, reproducibility
Abstract

Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available.

Published
2022
Full Text
View/download PDF

15. Many Labs 2: Investigating Variation in Replicability Across Sample and Setting

Author

Salomon , Erika, Smith-Castro , Vanessa, Chang , Jen-Ho, Collisson , Brian, Malingumu , Winfrida, Karick , Haruna, Cambier , Fanny, Eller , Anja, Coleman , Jennifer, Kovacs , Carrie, Williams , Lisa, Pinter , Brad, Vranka , Marek, Packard , Grant, Zelenski , John, Sundfelt , Oskar, Hall , Michael, Thomae , Manuela, Schmidt , Kathleen, Haigh , Matthew, Finck , Carolyn, Galliani , Elisa, Steiner , Troy, Bernstein , Michael, Ebersole , Charles, Tybur , Joshua, Dunham , Yarrow, Stouten , Jeroen, Coen , Sharon, Smith , Michael, Gnambs , Timo, Hicks , Joshua, Giessner , Steffen, Osowiecka , Malgorzata, Devos , Thierry, Mallett , Robyn, English , Alexander, Nelson , Anthony, Cheong , Winnee, Petrovic , Boban, Ujhelyi , Adrienn, Gonzalez , Roberto, Berkics , Mihaly, Graham , Jesse, Nichols , Austin, Dozo , Nerisa, Tang , Andrew, Szumowska , Ewa, Skorinko , Jeanine, Rosa , Anna, Haines , Elizabeth, Myachykov , Andriy, Carmichael , Cheryl, Maitner , Angela, Vega , Diego, Van Der Hulst , Marije, Oikawa , Masanori, Ghoshal , Tanuka, Frankowska , Natalia, Saavedra , Patricio, Keller , Victor, Torres-Fernández , David, Huntsinger , Jeffrey, Sirlopu , David, ODonnell , Susan, Bialobrzeska , Olga, Levitan , Carmel, Berry , Daniel, Spachtholz , Philipp, Curran , Paul, Traczyk , Jakub, Kurapov , German, Kurtz , Jaime, Lakens , Daniel, Sacco , Airi, Corker , Katherine, Durrheim , Kevin, Chandler , Jesse, Cai , Huajian, Jimenez-Leal , William, Easterbrook , Matthew, Maassen , Esther, Saeri , Alexander, Brandt , Mark, Cantarero , Katarzyna, Hai , Kakul, Heffernan , Marie, Kende , Anna, Doğulu , Canay, Karabati , Serdar, Freyre , Miguel-Ángel, Voermans, Ingrid, Huynh , Ho, Busching , Robert, Nosek , Brian, Woodzicka , Julie, John , Melissa-Sue, Orosz , Gabor, Coen, Sharon, Van T Veer , Anna, Joy-Gaba , Jennifer, Dukes , Kristin, Marotta , Satia, Welch , Cheryl, Tear , Morgan, Lazarevic , Ljiljana, Kamiloglu , Roza, Van Assen , Marcel, Međedović , Janko, Podesta , Lysandra, Pollmann , Monique, Schönbrodt , Felix, Theriault , Jordan, De Bruijn , Maaike, Sekerdej , Maciek, Ms Ms, Alexandra, Pr. Pr., Nicolas, Grahe , Jon, Neto , Felix, Conway , Morgan, Klein , Richard, Mcintyre , Jason, Murphy , Sean, Adams Jr., Reginald, Kappes , Heather, Cushman , Fiery, Street , Chris, Wichman , Aaron, Lewis Jr., Neil, Babalola , Mayowa, Alper , Sinan, Hasselman , Fred, Aveyard , Mark, Saavedra, Patricio, Babalola, Mayowa, Torres-Fernández, David, Vianello , Michelangelo, Adams , Byron, Barlow , Fiona, Axt , Jordan, Bahník , Štěpán, Young , Liane, Sowden, Walter, Knezevic , Goran, Verschoor , Mark, Tanzer , Norbert, Edlund , John, De Vries, Marieke, Vaughn , Leigh, Morris , Wendy, Lins , Samuel, Rutchick , Abraham, Krueger , Lacy, Ijzerman , Hans, Green , Eva, Davis , William, Inbar , Yoel, Sobkow , Agata, Cicero , David, Bocian , Konrad, Houdek , Petr, Chatard , Armand, Gomez , Angel, Innes-Ker , Åse, Dalgar , Ilker, Echeverría , Alejandro, Milfont , Taciano, Cemalcilar , Zeynep, Wronska , Marta, Gill , Tripat, Verniers , Catherine, Pilati , Ronaldo, Friedman , Mike, Grahek , Ivan, Chen , Eva, Neijenhuijs , Koen, Pérez , Rolando, Kappes , Andreas, and Coen, S

Subjects
manylabs, PsyArXiv|Social and Behavioral Sciences, replication, bepress|Social and Behavioral Sciences, PsyArXiv|Social and Behavioral Sciences|Cognitive Psychology, bepress|Social and Behavioral Sciences|Psychology|Personality and Social Contexts, bepress|Social and Behavioral Sciences|Psychology|Quantitative Psychology, PsyArXiv|Social and Behavioral Sciences|Quantitative Methods, psychology, PsyArXiv|Social and Behavioral Sciences|Social and Personality Psychology, WEIRD, bepress|Social and Behavioral Sciences|Psychology|Cognitive Psychology
Abstract

We conducted preregistered replications of 28 classic and contemporary published findings with protocols that were peer reviewed in advance to examine variation in effect magnitudes across sample and setting. Each protocol was administered to approximately half of 125 samples and 15,305 total participants from 36 countries and territories. Using conventional statistical significance (p < .05), fifteen (54%) of the replications provided evidence in the same direction and statistically significant as the original finding. With a strict significance criterion (p < .0001), fourteen (50%) provide such evidence reflecting the extremely high powered design. Seven (25%) of the replications had effect sizes larger than the original finding and 21 (75%) had effect sizes smaller than the original finding. The median comparable Cohen’s d effect sizes for original findings was 0.60 and for replications was 0.15. Sixteen replications (57%) had small effect sizes (< .20) and 9 (32%) were in the opposite direction from the original finding. Across settings, 11 (39%) showed significant heterogeneity using the Q statistic and most of those were among the findings eliciting the largest overall effect sizes; only one effect that was near zero in the aggregate showed significant heterogeneity. Only one effect showed a Tau > 0.20 indicating moderate heterogeneity. Nine others had a Tau near or slightly above 0.10 indicating slight heterogeneity. In moderation tests, very little heterogeneity was attributable to task order, administration in lab versus online, and exploratory WEIRD versus less WEIRD culture comparisons. Cumulatively, variability in observed effect sizes was more attributable to the effect being studied than the sample or setting in which it was studied.\ud \ud Data, materials and code available at: https://osf.io/8cd4r/

Published
2022
Full Text
View/download PDF

17. Early Maternal Caregiving Capacities in Highly Vulnerable, Multi-Problem Families

Author

van der Hulst, Marije, Kok, Rianne, Prinzie, Peter, Steegers, Eric, Bertens, L.C.M., van der Hulst, Marije, Kok, Rianne, Prinzie, Peter, Steegers, Eric, and Bertens, L.C.M.

Abstract

Caregiving capacities may be an important link between multi-problem circumstances and adverse child development. This study aims to assess caregiving capacities and their correlations in highly vulnerable, multi-problem families in Rotterdam, the Netherlands. Caregiving capacity (overall, emotional and instrumental) was prospectively assessed in 83 highly vulnerable women using video-observations of daily caregiving tasks, six week postpartum. Supporting data were collected at three time points: at inclusion, six weeks after inclusion and six weeks postpartum, and these included psychological symptoms, self-sufficiency, problematic life domains, home environment, income, depression, anxiety and stress. Pregnancy- and delivery-related information was collected from obstetric care professionals. Maternal caregiving scores averaged below adequate quality. Mothers living in an unsafe home environment (B = 0.62) and mothers with more problematic life domains (≤3 domains, B = 0.32) showed significantly higher instrumental caregiving capacities. Other variables were not related to caregiving capacities. Caregiving capacity in this highly vulnerable population was below adequate quality. However, in most cases there was no significant association between caregiving and the variables related to vulnerability. This means that a potential association between vulnerability and caregiving capacities might be driven by the interaction between several problems, rather than the type or number of problems.

Published
2022

18. Socio-economic determinants of healthcare costs in early life:a register-based study in the Netherlands

Author

van der Hulst, Marije, Polinder, Suzanne, Kok, Rianne, Prinzie, Peter, de Groot, Marijke W., Burdorf, Alex, Bertens, Loes C.M., van der Hulst, Marije, Polinder, Suzanne, Kok, Rianne, Prinzie, Peter, de Groot, Marijke W., Burdorf, Alex, and Bertens, Loes C.M.

Abstract

Background: Children with low socioeconomic status (SES) have an increased risk of a suboptimal start in life with ensuing higher healthcare costs. This study aims to investigate the effects of individual- (monthly household income) and contextual-level SES (household income and neighborhood deprivation), and perinatal morbidity (preterm birth and small for gestational age ((<10th percentile), SGA)) on healthcare costs in early life (0–3 years of age). Methods: Individual-linked data from three national registries (Perinatal Registry Netherlands, Statistics Netherlands, and Healthcare Vektis) were obtained of all children born between 2011 and 2014 (N = 480,471) in the Netherlands. Binomial logistic regression was used to model annual healthcare costs as a function of their household income (per €1000), neighborhood deprivation index (range − 13.26 – 10.70), their perinatal morbidity and demographic characteristics. Annual healthcare cost were dichotomized into low healthcare costs (Q1-Q3 below €1000) and high healthcare costs (Q4 €1000 or higher). Results: Children had a median of €295 annual healthcare costs, ranging from €72 to €4299 (5–95%). Binomial logistic regression revealed that for every €1000 decrease in monthly household income, the OR for having high healthcare costs is 0.99 (0.99–0.99). Furthermore, for every one-unit increase in neighborhood deprivation the OR for having high healthcare costs increase 1.02 (1.01–1.02). Finally, the model revealed an OR of 2.55 (2.48–2.61) for preterm born children, and an OR of 1.44 (1.41–1.48) for children SGA, to have high healthcare costs compared to their healthy peers. Conclusion: More neighborhood deprivation was directly related to higher healthcare costs in young children. On top of this, lower household income was consistently and independently related to higher healthcare costs. By optimizing conditions for low SES populations, the impact of low SES circumstances on their healthcare costs can be positi

Published
2022

19. Examining the role of intrinsic and reflexive contributions to ankle joint hyper-resistance treated with botulinum toxin-A.

Author

van't Veld, Ronald C., Flux, Eline, van Oorschot, Wieneke, Schouten, Alfred C., van der Krogt, Marjolein M., van der Kooij, Herman, Vos-van der Hulst, Marije, Keijsers, Noël L. W., and van Asseldonk, Edwin H. F.

Subjects
ANKLE joint, BOTULINUM A toxins, BOTULINUM toxin, CALF muscles, SYSTEM identification, SPINAL cord injuries, STROKE
Abstract

Background: Spasticity, i.e. stretch hyperreflexia, increases joint resistance similar to symptoms like hypertonia and contractures. Botulinum neurotoxin-A (BoNT-A) injections are a widely used intervention to reduce spasticity. BoNT-A effects on spasticity are poorly understood, because clinical measures, e.g. modified Ashworth scale (MAS), cannot differentiate between the symptoms affecting joint resistance. This paper distinguishes the contributions of the reflexive and intrinsic pathways to ankle joint hyper-resistance for participants treated with BoNT-A injections. We hypothesized that the overall joint resistance and reflexive contribution decrease 6 weeks after injection, while returning close to baseline after 12 weeks. Methods: Nine participants with spasticity after spinal cord injury or after stroke were evaluated across three sessions: 0, 6 and 12 weeks after BoNT-A injection in the calf muscles. Evaluation included clinical measures (MAS, Tardieu Scale) and motorized instrumented assessment using the instrumented spasticity test (SPAT) and parallel-cascade (PC) system identification. Assessments included measures for: (1) overall resistance from MAS and fast velocity SPAT; (2) reflexive resistance contribution from Tardieu Scale, difference between fast and slow velocity SPAT and PC reflexive gain; and (3) intrinsic resistance contribution from slow velocity SPAT and PC intrinsic stiffness/damping. Results: Individually, the hypothesized BoNT-A effect, the combination of a reduced resistance (week 6) and return towards baseline (week 12), was observed in the MAS (5 participants), fast velocity SPAT (2 participants), Tardieu Scale (2 participants), SPAT (1 participant) and reflexive gain (4 participants). On group-level, the hypothesis was only confirmed for the MAS, which showed a significant resistance reduction at week 6. All instrumented measures were strongly correlated when quantifying the same resistance contribution. Conclusion: At group-level, the expected joint resistance reduction due to BoNT-A injections was only observed in the MAS (overall resistance). This observed reduction could not be attributed to an unambiguous group-level reduction of the reflexive resistance contribution, as no instrumented measure confirmed the hypothesis. Validity of the instrumented measures was supported through a strong association between different assessment methods. Therefore, further quantification of the individual contributions to joint resistance changes using instrumented measures across a large sample size are essential to understand the heterogeneous response to BoNT-A injections. [ABSTRACT FROM AUTHOR]

Published
2023
Full Text
View/download PDF

27. Incidence of urinary tract infection following initiation of intermittent catheterization among patients with recent spinal cord injury in Germany and the Netherlands

Author

Berger, Ariel, primary, Goldstine, Jimena, additional, Hofstad, Cheriel, additional, Inglese, Gary W., additional, Kirschner-Hermanns, Ruth, additional, MacLachlan, Sharon, additional, Shah, Surbhi, additional, Vos-van der Hulst, Marije, additional, and Weiss, Jerome, additional

Published
2020
Full Text
View/download PDF

32. Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

Author

Klein, Richard A., primary, Vianello, Michelangelo, additional, Hasselman, Fred, additional, Adams, Byron G., additional, Adams, Reginald B., additional, Alper, Sinan, additional, Aveyard, Mark, additional, Axt, Jordan R., additional, Babalola, Mayowa T., additional, Bahník, Štěpán, additional, Batra, Rishtee, additional, Berkics, Mihály, additional, Bernstein, Michael J., additional, Berry, Daniel R., additional, Bialobrzeska, Olga, additional, Binan, Evans Dami, additional, Bocian, Konrad, additional, Brandt, Mark J., additional, Busching, Robert, additional, Rédei, Anna Cabak, additional, Cai, Huajian, additional, Cambier, Fanny, additional, Cantarero, Katarzyna, additional, Carmichael, Cheryl L., additional, Ceric, Francisco, additional, Chandler, Jesse, additional, Chang, Jen-Ho, additional, Chatard, Armand, additional, Chen, Eva E., additional, Cheong, Winnee, additional, Cicero, David C., additional, Coen, Sharon, additional, Coleman, Jennifer A., additional, Collisson, Brian, additional, Conway, Morgan A., additional, Corker, Katherine S., additional, Curran, Paul G., additional, Cushman, Fiery, additional, Dagona, Zubairu K., additional, Dalgar, Ilker, additional, Dalla Rosa, Anna, additional, Davis, William E., additional, de Bruijn, Maaike, additional, De Schutter, Leander, additional, Devos, Thierry, additional, de Vries, Marieke, additional, Doğulu, Canay, additional, Dozo, Nerisa, additional, Dukes, Kristin Nicole, additional, Dunham, Yarrow, additional, Durrheim, Kevin, additional, Ebersole, Charles R., additional, Edlund, John E., additional, Eller, Anja, additional, English, Alexander Scott, additional, Finck, Carolyn, additional, Frankowska, Natalia, additional, Freyre, Miguel-Ángel, additional, Friedman, Mike, additional, Galliani, Elisa Maria, additional, Gandi, Joshua C., additional, Ghoshal, Tanuka, additional, Giessner, Steffen R., additional, Gill, Tripat, additional, Gnambs, Timo, additional, Gómez, Ángel, additional, González, Roberto, additional, Graham, Jesse, additional, Grahe, Jon E., additional, Grahek, Ivan, additional, Green, Eva G. T., additional, Hai, Kakul, additional, Haigh, Matthew, additional, Haines, Elizabeth L., additional, Hall, Michael P., additional, Heffernan, Marie E., additional, Hicks, Joshua A., additional, Houdek, Petr, additional, Huntsinger, Jeffrey R., additional, Huynh, Ho Phi, additional, IJzerman, Hans, additional, Inbar, Yoel, additional, Innes-Ker, Åse H., additional, Jiménez-Leal, William, additional, John, Melissa-Sue, additional, Joy-Gaba, Jennifer A., additional, Kamiloğlu, Roza G., additional, Kappes, Heather Barry, additional, Karabati, Serdar, additional, Karick, Haruna, additional, Keller, Victor N., additional, Kende, Anna, additional, Kervyn, Nicolas, additional, Knežević, Goran, additional, Kovacs, Carrie, additional, Krueger, Lacy E., additional, Kurapov, German, additional, Kurtz, Jamie, additional, Lakens, Daniël, additional, Lazarević, Ljiljana B., additional, Levitan, Carmel A., additional, Lewis, Neil A., additional, Lins, Samuel, additional, Lipsey, Nikolette P., additional, Losee, Joy E., additional, Maassen, Esther, additional, Maitner, Angela T., additional, Malingumu, Winfrida, additional, Mallett, Robyn K., additional, Marotta, Satia A., additional, Međedović, Janko, additional, Mena-Pacheco, Fernando, additional, Milfont, Taciano L., additional, Morris, Wendy L., additional, Murphy, Sean C., additional, Myachykov, Andriy, additional, Neave, Nick, additional, Neijenhuijs, Koen, additional, Nelson, Anthony J., additional, Neto, Félix, additional, Lee Nichols, Austin, additional, Ocampo, Aaron, additional, O’Donnell, Susan L., additional, Oikawa, Haruka, additional, Oikawa, Masanori, additional, Ong, Elsie, additional, Orosz, Gábor, additional, Osowiecka, Malgorzata, additional, Packard, Grant, additional, Pérez-Sánchez, Rolando, additional, Petrović, Boban, additional, Pilati, Ronaldo, additional, Pinter, Brad, additional, Podesta, Lysandra, additional, Pogge, Gabrielle, additional, Pollmann, Monique M. H., additional, Rutchick, Abraham M., additional, Saavedra, Patricio, additional, Saeri, Alexander K., additional, Salomon, Erika, additional, Schmidt, Kathleen, additional, Schönbrodt, Felix D., additional, Sekerdej, Maciej B., additional, Sirlopú, David, additional, Skorinko, Jeanine L. M., additional, Smith, Michael A., additional, Smith-Castro, Vanessa, additional, Smolders, Karin C. H. J., additional, Sobkow, Agata, additional, Sowden, Walter, additional, Spachtholz, Philipp, additional, Srivastava, Manini, additional, Steiner, Troy G., additional, Stouten, Jeroen, additional, Street, Chris N. H., additional, Sundfelt, Oskar K., additional, Szeto, Stephanie, additional, Szumowska, Ewa, additional, Tang, Andrew C. W., additional, Tanzer, Norbert, additional, Tear, Morgan J., additional, Theriault, Jordan, additional, Thomae, Manuela, additional, Torres, David, additional, Traczyk, Jakub, additional, Tybur, Joshua M., additional, Ujhelyi, Adrienn, additional, van Aert, Robbie C. M., additional, van Assen, Marcel A. L. M., additional, van der Hulst, Marije, additional, van Lange, Paul A. M., additional, van ’t Veer, Anna Elisabeth, additional, Vásquez- Echeverría, Alejandro, additional, Ann Vaughn, Leigh, additional, Vázquez, Alexandra, additional, Vega, Luis Diego, additional, Verniers, Catherine, additional, Verschoor, Mark, additional, Voermans, Ingrid P. J., additional, Vranka, Marek A., additional, Welch, Cheryl, additional, Wichman, Aaron L., additional, Williams, Lisa A., additional, Wood, Michael, additional, Woodzicka, Julie A., additional, Wronska, Marta K., additional, Young, Liane, additional, Zelenski, John M., additional, Zhijia, Zeng, additional, and Nosek, Brian A., additional

Published
2018
Full Text
View/download PDF

34. Many Labs 2: Investigating Variation in Replicability Across Sample and Setting

Author

Klein, Richard Anthony, primary, Vianello, Michelangelo, additional, Hasselman, Fred, additional, Adams, Byron Gregory, additional, Adams, Reginald B., additional, Alper, Sinan, additional, Aveyard, Mark, additional, Axt, Jordan, additional, Babalola, Mayowa Tosin, additional, Bahník, Štěpán, additional, Berkics, Mihaly, additional, Bernstein, Michael Jason, additional, Berry, Daniel R., additional, Bialobrzeska, Olga, additional, Bocian, Konrad, additional, Brandt, Mark, additional, Busching, Robert, additional, Cai, Huajian, additional, Cambier, Fanny, additional, Cantarero, Katarzyna, additional, Carmichael, Cheryl L, additional, Cemalcilar, Zeynep, additional, Chandler, Jesse J., additional, Chang, Jen-Ho, additional, Chatard, Armand, additional, CHEN, Eva, additional, Cheong, Winnee, additional, Cicero, David C, additional, Coen, Sharon, additional, Coleman, Jennifer A., additional, Collisson, Brian, additional, Conway, Morgan Anna, additional, Corker, Katherine S., additional, Curran, Paul G, additional, Cushman, Fiery Andrews, additional, Dalgar, Ilker, additional, Davis, William E., additional, de Bruijn, Maaike Jolise, additional, de Vries, Marieke, additional, Devos, Thierry, additional, Doğulu, Canay, additional, Dozo, Nerisa, additional, Dukes, Kristin Nicole, additional, Dunham, Yarrow, additional, Durrheim, Kevin, additional, Easterbrook, Matthew, additional, Ebersole, Charles R., additional, Edlund, John, additional, English, Alexander Scott, additional, Eller, Anja, additional, Finck, Carolyn, additional, Freyre, Miguel-Ángel, additional, Friedman, Mike, additional, Frankowska, Natalia, additional, Galliani, Elisa Maria, additional, Ghoshal, Tanuka, additional, Giessner, Steffen Robert, additional, Gill, Tripat, additional, Gnambs, Timo, additional, Gomez, Angel, additional, Gonzalez, Roberto, additional, Graham, Jesse, additional, Grahe, Jon E., additional, Grahek, Ivan, additional, Green, Eva, additional, Hai, Kakul, additional, Haigh, Matthew, additional, Haines, Elizabeth L., additional, Hall, Michael P., additional, Heffernan, Marie E., additional, Hicks, Joshua A., additional, Houdek, Petr, additional, van der Hulst, Marije, additional, Huntsinger, Jeffrey R., additional, Huynh, Ho Phi, additional, IJzerman, Hans, additional, Inbar, Yoel, additional, Innes-Ker, Åse, additional, Jimenez-Leal, William, additional, John, Melissa-Sue, additional, Joy-Gaba, Jennifer Alana, additional, Kamiloglu, Roza Gizem, additional, Kappes, Andreas, additional, Kappes, Heather Barry, additional, Karabati, Serdar, additional, Karick, Haruna, additional, Keller, Victor N., additional, Kende, Anna, additional, Kervyn, Nicolas /, additional, Knezevic, Goran, additional, Kovacs, Carrie, additional, Krueger, Lacy Elise, additional, Kurapov, German, additional, Kurtz, Jaime, additional, Lakens, Daniel, additional, Lazarevic, Ljiljana B., additional, Levitan, Carmel, additional, Lewis, Neil Anthony, additional, Lins, Samuel, additional, Maassen, Esther, additional, Maitner, Angela, additional, Malingumu, Winfrida, additional, Mallett, Robyn, additional, Marotta, Satia Adele, additional, McIntyre, Jason Cameron, additional, Međedović, Janko Mileta, additional, Milfont, Taciano L, additional, Morris, Wendy, additional, Myachykov, Andriy, additional, Murphy, Sean Christopher, additional, Neijenhuijs, Koen Ilja, additional, Nelson, Anthony J., additional, Neto, Felix Fernando Monteiro, additional, Nichols, Austin Lee, additional, O'Donnell, Susan L., additional, Oikawa, Masanori, additional, Orosz, Gabor, additional, Osowiecka, Malgorzata, additional, Packard, Grant, additional, Pérez, Rolando, additional, Petrovic, Boban, additional, Pilati, Ronaldo, additional, Pinter, Brad, additional, Podesta, Lysandra Maria, additional, Pollmann, Monique Maria Henriettte, additional, Dalla Rosa, Anna, additional, Rutchick, Abraham M., additional, Saavedra, Patricio, additional, Sacco, Airi, additional, Saeri, Alexander K, additional, Salomon, Erika, additional, Schmidt, Kathleen, additional, Schönbrodt, Felix D., additional, Sekerdej, Maciek Borys, additional, Sirlopu, David Ricardo, additional, Skorinko, Jeanine, additional, Smith, Michael A., additional, Smith-Castro, Vanessa, additional, Sobkow, Agata, additional, Sowden, Walter J., additional, Spachtholz, Philipp, additional, Steiner, Troy G., additional, Stouten, Jeroen, additional, Street, Chris N. H., additional, Sundfelt, Oskar, additional, Szumowska, Ewa, additional, Tang, Andrew, additional, Tanzer, Norbert K., additional, Tear, Morgan James, additional, Theriault, Jordan E., additional, Thomae, Manuela, additional, Torres-Fernández, David, additional, Traczyk, Jakub, additional, Tybur, Joshua M., additional, Ujhelyi, Adrienn, additional, van Assen, Marcel A. L. M., additional, van 't Veer, Anna Elisabeth, additional, Vásquez-Echeverría, Alejandro, additional, Vaughn, Leigh Ann, additional, Vázquez, Alexandra ., additional, Vega, Diego, additional, Verniers, Catherine, additional, Verschoor, Mark, additional, Voermans, Ingrid, additional, Vranka, Marek Albert, additional, Welch, Cheryl Alyssa, additional, Wichman, Aaron Lee, additional, Williams, Lisa A., additional, Woodzicka, Julie A., additional, Wronska, Marta Katarzyna, additional, Young, Liane, additional, Zelenski, John M., additional, and Nosek, Brian A., additional

Published
2018
Full Text
View/download PDF

38. Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

Author

Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Babalola, Mayowa T., Bahník, Štěpán, Batra, Rishtee, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Binan, Evans Dami, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Cai, Huajian, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Chang, Jen-Ho, Chatard, Armand, Chen, Eva E., Cheong, Winnee, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Cushman, Fiery, Dagona, Zubairu K., Dalgar, Ilker, Dalla Rosa, Anna, Davis, William E., de Bruijn, Maaike, De Schutter, Leander, Devos, Thierry, de Vries, Marieke, Doğulu, Canay, Dozo, Nerisa, Dukes, Kristin Nicole, Dunham, Yarrow, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Freyre, Miguel-ángel, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Ghoshal, Tanuka, Giessner, Steffen R., Gill, Tripat, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G.T., Hai, Kakul, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, Ijzerman, Hans, Inbar, Yoel, Innes-ker, Åse H., Jiménez-leal, William, John, Melissa-sue, Joy-gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Lipsey, Nikolette P., Losee, Joy E., Maassen, Esther, Maitner, Angela T., Malingumu, Winfrida, Mallett, Robyn K., Marotta, Satia A., Međedović, Janko, Mena-pacheco, Fernando, Milfont, Taciano L., Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Lee Nichols, Austin, Ocampo, Aaron, O’donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Osowiecka, Malgorzata, Packard, Grant, Pérez-sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M. H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L. M., Smith, Michael A., Smith-castro, Vanessa, Smolders, Karin C.H.J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Srivastava, Manini, Steiner, Troy G., Stouten, Jeroen, Street, Chris N.H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C.W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, Van Aert, Robbie C. M., Van Assen, Marcel A. L. M., Van Der Hulst, Marije, Van Lange, Paul A. M., Van ’t Veer, Anna Elisabeth, Vásquez- Echeverría, Alejandro, Ann Vaughn, Leigh, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P. J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, Nosek, Brian A., Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Babalola, Mayowa T., Bahník, Štěpán, Batra, Rishtee, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Binan, Evans Dami, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Cai, Huajian, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Chang, Jen-Ho, Chatard, Armand, Chen, Eva E., Cheong, Winnee, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Cushman, Fiery, Dagona, Zubairu K., Dalgar, Ilker, Dalla Rosa, Anna, Davis, William E., de Bruijn, Maaike, De Schutter, Leander, Devos, Thierry, de Vries, Marieke, Doğulu, Canay, Dozo, Nerisa, Dukes, Kristin Nicole, Dunham, Yarrow, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Freyre, Miguel-ángel, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Ghoshal, Tanuka, Giessner, Steffen R., Gill, Tripat, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G.T., Hai, Kakul, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, Ijzerman, Hans, Inbar, Yoel, Innes-ker, Åse H., Jiménez-leal, William, John, Melissa-sue, Joy-gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Lipsey, Nikolette P., Losee, Joy E., Maassen, Esther, Maitner, Angela T., Malingumu, Winfrida, Mallett, Robyn K., Marotta, Satia A., Međedović, Janko, Mena-pacheco, Fernando, Milfont, Taciano L., Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Lee Nichols, Austin, Ocampo, Aaron, O’donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Osowiecka, Malgorzata, Packard, Grant, Pérez-sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M. H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L. M., Smith, Michael A., Smith-castro, Vanessa, Smolders, Karin C.H.J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Srivastava, Manini, Steiner, Troy G., Stouten, Jeroen, Street, Chris N.H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C.W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, Van Aert, Robbie C. M., Van Assen, Marcel A. L. M., Van Der Hulst, Marije, Van Lange, Paul A. M., Van ’t Veer, Anna Elisabeth, Vásquez- Echeverría, Alejandro, Ann Vaughn, Leigh, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P. J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, and Nosek, Brian A.

Abstract

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p < .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p < .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely high-powered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relati

Published
2018

39. Many labs 2:Investigating variation in replicability across samples and settings

Author

Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Babalola, Mayowa T., Bahník, Štěpán, Batra, Rishtee, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Binan, Evans Dami, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Cai, Huajian, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Chang, Jen Ho, Chatard, Armand, Chen, Eva E., Cheong, Winnee, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Cushman, Fiery, Dagona, Zubairu K., Dalgar, Ilker, Dalla Rosa, Anna, Davis, William E., de Bruijn, Maaike, De Schutter, Leander, Devos, Thierry, de Vries, Marieke, Doğulu, Canay, Dozo, Nerisa, Dukes, Kristin Nicole, Dunham, Yarrow, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Freyre, Miguel Ángel, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Ghoshal, Tanuka, Giessner, Steffen R., Gill, Tripat, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G.T., Hai, Kakul, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, Ijzerman, Hans, Inbar, Yoel, Innes-Ker, Åse H., Jiménez-Leal, William, John, Melissa Sue, Joy-Gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Lipsey, Nikolette P., Losee, Joy E., Maassen, Esther, Maitner, Angela T., Malingumu, Winfrida, Mallett, Robyn K., Marotta, Satia A., Međedović, Janko, Mena-Pacheco, Fernando, Milfont, Taciano L., Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Nichols, Austin Lee, Ocampo, Aaron, O’donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Osowiecka, Malgorzata, Packard, Grant, Pérez-Sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M.H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L.M., Smith, Michael A., Smith-Castro, Vanessa, Smolders, Karin C.H.J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Srivastava, Manini, Steiner, Troy G., Stouten, Jeroen, Street, Chris N.H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C.W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, van Aert, Robbie C.M., van Assen, Marcel A.L.M., van der Hulst, Marije, van Lange, Paul A.M., van ’t Veer, Anna Elisabeth, Vásquez-Echeverría, Alejandro, Vaughn, Leigh Ann, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P.J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, Nosek, Brian A., Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Babalola, Mayowa T., Bahník, Štěpán, Batra, Rishtee, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Binan, Evans Dami, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Cai, Huajian, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Chang, Jen Ho, Chatard, Armand, Chen, Eva E., Cheong, Winnee, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Cushman, Fiery, Dagona, Zubairu K., Dalgar, Ilker, Dalla Rosa, Anna, Davis, William E., de Bruijn, Maaike, De Schutter, Leander, Devos, Thierry, de Vries, Marieke, Doğulu, Canay, Dozo, Nerisa, Dukes, Kristin Nicole, Dunham, Yarrow, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Freyre, Miguel Ángel, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Ghoshal, Tanuka, Giessner, Steffen R., Gill, Tripat, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G.T., Hai, Kakul, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, Ijzerman, Hans, Inbar, Yoel, Innes-Ker, Åse H., Jiménez-Leal, William, John, Melissa Sue, Joy-Gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Lipsey, Nikolette P., Losee, Joy E., Maassen, Esther, Maitner, Angela T., Malingumu, Winfrida, Mallett, Robyn K., Marotta, Satia A., Međedović, Janko, Mena-Pacheco, Fernando, Milfont, Taciano L., Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Nichols, Austin Lee, Ocampo, Aaron, O’donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Osowiecka, Malgorzata, Packard, Grant, Pérez-Sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M.H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L.M., Smith, Michael A., Smith-Castro, Vanessa, Smolders, Karin C.H.J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Srivastava, Manini, Steiner, Troy G., Stouten, Jeroen, Street, Chris N.H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C.W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, van Aert, Robbie C.M., van Assen, Marcel A.L.M., van der Hulst, Marije, van Lange, Paul A.M., van ’t Veer, Anna Elisabeth, Vásquez-Echeverría, Alejandro, Vaughn, Leigh Ann, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P.J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, and Nosek, Brian A.

Abstract

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p <.05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p <.0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely highpowered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than.20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above.10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relative

Published
2018

40. Data and Results (per site, etc.)

Author

Huajian Cai, Vázquez, Alexandra, Voermans, Ingrid, Spachtholz, Philipp, English, Alexander Scott, Adams, Byron Gregory, Conway, Morgan, Stouten, Jeroen, Ruggs, Enrica N., Bocian, Konrad, Cicero, David C, Pinter, Brad, Štěpán Bahník, Van Aert, Robbie C. M., Chatard, Armand, Sacco, Airi, Kende, Anna, Aveyard, Mark, Vranka, Marek A., Ujhelyi, Adrienn, Zelenski, John M., Patricio Saavedra, M., Young, Liane, Bernstein, Michael Jason, Theriault, Jordan, Neto, Felix, De Bruijn, Maaike, Lewis, Neil, Berry, Daniel R., Gnambs, Timo, Busching, Robert, Tanuka Ghoshal, Houdek, Petr, Kappes, Andreas, Kakul Hai, Vaughn, Leigh Ann, Pilati, Ronaldo, Giessner, Steffen Robert, Green, Eva, Malgorzata Osowiecka, Mayowa Babaloia, Mihaly Berkics, Krueger, Lacy Elise, Joy-Gaba, Jennifer, Melissa-Sue John, Verniers, Catherine, Yarrow Dunham, Vásquez-Echeverría, Alejandro, Winfrida Malingumu, Coen, Sharon, Woodzicka, Julie A., Morris, Wendy, Ilker Dalgar, Van Assen, Marcel A.L.M., Tanzer, Norbert K., Collisson, Brian, Dukes, Kristin, Bialobrzeska, Olga, Durrheim, Kevin, Jen-Ho Chang, Welch, Cheryl, Orosz, Gabor, Huynh, Ho Phi, Thomae, Manuela, Friedman, Mike, Kappes, Heather, Jimenez-Leal, William, CHEN, Eva, Karabati, Serdar, Corker, Katherine S., Grahe, Jon, Pérez, Rolando, Alper, Sinan, Haines, Elizabeth L., Sundfelt, Oskar, De Vries, Marieke, Innes-Ker, Åse, Međedović, Janko, Eller, Anja, Curran, Paul G, Nerisa Dozo, Steiner, Troy G., Tanzer, Norbert, Karick, Haruna, Schmidt, Kathleen, Maitner, Angela, Davis, William E., Sowden, Walter J., Tripat Gill, Gonzalez, Roberto, Murphy, Sean, Doğulu, Canay, Wronska, Marta Katarzyna, Huntsinger, Jeffrey R., Lakens, Daniel, Graham, Jesse, Carmichael, Cheryl L, Kovacs, Carrie, IJzerman, Hans, Cemalcilar, Zeynep, O'Donnell, Susan L., Maciek Sekerdej, Maassen, Esther, Traczyk, Jakub, Tang, Andrew, Rosa, Anna Dalla, Smith-Castro, Vanessa, Tybur, Joshua M., Vega, Diego, Sobkow, Agata, Kervyn, Nicolas, Easterbrook, Matthew, Wichman, Aaron, Nosek, Brian A., Hall, Michael P., Nelson, Anthony J., Edlund, John, Williams, Lisa A., Finck, Carolyn, Myachykov, Andriy, Brandt, Mark, Heffernan, Marie E., Verschoor, Mark, Nichols, Austin Lee, Coleman, Jennifer A., Winnee Cheong, Petrovic, Boban, Inbar, Yoel, Van Der Hulst, Marije, Levitan, Carmel, Lazarevic, Lili, Galliani, Elisa Maria, Packard, Grant, McIntyre, Jason, Haigh, Matthew, Skorinko, Jeanine, Frankowska, Natalia, Szumowska, Ewa, Keller, Victor N., Podesta, Lysandra, Adams, Reginald B., Klein, Richard A., Knezevic, Goran, Saeri, Alexander K, Torres, David, Sirlopu, David Ricardo, Salomon, Erika, Anna Van 'T Veer, Tear, Morgan, Lins, Samuel, Neijenhuijs, Koen Ilja, Vianello, Michelangelo, Marotta, Satia, Street, Chris N. H., Mallett, Robyn, Kurapov, German, Pollmann, Monique, Kamiloglu, Roza, Ebersole, Charles R., Cambier, Fanny, Gomez, Angel, Smith, Michael A., Chandler, Jesse J., Kurtz, Jaime, Oikawa, Masanori, Devos, Thierry, Schönbrodt, Felix, Milfont, Taciano L., Miguel-Ángel Freyre, Rutchick, Abraham M., Axt, Jordan, Hasselman, Fred, Hicks, Joshua A., Grahek, Ivan, Cantarero, Katarzyna, and Cushman, Fiery

Abstract

Data from Many Labs 2 Replication Project

Published
2017
Full Text
View/download PDF

41. Analysis Scripts

Author

Bernstein, Michael Jason, De Bruijn, Maaike, Huntsinger, Jeffrey R., Young, Liane, Lazarevic, Lili, Milfont, Taciano L., Nerisa Dozo, Heffernan, Marie E., Alper, Sinan, Jimenez-Leal, William, Torres, David, Vásquez-Echeverría, Alejandro, Keller, Victor N., Friedman, Mike, Corker, Katherine S., Verniers, Catherine, Cushman, Fiery, Pinter, Brad, Collisson, Brian, Sacco, Airi, Maassen, Esther, Pilati, Ronaldo, Carmichael, Cheryl L, Haigh, Matthew, Chatard, Armand, Durrheim, Kevin, Verschoor, Mark, Traczyk, Jakub, Innes-Ker, Åse, Sowden, Walter J., Yarrow Dunham, Huajian Cai, Winnee Cheong, Nosek, Brian A., English, Alexander Scott, Schmidt, Kathleen, Inbar, Yoel, Ujhelyi, Adrienn, Kovacs, Carrie, Vranka, Marek A., Tanzer, Norbert K., Kende, Anna, Podesta, Lysandra, Vaughn, Leigh Ann, Tanzer, Norbert, Houdek, Petr, Curran, Paul G, Haines, Elizabeth L., Rosa, Anna Dalla, Nelson, Anthony J., Vega, Diego, Maciek Sekerdej, Kurtz, Jaime, Williams, Lisa A., Cemalcilar, Zeynep, CHEN, Eva, Skorinko, Jeanine, Grahe, Jon, Murphy, Sean, Sirlopu, David Ricardo, Kervyn, Nicolas, Smith-Castro, Vanessa, Karabati, Serdar, Patricio Saavedra, M., Van Der Hulst, Marije, Coen, Sharon, Miguel-Ángel Freyre, Graham, Jesse, Neijenhuijs, Koen Ilja, Winfrida Malingumu, Maitner, Angela, Adams, Byron Gregory, Morris, Wendy, IJzerman, Hans, Smith, Michael A., Vianello, Michelangelo, Bialobrzeska, Olga, Davis, William E., Tripat Gill, Huynh, Ho Phi, Orosz, Gabor, Tybur, Joshua M., Gnambs, Timo, Myachykov, Andriy, Lakens, Daniel, Van Assen, Marcel A.L.M., Cantarero, Katarzyna, Brandt, Mark, Oikawa, Masanori, Tang, Andrew, Finck, Carolyn, Gonzalez, Roberto, Stouten, Jeroen, Ebersole, Charles R., Cambier, Fanny, Klein, Richard A., Galliani, Elisa Maria, Štěpán Bahník, Ruggs, Enrica N., Adams, Reginald B., Aveyard, Mark, Petrovic, Boban, Conway, Morgan, McIntyre, Jason, Giessner, Steffen Robert, Rutchick, Abraham M., Axt, Jordan, Levitan, Carmel, Međedović, Janko, Packard, Grant, Hall, Michael P., Wichman, Aaron, Mayowa Babaloia, Woodzicka, Julie A., Busching, Robert, Theriault, Jordan, Kurapov, German, Berry, Daniel R., Frankowska, Natalia, Chandler, Jesse J., Kakul Hai, Szumowska, Ewa, Marotta, Satia, Pollmann, Monique, Mallett, Robyn, Vázquez, Alexandra, Salomon, Erika, Knezevic, Goran, Kamiloglu, Roza, Dukes, Kristin, Devos, Thierry, Zelenski, John M., Lins, Samuel, Green, Eva, Anna Van 'T Veer, Cicero, David C, Joy-Gaba, Jennifer, Sobkow, Agata, Doğulu, Canay, Sundfelt, Oskar, Ilker Dalgar, Wronska, Marta Katarzyna, Malgorzata Osowiecka, Schönbrodt, Felix, Gomez, Angel, O'Donnell, Susan L., Tear, Morgan, Spachtholz, Philipp, Eller, Anja, Voermans, Ingrid, Tanuka Ghoshal, Mihaly Berkics, Melissa-Sue John, Easterbrook, Matthew, Saeri, Alexander K, Edlund, John, Kappes, Heather, Neto, Felix, Welch, Cheryl, Steiner, Troy G., Karick, Haruna, Lewis, Neil, Street, Chris N. H., Hicks, Joshua A., Pérez, Rolando, Krueger, Lacy Elise, Kappes, Andreas, Thomae, Manuela, De Vries, Marieke, Grahek, Ivan, Bocian, Konrad, Nichols, Austin Lee, Hasselman, Fred, Coleman, Jennifer A., and Jen-Ho Chang

Published
2017
Full Text
View/download PDF

42. Response to Comment on 'Estimating the reproducibility of psychological science'

Author

Anderson, Christopher J, Bahník, Štěpán, Barnett-Cowan, Michael, Bosco, Frank A, Chandler, Jesse, Chartier, Christopher R, Cheung, Felix, Christopherson, Cody D, Cordes, Andreas, Cremata, Edward J, Della Penna, Nicolas, Estel, Vivien, Fedor, Anna, Fitneva, Stanka A, Frank, Michael C, Grange, James A, Hartshorne, Joshua K, Hasselman, Fred, Henninger, Felix, van der Hulst, Marije, Jonas, Kai J, Lai, Calvin K, Levitan, Carmel A, Miller, Jeremy K, Moore, Katherine S, Meixner, Johannes M, Munafò, Marcus R, Neijenhuijs, Koen I, Nilsonne, Gustav, Nosek, Brian A, Plessow, Franziska, Prenoveau, Jason M, Ricker, Ashley A, Schmidt, Kathleen, Spies, Jeffrey R, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B, van Aert, Robbie C M, van Assen, Marcel A L M, Vanpaemel, Wolf, Vianello, Michelangelo, Voracek, Martin, Zuni, Kellylynn, Anderson, Christopher J, Bahník, Štěpán, Barnett-Cowan, Michael, Bosco, Frank A, Chandler, Jesse, Chartier, Christopher R, Cheung, Felix, Christopherson, Cody D, Cordes, Andreas, Cremata, Edward J, Della Penna, Nicolas, Estel, Vivien, Fedor, Anna, Fitneva, Stanka A, Frank, Michael C, Grange, James A, Hartshorne, Joshua K, Hasselman, Fred, Henninger, Felix, van der Hulst, Marije, Jonas, Kai J, Lai, Calvin K, Levitan, Carmel A, Miller, Jeremy K, Moore, Katherine S, Meixner, Johannes M, Munafò, Marcus R, Neijenhuijs, Koen I, Nilsonne, Gustav, Nosek, Brian A, Plessow, Franziska, Prenoveau, Jason M, Ricker, Ashley A, Schmidt, Kathleen, Spies, Jeffrey R, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B, van Aert, Robbie C M, van Assen, Marcel A L M, Vanpaemel, Wolf, Vianello, Michelangelo, Voracek, Martin, and Zuni, Kellylynn

Abstract

Gilbert et al. conclude that evidence from the Open Science Collaboration's Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data. Using the Reproducibility Project: Psychology data, both optimistic and pessimistic conclusions about reproducibility are possible, and neither are yet warranted.

Published
2016

43. Response to Comment on 'Estimating the reproducibility of psychological science'

Author

Anderson, Christopher J., Bahník, Štěpán, Barnett-Cowan, Michael, Bosco, Frank A., Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cordes, Andreas, Cremata, Edward J., Della Penna, Nicolas, Estel, Vivien, Fedor, Anna, Fitneva, Stanka A., Frank, Michael C., Grange, James A., Hartshorne, Joshua K., Hasselman, Fred, Henninger, Felix, van der Hulst, Marije, Jonas, Kai J., Lai, Calvin K., Levitan, Carmel A., Miller, Jeremy K., Moore, Katherine S., Meixner, Johannes M., Munafò, Marcus R., Neijenhuijs, Koen I., Nilsonne, Gustav, Nosek, Brian A., Plessow, Franziska, Prenoveau, Jason M., Ricker, Ashley A., Schmidt, Kathleen, Spies, Jeffrey R., Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., van Aert, Robbie C. M., van Assen, Marcel A. L. M., Vanpaemel, Wolf, Vianello, Michelangelo, Voracek, Martin, Zuni, Kellylynn, Anderson, Christopher J., Bahník, Štěpán, Barnett-Cowan, Michael, Bosco, Frank A., Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cordes, Andreas, Cremata, Edward J., Della Penna, Nicolas, Estel, Vivien, Fedor, Anna, Fitneva, Stanka A., Frank, Michael C., Grange, James A., Hartshorne, Joshua K., Hasselman, Fred, Henninger, Felix, van der Hulst, Marije, Jonas, Kai J., Lai, Calvin K., Levitan, Carmel A., Miller, Jeremy K., Moore, Katherine S., Meixner, Johannes M., Munafò, Marcus R., Neijenhuijs, Koen I., Nilsonne, Gustav, Nosek, Brian A., Plessow, Franziska, Prenoveau, Jason M., Ricker, Ashley A., Schmidt, Kathleen, Spies, Jeffrey R., Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., van Aert, Robbie C. M., van Assen, Marcel A. L. M., Vanpaemel, Wolf, Vianello, Michelangelo, Voracek, Martin, and Zuni, Kellylynn

Abstract

Gilbert et al. conclude that evidence from the Open Science Collaboration's Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data. Using the Reproducibility Project: Psychology data, both optimistic and pessimistic conclusions about reproducibility are possible, and neither are yet warranted.

Published
2016
Full Text
View/download PDF

44. Response to Comment on 'Estimating the reproducibility of psychological science'

Author

Social Networks, Solidarity and Inequality, Leerstoel Buskens, Anderson, Christopher J, Bahník, Štěpán, Barnett-Cowan, Michael, Bosco, Frank A, Chandler, Jesse, Chartier, Christopher R, Cheung, Felix, Christopherson, Cody D, Cordes, Andreas, Cremata, Edward J, Della Penna, Nicolas, Estel, Vivien, Fedor, Anna, Fitneva, Stanka A, Frank, Michael C, Grange, James A, Hartshorne, Joshua K, Hasselman, Fred, Henninger, Felix, van der Hulst, Marije, Jonas, Kai J, Lai, Calvin K, Levitan, Carmel A, Miller, Jeremy K, Moore, Katherine S, Meixner, Johannes M, Munafò, Marcus R, Neijenhuijs, Koen I, Nilsonne, Gustav, Nosek, Brian A, Plessow, Franziska, Prenoveau, Jason M, Ricker, Ashley A, Schmidt, Kathleen, Spies, Jeffrey R, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B, van Aert, Robbie C M, van Assen, Marcel A L M, Vanpaemel, Wolf, Vianello, Michelangelo, Voracek, Martin, Zuni, Kellylynn, Social Networks, Solidarity and Inequality, Leerstoel Buskens, Anderson, Christopher J, Bahník, Štěpán, Barnett-Cowan, Michael, Bosco, Frank A, Chandler, Jesse, Chartier, Christopher R, Cheung, Felix, Christopherson, Cody D, Cordes, Andreas, Cremata, Edward J, Della Penna, Nicolas, Estel, Vivien, Fedor, Anna, Fitneva, Stanka A, Frank, Michael C, Grange, James A, Hartshorne, Joshua K, Hasselman, Fred, Henninger, Felix, van der Hulst, Marije, Jonas, Kai J, Lai, Calvin K, Levitan, Carmel A, Miller, Jeremy K, Moore, Katherine S, Meixner, Johannes M, Munafò, Marcus R, Neijenhuijs, Koen I, Nilsonne, Gustav, Nosek, Brian A, Plessow, Franziska, Prenoveau, Jason M, Ricker, Ashley A, Schmidt, Kathleen, Spies, Jeffrey R, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B, van Aert, Robbie C M, van Assen, Marcel A L M, Vanpaemel, Wolf, Vianello, Michelangelo, Voracek, Martin, and Zuni, Kellylynn

Published
2016

45. Response to Comment on “Estimating the reproducibility of psychological science”

Author

Anderson, Christopher J., primary, Bahník, Štěpán, additional, Barnett-Cowan, Michael, additional, Bosco, Frank A., additional, Chandler, Jesse, additional, Chartier, Christopher R., additional, Cheung, Felix, additional, Christopherson, Cody D., additional, Cordes, Andreas, additional, Cremata, Edward J., additional, Della Penna, Nicolas, additional, Estel, Vivien, additional, Fedor, Anna, additional, Fitneva, Stanka A., additional, Frank, Michael C., additional, Grange, James A., additional, Hartshorne, Joshua K., additional, Hasselman, Fred, additional, Henninger, Felix, additional, van der Hulst, Marije, additional, Jonas, Kai J., additional, Lai, Calvin K., additional, Levitan, Carmel A., additional, Miller, Jeremy K., additional, Moore, Katherine S., additional, Meixner, Johannes M., additional, Munafò, Marcus R., additional, Neijenhuijs, Koen I., additional, Nilsonne, Gustav, additional, Nosek, Brian A., additional, Plessow, Franziska, additional, Prenoveau, Jason M., additional, Ricker, Ashley A., additional, Schmidt, Kathleen, additional, Spies, Jeffrey R., additional, Stieger, Stefan, additional, Strohminger, Nina, additional, Sullivan, Gavin B., additional, van Aert, Robbie C. M., additional, van Assen, Marcel A. L. M., additional, Vanpaemel, Wolf, additional, Vianello, Michelangelo, additional, Voracek, Martin, additional, and Zuni, Kellylynn, additional

Published
2016
Full Text
View/download PDF

46. Materials for Individual Studies

Author

Maassen, Esther, English, Alexander Scott, Winnee Cheong, Adams, Byron Gregory, Steiner, Troy G., Coleman, Jennifer A., Finck, Carolyn, Theriault, Jordan, Cambier, Fanny, Kovacs, Carrie, Kakul Hai, Houdek, Petr, Lakens, Daniel, Wronska, Marta Katarzyna, Nichols, Austin Lee, Tybur, Joshua M., Anna Van 'T Veer, Nerisa Dozo, Vianello, Michelangelo, Eller, Anja, Aveyard, Mark, Easterbrook, Matthew, Lazarevic, Lili, O'Donnell, Susan L., Saeri, Alexander K, Orosz, Gabor, Lewis, Neil, Hall, Michael P., Tear, Morgan, Klein, Richard A., Myachykov, Andriy, Chandler, Jesse J., Voermans, Ingrid, Kappes, Andreas, Knezevic, Goran, Sirlopu, David Ricardo, Neijenhuijs, Koen Ilja, Smith, Michael A., Kamiloglu, Roza, Vega, Diego, Kurapov, German, Murphy, Sean, Graham, Jesse, Milfont, Taciano L., Spachtholz, Philipp, Gnambs, Timo, Green, Eva, Vranka, Marek A., Nelson, Anthony J., De Bruijn, Maaike, Mayowa Babaloia, Morris, Wendy, Van Der Hulst, Marije, Heffernan, Marie E., Van Assen, Marcel A.L.M., Cantarero, Katarzyna, Smith-Castro, Vanessa, Street, Chris N. H., Corker, Katherine S., Brandt, Mark, Pollmann, Monique, Tanuka Ghoshal, Inbar, Yoel, Stouten, Jeroen, Thomae, Manuela, Haigh, Matthew, Patricio Saavedra, M., Vázquez, Alexandra, Axt, Jordan, Williams, Lisa A., Cicero, David C, Winfrida Malingumu, Conway, Morgan, Maitner, Angela, Sundfelt, Oskar, Young, Liane, Grahe, Jon, Galliani, Elisa Maria, Edlund, John, Ujhelyi, Adrienn, Cushman, Fiery, Tanzer, Norbert, Yarrow Dunham, Maciek Sekerdej, Sowden, Walter J., Berry, Daniel R., Skorinko, Jeanine, Dukes, Kristin, Cemalcilar, Zeynep, Pilati, Ronaldo, Collisson, Brian, Carmichael, Cheryl L, Neto, Felix, Friedman, Mike, Haines, Elizabeth L., Wichman, Aaron, De Vries, Marieke, Ilker Dalgar, Keller, Victor N., Salomon, Erika, Grahek, Ivan, Innes-Ker, Åse, Zelenski, John M., Sobkow, Agata, Lins, Samuel, Ebersole, Charles R., Sacco, Airi, Kappes, Heather, Doğulu, Canay, Hasselman, Fred, Melissa-Sue John, Nosek, Brian A., Pinter, Brad, Pérez, Rolando, Bocian, Konrad, Miguel-Ángel Freyre, Woodzicka, Julie A., Međedović, Janko, Karabati, Serdar, Tang, Andrew, Adams, Reginald B., Verniers, Catherine, Bialobrzeska, Olga, Joy-Gaba, Jennifer, Frankowska, Natalia, Alper, Sinan, CHEN, Eva, Vásquez-Echeverría, Alejandro, Torres, David, Mallett, Robyn, Hicks, Joshua A., Coen, Sharon, McIntyre, Jason, Durrheim, Kevin, Rosa, Anna Dalla, Curran, Paul G, IJzerman, Hans, Schmidt, Kathleen, Schönbrodt, Felix, Ruggs, Enrica N., Verschoor, Mark, Devos, Thierry, Jimenez-Leal, William, Kende, Anna, Petrovic, Boban, Giessner, Steffen Robert, Traczyk, Jakub, Packard, Grant, Huajian Cai, Vaughn, Leigh Ann, Bernstein, Michael Jason, Rutchick, Abraham M., Welch, Cheryl, Chatard, Armand, Levitan, Carmel, Tanzer, Norbert K., Podesta, Lysandra, Busching, Robert, Gomez, Angel, Gonzalez, Roberto, Huynh, Ho Phi, Tripat Gill, Marotta, Satia, Szumowska, Ewa, Štěpán Bahník, Krueger, Lacy Elise, Karick, Haruna, Huntsinger, Jeffrey R., Davis, William E., Kervyn, Nicolas, Jen-Ho Chang, Malgorzata Osowiecka, Kurtz, Jaime, Mihaly Berkics, and Oikawa, Masanori

Published
2014
Full Text
View/download PDF

47. Codebooks and Study Files

Author

Ujhelyi, Adrienn, Young, Liane, Pérez, Rolando, Tanuka Ghoshal, Thomae, Manuela, Durrheim, Kevin, Kovacs, Carrie, Tybur, Joshua M., Street, Chris N. H., Nichols, Austin Lee, Maassen, Esther, Mayowa Babaloia, Morris, Wendy, Busching, Robert, Anna Van 'T Veer, Levitan, Carmel, Innes-Ker, Åse, Grahek, Ivan, Jen-Ho Chang, Schönbrodt, Felix, Pilati, Ronaldo, Nerisa Dozo, Van Assen, Marcel A.L.M., Gomez, Angel, Yarrow Dunham, Eller, Anja, De Bruijn, Maaike, Frankowska, Natalia, Ebersole, Charles R., Keller, Victor N., CHEN, Eva, English, Alexander Scott, Curran, Paul G, Brandt, Mark, Adams, Reginald B., Miguel-Ángel Freyre, Traczyk, Jakub, Friedman, Mike, Tripat Gill, Kurapov, German, Wronska, Marta Katarzyna, Bocian, Konrad, Knezevic, Goran, Carmichael, Cheryl L, Wichman, Aaron, Theriault, Jordan, Chatard, Armand, Haigh, Matthew, Lewis, Neil, Alper, Sinan, Huntsinger, Jeffrey R., Haines, Elizabeth L., Winnee Cheong, Skorinko, Jeanine, Pinter, Brad, Pollmann, Monique, Bialobrzeska, Olga, Cicero, David C, Stouten, Jeroen, Cushman, Fiery, Green, Eva, Williams, Lisa A., Ruggs, Enrica N., Nosek, Brian A., Marotta, Satia, Kakul Hai, Graham, Jesse, Vega, Diego, Voermans, Ingrid, Klein, Richard A., Conway, Morgan, Tang, Andrew, Verschoor, Mark, Lins, Samuel, Sacco, Airi, Štěpán Bahník, Giessner, Steffen Robert, Tanzer, Norbert, Patricio Saavedra, M., Adams, Byron Gregory, Packard, Grant, Axt, Jordan, Vranka, Marek A., Sowden, Walter J., Oikawa, Masanori, Kappes, Andreas, Chandler, Jesse J., Gonzalez, Roberto, Neto, Felix, Milfont, Taciano L., Lazarevic, Lili, Kappes, Heather, Hicks, Joshua A., Nelson, Anthony J., Saeri, Alexander K, Winfrida Malingumu, Edlund, John, Rutchick, Abraham M., Easterbrook, Matthew, Myachykov, Andriy, McIntyre, Jason, Karick, Haruna, Međedović, Janko, Welch, Cheryl, O'Donnell, Susan L., Kende, Anna, Berry, Daniel R., Szumowska, Ewa, Doğulu, Canay, Dukes, Kristin, Mallett, Robyn, Maitner, Angela, Collisson, Brian, Tear, Morgan, Spachtholz, Philipp, Orosz, Gabor, Coleman, Jennifer A., Neijenhuijs, Koen Ilja, Petrovic, Boban, Torres, David, Steiner, Troy G., Cambier, Fanny, Hall, Michael P., Podesta, Lysandra, Vianello, Michelangelo, Sobkow, Agata, Inbar, Yoel, Coen, Sharon, Kervyn, Nicolas, Davis, William E., Sundfelt, Oskar, Maciek Sekerdej, Tanzer, Norbert K., Vázquez, Alexandra, De Vries, Marieke, Cemalcilar, Zeynep, Karabati, Serdar, Verniers, Catherine, Salomon, Erika, Kurtz, Jaime, Rosa, Anna Dalla, Melissa-Sue John, Huajian Cai, Woodzicka, Julie A., Hasselman, Fred, Schmidt, Kathleen, Bernstein, Michael Jason, Gnambs, Timo, Sirlopu, David Ricardo, Vásquez-Echeverría, Alejandro, Aveyard, Mark, IJzerman, Hans, Vaughn, Leigh Ann, Smith-Castro, Vanessa, Galliani, Elisa Maria, Cantarero, Katarzyna, Malgorzata Osowiecka, Devos, Thierry, Jimenez-Leal, William, Ilker Dalgar, Zelenski, John M., Corker, Katherine S., Finck, Carolyn, Mihaly Berkics, Huynh, Ho Phi, Smith, Michael A., Lakens, Daniel, Houdek, Petr, Murphy, Sean, Joy-Gaba, Jennifer, Van Der Hulst, Marije, Krueger, Lacy Elise, Heffernan, Marie E., Grahe, Jon, and Kamiloglu, Roza

Abstract

See the "Wiki" for more details.

Published
2013
Full Text
View/download PDF

48. Videos Documenting Data Collection

Author

Vega, Diego, Easterbrook, Matthew, Giessner, Steffen Robert, Pollmann, Monique, Galliani, Elisa Maria, Rutchick, Abraham M., Corker, Katherine S., Tanuka Ghoshal, Karabati, Serdar, Hasselman, Fred, Huajian Cai, Kamiloglu, Roza, Carmichael, Cheryl L, Smith-Castro, Vanessa, Schönbrodt, Felix, Sacco, Airi, Edlund, John, Pilati, Ronaldo, Zelenski, John M., Kurtz, Jaime, Tang, Andrew, Nelson, Anthony J., Pérez, Rolando, Kakul Hai, Vázquez, Alexandra, Verniers, Catherine, Alper, Sinan, Vranka, Marek A., Durrheim, Kevin, Marotta, Satia, Klein, Richard A., Gnambs, Timo, Chatard, Armand, IJzerman, Hans, Packard, Grant, Maassen, Esther, Innes-Ker, Åse, Vásquez-Echeverría, Alejandro, Theriault, Jordan, Sundfelt, Oskar, Schmidt, Kathleen, Lins, Samuel, Vianello, Michelangelo, Inbar, Yoel, Kappes, Andreas, Coen, Sharon, Young, Liane, Štěpán Bahník, Wronska, Marta Katarzyna, Nichols, Austin Lee, Kurapov, German, Kappes, Heather, Wichman, Aaron, Vaughn, Leigh Ann, Sowden, Walter J., English, Alexander Scott, Szumowska, Ewa, Yarrow Dunham, Huntsinger, Jeffrey R., Doğulu, Canay, Coleman, Jennifer A., Pinter, Brad, Hall, Michael P., Joy-Gaba, Jennifer, Frankowska, Natalia, Steiner, Troy G., Cambier, Fanny, Neto, Felix, Adams, Reginald B., Sirlopu, David Ricardo, Brandt, Mark, Nerisa Dozo, Levitan, Carmel, Curran, Paul G, Conway, Morgan, Bocian, Konrad, Busching, Robert, Cushman, Fiery, Melissa-Sue John, Axt, Jordan, Van Assen, Marcel A.L.M., Finck, Carolyn, Graham, Jesse, Berry, Daniel R., Grahek, Ivan, Green, Eva, Van Der Hulst, Marije, Kervyn, Nicolas, Morris, Wendy, Bialobrzeska, Olga, Mallett, Robyn, Gomez, Angel, Oikawa, Masanori, Traczyk, Jakub, De Bruijn, Maaike, Malgorzata Osowiecka, Maitner, Angela, Haines, Elizabeth L., Ilker Dalgar, Davis, William E., Stouten, Jeroen, Saeri, Alexander K, Chandler, Jesse J., Kende, Anna, Mayowa Babaloia, Međedović, Janko, Salomon, Erika, Lakens, Daniel, Tear, Morgan, Knezevic, Goran, Podesta, Lysandra, O'Donnell, Susan L., Haigh, Matthew, Skorinko, Jeanine, Krueger, Lacy Elise, Houdek, Petr, Ujhelyi, Adrienn, Aveyard, Mark, Keller, Victor N., Ruggs, Enrica N., Jen-Ho Chang, Tanzer, Norbert, Mihaly Berkics, Huynh, Ho Phi, Miguel-Ángel Freyre, Torres, David, Devos, Thierry, Voermans, Ingrid, Myachykov, Andriy, Gonzalez, Roberto, Sobkow, Agata, Kovacs, Carrie, CHEN, Eva, Woodzicka, Julie A., Milfont, Taciano L., Rosa, Anna Dalla, Jimenez-Leal, William, Orosz, Gabor, Murphy, Sean, Welch, Cheryl, Winnee Cheong, Heffernan, Marie E., Williams, Lisa A., Winfrida Malingumu, Collisson, Brian, Spachtholz, Philipp, Patricio Saavedra, M., Eller, Anja, Verschoor, Mark, McIntyre, Jason, Adams, Byron Gregory, Anna Van 'T Veer, Tybur, Joshua M., Petrovic, Boban, Lazarevic, Lili, Karick, Haruna, Nosek, Brian A., Friedman, Mike, Cantarero, Katarzyna, Dukes, Kristin, Grahe, Jon, Tanzer, Norbert K., Hicks, Joshua A., Cicero, David C, Ebersole, Charles R., Neijenhuijs, Koen Ilja, Tripat Gill, Cemalcilar, Zeynep, Maciek Sekerdej, De Vries, Marieke, Street, Chris N. H., Smith, Michael A., Bernstein, Michael Jason, Lewis, Neil, and Thomae, Manuela

Published
2013
Full Text
View/download PDF

49. Estimating the reproducibility of psychological science

Author

Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, and Zuni, Kellylynn

Abstract

Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.

Published
2015

50. Estimating the reproducibility of psychological science

Author

Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahnik, Stepan, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Bruening, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D. Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolas, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernandez-Castilla, Belen, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Gloeckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O. -Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jaekel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer, Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniel, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana, LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Moeschl, Marcus, Motyl, Matt, Mueller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Gandalf, Nicolas, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michele B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, Rene, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L. M., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valasek, Milan, van 't Veer, Anna E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Don, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Echeverria, Alejandro Vasquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahnik, Stepan, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Bruening, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D. Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolas, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernandez-Castilla, Belen, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Gloeckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O. -Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jaekel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer, Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniel, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana, LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Moeschl, Marcus, Motyl, Matt, Mueller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Gandalf, Nicolas, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michele B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, Rene, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L. M., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valasek, Milan, van 't Veer, Anna E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Don, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Echeverria, Alejandro Vasquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, and Zuni, Kellylynn

Abstract

Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.

Published
2015

Catalog

Books, media, physical & digital resources
See catalog results