Search

Your search keyword '"Dorsthorst, Anniek"' showing total 10 results
Start Over Author "Dorsthorst, Anniek"
10 results on '"Dorsthorst, Anniek"'

1. Data

Author

Neijenhuijs, Koen, Luteijn, Ilse, Bosch, Annick, van der Hulst, Marije, Dorsthorst, Anniek, van de Ven, Mathijs, and Weerdmeester, Johanna

Published
2022
Full Text
View/download PDF

2. Materials

Author

Neijenhuijs, Koen, van de Ven, Mathijs, Weerdmeester, Johanna, Dorsthorst, Anniek, van der Hulst, Marije, Bosch, Annick, and Luteijn, Ilse

Published
2022
Full Text
View/download PDF

4. Reproducibility Project: Psychology

Author

Anderson, Christopher, Anderson, Joanna, van Assen, Marcel, Attridge, Peter, Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, van den Bergh, Don, Beyan, Leah, den Bezemer, Bobby, Borsboom, Denny, Bosch, Annick, Bosco, Frank, Bowman, Sara, Brandt, Mark, Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin, Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon, Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher, Cheung, Felix, Chu, Phuonguyen, Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark, Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Costantini, Giulio, Cramblet Alvarez, Leslie, Cremata, Edward, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle, Della Penna, Nicolás, Deserno, Marie, Devitt, Olivia, Dewitte, Laura, DiGiacomo, Philip, Dobolyi, David, Dodson, Geneva, Donnellan, Brent, Donohue, Ryan, van Dooren, Roel, van Doorn, Johnny, Dore, Rebecca, Dorrough, Angela, Dorsthorst, Anniek, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth, Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy, Estel, Vivien, Farach, Frank, Feather, Jenelle, Fedor, Anna, Fernández, Belén, Fiedler, Susann, Field, James, Fitneva, Stanka, Flagan, Taru, Forest, Amanda, Forsell, Eskil, Foster, Joshua, Frank, Michael, Frazier, Rebecca, Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin, Goldberg, Rebecca, Goldinger, Stephen, Goodbourn, Patrick, Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Gray, Jeremy, Hartgerink, Chris, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hicks, Grace, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Geertje, van der Hulst, Marije, Humphries, Denise, Hung, Cathy, Immelman, Nathali, Irsik, Vanessa, Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, David, Johnson-Grey, Kate, Johnson, Larissa, Johnston, William, Jonas, Kai, Joy-Gaba, Jennifer, Kappes, Heather, Kelso, Kim, Kidwell, Mallory, Kim, Seung, Kirkhart, Matthew, Kleinberg, Bennett, Knezevic, Goran, Kolorz, Franziska, Krause, Robert, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram, Kyc, Megan, Lai, Calvin, Laique, Aamir, Lakens, Daniel, Lane, Kristin, Lassetter, Bethany, Lazarevic, Ljiljana, LeBel, Etienne, Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel, Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Lumian, Daniel, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather, Marigold, Denise, Martin, Daniel, Martinez, Tylar, Masicampo, E.J., Matacotta, Joshua, Mathur, Maya, May, Michael, McRae, Kateri, McElroy, Todd, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy, Smith, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie, Munafo, Marcus, Muñoz, Alisa, Neijenhuijs, Koen, Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian, Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason, Ratliff, Kate, Reinhard, David, Renkewitz, Frank, van Renswoude, Daan, Ricker, Ashley, Rigney, Anastasia, van Rijn, Hedderik, Rivers, Andrew, Roebke, Mark, Rutchick, Abraham, Ryan, Robert, Sahin, Onur, Saide, Anondah, Sandstrom, Gillian, Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan, Shaki, Samuel, Simpson, William, Sinclair, H., Skorinko, Jeanine, Slowik, Agnieszka, Snyder, Joel, Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nicholas, Spies, Jeffrey, Staples, Angela, steegen, sara, Steinberg, Mia, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin, Talhelm, Thomas, Tapia, Megan, Thomae, Manuela, Toton, Sarah, Tibboel, Helen, Tio, Pia, Traets, Frits, Tsang, Steve, tuerlinckx, francis, Tullett, Alexa, Turchan, Paul, vanpaemel, wolf, Vásquez-Echeverría, Alejandro, van 't Veer, Anna, Vélez, Natalia, van de Ven, Mathijs, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Johanna, Welsh, Ashlee, Westgate, Erin, Wissink, Joeri, Wood, Michael, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Hartshorne, Joshua, and Grange, James

Subjects
reproduction, metascience, replication, psychological science, open science, psychology, crowdsource, reproducibility
Abstract

Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available.

Published
2022
Full Text
View/download PDF

6. The (non) gradual association of popularity with peer‐nominated and observed behavior in a cooperative and competitive context.

Author

Lansu, Tessa A. M., Rovers, Anne C., and Dorsthorst, Anniek M.

Subjects
COMPETITION (Psychology), POPULARITY, BULLYING, TEENAGERS
Abstract

Popularity among peers might be related to behavior in gradual or non‐gradual ways. In this research, a popularity subgroups approach was used to examine whether some behaviors were associated with only specific levels of popularity. Moreover, observational data in popularity research is valuable yet scarce. This research, therefore, also examined the association between popularity and observed behavior in a cooperative and competitive setting. In total, 182 early adolescents (58.2% girls, Mage = 10.7 years) completed peer nominations and were observed during a cooperative and a competitive task in groups of four. Results show that affective ties increased gradually with increasing popularity, but that relational aggression, bullying and attention‐attracting qualities distinguished popular adolescents from other early adolescents, and victimization distinguished unpopular adolescents from the other early adolescents. Observations showed that high popularity was defined by high levels of negative behavior, prosocial resource control, skillful leadership, and influence, with the effect of popularity on influence being stronger in the cooperative than the competitive setting. Using multiple methods, and taking context into account, a more complete behavioral profile of different levels of popularity is provided. [ABSTRACT FROM AUTHOR]

Published
2021
Full Text
View/download PDF

7. Estimating the reproducibility of psychological science

Author

Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, and Zuni, Kellylynn

Abstract

Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.

Published
2015

8. Estimating the reproducibility of psychological science

Author

Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahnik, Stepan, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Bruening, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D. Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolas, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernandez-Castilla, Belen, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Gloeckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O. -Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jaekel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer, Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniel, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana, LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Moeschl, Marcus, Motyl, Matt, Mueller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Gandalf, Nicolas, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michele B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, Rene, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L. M., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valasek, Milan, van 't Veer, Anna E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Don, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Echeverria, Alejandro Vasquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahnik, Stepan, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Bruening, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D. Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolas, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernandez-Castilla, Belen, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Gloeckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O. -Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jaekel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer, Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniel, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana, LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Moeschl, Marcus, Motyl, Matt, Mueller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Gandalf, Nicolas, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michele B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, Rene, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L. M., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valasek, Milan, van 't Veer, Anna E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Don, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Echeverria, Alejandro Vasquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, and Zuni, Kellylynn

Abstract

Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.

Published
2015

9. Estimating the reproducibility of psychological science

Author

Social Networks, Solidarity and Inequality, Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Social Networks, Solidarity and Inequality, Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, and Zuni, Kellylynn

Published
2015

10. Estimating the reproducibility of psychological science

Author

Open Science Collaboration, Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Cramblet Alvarez, Leslie D., Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolás, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O.Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E.J., Matacotta, Josh, Mathur, Maya B., May, Michael, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, Colleen, Skorinko, Jeanine L., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, van ‘t Veer, A. E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Donald, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Vásquez Echeverría, Alejandro, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Open Science Collaboration, Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Cramblet Alvarez, Leslie D., Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolás, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O.Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E.J., Matacotta, Josh, Mathur, Maya B., May, Michael, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, Colleen, Skorinko, Jeanine L., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, van ‘t Veer, A. E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Donald, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Vásquez Echeverría, Alejandro, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, and Zuni, Kellylynn

Abstract

Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.

Catalog

Books, media, physical & digital resources
See catalog results