Author: "Spies, Jeffrey R" - Searchworks@Jio Institute Digital Library Search Results

Your search keyword '"Spies, Jeffrey R"' showing total 33 results

Start Over Author "Spies, Jeffrey R"

33 results on '"Spies, Jeffrey R"'

1. The principles of tomorrow's university

Author: Katz, Daniel S, Allen, Gabrielle, Barba, Lorena A, Berg, Devin R, Bik, Holly, Boettiger, Carl, Borgman, Christine L, Brown, C. Titus, Buck, Stuart, Burd, Randy, de Waard, Anita, Eve, Martin Paul, Granger, Brian E, Greenberg, Josh, Howe, Adina, Howe, Bill, Khanna, May, Killeen, Timothy L, Mayernik, Matthew, McKiernan, Erin, Mentzel, Chris, Merchant, Nirav, Niemeyer, Kyle E, Noren, Laura, Nusser, Sarah M, Reed, Daniel A, Seidel, Edward, Smith, MacKenzie, Spies, Jeffrey R, Turk, Matt, Van Horn, John D, and Walsh, Jay
Abstract: In the 21st Century, research is increasingly data- and computation-driven. Researchers, funders, and the larger community today emphasize the traits of openness and reproducibility. In March 2017, 13 mostly early-career research leaders who are building their careers around these traits came together with ten university leaders (presidents, vice presidents, and vice provosts), representatives from four funding agencies, and eleven organizers and other stakeholders in an NIH- and NSF-funded one-day, invitation-only workshop titled "Imagining Tomorrow's University." Workshop attendees were charged with launching a new dialog around open research – the current status, opportunities for advancement, and challenges that limit sharing.The workshop examined how the internet-enabled research world has changed, and how universities need to change to adapt commensurately, aiming to understand how universities can and should make themselves competitive and attract the best students, staff, and faculty in this new world. During the workshop, the participants re-imagined scholarship, education, and institutions for an open, networked era, to uncover new opportunities for universities to create value and serve society. They expressed the results of these deliberations as a set of 22 principles of tomorrow's university across six areas: credit and attribution, communities, outreach and engagement, education, preservation and reproducibility, and technologies.Activities that follow on from workshop results take one of three forms. First, since the workshop, a number of workshop authors have further developed and published their white papers to make their reflections and recommendations more concrete. These authors are also conducting efforts to implement these ideas, and to make changes in the university system. Second, we plan to organise a follow-up workshop that focuses on how these principles could be implemented. Third, we believe that the outcomes of this workshop support and are connected with recent theoretical work on the position and future of open knowledge institutions.
Published: 2018

2. How open science helps researchers succeed

Author: McKiernan, Erin C, Bourne, Philip E, Brown, C Titus, Buck, Stuart, Kenall, Amye, Lin, Jennifer, McDougall, Damon, Nosek, Brian A, Ram, Karthik, Soderberg, Courtney K, Spies, Jeffrey R, Thaney, Kaitlin, Updegrove, Andrew, Woo, Kara H, and Yarkoni, Tal
Subjects: Biological Sciences, Biomedical and Clinical Sciences, Health Sciences, Access to Information, Open Access Publishing, Research, Research Personnel, none, open access, open data, open science, open source, research, Biochemistry and Cell Biology, Biological sciences, Biomedical and clinical sciences, Health sciences
Abstract: Open access, open data, open source and other open scholarship practices are growing in popularity and necessity. However, widespread adoption of these practices has not yet been achieved. One reason is that researchers are uncertain about how sharing their work will affect their careers. We review literature demonstrating that open research is associated with increases in citations, media attention, potential collaborators, job opportunities and funding opportunities. These findings are evidence that open research practices bring significant benefits to researchers relative to more traditional closed practices.
Published: 2016

3. Scientific Utopia: II. Restructuring incentives and practices to promote truth over publishability

Author: Nosek, Brian A., Spies, Jeffrey R., and Motyl, Matt
Subjects: Physics - Physics and Society, Computer Science - Digital Libraries
Abstract: An academic scientist's professional success depends on publishing. Publishing norms emphasize novel, positive results. As such, disciplinary incentives encourage design, analysis, and reporting decisions that elicit positive results and ignore negative results. Prior reports demonstrate how these incentives inflate the rate of false effects in published science. When incentives favor novelty over replication, false results persist in the literature unchallenged, reducing efficiency in knowledge accumulation. Previous suggestions to address this problem are unlikely to be effective. For example, a journal of negative results publishes otherwise unpublishable reports. This enshrines the low status of the journal and its content. The persistence of false findings can be meliorated with strategies that make the fundamental but abstract accuracy motive - getting it right - competitive with the more tangible and concrete incentive - getting it published. We develop strategies for improving scientific practices and knowledge accumulation that account for ordinary human motivations and self-serving biases., Comment: 41 pages, 1 table
Published: 2012

4. Justify your alpha

Author: Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A. J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Van Calster, Ben, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, van Harmelen, Anne-Laura, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M. A., Lukavský, Jiří, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q. X., Nilsonne, Gustav, de Oliveira, Cilene Lino, de Xivry, Jean-Jacques Orban, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A. L. M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, and Zwaan, Rolf A.
Published: 2018
Full Text: View/download PDF

5. The Replication Recipe: What makes for a convincing replication?

Author: Brandt, Mark J., IJzerman, Hans, Dijksterhuis, Ap, Farach, Frank J., Geller, Jason, Giner-Sorolla, Roger, Grange, James A., Perugini, Marco, Spies, Jeffrey R., and van 't Veer, Anna
Published: 2014
Full Text: View/download PDF

6. Effects of Damping Head Movement and Facial Expression in Dyadic Conversation Using Real-Time Facial Expression Tracking and Synthesized Avatars

Author: Boker, Steven M., Cohn, Jeffrey F., Theobald, Barry-John, Matthews, Iain, Brick, Timothy R., and Spies, Jeffrey R.
Published: 2009
Full Text: View/download PDF

7. Mapping and manipulating facial expression

Author: Theobald, Barry-John, Matthews, Iain, Mangini, Michael, Spies, Jeffrey R., Brick, Timothy R., Cohn, Jeffrey F., and Boker, Steven M.
Subjects: Facial expression -- Psychological aspects -- Research, Visualization (Mental images) -- Research -- Psychological aspects, Health, Languages and linguistics, Psychological aspects, Research
Abstract: Abstract Nonverbal visual cues accompany speech to supplement the meaning of spoken words, signify emotional state, indicate position in discourse, and provide back-channel feedback. This visual information includes head movements, [...]
Published: 2009

8. Something in the Way We Move: Motion Dynamics, Not Perceived Sex, Influence Head Movements in Conversation

Author: Boker, Steven M., Cohn, Jeffrey F., Theobald, Barry-John, Matthews, Iain, Mangini, Michael, Spies, Jeffrey R., Ambadar, Zara, and Brick, Timothy R.
Published: 2011
Full Text: View/download PDF

9. Justify your alpha

Author: Human-Media Interaction Technology, Leerstoel Buskens, Social Networks, Solidarity and Inequality, Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Van Calster, Ben, Carlsson, Rickard, Chen, Sau Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, Debruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Van Harmelen, Anne Laura, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavský, Jiří, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, De Oliveira, Cilene Lino, De Xivry, Jean Jacques Orban, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, Zwaan, Rolf A., Human-Media Interaction Technology, Leerstoel Buskens, Social Networks, Solidarity and Inequality, Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Van Calster, Ben, Carlsson, Rickard, Chen, Sau Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, Debruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Van Harmelen, Anne Laura, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavský, Jiří, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, De Oliveira, Cilene Lino, De Xivry, Jean Jacques Orban, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, and Zwaan, Rolf A.
Published: 2018

10. The benefits of open research: How sharing can help researchers succeed

Author: McKiernan, Erin, Bourne, Philip E., Brown, C. Titus, Buck, Stuart, Amye Kenall, Lin, Jennifer, McDougall, Damon, Nosek, Brian, Ram, Karthik, Soderberg, Courtney, Spies, Jeffrey R., Thaney, Kaitlin, Updegrove, Andrew, Woo, Kara, and Yarkoni, Tal
Abstract: This is a preprint, which has been submitted for publication in an open access journal. Open access, open data, open source, and other open scholarship practices are growing in popularity and necessity. However, widespread adoption of these practices has not yet been achieved. One reason is that researchers are uncertain about how sharing their work will affect their careers. We review literature demonstrating that open research is associated with gains in citation rate, media attention, collaboration opportunities, author reputation, funding opportunities, and more. These findings are evidence that open research practices bring significant benefits to researchers, relative to more traditional closed practices.
Published: 2016
Full Text: View/download PDF

11. SHARE: Community-focused Infrastructure and a Public Goods, Scholarly Database to Advance Access to Research

Author: Hudson-Vitale, Cynthia R., primary, Johnson, Richard P., additional, Ruttenberg, Judy, additional, and Spies, Jeffrey R., additional
Published: 2017
Full Text: View/download PDF

12. The open research value proposition: How sharing can help researchers succeed

Author: McKiernan, Erin, Bourne, Philip E., Brown, C. Titus, Buck, Stuart, Amye Kenall, Lin, Jennifer, McDougall, Damon, Nosek, Brian, Ram, Karthik, Soderberg, Courtney, Spies, Jeffrey R., Thaney, Kaitlin, Updegrove, Andrew, Woo, Kara, and Yarkoni, Tal
Abstract: This is a working paper. Feedback is welcome! AbstractOpen access, open data, open source, and other open scholarship practices are growing in necessity and popularity, rapidly becoming part of the integral workflow of researchers. However, widespread adoption of many of these practices has not yet been achieved. Understandably, researchers have concerns as to how sharing their work will affect their careers. Some of these concerns stem from a lack of awareness about the career benefits associated with open research. Herein, we review literature on the open citation advantage, media attention for publicly available research, collaborative possibilities, and special funding opportunities to show how open practices can give researchers a competitive advantage.
Published: 2015
Full Text: View/download PDF

13. Response to Comment on 'Estimating the reproducibility of psychological science'

Author: Anderson, Christopher J, Bahník, Štěpán, Barnett-Cowan, Michael, Bosco, Frank A, Chandler, Jesse, Chartier, Christopher R, Cheung, Felix, Christopherson, Cody D, Cordes, Andreas, Cremata, Edward J, Della Penna, Nicolas, Estel, Vivien, Fedor, Anna, Fitneva, Stanka A, Frank, Michael C, Grange, James A, Hartshorne, Joshua K, Hasselman, Fred, Henninger, Felix, van der Hulst, Marije, Jonas, Kai J, Lai, Calvin K, Levitan, Carmel A, Miller, Jeremy K, Moore, Katherine S, Meixner, Johannes M, Munafò, Marcus R, Neijenhuijs, Koen I, Nilsonne, Gustav, Nosek, Brian A, Plessow, Franziska, Prenoveau, Jason M, Ricker, Ashley A, Schmidt, Kathleen, Spies, Jeffrey R, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B, van Aert, Robbie C M, van Assen, Marcel A L M, Vanpaemel, Wolf, Vianello, Michelangelo, Voracek, Martin, Zuni, Kellylynn, Anderson, Christopher J, Bahník, Štěpán, Barnett-Cowan, Michael, Bosco, Frank A, Chandler, Jesse, Chartier, Christopher R, Cheung, Felix, Christopherson, Cody D, Cordes, Andreas, Cremata, Edward J, Della Penna, Nicolas, Estel, Vivien, Fedor, Anna, Fitneva, Stanka A, Frank, Michael C, Grange, James A, Hartshorne, Joshua K, Hasselman, Fred, Henninger, Felix, van der Hulst, Marije, Jonas, Kai J, Lai, Calvin K, Levitan, Carmel A, Miller, Jeremy K, Moore, Katherine S, Meixner, Johannes M, Munafò, Marcus R, Neijenhuijs, Koen I, Nilsonne, Gustav, Nosek, Brian A, Plessow, Franziska, Prenoveau, Jason M, Ricker, Ashley A, Schmidt, Kathleen, Spies, Jeffrey R, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B, van Aert, Robbie C M, van Assen, Marcel A L M, Vanpaemel, Wolf, Vianello, Michelangelo, Voracek, Martin, and Zuni, Kellylynn
Abstract: Gilbert et al. conclude that evidence from the Open Science Collaboration's Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data. Using the Reproducibility Project: Psychology data, both optimistic and pessimistic conclusions about reproducibility are possible, and neither are yet warranted.
Published: 2016

14. Response to Comment on 'Estimating the reproducibility of psychological science'

Author: Anderson, Christopher J., Bahník, Štěpán, Barnett-Cowan, Michael, Bosco, Frank A., Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cordes, Andreas, Cremata, Edward J., Della Penna, Nicolas, Estel, Vivien, Fedor, Anna, Fitneva, Stanka A., Frank, Michael C., Grange, James A., Hartshorne, Joshua K., Hasselman, Fred, Henninger, Felix, van der Hulst, Marije, Jonas, Kai J., Lai, Calvin K., Levitan, Carmel A., Miller, Jeremy K., Moore, Katherine S., Meixner, Johannes M., Munafò, Marcus R., Neijenhuijs, Koen I., Nilsonne, Gustav, Nosek, Brian A., Plessow, Franziska, Prenoveau, Jason M., Ricker, Ashley A., Schmidt, Kathleen, Spies, Jeffrey R., Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., van Aert, Robbie C. M., van Assen, Marcel A. L. M., Vanpaemel, Wolf, Vianello, Michelangelo, Voracek, Martin, Zuni, Kellylynn, Anderson, Christopher J., Bahník, Štěpán, Barnett-Cowan, Michael, Bosco, Frank A., Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cordes, Andreas, Cremata, Edward J., Della Penna, Nicolas, Estel, Vivien, Fedor, Anna, Fitneva, Stanka A., Frank, Michael C., Grange, James A., Hartshorne, Joshua K., Hasselman, Fred, Henninger, Felix, van der Hulst, Marije, Jonas, Kai J., Lai, Calvin K., Levitan, Carmel A., Miller, Jeremy K., Moore, Katherine S., Meixner, Johannes M., Munafò, Marcus R., Neijenhuijs, Koen I., Nilsonne, Gustav, Nosek, Brian A., Plessow, Franziska, Prenoveau, Jason M., Ricker, Ashley A., Schmidt, Kathleen, Spies, Jeffrey R., Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., van Aert, Robbie C. M., van Assen, Marcel A. L. M., Vanpaemel, Wolf, Vianello, Michelangelo, Voracek, Martin, and Zuni, Kellylynn
Abstract: Gilbert et al. conclude that evidence from the Open Science Collaboration's Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data. Using the Reproducibility Project: Psychology data, both optimistic and pessimistic conclusions about reproducibility are possible, and neither are yet warranted.
Published: 2016
Full Text: View/download PDF

15. Response to Comment on 'Estimating the reproducibility of psychological science'

Author: Social Networks, Solidarity and Inequality, Leerstoel Buskens, Anderson, Christopher J, Bahník, Štěpán, Barnett-Cowan, Michael, Bosco, Frank A, Chandler, Jesse, Chartier, Christopher R, Cheung, Felix, Christopherson, Cody D, Cordes, Andreas, Cremata, Edward J, Della Penna, Nicolas, Estel, Vivien, Fedor, Anna, Fitneva, Stanka A, Frank, Michael C, Grange, James A, Hartshorne, Joshua K, Hasselman, Fred, Henninger, Felix, van der Hulst, Marije, Jonas, Kai J, Lai, Calvin K, Levitan, Carmel A, Miller, Jeremy K, Moore, Katherine S, Meixner, Johannes M, Munafò, Marcus R, Neijenhuijs, Koen I, Nilsonne, Gustav, Nosek, Brian A, Plessow, Franziska, Prenoveau, Jason M, Ricker, Ashley A, Schmidt, Kathleen, Spies, Jeffrey R, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B, van Aert, Robbie C M, van Assen, Marcel A L M, Vanpaemel, Wolf, Vianello, Michelangelo, Voracek, Martin, Zuni, Kellylynn, Social Networks, Solidarity and Inequality, Leerstoel Buskens, Anderson, Christopher J, Bahník, Štěpán, Barnett-Cowan, Michael, Bosco, Frank A, Chandler, Jesse, Chartier, Christopher R, Cheung, Felix, Christopherson, Cody D, Cordes, Andreas, Cremata, Edward J, Della Penna, Nicolas, Estel, Vivien, Fedor, Anna, Fitneva, Stanka A, Frank, Michael C, Grange, James A, Hartshorne, Joshua K, Hasselman, Fred, Henninger, Felix, van der Hulst, Marije, Jonas, Kai J, Lai, Calvin K, Levitan, Carmel A, Miller, Jeremy K, Moore, Katherine S, Meixner, Johannes M, Munafò, Marcus R, Neijenhuijs, Koen I, Nilsonne, Gustav, Nosek, Brian A, Plessow, Franziska, Prenoveau, Jason M, Ricker, Ashley A, Schmidt, Kathleen, Spies, Jeffrey R, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B, van Aert, Robbie C M, van Assen, Marcel A L M, Vanpaemel, Wolf, Vianello, Michelangelo, Voracek, Martin, and Zuni, Kellylynn
Published: 2016

16. Author response: How open science helps researchers succeed

Author: McKiernan, Erin C, primary, Bourne, Philip E, additional, Brown, C Titus, additional, Buck, Stuart, additional, Kenall, Amye, additional, Lin, Jennifer, additional, McDougall, Damon, additional, Nosek, Brian A, additional, Ram, Karthik, additional, Soderberg, Courtney K, additional, Spies, Jeffrey R, additional, Thaney, Kaitlin, additional, Updegrove, Andrew, additional, Woo, Kara H, additional, and Yarkoni, Tal, additional
Published: 2016
Full Text: View/download PDF

17. Response to Comment on “Estimating the reproducibility of psychological science”

Author: Anderson, Christopher J., primary, Bahník, Štěpán, additional, Barnett-Cowan, Michael, additional, Bosco, Frank A., additional, Chandler, Jesse, additional, Chartier, Christopher R., additional, Cheung, Felix, additional, Christopherson, Cody D., additional, Cordes, Andreas, additional, Cremata, Edward J., additional, Della Penna, Nicolas, additional, Estel, Vivien, additional, Fedor, Anna, additional, Fitneva, Stanka A., additional, Frank, Michael C., additional, Grange, James A., additional, Hartshorne, Joshua K., additional, Hasselman, Fred, additional, Henninger, Felix, additional, van der Hulst, Marije, additional, Jonas, Kai J., additional, Lai, Calvin K., additional, Levitan, Carmel A., additional, Miller, Jeremy K., additional, Moore, Katherine S., additional, Meixner, Johannes M., additional, Munafò, Marcus R., additional, Neijenhuijs, Koen I., additional, Nilsonne, Gustav, additional, Nosek, Brian A., additional, Plessow, Franziska, additional, Prenoveau, Jason M., additional, Ricker, Ashley A., additional, Schmidt, Kathleen, additional, Spies, Jeffrey R., additional, Stieger, Stefan, additional, Strohminger, Nina, additional, Sullivan, Gavin B., additional, van Aert, Robbie C. M., additional, van Assen, Marcel A. L. M., additional, Vanpaemel, Wolf, additional, Vianello, Michelangelo, additional, Voracek, Martin, additional, and Zuni, Kellylynn, additional
Published: 2016
Full Text: View/download PDF

18. Estimating the reproducibility of psychological science

Author: Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, and Zuni, Kellylynn
Abstract: Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.
Published: 2015

19. Estimating the reproducibility of psychological science

Author: Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahnik, Stepan, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Bruening, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D. Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolas, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernandez-Castilla, Belen, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Gloeckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O. -Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jaekel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer, Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniel, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana, LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Moeschl, Marcus, Motyl, Matt, Mueller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Gandalf, Nicolas, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michele B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, Rene, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L. M., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valasek, Milan, van 't Veer, Anna E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Don, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Echeverria, Alejandro Vasquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahnik, Stepan, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Bruening, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D. Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolas, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernandez-Castilla, Belen, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Gloeckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O. -Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jaekel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer, Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniel, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana, LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Moeschl, Marcus, Motyl, Matt, Mueller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Gandalf, Nicolas, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michele B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, Rene, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L. M., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valasek, Milan, van 't Veer, Anna E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Don, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Echeverria, Alejandro Vasquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, and Zuni, Kellylynn
Abstract: Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.
Published: 2015

20. Estimating the reproducibility of psychological science

Author: Social Networks, Solidarity and Inequality, Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Social Networks, Solidarity and Inequality, Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, and Zuni, Kellylynn
Published: 2015

21. The replication recipe: What makes for a convincing replication?

Author: Brandt, M.J., IJzerman, H., Dijksterhuis, Ap, Farach, Frank J., Geller, Jason, Giner-Sorolla, Roger, Grange, James A., Perugini, Marco, Spies, Jeffrey R., van 't Veer, Anna, Brandt, M.J., IJzerman, H., Dijksterhuis, Ap, Farach, Frank J., Geller, Jason, Giner-Sorolla, Roger, Grange, James A., Perugini, Marco, Spies, Jeffrey R., and van 't Veer, Anna
Abstract: Psychological scientists have recently started to reconsider the importance of close replications in building a cumulative knowledge base; however, there is no consensus about what constitutes a convincing close replication study. To facilitate convincing close replication attempts we have developed a Replication Recipe, outlining standard criteria for a convincing close replication. Our Replication Recipe can be used by researchers, teachers, and students to conduct meaningful replication studies and integrate replications into their scholarly habits.
Published: 2014

22. An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science

Author: Alexander, Anita, Barnett-Cowan, Michael, Bartmess, Elizabeth, Bosco, Frank A., Brandt, Mark, Carp, Joshua, Chandler, Jesse J., Clay, Russ, Cleary, Hayley, Cohn, Michael, Costantini, Giulio, DeCoster, Jamie, Dunn, Elizabeth, Eggleston, Casey, Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fiedler, Susann, Field, James G., Foster, Joshua D., Frank, Michael, Frazier, Rebecca S., Fuchs, Heather M., Galak, Jeff, Galliani, Elisa Maria, Garcia, Sara, Giammanco, Elise M., Gilbert, Elizabeth A., Giner-Sorolla, Roger, Goellner, Lars, Goh, Jin X., Goss, R. Justin, Graham, Jesse, Grange, James A., Gray, Jeremy R., Gripshover, Sarah, Hartshorne, Joshua, Hayes, Timothy B., Jahn, Georg, Johnson, Kate, Johnston, William, Joy-Gaba, Jennifer A., Lai, Calvin K., Lakens, Daniel, Lane, Kristin, LeBel, Etienne P., Lee, Minha, Lemm, Kristi, Mackinnon, Sean, May, Michael, Moore, Katherine, Motyl, Matt, Mueller, Stephanie M., Munafo, Marcus, Nosek, Brian A., Olsson, Catherine, Paunesku, Dave, Perugini, Marco, Pitts, Michael, Ratliff, Kate, Renkewitz, Frank, Rutchick, Abraham M., Sandstrom, Gillian, Saxe, Rebecca, Selterman, Dylan, Simpson, William, Smith, Colin Tucker, Spies, Jeffrey R., Strohminger, Nina, Talhelm, Thomas, van 't Veer, Anna, Vianello, Michelangelo, Alexander, Anita, Barnett-Cowan, Michael, Bartmess, Elizabeth, Bosco, Frank A., Brandt, Mark, Carp, Joshua, Chandler, Jesse J., Clay, Russ, Cleary, Hayley, Cohn, Michael, Costantini, Giulio, DeCoster, Jamie, Dunn, Elizabeth, Eggleston, Casey, Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fiedler, Susann, Field, James G., Foster, Joshua D., Frank, Michael, Frazier, Rebecca S., Fuchs, Heather M., Galak, Jeff, Galliani, Elisa Maria, Garcia, Sara, Giammanco, Elise M., Gilbert, Elizabeth A., Giner-Sorolla, Roger, Goellner, Lars, Goh, Jin X., Goss, R. Justin, Graham, Jesse, Grange, James A., Gray, Jeremy R., Gripshover, Sarah, Hartshorne, Joshua, Hayes, Timothy B., Jahn, Georg, Johnson, Kate, Johnston, William, Joy-Gaba, Jennifer A., Lai, Calvin K., Lakens, Daniel, Lane, Kristin, LeBel, Etienne P., Lee, Minha, Lemm, Kristi, Mackinnon, Sean, May, Michael, Moore, Katherine, Motyl, Matt, Mueller, Stephanie M., Munafo, Marcus, Nosek, Brian A., Olsson, Catherine, Paunesku, Dave, Perugini, Marco, Pitts, Michael, Ratliff, Kate, Renkewitz, Frank, Rutchick, Abraham M., Sandstrom, Gillian, Saxe, Rebecca, Selterman, Dylan, Simpson, William, Smith, Colin Tucker, Spies, Jeffrey R., Strohminger, Nina, Talhelm, Thomas, van 't Veer, Anna, and Vianello, Michelangelo
Abstract: Reproducibility is a defining feature of science. However, because of strong incentives for innovation and weak incentives for confirmation, direct replication is rarely practiced or published. The Reproducibility Project is an open, large-scale, collaborative effort to systematically examine the rate and predictors of reproducibility in psychological science. So far, 72 volunteer researchers from 41 institutions have organized to openly and transparently replicate studies published in three prominent psychological journals in 2008. Multiple methods will be used to evaluate the findings, calculate an empirical rate of replication, and investigate factors that predict reproducibility. Whatever the result, a better understanding of reproducibility will ultimately improve confidence in scientific methodology and findings.
Published: 2012

23. Scientific Utopia

Author: Nosek, Brian A., primary, Spies, Jeffrey R., additional, and Motyl, Matt, additional
Published: 2012
Full Text: View/download PDF

24. Modeling Accuracy and Variability of Motor Timing in Treated and Untreated Parkinson’s Disease and Healthy Controls

Author: Jones, Catherine R. G., primary, Claassen, Daniel O., additional, Yu, Minhong, additional, Spies, Jeffrey R., additional, Malone, Tim, additional, Dirnberger, Georg, additional, Jahanshahi, Marjan, additional, and Kubovy, Michael, additional
Published: 2011
Full Text: View/download PDF

25. High-presence, low-bandwidth, apparent 3D video-conferencing with a single camera

Author: Brick, Timothy R., primary, Spies, Jeffrey R., additional, Theobald, Barry-John, additional, Matthews, Iain, additional, and Boker, Steven M., additional
Published: 2009
Full Text: View/download PDF

26. Justify your alpha

Author: Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, Zwaan, Rolf A., Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, and Zwaan, Rolf A.
Abstract: In response to recommendations to redefine statistical significance to p ≤ .005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.
Full Text: View/download PDF

27. Justify your alpha

Author: Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, Zwaan, Rolf A., Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, and Zwaan, Rolf A.
Abstract: In response to recommendations to redefine statistical significance to p ≤ .005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.
Full Text: View/download PDF

28. Justify your alpha

Author: Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, Zwaan, Rolf A., Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, and Zwaan, Rolf A.
Abstract: In response to recommendations to redefine statistical significance to p ≤ .005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.
Full Text: View/download PDF

29. Estimating the reproducibility of psychological science

Author: Open Science Collaboration, Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Cramblet Alvarez, Leslie D., Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolás, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O.Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E.J., Matacotta, Josh, Mathur, Maya B., May, Michael, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, Colleen, Skorinko, Jeanine L., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, van ‘t Veer, A. E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Donald, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Vásquez Echeverría, Alejandro, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Open Science Collaboration, Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Cramblet Alvarez, Leslie D., Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolás, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O.Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E.J., Matacotta, Josh, Mathur, Maya B., May, Michael, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, Colleen, Skorinko, Jeanine L., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, van ‘t Veer, A. E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Donald, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Vásquez Echeverría, Alejandro, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, and Zuni, Kellylynn
Abstract: Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.

30. Justify your alpha

Author: Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, Zwaan, Rolf A., Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, and Zwaan, Rolf A.
Abstract: In response to recommendations to redefine statistical significance to p ≤ .005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.
Full Text: View/download PDF

31. Justify your alpha

Author: Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, Zwaan, Rolf A., Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, and Zwaan, Rolf A.
Abstract: In response to recommendations to redefine statistical significance to p ≤ .005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.
Full Text: View/download PDF

32. Justify your alpha

Author: Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, Zwaan, Rolf A., Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, and Zwaan, Rolf A.
Abstract: In response to recommendations to redefine statistical significance to p ≤ .005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.
Full Text: View/download PDF

33. Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability.

Author: Nosek BA, Spies JR, and Motyl M
Abstract: An academic scientist's professional success depends on publishing. Publishing norms emphasize novel, positive results. As such, disciplinary incentives encourage design, analysis, and reporting decisions that elicit positive results and ignore negative results. Prior reports demonstrate how these incentives inflate the rate of false effects in published science. When incentives favor novelty over replication, false results persist in the literature unchallenged, reducing efficiency in knowledge accumulation. Previous suggestions to address this problem are unlikely to be effective. For example, a journal of negative results publishes otherwise unpublishable reports. This enshrines the low status of the journal and its content. The persistence of false findings can be meliorated with strategies that make the fundamental but abstract accuracy motive-getting it right-competitive with the more tangible and concrete incentive-getting it published. This article develops strategies for improving scientific practices and knowledge accumulation that account for ordinary human motivations and biases., (© The Author(s) 2012.)
Published: 2012
Full Text: View/download PDF

Catalog

Books, media, physical & digital resources

See catalog results

Searchworks

Select search scope, currently: Articles

Catalog

books, media & more in Jio Institute collections

Articles

journal articles & other e-resources

Refine your results

33 results on '"Spies, Jeffrey R"'

1. The principles of tomorrow's university

2. How open science helps researchers succeed

3. Scientific Utopia: II. Restructuring incentives and practices to promote truth over publishability

4. Justify your alpha

5. The Replication Recipe: What makes for a convincing replication?

6. Effects of Damping Head Movement and Facial Expression in Dyadic Conversation Using Real-Time Facial Expression Tracking and Synthesized Avatars

7. Mapping and manipulating facial expression

8. Something in the Way We Move: Motion Dynamics, Not Perceived Sex, Influence Head Movements in Conversation

9. Justify your alpha

10. The benefits of open research: How sharing can help researchers succeed

11. SHARE: Community-focused Infrastructure and a Public Goods, Scholarly Database to Advance Access to Research

12. The open research value proposition: How sharing can help researchers succeed

13. Response to Comment on 'Estimating the reproducibility of psychological science'

14. Response to Comment on 'Estimating the reproducibility of psychological science'

15. Response to Comment on 'Estimating the reproducibility of psychological science'

16. Author response: How open science helps researchers succeed

17. Response to Comment on “Estimating the reproducibility of psychological science”

18. Estimating the reproducibility of psychological science

19. Estimating the reproducibility of psychological science

20. Estimating the reproducibility of psychological science

21. The replication recipe: What makes for a convincing replication?

22. An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science

23. Scientific Utopia

24. Modeling Accuracy and Variability of Motor Timing in Treated and Untreated Parkinson’s Disease and Healthy Controls

25. High-presence, low-bandwidth, apparent 3D video-conferencing with a single camera

26. Justify your alpha

27. Justify your alpha

28. Justify your alpha

29. Estimating the reproducibility of psychological science

30. Justify your alpha

31. Justify your alpha

32. Justify your alpha

33. Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability.

Catalog

Searchworks

Select search scope, currently: Articles Catalog books, media & more in Jio Institute collections Articles journal articles & other e-resources

Search

Search Constraints

Refine your results

Search Limiters

Topic

Publication Year Range

Language

Publication Type

Journal

Database

Publisher

33 results on '"Spies, Jeffrey R"'

Search Results

Catalog

Select search scope, currently: Articles

Catalog

books, media & more in Jio Institute collections

Articles

journal articles & other e-resources