13 results on '"Steegen, S"'
Search Results
2. Estimating the reproducibility of psychological science
- Author
-
Aarts, A, Anderson, J, Anderson, C, Attridge, P, Attwood, A, Axt, J, Babel, M, Bahník, Š, Baranski, E, Barnett Cowan, M, Bartmess, E, Beer, J, Bell, R, Bentley, H, Beyan, L, Binion, G, Borsboom, D, Bosch, A, Bosco, F, Bowman, S, Brandt, M, Braswell, E, Brohmer, H, Brown, B, Brown, K, Brüning, J, Calhoun Sauls, A, Callahan, S, Chagnon, E, Chandler, J, Chartier, C, Cheung, C, Cd, Cillessen, L, Clay, R, Cleary, H, Cloud, M, Cohn, M, Cohoon, J, Columbus, S, Cordes, A, Costantini, G, Cramblet Alvarez, L, Cremata, E, Crusius, J, Decoster, J, Degaetano, M, Della Penna, N, den Bezemer, B, Deserno, M, Devitt, O, Dewitte, L, Dobolyi, D, Dodson, G, Donnellan, M, Donohue, R, Dore, R, Dorrough, A, Dreber, A, Dugas, M, Dunn, E, Easey, K, Eboigbe, S, Eggleston, C, Embley, J, Epskamp, S, Errington, T, Estel, V, Farach, F, Feather, J, Fedor, A, Fernández Castilla, B, Fiedler, S, Field, J, Fitneva, S, Flagan, T, Forest, A, Forsell, E, Foster, J, Frank, M, Frazier, R, Fuchs, H, Gable, P, Galak, J, Galliani, E, Gampa, A, Garcia, S, Gazarian, D, Gilbert, E, Giner Sorolla, R, Glöckner, A, Goellner, L, Goh, J, Goldberg, R, Goodbourn, P, Gordon McKeon, S, Gorges, B, Gorges, J, Goss, J, Graham, J, Grange, J, Gray, J, Hartgerink, C, Hartshorne, J, Hasselman, F, Hayes, T, Heikensten, E, Henninger, F, Hodsoll, J, Holubar, T, Hoogendoorn, G, Humphries, D, Hung, C, Immelman, N, Irsik, V, Jahn, G, Jäkel, F, Jekel, M, Johannesson, M, Johnson, L, Johnson, D, Johnson, K, Johnston, W, Jonas, K, Joy Gaba, J, Kappes, H, Kelso, K, Kidwell, M, Kim, S, Kirkhart, M, Kleinberg, B, Kneževic, G, Kolorz, F, Kossakowski, J, Krause, R, Krijnen, J, Kuhlmann, T, Kunkels, Y, Kyc, M, Lai, C, Laique, A, Lakens, D, Lane, K, Lassetter, B, Lazarevic, L, Lebel, E, Lee, K, Lee, M, Lemm, K, Levitan, C, Lewis, M, Lin, L, Lin, S, Lippold, M, Loureiro, D, Luteijn, I, Mackinnon, S, Mainard, H, Marigold, D, Martin, D, Martinez, T, Masicampo, E, Matacotta, J, Mathur, M, May, M, Mechin, N, Mehta, P, Meixner, J, Melinger, A, Miller, J, Miller, M, Moore, K, Möschl, M, Motyl, M, Müller, S, Munafo, M, Neijenhuijs, K, Nervi, T, Nicolas, G, Nilsonne, G, Nosek, B, Nuijten, M, Olsson, C, Osborne, C, Ostkamp, L, Pavel, M, Penton Voak, I, Perna, O, Pernet, C, Perugini, M, Pipitone, N, Pitts, M, Plessow, F, Prenoveau, J, Rahal, R, Ratliff, K, Reinhard, D, Renkewitz, F, Ricker, A, Rigney, A, Rivers, A, Roebke, M, Rutchick, A, Ryan, R, Sahin, O, Saide, A, Sandstrom, G, Santos, D, Saxe, R, Schlegelmilch, R, Schmidt, K, Scholz, S, Seibel, L, Selterman, D, Shaki, S, Simpson, E, Sinclair, H, Skorinko, J, Slowik, A, Snyder, J, Soderberg, C, Sonnleitner, C, Spencer, N, Spies, J, Steegen, S, Stieger, S, Strohminger, N, Sullivan, G, Talhelm, T, Tapia, M, te Dorsthorst, A, Thomae, M, Thomas, S, Tio, P, Traets, F, Tsang, S, Tuerlinckx, F, Turchan, P, Valášek, M, van 't Veer, A, Van Aert, R, van Assen, M, van Bork, R, van de Ven, M, van den Bergh, D, van der Hulst, M, van Dooren, R, van Doorn, J, van Renswoude, D, van Rijn, H, Vanpaemel, W, Vásquez Echeverría, A, Vazquez, M, Velez, N, Vermue, M, Verschoor, M, Vianello, M, Voracek, M, Vuu, G, Wagenmakers, E, Weerdmeester, J, Welsh, A, Westgate, E, Wissink, J, Wood, M, Woods, A, Wright, E, Wu, S, Zeelenberg, M, Zuni, K, Aarts, AA, Anderson, JE, Anderson, CJ, Attridge, PR, Bosco, FA, Bowman, SD, Brandt, MJ, Brown, BT, Callahan, SP, Chartier, CR, Cheung, Christopherson, CD, Cloud, MD, COSTANTINI, GIULIO, Cramblet Alvarez, LD, DeCoster, J, DeGaetano, MA, Deserno, MK, Dobolyi, DG, Dodson, GT, Donnellan, MB, Dore, RA, Dunn, EW, Errington, TM, Farach, FJ, Field, JG, Fitneva, SA, Forest, AL, Foster, JD, Frank, MC, Frazier, RS, Galliani, EM, Goh, JX, Goodbourn, PT, Grange, JA, Humphries, DJ, Hung, COY, Irsik, VC, Johnson, LG, Johnson, DJ, Johnson, KM, Johnston, WJ, Joy Gaba, JA, Kappes, HB, Kidwell, MC, Kim, SK, Kolorz, FM, Kossakowski, JJ, Krause, RM, Kunkels, YK, Kyc, MM, Lai, CK, Lane, KA, Lazarevic, LB, LeBel, EP, Lee, KJ, Levitan, CA, Lin, Lin, Mainard, HN, Marigold, DC, Martin, DP, Masicampo, EJ, Miller, JK, Möschl,M, Müller, SM, Neijenhuijs, KI, Nosek, BA, Nuijten, MB, Penton Voak, IS, PERUGINI, MARCO, Prenoveau, JM, Rahal, RM, Ratliff, KA, Ricker, AA, Rivers, AM, Rutchick, AM, Ryan, RS, Sandstrom, GM, Selterman, DF, Simpson, EB, Sinclair, HC, Skorinko, JLM, Snyder, JS, Spies, JR, Sullivan, GB, Thomas, SL, van 't Veer, AE, van Renswoude, DR, Wagenmakers, EJ, Westgate, EC, Zuni, K., Aarts, A, Anderson, J, Anderson, C, Attridge, P, Attwood, A, Axt, J, Babel, M, Bahník, Š, Baranski, E, Barnett Cowan, M, Bartmess, E, Beer, J, Bell, R, Bentley, H, Beyan, L, Binion, G, Borsboom, D, Bosch, A, Bosco, F, Bowman, S, Brandt, M, Braswell, E, Brohmer, H, Brown, B, Brown, K, Brüning, J, Calhoun Sauls, A, Callahan, S, Chagnon, E, Chandler, J, Chartier, C, Cheung, C, Cd, Cillessen, L, Clay, R, Cleary, H, Cloud, M, Cohn, M, Cohoon, J, Columbus, S, Cordes, A, Costantini, G, Cramblet Alvarez, L, Cremata, E, Crusius, J, Decoster, J, Degaetano, M, Della Penna, N, den Bezemer, B, Deserno, M, Devitt, O, Dewitte, L, Dobolyi, D, Dodson, G, Donnellan, M, Donohue, R, Dore, R, Dorrough, A, Dreber, A, Dugas, M, Dunn, E, Easey, K, Eboigbe, S, Eggleston, C, Embley, J, Epskamp, S, Errington, T, Estel, V, Farach, F, Feather, J, Fedor, A, Fernández Castilla, B, Fiedler, S, Field, J, Fitneva, S, Flagan, T, Forest, A, Forsell, E, Foster, J, Frank, M, Frazier, R, Fuchs, H, Gable, P, Galak, J, Galliani, E, Gampa, A, Garcia, S, Gazarian, D, Gilbert, E, Giner Sorolla, R, Glöckner, A, Goellner, L, Goh, J, Goldberg, R, Goodbourn, P, Gordon McKeon, S, Gorges, B, Gorges, J, Goss, J, Graham, J, Grange, J, Gray, J, Hartgerink, C, Hartshorne, J, Hasselman, F, Hayes, T, Heikensten, E, Henninger, F, Hodsoll, J, Holubar, T, Hoogendoorn, G, Humphries, D, Hung, C, Immelman, N, Irsik, V, Jahn, G, Jäkel, F, Jekel, M, Johannesson, M, Johnson, L, Johnson, D, Johnson, K, Johnston, W, Jonas, K, Joy Gaba, J, Kappes, H, Kelso, K, Kidwell, M, Kim, S, Kirkhart, M, Kleinberg, B, Kneževic, G, Kolorz, F, Kossakowski, J, Krause, R, Krijnen, J, Kuhlmann, T, Kunkels, Y, Kyc, M, Lai, C, Laique, A, Lakens, D, Lane, K, Lassetter, B, Lazarevic, L, Lebel, E, Lee, K, Lee, M, Lemm, K, Levitan, C, Lewis, M, Lin, L, Lin, S, Lippold, M, Loureiro, D, Luteijn, I, Mackinnon, S, Mainard, H, Marigold, D, Martin, D, Martinez, T, Masicampo, E, Matacotta, J, Mathur, M, May, M, Mechin, N, Mehta, P, Meixner, J, Melinger, A, Miller, J, Miller, M, Moore, K, Möschl, M, Motyl, M, Müller, S, Munafo, M, Neijenhuijs, K, Nervi, T, Nicolas, G, Nilsonne, G, Nosek, B, Nuijten, M, Olsson, C, Osborne, C, Ostkamp, L, Pavel, M, Penton Voak, I, Perna, O, Pernet, C, Perugini, M, Pipitone, N, Pitts, M, Plessow, F, Prenoveau, J, Rahal, R, Ratliff, K, Reinhard, D, Renkewitz, F, Ricker, A, Rigney, A, Rivers, A, Roebke, M, Rutchick, A, Ryan, R, Sahin, O, Saide, A, Sandstrom, G, Santos, D, Saxe, R, Schlegelmilch, R, Schmidt, K, Scholz, S, Seibel, L, Selterman, D, Shaki, S, Simpson, E, Sinclair, H, Skorinko, J, Slowik, A, Snyder, J, Soderberg, C, Sonnleitner, C, Spencer, N, Spies, J, Steegen, S, Stieger, S, Strohminger, N, Sullivan, G, Talhelm, T, Tapia, M, te Dorsthorst, A, Thomae, M, Thomas, S, Tio, P, Traets, F, Tsang, S, Tuerlinckx, F, Turchan, P, Valášek, M, van 't Veer, A, Van Aert, R, van Assen, M, van Bork, R, van de Ven, M, van den Bergh, D, van der Hulst, M, van Dooren, R, van Doorn, J, van Renswoude, D, van Rijn, H, Vanpaemel, W, Vásquez Echeverría, A, Vazquez, M, Velez, N, Vermue, M, Verschoor, M, Vianello, M, Voracek, M, Vuu, G, Wagenmakers, E, Weerdmeester, J, Welsh, A, Westgate, E, Wissink, J, Wood, M, Woods, A, Wright, E, Wu, S, Zeelenberg, M, Zuni, K, Aarts, AA, Anderson, JE, Anderson, CJ, Attridge, PR, Bosco, FA, Bowman, SD, Brandt, MJ, Brown, BT, Callahan, SP, Chartier, CR, Cheung, Christopherson, CD, Cloud, MD, COSTANTINI, GIULIO, Cramblet Alvarez, LD, DeCoster, J, DeGaetano, MA, Deserno, MK, Dobolyi, DG, Dodson, GT, Donnellan, MB, Dore, RA, Dunn, EW, Errington, TM, Farach, FJ, Field, JG, Fitneva, SA, Forest, AL, Foster, JD, Frank, MC, Frazier, RS, Galliani, EM, Goh, JX, Goodbourn, PT, Grange, JA, Humphries, DJ, Hung, COY, Irsik, VC, Johnson, LG, Johnson, DJ, Johnson, KM, Johnston, WJ, Joy Gaba, JA, Kappes, HB, Kidwell, MC, Kim, SK, Kolorz, FM, Kossakowski, JJ, Krause, RM, Kunkels, YK, Kyc, MM, Lai, CK, Lane, KA, Lazarevic, LB, LeBel, EP, Lee, KJ, Levitan, CA, Lin, Lin, Mainard, HN, Marigold, DC, Martin, DP, Masicampo, EJ, Miller, JK, Möschl,M, Müller, SM, Neijenhuijs, KI, Nosek, BA, Nuijten, MB, Penton Voak, IS, PERUGINI, MARCO, Prenoveau, JM, Rahal, RM, Ratliff, KA, Ricker, AA, Rivers, AM, Rutchick, AM, Ryan, RS, Sandstrom, GM, Selterman, DF, Simpson, EB, Sinclair, HC, Skorinko, JLM, Snyder, JS, Spies, JR, Sullivan, GB, Thomas, SL, van 't Veer, AE, van Renswoude, DR, Wagenmakers, EJ, Westgate, EC, and Zuni, K.
- Abstract
Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.
- Published
- 2015
3. Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability
- Author
-
Lena F. Aeschbach, Balazs Aczel, Maria Vlachou, Blair Saunders, Jennifer A. Joy-Gaba, Ailsa E. Millen, Christopher R. Chartier, Danielle J. Kellier, Carlo Chiorri, Damian Pieńkosz, Tiago Jessé Souza de Lima, Sean Hughes, Carmel A. Levitan, Luca Andrighetto, Mallory C. Kidwell, Domenico Viganola, Sebastiaan Pessers, Sue Kraus, Claudia Chloe Brumbaugh, John E. Edlund, Ernest Baskin, Anna Fedor, Brett Mercier, Michał J. Białek, Sean Coary, Antonia M. Ciunci, Bence E. Bakos, Jon Grahe, Sabina Kołodziej, Radomir Belopavlović, Emilian Pękala, William J. Chopik, Rosanna E. Guadagno, Don A. Moore, Florian Brühlmann, Gideon Nave, Katarzyna Idzikowska, Rachel L. Shubella, Ryan J. Walker, Orsolya Szöke, Mathias Kauff, Ana Orlić, Sara Steegen, Hans IJzerman, Katarzyna Kuchno, Mitchell M. Metzger, Heather M. Claypool, Michael J. Wood, Samuel Lincoln Bezerra Lins, Michael C. Frank, Benjamin Dering, Iris Žeželj, Erica Baranski, Sophia C. Weissgerber, Timothy Razza, Leanne Boucher, Magnus Johannesson, R. Weylin Sternglanz, Yiling Chen, Maya B. Mathur, Christian Nunnally, Jonathan Ravid, Charles R. Ebersole, Lauren Skorb, Kurt Schuepfer, Łukasz Markiewicz, Thomas Schultze, Katherine S. Corker, Thomas Pfeiffer, Darko Stojilović, Oliver Christ, Kayla Ashbaugh, Alan Jern, Caio Ambrosio Lage, Filipe Falcão, Austin Lee Nichols, Peter Babincak, Mauro Giacomantonio, Sean C. Rife, Rafał Muda, Lacy E. Krueger, Jeremy K. Miller, Juliette Richetin, Martin Corley, Venus Meyet, W. Matthew Collins, Luana Elayne Cunha de Souza, Lynda A. R. Stein, Christopher Day, Erica Casini, Astrid Schütz, Ann-Kathrin Torka, Anna Dreber, Diane-Jo Bart-Plange, Steffen R. Giessner, Holly Arrow, Przemysław Sawicki, Joachim Hüffmeier, Ian R. Ferguson, Anna Dalla Rosa, Natasha Tidwell, Hause Lin, Matthew R. Penner, Boban Petrović, Bojana Bodroža, Janos Salamon, Josiah P. J. King, Mark Zrubka, Diane B. V. Bonfiglio, Stefan Schulz-Hardt, Emily Fryberger, Gabriel Baník, David Zealley, Amanda M. Kimbrough, Ewa Hałasa, William Jiménez-Leal, Angelo Panno, Karolina Krasuska, Michael Inzlicht, Jack Arnal, Madhavi Menon, Jia E. Loy, Vanessa S. Kolb, Nicholas G. Bloxsom, Michael H. Bernstein, Máire B. Ford, Grecia Kessinger, Marija V. Čolić, Wolf Vanpaemel, Barnabas Szaszi, Carly tocco, Nick Buttrick, Emanuele Preti, Andres Montealegre, Brian A. Nosek, Katarzyna Gawryluk, Kaylis Hase Rudy, Leigh Ann Vaughn, Anna Palinkas, Rúben Silva, Daniel Wolf, Sarah A. Novak, Aaron L. Wichman, Manuela Thomae, Adam Siegel, Ivana Pedović, Eleanor V. Langford, Kathleen Schmidt, Daniel Storage, Attila Szuts, Ljiljana B. Lazarević, Paul G. Curran, Rias A. Hilliard, Alexander Garinther, Joshua K. Hartshorne, Ani N. Shabazian, Tiago Ramos, Peter Szecsi, Hugh Rabagliati, Kimberly P. Parks, Lily Feinberg, Dylan Manfredi, Ivan Ropovik, Katrin Rentzsch, Michelangelo Vianello, Barbara Sioma, Marton Kovacs, Francis Tuerlinckx, Peter J. B. Hancock, Bradford J. Wiggins, Gavin Brent Sullivan, Danka Purić, Laboratoire Inter-universitaire de Psychologie : Personnalité, Cognition, Changement Social (LIP-PC2S), Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Savoie Mont Blanc (USMB [Université de Savoie] [Université de Chambéry]), Department of Organisation and Personnel Management, Human Resource Excellence, Ebersole, C, Mathur, M, Baranski, E, Bart-Plange, D, Buttrick, N, Chartier, C, Corker, K, Corley, M, Hartshorne, J, Ijzerman, H, Lazarević, L, Rabagliati, H, Ropovik, I, Aczel, B, Aeschbach, L, Andrighetto, L, Arnal, J, Arrow, H, Babincak, P, Bakos, B, Baník, G, Baskin, E, Belopavlović, R, Bernstein, M, Białek, M, Bloxsom, N, Bodroža, B, Bonfiglio, D, Boucher, L, Brühlmann, F, Brumbaugh, C, Casini, E, Chen, Y, Chiorri, C, Chopik, W, Christ, O, Ciunci, A, Claypool, H, Coary, S, Čolić, M, Collins, W, Curran, P, Day, C, Dering, B, Dreber, A, Edlund, J, Falcão, F, Fedor, A, Feinberg, L, Ferguson, I, Ford, M, Frank, M, Fryberger, E, Garinther, A, Gawryluk, K, Ashbaugh, K, Giacomantonio, M, Giessner, S, Grahe, J, Guadagno, R, Hałasa, E, Hancock, P, Hilliard, R, Hüffmeier, J, Hughes, S, Idzikowska, K, Inzlicht, M, Jern, A, Jiménez-Leal, W, Johannesson, M, Joy-Gaba, J, Kauff, M, Kellier, D, Kessinger, G, Kidwell, M, Kimbrough, A, King, J, Kolb, V, Kołodziej, S, Kovacs, M, Krasuska, K, Kraus, S, Krueger, L, Kuchno, K, Lage, C, Langford, E, Levitan, C, de Lima, T, Lin, H, Lins, S, Loy, J, Manfredi, D, Markiewicz, Ł, Menon, M, Mercier, B, Metzger, M, Meyet, V, Millen, A, Miller, J, Montealegre, A, Moore, D, Muda, R, Nave, G, Nichols, A, Novak, S, Nunnally, C, Orlić, A, Palinkas, A, Panno, A, Parks, K, Pedović, I, Pękala, E, Penner, M, Pessers, S, Petrović, B, Pfeiffer, T, Pieńkosz, D, Preti, E, Purić, D, Ramos, T, Ravid, J, Razza, T, Rentzsch, K, Richetin, J, Rife, S, Rosa, A, Rudy, K, Salamon, J, Saunders, B, Sawicki, P, Schmidt, K, Schuepfer, K, Schultze, T, Schulz-Hardt, S, Schütz, A, Shabazian, A, Shubella, R, Siegel, A, Silva, R, Sioma, B, Skorb, L, de Souza, L, Steegen, S, Stein, L, Sternglanz, R, Stojilović, D, Storage, D, Sullivan, G, Szaszi, B, Szecsi, P, Szöke, O, Szuts, A, Thomae, M, Tidwell, N, Tocco, C, Torka, A, Tuerlinckx, F, Vanpaemel, W, Vaughn, L, Vianello, M, Viganola, D, Vlachou, M, Walker, R, Weissgerber, S, Wichman, A, Wiggins, B, Wolf, D, Wood, M, Zealley, D, Žeželj, I, Zrubka, M, Nosek, B, and Faculdade de Psicologia e de Ciências da Educação
- Subjects
replication ,metascience ,Registered Reports ,biology ,media_common.quotation_subject ,Curran ,05 social sciences ,[SHS.PSY]Humanities and Social Sciences/Psychology ,open data ,Art history ,050109 social psychology ,Art ,biology.organism_classification ,preregistered ,050105 experimental psychology ,Attila ,[STAT.ML]Statistics [stat]/Machine Learning [stat.ML] ,0501 psychology and cognitive sciences ,reproducibility ,[STAT.ME]Statistics [stat]/Methodology [stat.ME] ,General Psychology ,media_common - Abstract
Additional co-authors: Ivan Ropovik, Balazs Aczel, Lena F. Aeschbach, Luca Andrighetto, Jack D. Arnal, Holly Arrow, Peter Babincak, Bence E. Bakos, Gabriel Banik, Ernest Baskin, Radomir Belopavlovic, Michael H. Bernstein, Michal Bialek, Nicholas G. Bloxsom, Bojana Bodroža, Diane B. V. Bonfiglio, Leanne Boucher, Florian Bruhlmann, Claudia C. Brumbaugh, Erica Casini, Yiling Chen, Carlo Chiorri, William J. Chopik, Oliver Christ, Antonia M. Ciunci, Heather M. Claypool, Sean Coary, Marija V. Cˇolic, W. Matthew Collins, Paul G. Curran, Chris R. Day, Anna Dreber, John E. Edlund, Filipe Falcao, Anna Fedor, Lily Feinberg, Ian R. Ferguson, Maire Ford, Michael C. Frank, Emily Fryberger, Alexander Garinther, Katarzyna Gawryluk, Kayla Ashbaugh, Mauro Giacomantonio, Steffen R. Giessner, Jon E. Grahe, Rosanna E. Guadagno, Ewa Halasa, Rias A. Hilliard, Joachim Huffmeier, Sean Hughes, Katarzyna Idzikowska, Michael Inzlicht, Alan Jern, William Jimenez-Leal, Magnus Johannesson, Jennifer A. Joy-Gaba, Mathias Kauff, Danielle J. Kellier, Grecia Kessinger, Mallory C. Kidwell, Amanda M. Kimbrough, Josiah P. J. King, Vanessa S. Kolb, Sabina Kolodziej, Marton Kovacs, Karolina Krasuska, Sue Kraus, Lacy E. Krueger, Katarzyna Kuchno, Caio Ambrosio Lage, Eleanor V. Langford, Carmel A. Levitan, Tiago Jesse Souza de Lima, Hause Lin, Samuel Lins, Jia E. Loy, Dylan Manfredi, Łukasz Markiewicz, Madhavi Menon, Brett Mercier, Mitchell Metzger, Venus Meyet, Jeremy K. Miller, Andres Montealegre, Don A. Moore, Rafal Muda, Gideon Nave, Austin Lee Nichols, Sarah A. Novak, Christian Nunnally, Ana Orlic, Anna Palinkas, Angelo Panno, Kimberly P. Parks, Ivana Pedovic, Emilian Pekala, Matthew R. Penner, Sebastiaan Pessers, Boban Petrovic, Thomas Pfeiffer, Damian Pienkosz, Emanuele Preti, Danka Puric, Tiago Ramos, Jonathan Ravid, Timothy S. Razza, Katrin Rentzsch, Juliette Richetin, Sean C. Rife, Anna Dalla Rosa, Kaylis Hase Rudy, Janos Salamon, Blair Saunders, Przemyslaw Sawicki, Kathleen Schmidt, Kurt Schuepfer, Thomas Schultze, Stefan Schulz-Hardt, Astrid Schutz, Ani N. Shabazian, Rachel L. Shubella, Adam Siegel, Ruben Silva, Barbara Sioma, Lauren Skorb, Luana Elayne Cunha de Souza, Sara Steegen, L. A. R. Stein, R. Weylin Sternglanz, Darko Stojilovic, Daniel Storage, Gavin Brent Sullivan, Barnabas Szaszi, Peter Szecsi, Orsolya Szoke, Attila Szuts, Manuela Thomae, Natasha D. Tidwell, Carly Tocco, Ann-Kathrin Torka, Francis Tuerlinckx, Wolf Vanpaemel, Leigh Ann Vaughn, Michelangelo Vianello, Domenico Viganola, Maria Vlachou, Ryan J. Walker, Sophia C. Weissgerber, Aaron L. Wichman, Bradford J. Wiggins, Daniel Wolf, Michael J. Wood, David Zealley, Iris Žeželj, Mark Zrubka, and Brian A. Nosek
- Published
- 2020
- Full Text
- View/download PDF
4. Estimating the reproducibility of psychological science
- Author
-
Yoram K. Kunkels, Dylan Selterman, Denise J. Humphries, Kristina G. Brown, David G. Dobolyi, David J. Johnson, Mark A. Roebke, Andy T. Woods, John Hodsoll, Marije van der Hulst, Alexander A. Aarts, Kim Kelso, Erin C. Westgate, James A. Grange, Jesse Chandler, Jenelle Feather, Annick Bosch, Olivia Devitt, Benjamin T. Brown, Megan M. Kyc, Štěpán Bahník, Alissa Melinger, Michael Conn, Rebecca S. Frazier, Marc Jekel, Sara Bowman, Michael J. Wood, Erica Baranski, Sining Wu, Milan Valášek, Anna E. Van't Veer, Jeanine L. M. Skorinko, Joeri Wissink, Sara Steegen, Michael C. Pitts, Douglas Gazarian, Steve N.H. Tsang, Matthew W. Kirkhart, Jennifer S. Beer, Nathali Immelman, Elizabeth Chagnon, Robbie C. M. van Aert, Maya B. Mathur, Magnus Johannesson, Joshua D. Foster, Frank J. Farach, Gandalf Nicolas, Ian S. Penton-Voak, Rebecca M. Goldberg, Sarah L. Thomas, Kathleen Schmidt, Stephanie C. Lin, Linda Cillessen, Belén Fernández-Castilla, Taru Flagan, René Schlegelmilch, Joanneke Weerdmeester, Cyril Pernet, Andreas Cordes, Onur Sahin, Jolanda J. Kossakowski, Samuel Shaki, David Santos, Sabine Scholz, Jeremy R. Gray, Frank Renkewitz, Key Jung Lee, Gillian M. Sandstrom, Marie K. Deserno, Melissa Vazquez, Ed Cremata, Rebecca Saxe, Manuela Thomae, Johannes M. Meixner, Emma Heikensten, Sylvia Eboigbe, Carmel A. Levitan, Natalia Vélez, James G. Field, Riet van Bork, Vivien Estel, Michèle B. Nuijten, Lin Lin, Kate M. Johnson, Bobby Den Bezemer, Jennifer A. Joy-Gaba, Francis Tuerlinckx, Frits Traets, Ilse Luteijn, Christopher R. Chartier, Denise C. Marigold, Denny Borsboom, Elizabeth Gilbert, Jeff Galak, Shannon P. Callahan, E. J. Masicampo, Thomas Talhelm, Chris H.J. Hartgerink, Patrick T. Goodbourn, Stephanie M. Müller, Taylor Nervi, Marcus Möschl, Katherine Moore, Wolf Vanpaemel, Seung K. Kim, Elizabeth Bartmess, Heather N. Mainard, Martin Voracek, Gea Hoogendoorn, Sean P. Mackinnon, Ryan Donohue, Kate A. Ratliff, Jin X. Goh, Anastasia E. Rigney, Andreas Glöckner, Marieke Vermue, Angela S. Attwood, Michelle A. DeGaetano, Nick Spencer, Heather Bentley, Nina Strohminger, Geneva T. Dodson, R. Nathan Pipitone, Hayley M. D. Cleary, Matt Motyl, Amanda L. Forest, Marcus R. Munafò, Marcel Zeelenberg, Susann Fiedler, Ann Calhoun-Sauls, Mallorie Miller, Anondah R. Saide, Ljiljana B. Lazarević, Hilmar Brohmer, Mallory C. Kidwell, Pranjal H. Mehta, Jessie Gorges, Russ Clay, Jeffrey R. Spies, Joanna E. Anderson, Johnny van Doorn, Ashley A. Ricker, Elizabeth W. Dunn, Erin L Braswell, Jamie DeCoster, Larissa Seibel, Matthias Lippold, Lutz Ostkamp, William B. Simpson, Cathy On-Ying Hung, Carina Sonnleitner, Emily M. Wright, Laura Dewitte, Koen Ilja Neijenhuijs, Tim Kuhlmann, Job Krijnen, Leah Beyan, Jesse Graham, Andrew M Rivers, Sacha Epskamp, Aamir Laique, Christopher J. Anderson, Peter Raymond Attridge, Eric-Jan Wagenmakers, Agnieszka Slowik, Michael C. Frank, Bryan Gorges, Alejandro Vásquez Echeverría, Gina Vuu, Giulio Costantini, Eskil Forsell, Michelangelo Vianello, Don van den Bergh, Anna Fedor, Courtney K. Soderberg, M. Brent Donnellan, Kayleigh E Easey, Shauna Gordon-McKeon, Raoul Bell, William J. Johnston, Brian A. Nosek, Ashlee Welsh, Melissa Lewis, Anna Dreber, Simon Columbus, Frank A. Bosco, Pia Tio, Joshua K. Hartshorne, Lars Goellner, Elisa Maria Galliani, Etienne P. Le Bel, Kellylynn Zuni, Olivia Perna, Kristi M. Lemm, Marco Perugini, Anniek M. te Dorsthorst, Hedderik van Rijn, Timothy M. Errington, Bennett Kleinberg, Vanessa C. Irsik, Frank Jäkel, Timothy Hayes, Mark Verschoor, Mark D. Cloud, Bethany Lassetter, Justin Goss, Paul J. Turchan, Gavin Brent Sullivan, Darren Loureiro, Jo Embley, Robert S. Ryan, Jovita Brüning, Jan Crusius, Joel S. Snyder, Larissa Gabrielle Johnson, Nicolás Delia Penna, Grace Binion, Calvin K. Lai, Gustav Nilsonne, Heather M. Fuchs, Angela Rachael Dorrough, Michelle Dugas, Johanna Cohoon, Minha Lee, Robert Krause, David Reinhard, Goran Knežević, Jason M. Prenoveau, Kristin A. Lane, Stanka A. Fitneva, Rima-Maria Rahal, Mathijs Van De Ven, Anup Gampa, Marcel A.L.M. van Assen, Jordan Axt, Felix Henninger, Misha Pavel, Daniel Lakens, Jeremy K. Miller, Sara García, Leslie Cramblet Alvarez, Colleen Osborne, Kai J. Jonas, Taylor Holubar, Stefan Stieger, Heather Barry Kappes, Felix Cheung, Daan R. van Renswoude, Catherine Olsson, Roel van Dooren, Tylar Martinez, Megan Tapia, Philip A. Gable, Cody D. Christopherson, Franziska Plessow, Roger Giner-Sorolla, Abraham M. Rutchick, Michael Barnett-Cowan, Mark J. Brandt, Rebecca A. Dore, Michael May, H. Colleen Sinclair, Georg Jahn, Daniel P. Martin, Fred Hasselman, Casey Eggleston, Nicole Mechin, Joshua J. Matacotta, Molly Babel, Franziska Maria Kolorz, Social & Organizational Psychology, IBBA, Clinical Psychology, EMGO+ - Mental Health, Social Networks, Solidarity and Inequality, Department of Social Psychology, Department of Methodology and Statistics, Aarts, A, Anderson, J, Anderson, C, Attridge, P, Attwood, A, Axt, J, Babel, M, Bahník, Š, Baranski, E, Barnett Cowan, M, Bartmess, E, Beer, J, Bell, R, Bentley, H, Beyan, L, Binion, G, Borsboom, D, Bosch, A, Bosco, F, Bowman, S, Brandt, M, Braswell, E, Brohmer, H, Brown, B, Brown, K, Brüning, J, Calhoun Sauls, A, Callahan, S, Chagnon, E, Chandler, J, Chartier, C, Cheung, C, Cd, Cillessen, L, Clay, R, Cleary, H, Cloud, M, Cohn, M, Cohoon, J, Columbus, S, Cordes, A, Costantini, G, Cramblet Alvarez, L, Cremata, E, Crusius, J, Decoster, J, Degaetano, M, Della Penna, N, den Bezemer, B, Deserno, M, Devitt, O, Dewitte, L, Dobolyi, D, Dodson, G, Donnellan, M, Donohue, R, Dore, R, Dorrough, A, Dreber, A, Dugas, M, Dunn, E, Easey, K, Eboigbe, S, Eggleston, C, Embley, J, Epskamp, S, Errington, T, Estel, V, Farach, F, Feather, J, Fedor, A, Fernández Castilla, B, Fiedler, S, Field, J, Fitneva, S, Flagan, T, Forest, A, Forsell, E, Foster, J, Frank, M, Frazier, R, Fuchs, H, Gable, P, Galak, J, Galliani, E, Gampa, A, Garcia, S, Gazarian, D, Gilbert, E, Giner Sorolla, R, Glöckner, A, Goellner, L, Goh, J, Goldberg, R, Goodbourn, P, Gordon McKeon, S, Gorges, B, Gorges, J, Goss, J, Graham, J, Grange, J, Gray, J, Hartgerink, C, Hartshorne, J, Hasselman, F, Hayes, T, Heikensten, E, Henninger, F, Hodsoll, J, Holubar, T, Hoogendoorn, G, Humphries, D, Hung, C, Immelman, N, Irsik, V, Jahn, G, Jäkel, F, Jekel, M, Johannesson, M, Johnson, L, Johnson, D, Johnson, K, Johnston, W, Jonas, K, Joy Gaba, J, Kappes, H, Kelso, K, Kidwell, M, Kim, S, Kirkhart, M, Kleinberg, B, Kneževic, G, Kolorz, F, Kossakowski, J, Krause, R, Krijnen, J, Kuhlmann, T, Kunkels, Y, Kyc, M, Lai, C, Laique, A, Lakens, D, Lane, K, Lassetter, B, Lazarevic, L, Lebel, E, Lee, K, Lee, M, Lemm, K, Levitan, C, Lewis, M, Lin, L, Lin, S, Lippold, M, Loureiro, D, Luteijn, I, Mackinnon, S, Mainard, H, Marigold, D, Martin, D, Martinez, T, Masicampo, E, Matacotta, J, Mathur, M, May, M, Mechin, N, Mehta, P, Meixner, J, Melinger, A, Miller, J, Miller, M, Moore, K, Möschl, M, Motyl, M, Müller, S, Munafo, M, Neijenhuijs, K, Nervi, T, Nicolas, G, Nilsonne, G, Nosek, B, Nuijten, M, Olsson, C, Osborne, C, Ostkamp, L, Pavel, M, Penton Voak, I, Perna, O, Pernet, C, Perugini, M, Pipitone, N, Pitts, M, Plessow, F, Prenoveau, J, Rahal, R, Ratliff, K, Reinhard, D, Renkewitz, F, Ricker, A, Rigney, A, Rivers, A, Roebke, M, Rutchick, A, Ryan, R, Sahin, O, Saide, A, Sandstrom, G, Santos, D, Saxe, R, Schlegelmilch, R, Schmidt, K, Scholz, S, Seibel, L, Selterman, D, Shaki, S, Simpson, E, Sinclair, H, Skorinko, J, Slowik, A, Snyder, J, Soderberg, C, Sonnleitner, C, Spencer, N, Spies, J, Steegen, S, Stieger, S, Strohminger, N, Sullivan, G, Talhelm, T, Tapia, M, te Dorsthorst, A, Thomae, M, Thomas, S, Tio, P, Traets, F, Tsang, S, Tuerlinckx, F, Turchan, P, Valášek, M, van 't Veer, A, Van Aert, R, van Assen, M, van Bork, R, van de Ven, M, van den Bergh, D, van der Hulst, M, van Dooren, R, van Doorn, J, van Renswoude, D, van Rijn, H, Vanpaemel, W, Vásquez Echeverría, A, Vazquez, M, Velez, N, Vermue, M, Verschoor, M, Vianello, M, Voracek, M, Vuu, G, Wagenmakers, E, Weerdmeester, J, Welsh, A, Westgate, E, Wissink, J, Wood, M, Woods, A, Wright, E, Wu, S, Zeelenberg, M, Zuni, K, Sociology/ICS, Experimental Psychology, Human Technology Interaction, Sociale Psychologie (Psychologie, FMG), Ontwikkelingspsychologie (Psychologie, FMG), and Brein en Cognitie (Psychologie, FMG)
- Subjects
Research design ,Department Psychologie ,BF Psychology ,media_common.quotation_subject ,POWER ,Learning and Plasticity ,Reproducibility Project ,Q1 ,Experimental Psychopathology and Treatment ,Replication (statistics) ,Statistics ,TRUTH ,Psychology ,General ,Mathematics ,media_common ,Selection bias ,Replication crisis ,Behaviour Change and Well-being ,Multidisciplinary ,PUBLICATION ,Publication bias ,Reproducibility ,Confidence interval ,INCENTIVES ,PREVALENCE ,Meta-analysis ,REPLICABILITY ,REPLICATION ,Developmental Psychopathology ,FALSE - Abstract
IntroductionReproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. Scientific claims should not gain credence because of the status or authority of their originator but by the replicability of their supporting evidence. Even research of exemplary quality may have irreproducible empirical findings because of random or systematic error.RationaleThere is concern about the rate and predictors of reproducibility, but limited evidence. Potentially problematic practices include selective reporting, selective analysis, and insufficient specification of the conditions necessary or sufficient to obtain the results. Direct replication is the attempt to recreate the conditions believed sufficient for obtaining a previously observed finding and is the means of establishing reproducibility of a finding with new data. We conducted a large-scale, collaborative effort to obtain an initial estimate of the reproducibility of psychological science.ResultsWe conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. There is no single standard for evaluating replication success. Here, we evaluated reproducibility using significance and P values, effect sizes, subjective assessments of replication teams, and meta-analysis of effect sizes. The mean effect size (r) of the replication effects (Mr = 0.197, SD = 0.257) was half the magnitude of the mean effect size of the original effects (Mr = 0.403, SD = 0.188), representing a substantial decline. Ninety-seven percent of original studies had significant results (P < .05). Thirty-six percent of replications had significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.ConclusionNo single indicator sufficiently describes replication success, and the five indicators examined here are not the only ways to evaluate reproducibility. Nonetheless, collectively these results offer a clear conclusion: A large portion of replications produced weaker evidence for the original findings despite using materials provided by the original authors, review in advance for methodological fidelity, and high statistical power to detect the original effect sizes. Moreover, correlational evidence is consistent with the conclusion that variation in the strength of initial evidence (such as original P value) was more predictive of replication success than variation in the characteristics of the teams conducting the research (such as experience and expertise). The latter factors certainly can influence replication success, but they did not appear to do so here. Reproducibility is not well understood because the incentives for individual scientists prioritize novelty over replication. Innovation is the engine of discovery and is vital for a productive, effective scientific enterprise. However, innovative ideas become old news fast. Journal reviewers and editors may dismiss a new test of a published idea as unoriginal. The claim that “we already know this” belies the uncertainty of scientific evidence. Innovation points out paths that are possible; replication points out paths that are likely; progress relies on both. Replication can increase certainty when findings are reproduced and promote innovation when they are not. This project provides accumulating evidence for many findings in psychological research and suggests that there is still more work to do to verify whether we know what we think we know.
- Published
- 2015
- Full Text
- View/download PDF
5. A pre-registered, multi-lab non-replication of the action-sentence compatibility effect (ACE).
- Author
-
Morey RD, Kaschak MP, Díez-Álamo AM, Glenberg AM, Zwaan RA, Lakens D, Ibáñez A, García A, Gianelli C, Jones JL, Madden J, Alifano F, Bergen B, Bloxsom NG, Bub DN, Cai ZG, Chartier CR, Chatterjee A, Conwell E, Cook SW, Davis JD, Evers ERK, Girard S, Harter D, Hartung F, Herrera E, Huettig F, Humphries S, Juanchich M, Kühne K, Lu S, Lynes T, Masson MEJ, Ostarek M, Pessers S, Reglin R, Steegen S, Thiessen ED, Thomas LE, Trott S, Vandekerckhove J, Vanpaemel W, Vlachou M, Williams K, and Ziv-Crispel N
- Subjects
- Humans, Movement, Reaction Time, Comprehension, Language
- Abstract
The Action-sentence Compatibility Effect (ACE) is a well-known demonstration of the role of motor activity in the comprehension of language. Participants are asked to make sensibility judgments on sentences by producing movements toward the body or away from the body. The ACE is the finding that movements are faster when the direction of the movement (e.g., toward) matches the direction of the action in the to-be-judged sentence (e.g., Art gave you the pen describes action toward you). We report on a pre-registered, multi-lab replication of one version of the ACE. The results show that none of the 18 labs involved in the study observed a reliable ACE, and that the meta-analytic estimate of the size of the ACE was essentially zero., (© 2021. The Author(s).)
- Published
- 2022
- Full Text
- View/download PDF
6. The reproducibility of statistical results in psychological research: An investigation using unpublished raw data.
- Author
-
Artner R, Verliefde T, Steegen S, Gomes S, Traets F, Tuerlinckx F, and Vanpaemel W
- Subjects
- Humans, Reproducibility of Results, Research Design
- Abstract
We investigated the reproducibility of the major statistical conclusions drawn in 46 articles published in 2012 in three APA journals. After having identified 232 key statistical claims, we tried to reproduce, for each claim, the test statistic, its degrees of freedom, and the corresponding p value, starting from the raw data that were provided by the authors and closely following the Method section in the article. Out of the 232 claims, we were able to successfully reproduce 163 (70%), 18 of which only by deviating from the article's analytical description. Thirteen (7%) of the 185 claims deemed significant by the authors are no longer so. The reproduction successes were often the result of cumbersome and time-consuming trial-and-error work, suggesting that APA style reporting in conjunction with raw data makes numerical verification at least hard, if not impossible. This article discusses the types of mistakes we could identify and the tediousness of our reproduction efforts in the light of a newly developed taxonomy for reproducibility. We then link our findings with other findings of empirical research on this topic, give practical recommendations on how to achieve reproducibility, and discuss the challenges of large-scale reproducibility checks as well as promising ideas that could considerably increase the reproducibility of psychological research. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
- Published
- 2021
- Full Text
- View/download PDF
7. Depressive Symptoms and Category Learning: A Preregistered Conceptual Replication Study.
- Author
-
Rutten I, Voorspoels W, Steegen S, Kuppens P, and Vanpaemel W
- Abstract
We present a fully preregistered, high-powered conceptual replication of Experiment 1 by Smith, Tracy, and Murray (1993). They observed a cognitive deficit in people with elevated depressive symptoms in a task requiring flexible analytic processing and deliberate hypothesis testing, but no deficit in a task assumed to require more automatic, holistic processing. Specifically, they found that individuals with depressive symptoms showed impaired performance on a criterial-attribute classification task, requiring flexible analysis of the attributes and deliberate hypothesis testing, but not on a family-resemblance classification task, assumed to rely on holistic processing. While deficits in tasks requiring flexible hypothesis testing are commonly observed in people diagnosed with a major depressive disorder, these deficits are much less commonly observed in people with merely elevated depressive symptoms, and therefore Smith et al.'s (1993) finding deserves further scrutiny. We observed no deficit in performance on the criterial-attribute task in people with above average depressive symptoms. Rather, we found a similar difference in performance on the criterial-attribute versus family-resemblance task between people with high and low depressive symptoms. The absence of a deficit in people with elevated depressive symptoms is consistent with previous findings focusing on different tasks., Competing Interests: The authors have no competing interests to declare.
- Published
- 2018
- Full Text
- View/download PDF
8. Using parameter space partitioning to evaluate a model's qualitative fit.
- Author
-
Steegen S, Tuerlinckx F, and Vanpaemel W
- Subjects
- Humans, Models, Theoretical, Statistics as Topic
- Abstract
Parameter space partitioning (PSP) is a versatile tool for model analysis that detects the qualitatively distinctive data patterns a model can generate, and partitions a model's parameter space into regions corresponding to these patterns. In this paper, we propose a PSP fit measure that summarizes the outcome of a PSP analysis into a single number, which can be used for model selection. In contrast to traditional model selection methods, PSP-based model selection focuses on qualitative data. We demonstrate PSP-based model selection by use of application examples in the area of category learning. A large-scale model recovery study reveals excellent recovery properties, suggesting that PSP fit is useful for model selection.
- Published
- 2017
- Full Text
- View/download PDF
9. Increasing Transparency Through a Multiverse Analysis.
- Author
-
Steegen S, Tuerlinckx F, Gelman A, and Vanpaemel W
- Subjects
- Attitude, Choice Behavior, Female, Fertility, Humans, Information Management methods, Marital Status, Politics, Religion, Research Design, Data Interpretation, Statistical
- Abstract
Empirical research inevitably includes constructing a data set by processing raw data into a form ready for statistical analysis. Data processing often involves choices among several reasonable options for excluding, transforming, and coding data. We suggest that instead of performing only one analysis, researchers could perform a multiverse analysis, which involves performing all analyses across the whole set of alternatively processed data sets corresponding to a large set of reasonable scenarios. Using an example focusing on the effect of fertility on religiosity and political attitudes, we show that analyzing a single data set can be misleading and propose a multiverse analysis as an alternative practice. A multiverse analysis offers an idea of how much the conclusions change because of arbitrary choices in data construction and gives pointers as to which choices are most consequential in the fragility of the result., (© The Author(s) 2016.)
- Published
- 2016
- Full Text
- View/download PDF
10. Corrigendum: Measuring the crowd within again: a pre-registered replication study.
- Author
-
Steegen S, Dewitte L, Tuerlinckx F, and Vanpaemel W
- Abstract
[This corrects the article on p. 786 in vol. 5, PMID: 25120505.].
- Published
- 2015
- Full Text
- View/download PDF
11. Measuring the crowd within again: a pre-registered replication study.
- Author
-
Steegen S, Dewitte L, Tuerlinckx F, and Vanpaemel W
- Abstract
According to the crowd within effect, the average of two estimates from one person tends to be more accurate than a single estimate of that person. The effect implies that the well documented wisdom of the crowd effect-the crowd's average estimate tends to be more accurate than the individual estimates-can be obtained within a single individual. In this paper, we performed a high-powered, pre-registered replication study of the original experiment. Our replication results are evaluated with the traditional null hypothesis significance testing approach, as well as with effect sizes and their confidence intervals. We adopted a co-pilot approach, in the sense that all analyses were performed independently by two researchers using different analysis software. Moreover, we report Bayes factors for all tests. We successfully replicated the crowd within effect, both when the second guess was made immediately after the first guess, as well as when it was made 3 weeks later. The experimental protocol, the raw data, the post-processed data and the analysis code are available online.
- Published
- 2014
- Full Text
- View/download PDF
12. Outcome probability modulates anticipatory behavior to signals that are equally reliable.
- Author
-
Matute H, Steegen S, and Vadillo MA
- Abstract
A stimulus is a reliable signal of an outcome when the probability that the outcome occurs in its presence is different from in its absence. Reliable signals of important outcomes are responsible for triggering critical anticipatory or preparatory behavior, which is any form of behavior that prepares the organism to receive a biologically significant event. Previous research has shown that humans and other animals prepare more for outcomes that occur in the presence of highly reliable (i.e., highly contingent) signals, that is, those for which that difference is larger. However, it seems reasonable to expect that, all other things being equal, the probability with which the outcome follows the signal should also affect preparatory behavior. In the present experiment with humans, we used two signals. They were differentially followed by the outcome, but they were equally (and relatively weakly) reliable. The dependent variable was preparatory behavior in a Martians video game. Participants prepared more for the outcome (a Martians' invasion) when the outcome was most probable. These results indicate that the probability of the outcome can bias preparatory behavior to occur with different intensities despite identical outcome signaling.
- Published
- 2014
- Full Text
- View/download PDF
13. Belief inhibition in children's reasoning: memory-based evidence.
- Author
-
Steegen S and De Neys W
- Subjects
- Adolescent, Age Factors, Belgium, Child, Culture, Female, Humans, Male, Problem Solving, Reaction Time, Adolescent Development, Conflict, Psychological, Decision Making, Inhibition, Psychological, Intuition, Logic
- Abstract
Adult reasoning has been shown as mediated by the inhibition of intuitive beliefs that are in conflict with logic. The current study introduces a classic procedure from the memory field to investigate belief inhibition in 12- to 17-year-old reasoners. A lexical decision task was used to probe the memory accessibility of beliefs that were cued during thinking on syllogistic reasoning problems. Results indicated an impaired memory access for words associated with misleading beliefs that were cued during reasoning if syllogisms had been solved correctly. This finding supports the claim that even for younger reasoners, correct reasoning is mediated by inhibitory processing as soon as intuitive beliefs conflict with logical considerations., (Copyright © 2012 Elsevier Inc. All rights reserved.)
- Published
- 2012
- Full Text
- View/download PDF
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.