92 results on '"Galliani, Elisa Maria"'
Search Results
2. Theory Building through Replication: Response to Commentaries on the “Many Labs” Replication Project
- Author
-
Klein, Richard Anthony, primary, Ratliff, Kate A., additional, Vianello, Michelangelo, additional, Adams, Reginald B., additional, Bahník, Štěpán, additional, Bernstein, Michael, additional, Bocian, Konrad, additional, Brandt, Mark, additional, Brooks, Beach Smith, additional, Brumbaugh, Claudia Chloe, additional, Cemalcilar, Zeynep, additional, Chandler, Jesse J., additional, Cheong, Winnee, additional, Davis, William E., additional, Devos, Thierry, additional, Eisner, Matthew, additional, Frankowska, Natalia, additional, Furrow, David, additional, Galliani, Elisa Maria, additional, Hasselman, Fred, additional, Hicks, Joshua A., additional, Hovermale, James F., additional, Hunt, S. Jane, additional, Huntsinger, Jeffrey R., additional, IJzerman, Hans, additional, John, Melissa-Sue, additional, Joy-Gaba, Jennifer, additional, Kappes, Heather Barry, additional, Krueger, Lacy Elise, additional, Kurtz, Jaime, additional, Levitan, Carmel, additional, Mallett, Robyn, additional, Morris, Wendy, additional, Nelson, Anthony J., additional, Nier, Jason A., additional, Packard, Grant, additional, Pilati, Ronaldo, additional, Rutchick, Abraham M., additional, Schmidt, Kathleen, additional, Skorinko, Jeanine, additional, Smith, Robert, additional, Steiner, Troy G., additional, Storbeck, Justin, additional, van Swol, Lyn, additional, Thompson, Donna, additional, van 't Veer, Anna Elisabeth, additional, Vaughn, Leigh Ann, additional, Vranka, Marek Albert, additional, Wichman, Aaron Lee, additional, Woodzicka, Julie A., additional, and Nosek, Brian A., additional
- Published
- 2022
- Full Text
- View/download PDF
3. Data from Investigating Variation in Replicability: A “Many Labs” Replication Project
- Author
-
Klein, Richard Anthony, primary, Ratliff, Kate A., additional, Vianello, Michelangelo, additional, Adams, Reginald B., additional, Bahník, Štěpán, additional, Bernstein, Michael Jason, additional, Bocian, Konrad, additional, Brandt, Mark John, additional, Brooks, Beach Smith, additional, Brumbaugh, Claudia Chloe, additional, Cemalcilar, Zeynep, additional, Chandler, Jesse J., additional, Cheong, Winnee, additional, Davis, William E., additional, Devos, Thierry, additional, Eisner, Matthew, additional, Frankowska, Natalia, additional, Furrow, David, additional, Galliani, Elisa Maria, additional, Hasselman, Fred, additional, Hicks, Joshua A., additional, Hovermale, James F., additional, Hunt, S. Jane, additional, Huntsinger, Jeffrey R., additional, IJzerman, Hans, additional, John, Melissa-Sue, additional, Joy-Gaba, Jennifer Alana, additional, Kappes, Heather Barry, additional, Krueger, Lacy Elise, additional, Kurtz, Jaime, additional, Levitan, Carmel, additional, Mallett, Robyn, additional, Morris, Wendy, additional, Nelson, Anthony J., additional, Nier, Jason A., additional, Packard, Grant, additional, Pilati, Ronaldo, additional, Rutchick, Abraham M., additional, Schmidt, Kathleen, additional, Skorinko, Jeanine, additional, Smith, Robert, additional, Steiner, Troy G., additional, Storbeck, Justin, additional, van Swol, Lyn, additional, Thompson, Donna, additional, van 't Veer, Anna Elisabeth, additional, Vaughn, Leigh Ann, additional, Vranka, Marek Albert, additional, Wichman, Aaron Lee, additional, Woodzicka, Julie A., additional, and Nosek, Brian A., additional
- Published
- 2022
- Full Text
- View/download PDF
4. Investigating Variation in Replicability: A “Many Labs” Replication Project
- Author
-
Klein, Richard Anthony, primary, Ratliff, Kate A., additional, Vianello, Michelangelo, additional, Adams, Reginald B., additional, Bahník, Štěpán, additional, Bernstein, Michael, additional, Bocian, Konrad, additional, Brandt, Mark, additional, Brooks, Beach Smith, additional, Brumbaugh, Claudia Chloe, additional, Cemalcilar, Zeynep, additional, Chandler, Jesse J., additional, Cheong, Winnee, additional, Davis, William E., additional, Devos, Thierry, additional, Eisner, Matthew, additional, Frankowska, Natalia, additional, Furrow, David, additional, Galliani, Elisa Maria, additional, Hasselman, Fred, additional, Hicks, Joshua A., additional, Hovermale, James F., additional, Hunt, S. Jane, additional, Huntsinger, Jeffrey R., additional, IJzerman, Hans, additional, John, Melissa-Sue, additional, Joy-Gaba, Jennifer Alana, additional, Kappes, Heather Barry, additional, Krueger, Lacy Elise, additional, Kurtz, Jaime, additional, Levitan, Carmel, additional, Mallett, Robyn, additional, Morris, Wendy, additional, Nelson, Anthony J., additional, Nier, Jason A., additional, Packard, Grant, additional, Pilati, Ronaldo, additional, Rutchick, Abraham M., additional, Schmidt, Kathleen, additional, Skorinko, Jeanine, additional, Steiner, Troy G., additional, Storbeck, Justin, additional, van Swol, Lyn, additional, Thompson, Donna, additional, van 't Veer, Anna Elisabeth, additional, Vaughn, Leigh Ann, additional, Vranka, Marek Albert, additional, Wichman, Aaron Lee, additional, Woodzicka, Julie A., additional, and Nosek, Brian A., additional
- Published
- 2022
- Full Text
- View/download PDF
5. CAREER CALLING: SCALE VALIDATION AND MEDIATION EFFECTS ON WORK-RELATED OUTCOMES
- Author
-
DALLA ROSA, Anna, Vianello, Michelangelo, and Galliani, ELISA MARIA
- Subjects
Career calling ,Career calling scale ,Career commitment ,Work-related outcomes - Published
- 2021
6. Theory Building Through Replication: Response to Commentaries on the “Many Labs” Replication Project
- Author
-
Klein, Richard A., Ratliff, Kate A., Vianello, Michelangelo, Adams, Reginald B., Jr., Bahník, Štěpán, Bernstein, Michael J., Bocian, Konrad, Brandt, Mark J., Brooks, Beach, Brumbaugh, Claudia Chloe, Cemalcilar, Zeynep, Chandler, Jesse, Cheong, Winnee, Davis, William E., Devos, Thierry, Eisner, Matthew, Frankowska, Natalia, Furrow, David, Galliani, Elisa Maria, Hasselman, Fred, Hicks, Joshua A., Hovermale, James F., Hunt, Jane S., Huntsinger, Jeffrey R., IJzerman, Hans, John, Melissa-Sue, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Krueger, Lacy E., Kurtz, Jaime, Levitan, Carmel A., Mallett, Robyn K, Morris, Wendy L., Nelson, Anthony J., Nier, Jason A., Packard, Grant, Pilati, Ronaldo, Rutchick, Abraham M., Schmidt, Kathleen, Skorinko, Jeanine L., Smith, Robert, Steiner, Troy G., Storbeck, Justin, Van Swol, Lyn M., Thompson, Donna, van ʼt Veer, A. E., Vaughn, Leigh Ann, Vranka, Marek, Wichman, Aaron L., Woodzicka, Julie A., and Nosek, Brian A
- Published
- 2014
7. Investigating Variation in Replicability: A “Many Labs” Replication Project
- Author
-
Klein, Richard A., Ratliff, Kate A., Vianello, Michelangelo, Adams, Reginald B., Jr., Bahník, Štěpán, Bernstein, Michael J., Bocian, Konrad, Brandt, Mark J., Brooks, Beach, Brumbaugh, Claudia Chloe, Cemalcilar, Zeynep, Chandler, Jesse, Cheong, Winnee, Davis, William E., Devos, Thierry, Eisner, Matthew, Frankowska, Natalia, Furrow, David, Galliani, Elisa Maria, Hasselman, Fred, Hicks, Joshua A., Hovermale, James F., Hunt, Jane S., Huntsinger, Jeffrey R., IJzerman, Hans, John, Melissa-Sue, Joy-Gaba, Jennifer A., Barry Kappes, Heather, Krueger, Lacy E., Kurtz, Jaime, Levitan, Carmel A., Mallett, Robyn K., Morris, Wendy L., Nelson, Anthony J., Nier, Jason A., Packard, Grant, Pilati, Ronaldo, Rutchick, Abraham M., Schmidt, Kathleen, Skorinko, Jeanine L., Smith, Robert, Steiner, Troy G., Storbeck, Justin, Van Swol, Lyn M., Thompson, Donna, van ʼt Veer, A. E., Vaughn, Leigh Ann, Vranka, Marek, Wichman, Aaron L., Woodzicka, Julie A., and Nosek, Brian A.
- Published
- 2014
- Full Text
- View/download PDF
8. Calling Scale--Italian Version
- Author
-
Dala Rosa, Anna, primary, Vianello, Michelangelo, additional, and Galliani, Elisa Maria, additional
- Published
- 2021
- Full Text
- View/download PDF
9. Moderators of Career Calling and Job‐Search Behaviors Among Unemployed Individuals
- Author
-
Dalla Rosa, Anna, primary, Vianello, Michelangelo, additional, Galliani, Elisa Maria, additional, and Duffy, Ryan D., additional
- Published
- 2020
- Full Text
- View/download PDF
10. Klein_Open_Practices_Disclosure – Supplemental material for Many Labs 2: Investigating Variation in Replicability Across Samples and Settings
- Author
-
Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Mayowa T. Babalola, Štěpán Bahník, Rishtee Batra, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Evans Dami Binan, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Huajian Cai, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Jen-Ho Chang, Chatard, Armand, Chen, Eva E., Winnee Cheong, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Fiery Cushman, Zubairu K. Dagona, Ilker Dalgar, Rosa, Anna Dalla, Davis, William E., Bruijn, Maaike De, Schutter, Leander De, Devos, Thierry, Vries, Marieke De, Canay Doğulu, Nerisa Dozo, Dukes, Kristin Nicole, Yarrow Dunham, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Miguel-Ángel Freyre, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Tanuka Ghoshal, Giessner, Steffen R., Tripat Gill, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G. T., Kakul Hai, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, IJzerman, Hans, Inbar, Yoel, Innes-Ker, Åse H., Jiménez-Leal, William, Melissa-Sue John, Joy-Gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Nikolette P. Lipsey, Losee, Joy E., Maassen, Esther, Maitner, Angela T., Winfrida Malingumu, Mallett, Robyn K., Satia A. Marotta, Međedović, Janko, Mena-Pacheco, Fernando, Taciano L. Milfont, Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Nichols, Austin Lee, Ocampo, Aaron, O’Donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Malgorzata Osowiecka, Packard, Grant, Pérez-Sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M. H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L. M., Smith, Michael A., Smith-Castro, Vanessa, Smolders, Karin C. H. J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Manini Srivastava, Steiner, Troy G., Stouten, Jeroen, Street, Chris N. H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C. W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, Aert, Robbie C. M. Van, Assen, Marcel A. L. M. Van, Hulst, Marije Van Der, Lange, Paul A. M. Van, Anna Elisabeth Van ’T Veer, Echeverría, Alejandro Vásquez, Vaughn, Leigh Ann, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P. J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, and Nosek, Brian A.
- Subjects
FOS: Psychology ,FOS: Clinical medicine ,170199 Psychology not elsewhere classified ,110319 Psychiatry (incl. Psychotherapy) - Abstract
Supplemental material, Klein_Open_Practices_Disclosure for Many Labs 2: Investigating Variation in Replicability Across Samples and Settings by Richard A. Klein, Michelangelo Vianello, Fred Hasselman, Byron G. Adams, Reginald B. Adams, Sinan Alper, Mark Aveyard, Jordan R. Axt, Mayowa T. Babalola, Štěpán Bahník, Rishtee Batra, Mihály Berkics, Michael J. Bernstein, Daniel R. Berry, Olga Bialobrzeska, Evans Dami Binan, Konrad Bocian, Mark J. Brandt, Robert Busching, Anna Cabak Rédei, Huajian Cai, Fanny Cambier, Katarzyna Cantarero, Cheryl L. Carmichael, Francisco Ceric, Jesse Chandler, Jen-Ho Chang, Armand Chatard, Eva E. Chen, Winnee Cheong, David C. Cicero, Sharon Coen, Jennifer A. Coleman, Brian Collisson, Morgan A. Conway, Katherine S. Corker, Paul G. Curran, Fiery Cushman, Zubairu K. Dagona, Ilker Dalgar, Anna Dalla Rosa, William E. Davis, Maaike de Bruijn, Leander De Schutter, Thierry Devos, Marieke de Vries, Canay Doğulu, Nerisa Dozo, Kristin Nicole Dukes, Yarrow Dunham, Kevin Durrheim, Charles R. Ebersole, John E. Edlund, Anja Eller, Alexander Scott English, Carolyn Finck, Natalia Frankowska, Miguel-Ángel Freyre, Mike Friedman, Elisa Maria Galliani, Joshua C. Gandi, Tanuka Ghoshal, Steffen R. Giessner, Tripat Gill, Timo Gnambs, Ángel Gómez, Roberto González, Jesse Graham, Jon E. Grahe, Ivan Grahek, Eva G. T. Green, Kakul Hai, Matthew Haigh, Elizabeth L. Haines, Michael P. Hall, Marie E. Heffernan, Joshua A. Hicks, Petr Houdek, Jeffrey R. Huntsinger, Ho Phi Huynh, Hans IJzerman, Yoel Inbar, Åse H. Innes-Ker, William Jiménez-Leal, Melissa-Sue John, Jennifer A. Joy-Gaba, Roza G. Kamiloğlu, Heather Barry Kappes, Serdar Karabati, Haruna Karick, Victor N. Keller, Anna Kende, Nicolas Kervyn, Goran Knežević, Carrie Kovacs, Lacy E. Krueger, German Kurapov, Jamie Kurtz, Daniël Lakens, Ljiljana B. Lazarević, Carmel A. Levitan, Neil A. Lewis, Samuel Lins, Nikolette P. Lipsey, Joy E. Losee, Esther Maassen, Angela T. Maitner, Winfrida Malingumu, Robyn K. Mallett, Satia A. Marotta, Janko Međedović, Fernando Mena-Pacheco, Taciano L. Milfont, Wendy L. Morris, Sean C. Murphy, Andriy Myachykov, Nick Neave, Koen Neijenhuijs, Anthony J. Nelson, Félix Neto, Austin Lee Nichols, Aaron Ocampo, Susan L. O’Donnell, Haruka Oikawa, Masanori Oikawa, Elsie Ong, Gábor Orosz, Malgorzata Osowiecka, Grant Packard, Rolando Pérez-Sánchez, Boban Petrović, Ronaldo Pilati, Brad Pinter, Lysandra Podesta, Gabrielle Pogge, Monique M. H. Pollmann, Abraham M. Rutchick, Patricio Saavedra, Alexander K. Saeri, Erika Salomon, Kathleen Schmidt, Felix D. Schönbrodt, Maciej B. Sekerdej, David Sirlopú, Jeanine L. M. Skorinko, Michael A. Smith, Vanessa Smith-Castro, Karin C. H. J. Smolders, Agata Sobkow, Walter Sowden, Philipp Spachtholz, Manini Srivastava, Troy G. Steiner, Jeroen Stouten, Chris N. H. Street, Oskar K. Sundfelt, Stephanie Szeto, Ewa Szumowska, Andrew C. W. Tang, Norbert Tanzer, Morgan J. Tear, Jordan Theriault, Manuela Thomae, David Torres, Jakub Traczyk, Joshua M. Tybur, Adrienn Ujhelyi, Robbie C. M. van Aert, Marcel A. L. M. van Assen, Marije van der Hulst, Paul A. M. van Lange, Anna Elisabeth van ’t Veer, Alejandro Vásquez- Echeverría, Leigh Ann Vaughn, Alexandra Vázquez, Luis Diego Vega, Catherine Verniers, Mark Verschoor, Ingrid P. J. Voermans, Marek A. Vranka, Cheryl Welch, Aaron L. Wichman, Lisa A. Williams, Michael Wood, Julie A. Woodzicka, Marta K. Wronska, Liane Young, John M. Zelenski, Zeng Zhijia and Brian A. Nosek in Advances in Methods and Practices in Psychological Science
- Published
- 2018
- Full Text
- View/download PDF
11. Data from a three-wave complete longitudinal design survey on career calling and related constructs (N = 6368)
- Author
-
Dalla Rosa, Anna, primary, Vianello, Michelangelo, additional, Galliani, Elisa Maria, additional, Boffo, Vanna, additional, Fedeli, Monica, additional, Lo Presti, Francesco, additional, and Melacarne, Claudio, additional
- Published
- 2019
- Full Text
- View/download PDF
12. The Developmental Trajectories of Calling: Predictors and Outcomes
- Author
-
Vianello, Michelangelo, primary, Galliani, Elisa Maria, additional, Rosa, Anna Dalla, additional, and Anselmi, Pasquale, additional
- Published
- 2019
- Full Text
- View/download PDF
13. Validity and measurement invariance of the Unified Multidimensional Calling Scale (UMCS): A three-wave survey study
- Author
-
Vianello, Michelangelo, primary, Dalla Rosa, Anna, additional, Anselmi, Pasquale, additional, and Galliani, Elisa Maria, additional
- Published
- 2018
- Full Text
- View/download PDF
14. Many Labs 2: Investigating Variation in Replicability Across Samples and Settings
- Author
-
Klein, Richard A., primary, Vianello, Michelangelo, additional, Hasselman, Fred, additional, Adams, Byron G., additional, Adams, Reginald B., additional, Alper, Sinan, additional, Aveyard, Mark, additional, Axt, Jordan R., additional, Babalola, Mayowa T., additional, Bahník, Štěpán, additional, Batra, Rishtee, additional, Berkics, Mihály, additional, Bernstein, Michael J., additional, Berry, Daniel R., additional, Bialobrzeska, Olga, additional, Binan, Evans Dami, additional, Bocian, Konrad, additional, Brandt, Mark J., additional, Busching, Robert, additional, Rédei, Anna Cabak, additional, Cai, Huajian, additional, Cambier, Fanny, additional, Cantarero, Katarzyna, additional, Carmichael, Cheryl L., additional, Ceric, Francisco, additional, Chandler, Jesse, additional, Chang, Jen-Ho, additional, Chatard, Armand, additional, Chen, Eva E., additional, Cheong, Winnee, additional, Cicero, David C., additional, Coen, Sharon, additional, Coleman, Jennifer A., additional, Collisson, Brian, additional, Conway, Morgan A., additional, Corker, Katherine S., additional, Curran, Paul G., additional, Cushman, Fiery, additional, Dagona, Zubairu K., additional, Dalgar, Ilker, additional, Dalla Rosa, Anna, additional, Davis, William E., additional, de Bruijn, Maaike, additional, De Schutter, Leander, additional, Devos, Thierry, additional, de Vries, Marieke, additional, Doğulu, Canay, additional, Dozo, Nerisa, additional, Dukes, Kristin Nicole, additional, Dunham, Yarrow, additional, Durrheim, Kevin, additional, Ebersole, Charles R., additional, Edlund, John E., additional, Eller, Anja, additional, English, Alexander Scott, additional, Finck, Carolyn, additional, Frankowska, Natalia, additional, Freyre, Miguel-Ángel, additional, Friedman, Mike, additional, Galliani, Elisa Maria, additional, Gandi, Joshua C., additional, Ghoshal, Tanuka, additional, Giessner, Steffen R., additional, Gill, Tripat, additional, Gnambs, Timo, additional, Gómez, Ángel, additional, González, Roberto, additional, Graham, Jesse, additional, Grahe, Jon E., additional, Grahek, Ivan, additional, Green, Eva G. T., additional, Hai, Kakul, additional, Haigh, Matthew, additional, Haines, Elizabeth L., additional, Hall, Michael P., additional, Heffernan, Marie E., additional, Hicks, Joshua A., additional, Houdek, Petr, additional, Huntsinger, Jeffrey R., additional, Huynh, Ho Phi, additional, IJzerman, Hans, additional, Inbar, Yoel, additional, Innes-Ker, Åse H., additional, Jiménez-Leal, William, additional, John, Melissa-Sue, additional, Joy-Gaba, Jennifer A., additional, Kamiloğlu, Roza G., additional, Kappes, Heather Barry, additional, Karabati, Serdar, additional, Karick, Haruna, additional, Keller, Victor N., additional, Kende, Anna, additional, Kervyn, Nicolas, additional, Knežević, Goran, additional, Kovacs, Carrie, additional, Krueger, Lacy E., additional, Kurapov, German, additional, Kurtz, Jamie, additional, Lakens, Daniël, additional, Lazarević, Ljiljana B., additional, Levitan, Carmel A., additional, Lewis, Neil A., additional, Lins, Samuel, additional, Lipsey, Nikolette P., additional, Losee, Joy E., additional, Maassen, Esther, additional, Maitner, Angela T., additional, Malingumu, Winfrida, additional, Mallett, Robyn K., additional, Marotta, Satia A., additional, Međedović, Janko, additional, Mena-Pacheco, Fernando, additional, Milfont, Taciano L., additional, Morris, Wendy L., additional, Murphy, Sean C., additional, Myachykov, Andriy, additional, Neave, Nick, additional, Neijenhuijs, Koen, additional, Nelson, Anthony J., additional, Neto, Félix, additional, Lee Nichols, Austin, additional, Ocampo, Aaron, additional, O’Donnell, Susan L., additional, Oikawa, Haruka, additional, Oikawa, Masanori, additional, Ong, Elsie, additional, Orosz, Gábor, additional, Osowiecka, Malgorzata, additional, Packard, Grant, additional, Pérez-Sánchez, Rolando, additional, Petrović, Boban, additional, Pilati, Ronaldo, additional, Pinter, Brad, additional, Podesta, Lysandra, additional, Pogge, Gabrielle, additional, Pollmann, Monique M. H., additional, Rutchick, Abraham M., additional, Saavedra, Patricio, additional, Saeri, Alexander K., additional, Salomon, Erika, additional, Schmidt, Kathleen, additional, Schönbrodt, Felix D., additional, Sekerdej, Maciej B., additional, Sirlopú, David, additional, Skorinko, Jeanine L. M., additional, Smith, Michael A., additional, Smith-Castro, Vanessa, additional, Smolders, Karin C. H. J., additional, Sobkow, Agata, additional, Sowden, Walter, additional, Spachtholz, Philipp, additional, Srivastava, Manini, additional, Steiner, Troy G., additional, Stouten, Jeroen, additional, Street, Chris N. H., additional, Sundfelt, Oskar K., additional, Szeto, Stephanie, additional, Szumowska, Ewa, additional, Tang, Andrew C. W., additional, Tanzer, Norbert, additional, Tear, Morgan J., additional, Theriault, Jordan, additional, Thomae, Manuela, additional, Torres, David, additional, Traczyk, Jakub, additional, Tybur, Joshua M., additional, Ujhelyi, Adrienn, additional, van Aert, Robbie C. M., additional, van Assen, Marcel A. L. M., additional, van der Hulst, Marije, additional, van Lange, Paul A. M., additional, van ’t Veer, Anna Elisabeth, additional, Vásquez- Echeverría, Alejandro, additional, Ann Vaughn, Leigh, additional, Vázquez, Alexandra, additional, Vega, Luis Diego, additional, Verniers, Catherine, additional, Verschoor, Mark, additional, Voermans, Ingrid P. J., additional, Vranka, Marek A., additional, Welch, Cheryl, additional, Wichman, Aaron L., additional, Williams, Lisa A., additional, Wood, Michael, additional, Woodzicka, Julie A., additional, Wronska, Marta K., additional, Young, Liane, additional, Zelenski, John M., additional, Zhijia, Zeng, additional, and Nosek, Brian A., additional
- Published
- 2018
- Full Text
- View/download PDF
15. Many Labs 2: Investigating Variation in Replicability Across Samples and Settings
- Author
-
Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Babalola, Mayowa T., Bahník, Štěpán, Batra, Rishtee, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Binan, Evans Dami, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Cai, Huajian, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Chang, Jen-Ho, Chatard, Armand, Chen, Eva E., Cheong, Winnee, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Cushman, Fiery, Dagona, Zubairu K., Dalgar, Ilker, Dalla Rosa, Anna, Davis, William E., de Bruijn, Maaike, De Schutter, Leander, Devos, Thierry, de Vries, Marieke, Doğulu, Canay, Dozo, Nerisa, Dukes, Kristin Nicole, Dunham, Yarrow, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Freyre, Miguel-ángel, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Ghoshal, Tanuka, Giessner, Steffen R., Gill, Tripat, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G.T., Hai, Kakul, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, Ijzerman, Hans, Inbar, Yoel, Innes-ker, Åse H., Jiménez-leal, William, John, Melissa-sue, Joy-gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Lipsey, Nikolette P., Losee, Joy E., Maassen, Esther, Maitner, Angela T., Malingumu, Winfrida, Mallett, Robyn K., Marotta, Satia A., Međedović, Janko, Mena-pacheco, Fernando, Milfont, Taciano L., Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Lee Nichols, Austin, Ocampo, Aaron, O’donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Osowiecka, Malgorzata, Packard, Grant, Pérez-sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M. H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L. M., Smith, Michael A., Smith-castro, Vanessa, Smolders, Karin C.H.J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Srivastava, Manini, Steiner, Troy G., Stouten, Jeroen, Street, Chris N.H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C.W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, Van Aert, Robbie C. M., Van Assen, Marcel A. L. M., Van Der Hulst, Marije, Van Lange, Paul A. M., Van ’t Veer, Anna Elisabeth, Vásquez- Echeverría, Alejandro, Ann Vaughn, Leigh, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P. J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, Nosek, Brian A., Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Babalola, Mayowa T., Bahník, Štěpán, Batra, Rishtee, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Binan, Evans Dami, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Cai, Huajian, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Chang, Jen-Ho, Chatard, Armand, Chen, Eva E., Cheong, Winnee, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Cushman, Fiery, Dagona, Zubairu K., Dalgar, Ilker, Dalla Rosa, Anna, Davis, William E., de Bruijn, Maaike, De Schutter, Leander, Devos, Thierry, de Vries, Marieke, Doğulu, Canay, Dozo, Nerisa, Dukes, Kristin Nicole, Dunham, Yarrow, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Freyre, Miguel-ángel, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Ghoshal, Tanuka, Giessner, Steffen R., Gill, Tripat, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G.T., Hai, Kakul, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, Ijzerman, Hans, Inbar, Yoel, Innes-ker, Åse H., Jiménez-leal, William, John, Melissa-sue, Joy-gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Lipsey, Nikolette P., Losee, Joy E., Maassen, Esther, Maitner, Angela T., Malingumu, Winfrida, Mallett, Robyn K., Marotta, Satia A., Međedović, Janko, Mena-pacheco, Fernando, Milfont, Taciano L., Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Lee Nichols, Austin, Ocampo, Aaron, O’donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Osowiecka, Malgorzata, Packard, Grant, Pérez-sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M. H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L. M., Smith, Michael A., Smith-castro, Vanessa, Smolders, Karin C.H.J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Srivastava, Manini, Steiner, Troy G., Stouten, Jeroen, Street, Chris N.H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C.W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, Van Aert, Robbie C. M., Van Assen, Marcel A. L. M., Van Der Hulst, Marije, Van Lange, Paul A. M., Van ’t Veer, Anna Elisabeth, Vásquez- Echeverría, Alejandro, Ann Vaughn, Leigh, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P. J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, and Nosek, Brian A.
- Abstract
We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p < .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p < .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely high-powered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relati
- Published
- 2018
16. Many labs 2:Investigating variation in replicability across samples and settings
- Author
-
Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Babalola, Mayowa T., Bahník, Štěpán, Batra, Rishtee, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Binan, Evans Dami, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Cai, Huajian, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Chang, Jen Ho, Chatard, Armand, Chen, Eva E., Cheong, Winnee, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Cushman, Fiery, Dagona, Zubairu K., Dalgar, Ilker, Dalla Rosa, Anna, Davis, William E., de Bruijn, Maaike, De Schutter, Leander, Devos, Thierry, de Vries, Marieke, Doğulu, Canay, Dozo, Nerisa, Dukes, Kristin Nicole, Dunham, Yarrow, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Freyre, Miguel Ángel, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Ghoshal, Tanuka, Giessner, Steffen R., Gill, Tripat, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G.T., Hai, Kakul, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, Ijzerman, Hans, Inbar, Yoel, Innes-Ker, Åse H., Jiménez-Leal, William, John, Melissa Sue, Joy-Gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Lipsey, Nikolette P., Losee, Joy E., Maassen, Esther, Maitner, Angela T., Malingumu, Winfrida, Mallett, Robyn K., Marotta, Satia A., Međedović, Janko, Mena-Pacheco, Fernando, Milfont, Taciano L., Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Nichols, Austin Lee, Ocampo, Aaron, O’donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Osowiecka, Malgorzata, Packard, Grant, Pérez-Sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M.H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L.M., Smith, Michael A., Smith-Castro, Vanessa, Smolders, Karin C.H.J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Srivastava, Manini, Steiner, Troy G., Stouten, Jeroen, Street, Chris N.H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C.W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, van Aert, Robbie C.M., van Assen, Marcel A.L.M., van der Hulst, Marije, van Lange, Paul A.M., van ’t Veer, Anna Elisabeth, Vásquez-Echeverría, Alejandro, Vaughn, Leigh Ann, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P.J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, Nosek, Brian A., Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Babalola, Mayowa T., Bahník, Štěpán, Batra, Rishtee, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Binan, Evans Dami, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Cai, Huajian, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Chang, Jen Ho, Chatard, Armand, Chen, Eva E., Cheong, Winnee, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Cushman, Fiery, Dagona, Zubairu K., Dalgar, Ilker, Dalla Rosa, Anna, Davis, William E., de Bruijn, Maaike, De Schutter, Leander, Devos, Thierry, de Vries, Marieke, Doğulu, Canay, Dozo, Nerisa, Dukes, Kristin Nicole, Dunham, Yarrow, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Freyre, Miguel Ángel, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Ghoshal, Tanuka, Giessner, Steffen R., Gill, Tripat, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G.T., Hai, Kakul, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, Ijzerman, Hans, Inbar, Yoel, Innes-Ker, Åse H., Jiménez-Leal, William, John, Melissa Sue, Joy-Gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Lipsey, Nikolette P., Losee, Joy E., Maassen, Esther, Maitner, Angela T., Malingumu, Winfrida, Mallett, Robyn K., Marotta, Satia A., Međedović, Janko, Mena-Pacheco, Fernando, Milfont, Taciano L., Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Nichols, Austin Lee, Ocampo, Aaron, O’donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Osowiecka, Malgorzata, Packard, Grant, Pérez-Sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M.H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L.M., Smith, Michael A., Smith-Castro, Vanessa, Smolders, Karin C.H.J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Srivastava, Manini, Steiner, Troy G., Stouten, Jeroen, Street, Chris N.H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C.W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, van Aert, Robbie C.M., van Assen, Marcel A.L.M., van der Hulst, Marije, van Lange, Paul A.M., van ’t Veer, Anna Elisabeth, Vásquez-Echeverría, Alejandro, Vaughn, Leigh Ann, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P.J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, and Nosek, Brian A.
- Abstract
We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p <.05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p <.0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely highpowered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than.20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above.10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relative
- Published
- 2018
17. Data and Results (per site, etc.)
- Author
-
Huajian Cai, Vázquez, Alexandra, Voermans, Ingrid, Spachtholz, Philipp, English, Alexander Scott, Adams, Byron Gregory, Conway, Morgan, Stouten, Jeroen, Ruggs, Enrica N., Bocian, Konrad, Cicero, David C, Pinter, Brad, Štěpán Bahník, Van Aert, Robbie C. M., Chatard, Armand, Sacco, Airi, Kende, Anna, Aveyard, Mark, Vranka, Marek A., Ujhelyi, Adrienn, Zelenski, John M., Patricio Saavedra, M., Young, Liane, Bernstein, Michael Jason, Theriault, Jordan, Neto, Felix, De Bruijn, Maaike, Lewis, Neil, Berry, Daniel R., Gnambs, Timo, Busching, Robert, Tanuka Ghoshal, Houdek, Petr, Kappes, Andreas, Kakul Hai, Vaughn, Leigh Ann, Pilati, Ronaldo, Giessner, Steffen Robert, Green, Eva, Malgorzata Osowiecka, Mayowa Babaloia, Mihaly Berkics, Krueger, Lacy Elise, Joy-Gaba, Jennifer, Melissa-Sue John, Verniers, Catherine, Yarrow Dunham, Vásquez-Echeverría, Alejandro, Winfrida Malingumu, Coen, Sharon, Woodzicka, Julie A., Morris, Wendy, Ilker Dalgar, Van Assen, Marcel A.L.M., Tanzer, Norbert K., Collisson, Brian, Dukes, Kristin, Bialobrzeska, Olga, Durrheim, Kevin, Jen-Ho Chang, Welch, Cheryl, Orosz, Gabor, Huynh, Ho Phi, Thomae, Manuela, Friedman, Mike, Kappes, Heather, Jimenez-Leal, William, CHEN, Eva, Karabati, Serdar, Corker, Katherine S., Grahe, Jon, Pérez, Rolando, Alper, Sinan, Haines, Elizabeth L., Sundfelt, Oskar, De Vries, Marieke, Innes-Ker, Åse, Međedović, Janko, Eller, Anja, Curran, Paul G, Nerisa Dozo, Steiner, Troy G., Tanzer, Norbert, Karick, Haruna, Schmidt, Kathleen, Maitner, Angela, Davis, William E., Sowden, Walter J., Tripat Gill, Gonzalez, Roberto, Murphy, Sean, Doğulu, Canay, Wronska, Marta Katarzyna, Huntsinger, Jeffrey R., Lakens, Daniel, Graham, Jesse, Carmichael, Cheryl L, Kovacs, Carrie, IJzerman, Hans, Cemalcilar, Zeynep, O'Donnell, Susan L., Maciek Sekerdej, Maassen, Esther, Traczyk, Jakub, Tang, Andrew, Rosa, Anna Dalla, Smith-Castro, Vanessa, Tybur, Joshua M., Vega, Diego, Sobkow, Agata, Kervyn, Nicolas, Easterbrook, Matthew, Wichman, Aaron, Nosek, Brian A., Hall, Michael P., Nelson, Anthony J., Edlund, John, Williams, Lisa A., Finck, Carolyn, Myachykov, Andriy, Brandt, Mark, Heffernan, Marie E., Verschoor, Mark, Nichols, Austin Lee, Coleman, Jennifer A., Winnee Cheong, Petrovic, Boban, Inbar, Yoel, Van Der Hulst, Marije, Levitan, Carmel, Lazarevic, Lili, Galliani, Elisa Maria, Packard, Grant, McIntyre, Jason, Haigh, Matthew, Skorinko, Jeanine, Frankowska, Natalia, Szumowska, Ewa, Keller, Victor N., Podesta, Lysandra, Adams, Reginald B., Klein, Richard A., Knezevic, Goran, Saeri, Alexander K, Torres, David, Sirlopu, David Ricardo, Salomon, Erika, Anna Van 'T Veer, Tear, Morgan, Lins, Samuel, Neijenhuijs, Koen Ilja, Vianello, Michelangelo, Marotta, Satia, Street, Chris N. H., Mallett, Robyn, Kurapov, German, Pollmann, Monique, Kamiloglu, Roza, Ebersole, Charles R., Cambier, Fanny, Gomez, Angel, Smith, Michael A., Chandler, Jesse J., Kurtz, Jaime, Oikawa, Masanori, Devos, Thierry, Schönbrodt, Felix, Milfont, Taciano L., Miguel-Ángel Freyre, Rutchick, Abraham M., Axt, Jordan, Hasselman, Fred, Hicks, Joshua A., Grahek, Ivan, Cantarero, Katarzyna, and Cushman, Fiery
- Abstract
Data from Many Labs 2 Replication Project
- Published
- 2017
- Full Text
- View/download PDF
18. Analysis Scripts
- Author
-
Bernstein, Michael Jason, De Bruijn, Maaike, Huntsinger, Jeffrey R., Young, Liane, Lazarevic, Lili, Milfont, Taciano L., Nerisa Dozo, Heffernan, Marie E., Alper, Sinan, Jimenez-Leal, William, Torres, David, Vásquez-Echeverría, Alejandro, Keller, Victor N., Friedman, Mike, Corker, Katherine S., Verniers, Catherine, Cushman, Fiery, Pinter, Brad, Collisson, Brian, Sacco, Airi, Maassen, Esther, Pilati, Ronaldo, Carmichael, Cheryl L, Haigh, Matthew, Chatard, Armand, Durrheim, Kevin, Verschoor, Mark, Traczyk, Jakub, Innes-Ker, Åse, Sowden, Walter J., Yarrow Dunham, Huajian Cai, Winnee Cheong, Nosek, Brian A., English, Alexander Scott, Schmidt, Kathleen, Inbar, Yoel, Ujhelyi, Adrienn, Kovacs, Carrie, Vranka, Marek A., Tanzer, Norbert K., Kende, Anna, Podesta, Lysandra, Vaughn, Leigh Ann, Tanzer, Norbert, Houdek, Petr, Curran, Paul G, Haines, Elizabeth L., Rosa, Anna Dalla, Nelson, Anthony J., Vega, Diego, Maciek Sekerdej, Kurtz, Jaime, Williams, Lisa A., Cemalcilar, Zeynep, CHEN, Eva, Skorinko, Jeanine, Grahe, Jon, Murphy, Sean, Sirlopu, David Ricardo, Kervyn, Nicolas, Smith-Castro, Vanessa, Karabati, Serdar, Patricio Saavedra, M., Van Der Hulst, Marije, Coen, Sharon, Miguel-Ángel Freyre, Graham, Jesse, Neijenhuijs, Koen Ilja, Winfrida Malingumu, Maitner, Angela, Adams, Byron Gregory, Morris, Wendy, IJzerman, Hans, Smith, Michael A., Vianello, Michelangelo, Bialobrzeska, Olga, Davis, William E., Tripat Gill, Huynh, Ho Phi, Orosz, Gabor, Tybur, Joshua M., Gnambs, Timo, Myachykov, Andriy, Lakens, Daniel, Van Assen, Marcel A.L.M., Cantarero, Katarzyna, Brandt, Mark, Oikawa, Masanori, Tang, Andrew, Finck, Carolyn, Gonzalez, Roberto, Stouten, Jeroen, Ebersole, Charles R., Cambier, Fanny, Klein, Richard A., Galliani, Elisa Maria, Štěpán Bahník, Ruggs, Enrica N., Adams, Reginald B., Aveyard, Mark, Petrovic, Boban, Conway, Morgan, McIntyre, Jason, Giessner, Steffen Robert, Rutchick, Abraham M., Axt, Jordan, Levitan, Carmel, Međedović, Janko, Packard, Grant, Hall, Michael P., Wichman, Aaron, Mayowa Babaloia, Woodzicka, Julie A., Busching, Robert, Theriault, Jordan, Kurapov, German, Berry, Daniel R., Frankowska, Natalia, Chandler, Jesse J., Kakul Hai, Szumowska, Ewa, Marotta, Satia, Pollmann, Monique, Mallett, Robyn, Vázquez, Alexandra, Salomon, Erika, Knezevic, Goran, Kamiloglu, Roza, Dukes, Kristin, Devos, Thierry, Zelenski, John M., Lins, Samuel, Green, Eva, Anna Van 'T Veer, Cicero, David C, Joy-Gaba, Jennifer, Sobkow, Agata, Doğulu, Canay, Sundfelt, Oskar, Ilker Dalgar, Wronska, Marta Katarzyna, Malgorzata Osowiecka, Schönbrodt, Felix, Gomez, Angel, O'Donnell, Susan L., Tear, Morgan, Spachtholz, Philipp, Eller, Anja, Voermans, Ingrid, Tanuka Ghoshal, Mihaly Berkics, Melissa-Sue John, Easterbrook, Matthew, Saeri, Alexander K, Edlund, John, Kappes, Heather, Neto, Felix, Welch, Cheryl, Steiner, Troy G., Karick, Haruna, Lewis, Neil, Street, Chris N. H., Hicks, Joshua A., Pérez, Rolando, Krueger, Lacy Elise, Kappes, Andreas, Thomae, Manuela, De Vries, Marieke, Grahek, Ivan, Bocian, Konrad, Nichols, Austin Lee, Hasselman, Fred, Coleman, Jennifer A., and Jen-Ho Chang
- Published
- 2017
- Full Text
- View/download PDF
19. An integrative model of Career Calling and meta-analyses of its nomological network
- Author
-
DALLA ROSA, Anna, Galliani, ELISA MARIA, and Vianello, Michelangelo
- Published
- 2017
20. Data
- Author
-
Cemalcilar, Zeynep, Klein, Richard A., Kurtz, Jaime, Huntsinger, Jeffrey R., Melissa-Sue John, Eisner, Matthew, Rutchick, Abraham M., Frankowska, Natalia, Galliani, Elisa Maria, Woodzicka, Julie A., Wichman, Aaron, Bernstein, Michael Jason, Kappes, Heather, Mallett, Robyn, Hasselman, Fred, Levitan, Carmel, Chandler, Jesse J., Nosek, Brian A., Van Swol, Lyn, Beach Brooks, Adams, Reginald B., Skorinko, Jeanine, Nelson, Anthony J., Packard, Grant, Vranka, Marek A., Bocian, Konrad, Davis, William E., Devos, Thierry, Smith, Robert W., Vaughn, Leigh Ann, Brumbaugh, Claudia, Winnee Cheong, Nier, Jason A., Vianello, Michelangelo, Pilati, Ronaldo, Thompson, Donna, Morris, Wendy, Ratliff, Kate, Krueger, Lacy Elise, Anna Van 'T Veer, Hicks, Joshua A., Schmidt, Kathleen, S. Jane Hunt, Hovermale, James F., Joy-Gaba, Jennifer, Brandt, Mark, Storbeck, Justin, IJzerman, Hans, Furrow, David, Štěpán Bahník, and Steiner, Troy G.
- Abstract
Dataset and codebook from the project are available for download below, under "files". Datasets.zip contains the data files in both .csv and .sav (SPSS) format. For any issues, please contact Rick Klein (raklein@ufl.edu).
- Published
- 2017
- Full Text
- View/download PDF
21. The Developmental Trajectories of Calling: Predictors and Outcomes.
- Author
-
Vianello, Michelangelo, Galliani, Elisa Maria, Rosa, Anna Dalla, and Anselmi, Pasquale
- Subjects
- *
OPEN-ended questions - Abstract
There are many open questions concerning the development of calling, and longitudinal empirical evidence is limited. We know that a calling is associated with many beneficial outcomes, but we do not know how it changes through time and what predicts these changes. Previous studies have shown that calling is relatively stable at the sample level. We show that, at the individual level, calling shows huge variations through time. We identified nine developmental trajectories that are typical across facets of calling, and we found evidence that the development of a calling is fostered by the extent to which individuals have lived it out. We also observed that the more a calling has grown over a 2-year period, the more it is lived out during the third year. These results provide support for a developmental model of calling according to which having a calling and living it out reciprocally influence each other. The practical and theoretical implications of these results are discussed. [ABSTRACT FROM AUTHOR]
- Published
- 2020
- Full Text
- View/download PDF
22. Many Labs 2: Investigating Variation in Replicability Across Sample and Setting
- Author
-
Klein, Richard Anthony, primary, Vianello, Michelangelo, additional, Hasselman, Fred, additional, Adams, Byron Gregory, additional, Adams, Reginald B., additional, Alper, Sinan, additional, Aveyard, Mark, additional, Axt, Jordan, additional, Babalola, Mayowa Tosin, additional, Bahník, Štěpán, additional, Berkics, Mihaly, additional, Bernstein, Michael Jason, additional, Berry, Daniel R., additional, Bialobrzeska, Olga, additional, Bocian, Konrad, additional, Brandt, Mark, additional, Busching, Robert, additional, Cai, Huajian, additional, Cambier, Fanny, additional, Cantarero, Katarzyna, additional, Carmichael, Cheryl L, additional, Cemalcilar, Zeynep, additional, Chandler, Jesse J., additional, Chang, Jen-Ho, additional, Chatard, Armand, additional, CHEN, Eva, additional, Cheong, Winnee, additional, Cicero, David C, additional, Coen, Sharon, additional, Coleman, Jennifer A., additional, Collisson, Brian, additional, Conway, Morgan Anna, additional, Corker, Katherine S., additional, Curran, Paul G, additional, Cushman, Fiery Andrews, additional, Dalgar, Ilker, additional, Davis, William E., additional, de Bruijn, Maaike Jolise, additional, de Vries, Marieke, additional, Devos, Thierry, additional, Doğulu, Canay, additional, Dozo, Nerisa, additional, Dukes, Kristin Nicole, additional, Dunham, Yarrow, additional, Durrheim, Kevin, additional, Easterbrook, Matthew, additional, Ebersole, Charles R., additional, Edlund, John, additional, English, Alexander Scott, additional, Eller, Anja, additional, Finck, Carolyn, additional, Freyre, Miguel-Ángel, additional, Friedman, Mike, additional, Frankowska, Natalia, additional, Galliani, Elisa Maria, additional, Ghoshal, Tanuka, additional, Giessner, Steffen Robert, additional, Gill, Tripat, additional, Gnambs, Timo, additional, Gomez, Angel, additional, Gonzalez, Roberto, additional, Graham, Jesse, additional, Grahe, Jon E., additional, Grahek, Ivan, additional, Green, Eva, additional, Hai, Kakul, additional, Haigh, Matthew, additional, Haines, Elizabeth L., additional, Hall, Michael P., additional, Heffernan, Marie E., additional, Hicks, Joshua A., additional, Houdek, Petr, additional, van der Hulst, Marije, additional, Huntsinger, Jeffrey R., additional, Huynh, Ho Phi, additional, IJzerman, Hans, additional, Inbar, Yoel, additional, Innes-Ker, Åse, additional, Jimenez-Leal, William, additional, John, Melissa-Sue, additional, Joy-Gaba, Jennifer Alana, additional, Kamiloglu, Roza Gizem, additional, Kappes, Andreas, additional, Kappes, Heather Barry, additional, Karabati, Serdar, additional, Karick, Haruna, additional, Keller, Victor N., additional, Kende, Anna, additional, Kervyn, Nicolas /, additional, Knezevic, Goran, additional, Kovacs, Carrie, additional, Krueger, Lacy Elise, additional, Kurapov, German, additional, Kurtz, Jaime, additional, Lakens, Daniel, additional, Lazarevic, Ljiljana B., additional, Levitan, Carmel, additional, Lewis, Neil Anthony, additional, Lins, Samuel, additional, Maassen, Esther, additional, Maitner, Angela, additional, Malingumu, Winfrida, additional, Mallett, Robyn, additional, Marotta, Satia Adele, additional, McIntyre, Jason Cameron, additional, Međedović, Janko Mileta, additional, Milfont, Taciano L, additional, Morris, Wendy, additional, Myachykov, Andriy, additional, Murphy, Sean Christopher, additional, Neijenhuijs, Koen Ilja, additional, Nelson, Anthony J., additional, Neto, Felix Fernando Monteiro, additional, Nichols, Austin Lee, additional, O'Donnell, Susan L., additional, Oikawa, Masanori, additional, Orosz, Gabor, additional, Osowiecka, Malgorzata, additional, Packard, Grant, additional, Pérez, Rolando, additional, Petrovic, Boban, additional, Pilati, Ronaldo, additional, Pinter, Brad, additional, Podesta, Lysandra Maria, additional, Pollmann, Monique Maria Henriettte, additional, Dalla Rosa, Anna, additional, Rutchick, Abraham M., additional, Saavedra, Patricio, additional, Sacco, Airi, additional, Saeri, Alexander K, additional, Salomon, Erika, additional, Schmidt, Kathleen, additional, Schönbrodt, Felix D., additional, Sekerdej, Maciek Borys, additional, Sirlopu, David Ricardo, additional, Skorinko, Jeanine, additional, Smith, Michael A., additional, Smith-Castro, Vanessa, additional, Sobkow, Agata, additional, Sowden, Walter J., additional, Spachtholz, Philipp, additional, Steiner, Troy G., additional, Stouten, Jeroen, additional, Street, Chris N. H., additional, Sundfelt, Oskar, additional, Szumowska, Ewa, additional, Tang, Andrew, additional, Tanzer, Norbert K., additional, Tear, Morgan James, additional, Theriault, Jordan E., additional, Thomae, Manuela, additional, Torres-Fernández, David, additional, Traczyk, Jakub, additional, Tybur, Joshua M., additional, Ujhelyi, Adrienn, additional, van Assen, Marcel A. L. M., additional, van 't Veer, Anna Elisabeth, additional, Vásquez-Echeverría, Alejandro, additional, Vaughn, Leigh Ann, additional, Vázquez, Alexandra ., additional, Vega, Diego, additional, Verniers, Catherine, additional, Verschoor, Mark, additional, Voermans, Ingrid, additional, Vranka, Marek Albert, additional, Welch, Cheryl Alyssa, additional, Wichman, Aaron Lee, additional, Williams, Lisa A., additional, Woodzicka, Julie A., additional, Wronska, Marta Katarzyna, additional, Young, Liane, additional, Zelenski, John M., additional, and Nosek, Brian A., additional
- Published
- 2018
- Full Text
- View/download PDF
23. What does it mean to have a calling? Validation of the Unified Multidimensional Calling Scale
- Author
-
Dalla Rosa, Anna, primary, Vianello, Michelangelo, additional, Anselmi, Pasquale, additional, and Galliani, Elisa Maria, additional
- Published
- 2018
- Full Text
- View/download PDF
24. Validity and Measurement Invariance of the Unified Multidimensional Calling Scale
- Author
-
Vianello, Michelangelo, primary, Dalla Rosa, Anna, additional, Anselmi, Pasquale, additional, and Galliani, Elisa Maria, additional
- Published
- 2018
- Full Text
- View/download PDF
25. The Developmental Trajectories of Calling: Predictors and Outcomes
- Author
-
Vianello, Michelangelo, primary, Galliani, Elisa Maria, additional, Dalla Rosa, Anna, additional, and Anselmi, Pasquale, additional
- Published
- 2018
- Full Text
- View/download PDF
26. Unified Multidimensional Calling Scale
- Author
-
Vianello, Michelangelo, primary, Rosa, Anna Dalla, additional, Anselmi, Pasquale, additional, and Galliani, Elisa Maria, additional
- Published
- 2018
- Full Text
- View/download PDF
27. The Development of Occupational Calling
- Author
-
Vianello, Michelangelo, primary, Dalla Rosa, Anna, additional, Anselmi, Pasquale, additional, and Galliani, Elisa Maria, additional
- Published
- 2017
- Full Text
- View/download PDF
28. Materials for Individual Studies
- Author
-
Maassen, Esther, English, Alexander Scott, Winnee Cheong, Adams, Byron Gregory, Steiner, Troy G., Coleman, Jennifer A., Finck, Carolyn, Theriault, Jordan, Cambier, Fanny, Kovacs, Carrie, Kakul Hai, Houdek, Petr, Lakens, Daniel, Wronska, Marta Katarzyna, Nichols, Austin Lee, Tybur, Joshua M., Anna Van 'T Veer, Nerisa Dozo, Vianello, Michelangelo, Eller, Anja, Aveyard, Mark, Easterbrook, Matthew, Lazarevic, Lili, O'Donnell, Susan L., Saeri, Alexander K, Orosz, Gabor, Lewis, Neil, Hall, Michael P., Tear, Morgan, Klein, Richard A., Myachykov, Andriy, Chandler, Jesse J., Voermans, Ingrid, Kappes, Andreas, Knezevic, Goran, Sirlopu, David Ricardo, Neijenhuijs, Koen Ilja, Smith, Michael A., Kamiloglu, Roza, Vega, Diego, Kurapov, German, Murphy, Sean, Graham, Jesse, Milfont, Taciano L., Spachtholz, Philipp, Gnambs, Timo, Green, Eva, Vranka, Marek A., Nelson, Anthony J., De Bruijn, Maaike, Mayowa Babaloia, Morris, Wendy, Van Der Hulst, Marije, Heffernan, Marie E., Van Assen, Marcel A.L.M., Cantarero, Katarzyna, Smith-Castro, Vanessa, Street, Chris N. H., Corker, Katherine S., Brandt, Mark, Pollmann, Monique, Tanuka Ghoshal, Inbar, Yoel, Stouten, Jeroen, Thomae, Manuela, Haigh, Matthew, Patricio Saavedra, M., Vázquez, Alexandra, Axt, Jordan, Williams, Lisa A., Cicero, David C, Winfrida Malingumu, Conway, Morgan, Maitner, Angela, Sundfelt, Oskar, Young, Liane, Grahe, Jon, Galliani, Elisa Maria, Edlund, John, Ujhelyi, Adrienn, Cushman, Fiery, Tanzer, Norbert, Yarrow Dunham, Maciek Sekerdej, Sowden, Walter J., Berry, Daniel R., Skorinko, Jeanine, Dukes, Kristin, Cemalcilar, Zeynep, Pilati, Ronaldo, Collisson, Brian, Carmichael, Cheryl L, Neto, Felix, Friedman, Mike, Haines, Elizabeth L., Wichman, Aaron, De Vries, Marieke, Ilker Dalgar, Keller, Victor N., Salomon, Erika, Grahek, Ivan, Innes-Ker, Åse, Zelenski, John M., Sobkow, Agata, Lins, Samuel, Ebersole, Charles R., Sacco, Airi, Kappes, Heather, Doğulu, Canay, Hasselman, Fred, Melissa-Sue John, Nosek, Brian A., Pinter, Brad, Pérez, Rolando, Bocian, Konrad, Miguel-Ángel Freyre, Woodzicka, Julie A., Međedović, Janko, Karabati, Serdar, Tang, Andrew, Adams, Reginald B., Verniers, Catherine, Bialobrzeska, Olga, Joy-Gaba, Jennifer, Frankowska, Natalia, Alper, Sinan, CHEN, Eva, Vásquez-Echeverría, Alejandro, Torres, David, Mallett, Robyn, Hicks, Joshua A., Coen, Sharon, McIntyre, Jason, Durrheim, Kevin, Rosa, Anna Dalla, Curran, Paul G, IJzerman, Hans, Schmidt, Kathleen, Schönbrodt, Felix, Ruggs, Enrica N., Verschoor, Mark, Devos, Thierry, Jimenez-Leal, William, Kende, Anna, Petrovic, Boban, Giessner, Steffen Robert, Traczyk, Jakub, Packard, Grant, Huajian Cai, Vaughn, Leigh Ann, Bernstein, Michael Jason, Rutchick, Abraham M., Welch, Cheryl, Chatard, Armand, Levitan, Carmel, Tanzer, Norbert K., Podesta, Lysandra, Busching, Robert, Gomez, Angel, Gonzalez, Roberto, Huynh, Ho Phi, Tripat Gill, Marotta, Satia, Szumowska, Ewa, Štěpán Bahník, Krueger, Lacy Elise, Karick, Haruna, Huntsinger, Jeffrey R., Davis, William E., Kervyn, Nicolas, Jen-Ho Chang, Malgorzata Osowiecka, Kurtz, Jaime, Mihaly Berkics, and Oikawa, Masanori
- Published
- 2014
- Full Text
- View/download PDF
29. Investigating variation in replicability
- Author
-
Klein, Richard A., Ratliff, Kate A., Vianello, Michelangelo, Adams, Reginald B., Bahník, Štěpán, Bernstein, Michael J., Bocian, Konrad, Brandt, Mark J., Brooks, Beach, Brumbaugh, Claudia Chloe, Cemalcilar, Zeynep, Chandler, Jesse, Cheong, Winnee, Davis, William E., Devos, Thierry, Eisner, Matthew, Frankowska, Natalia, Furrow, David, Galliani, Elisa Maria, Hasselman, Fred, Hicks, Joshua A., Hovermale, James F., Hunt, S. Jane, Huntsinger, Jeffrey R., IJzerman, Hans, John, Melissa-Sue, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Krueger, Lacy E., Kurtz, Jaime, Levitan, Carmel A., Mallett, Robyn K., Morris, Wendy L., Nelson, Anthony J., Nier, Jason A., Packard, Grant, Pilati, Ronaldo, Rutchick, Abraham M., Schmidt, Kathleen, Skorinko, Jeanine L., Smith, Robert, Steiner, Troy G., Storbeck, Justin, Van Swol, Lyn M., Thompson, Donna, van ‘t Veer, A. E., Ann Vaughn, Leigh, Vranka, Marek, Wichman, Aaron L., Woodzicka, Julie A., and Nosek, Brian A.
- Subjects
BF Psychology - Abstract
Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, 10 effects replicated consistently. One effect – imagined contact reducing prejudice – showed weak support for replicability. And two effects – flag priming influencing conservatism and currency priming influencing system justification – did not replicate. We compared whether the conditions such as lab versus online or US versus international sample predicted effect magnitudes. By and large they did not. The results of this small sample of effects suggest that replicability is more dependent on the effect itself than on the sample and setting used to investigate the effect.
- Published
- 2014
30. Theory Building Through Replication. Response to Commentaries on the Many Labs Replication Project
- Author
-
Klein, R. A., Ratliff, K. A., Vianello, Michelangelo, Adams, R. B., J. r., Bahník, Š., Bernstein, M. J., Bocian, K., Brandt, M. J., Brooks, B., Brumbaugh, C. C., Cemalcilar, Z., Chandler, J., Cheong, W., Davis, W. E., Devos, T., Eisner, M., Frankowska, N., Furrow, D., Galliani, ELISA MARIA, Hasselman, F., Hicks, J. A., Hovermale, J. F., Hunt, S. J., Huntsinger, J. R., Ijzerman, H., John, M., Joy Gaba, J. A., Kappes, H. B., Krueger, L. E., Kurtz, J., Levitan, C. A., Mallett, R., Morris, W. L., Nelson, A. J., Nier, J. A., Packard, G., Pilati, R., Rutchick, A. M., Schmidt, K., Skorinko, J. L., Smith, R., Steiner, T. G., Storbeck, J., Vanswol, L. M., Thompson, D., van’t Veer, A., Vaughn, L. A., Vranka, M., Wichman, A., Woodzicka, J. A., and Nosek, B. A.
- Subjects
Commentary ,Replication ,Iterative design - Published
- 2014
31. The Reproducibility Project: A model of large-scale collaboration for empirical research on reproducibility
- Author
-
Open Science Collaboration, Galliani, ELISA MARIA, Vianello, Michelangelo, and of Padua, for the U. n. i. v.
- Subjects
Open Science ,Methodology ,Replication ,Collaboration ,Reproducibility - Published
- 2014
32. Estimating the reproducibility of psychological science
- Author
-
Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, and Zuni, Kellylynn
- Abstract
Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.
- Published
- 2015
33. Estimating the reproducibility of psychological science
- Author
-
Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahnik, Stepan, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Bruening, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D. Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolas, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernandez-Castilla, Belen, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Gloeckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O. -Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jaekel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer, Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniel, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana, LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Moeschl, Marcus, Motyl, Matt, Mueller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Gandalf, Nicolas, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michele B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, Rene, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L. M., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valasek, Milan, van 't Veer, Anna E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Don, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Echeverria, Alejandro Vasquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahnik, Stepan, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Bruening, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D. Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolas, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernandez-Castilla, Belen, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Gloeckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O. -Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jaekel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer, Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniel, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana, LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Moeschl, Marcus, Motyl, Matt, Mueller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Gandalf, Nicolas, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michele B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, Rene, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L. M., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valasek, Milan, van 't Veer, Anna E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Don, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Echeverria, Alejandro Vasquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, and Zuni, Kellylynn
- Abstract
Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.
- Published
- 2015
34. Estimating the reproducibility of psychological science
- Author
-
Social Networks, Solidarity and Inequality, Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Social Networks, Solidarity and Inequality, Anderson, Joanna E., Aarts, Alexander A., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Conn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Penna, Nicolás Delia, Den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernández-Castilla, Belén, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O Y, Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniël, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana B., Le Bel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, MacKinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michèle B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L M, Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, Te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valášek, Milan, Van't Veer, Anna E., Van Aert, Robbie, Van Assen, Marcel, Van Bork, Riet, Van De Ven, Mathijs, Van Den Bergh, Don, Van Der Hulst, Marije, Van Dooren, Roel, Van Doorn, Johnny, Van Renswoude, Daan R., Van Rijn, Hedderik, Vanpaemel, Wolf, Echeverría, Alejandro Vásquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, and Zuni, Kellylynn
- Published
- 2015
35. Codebooks and Study Files
- Author
-
Ujhelyi, Adrienn, Young, Liane, Pérez, Rolando, Tanuka Ghoshal, Thomae, Manuela, Durrheim, Kevin, Kovacs, Carrie, Tybur, Joshua M., Street, Chris N. H., Nichols, Austin Lee, Maassen, Esther, Mayowa Babaloia, Morris, Wendy, Busching, Robert, Anna Van 'T Veer, Levitan, Carmel, Innes-Ker, Åse, Grahek, Ivan, Jen-Ho Chang, Schönbrodt, Felix, Pilati, Ronaldo, Nerisa Dozo, Van Assen, Marcel A.L.M., Gomez, Angel, Yarrow Dunham, Eller, Anja, De Bruijn, Maaike, Frankowska, Natalia, Ebersole, Charles R., Keller, Victor N., CHEN, Eva, English, Alexander Scott, Curran, Paul G, Brandt, Mark, Adams, Reginald B., Miguel-Ángel Freyre, Traczyk, Jakub, Friedman, Mike, Tripat Gill, Kurapov, German, Wronska, Marta Katarzyna, Bocian, Konrad, Knezevic, Goran, Carmichael, Cheryl L, Wichman, Aaron, Theriault, Jordan, Chatard, Armand, Haigh, Matthew, Lewis, Neil, Alper, Sinan, Huntsinger, Jeffrey R., Haines, Elizabeth L., Winnee Cheong, Skorinko, Jeanine, Pinter, Brad, Pollmann, Monique, Bialobrzeska, Olga, Cicero, David C, Stouten, Jeroen, Cushman, Fiery, Green, Eva, Williams, Lisa A., Ruggs, Enrica N., Nosek, Brian A., Marotta, Satia, Kakul Hai, Graham, Jesse, Vega, Diego, Voermans, Ingrid, Klein, Richard A., Conway, Morgan, Tang, Andrew, Verschoor, Mark, Lins, Samuel, Sacco, Airi, Štěpán Bahník, Giessner, Steffen Robert, Tanzer, Norbert, Patricio Saavedra, M., Adams, Byron Gregory, Packard, Grant, Axt, Jordan, Vranka, Marek A., Sowden, Walter J., Oikawa, Masanori, Kappes, Andreas, Chandler, Jesse J., Gonzalez, Roberto, Neto, Felix, Milfont, Taciano L., Lazarevic, Lili, Kappes, Heather, Hicks, Joshua A., Nelson, Anthony J., Saeri, Alexander K, Winfrida Malingumu, Edlund, John, Rutchick, Abraham M., Easterbrook, Matthew, Myachykov, Andriy, McIntyre, Jason, Karick, Haruna, Međedović, Janko, Welch, Cheryl, O'Donnell, Susan L., Kende, Anna, Berry, Daniel R., Szumowska, Ewa, Doğulu, Canay, Dukes, Kristin, Mallett, Robyn, Maitner, Angela, Collisson, Brian, Tear, Morgan, Spachtholz, Philipp, Orosz, Gabor, Coleman, Jennifer A., Neijenhuijs, Koen Ilja, Petrovic, Boban, Torres, David, Steiner, Troy G., Cambier, Fanny, Hall, Michael P., Podesta, Lysandra, Vianello, Michelangelo, Sobkow, Agata, Inbar, Yoel, Coen, Sharon, Kervyn, Nicolas, Davis, William E., Sundfelt, Oskar, Maciek Sekerdej, Tanzer, Norbert K., Vázquez, Alexandra, De Vries, Marieke, Cemalcilar, Zeynep, Karabati, Serdar, Verniers, Catherine, Salomon, Erika, Kurtz, Jaime, Rosa, Anna Dalla, Melissa-Sue John, Huajian Cai, Woodzicka, Julie A., Hasselman, Fred, Schmidt, Kathleen, Bernstein, Michael Jason, Gnambs, Timo, Sirlopu, David Ricardo, Vásquez-Echeverría, Alejandro, Aveyard, Mark, IJzerman, Hans, Vaughn, Leigh Ann, Smith-Castro, Vanessa, Galliani, Elisa Maria, Cantarero, Katarzyna, Malgorzata Osowiecka, Devos, Thierry, Jimenez-Leal, William, Ilker Dalgar, Zelenski, John M., Corker, Katherine S., Finck, Carolyn, Mihaly Berkics, Huynh, Ho Phi, Smith, Michael A., Lakens, Daniel, Houdek, Petr, Murphy, Sean, Joy-Gaba, Jennifer, Van Der Hulst, Marije, Krueger, Lacy Elise, Heffernan, Marie E., Grahe, Jon, and Kamiloglu, Roza
- Abstract
See the "Wiki" for more details.
- Published
- 2013
- Full Text
- View/download PDF
36. Integrità morale, emozioni positive e performance lavorativa
- Author
-
Galliani, ELISA MARIA and Vianello, Michelangelo
- Subjects
Emozioni ,Job performance ,Integrità morale - Published
- 2013
37. Videos Documenting Data Collection
- Author
-
Vega, Diego, Easterbrook, Matthew, Giessner, Steffen Robert, Pollmann, Monique, Galliani, Elisa Maria, Rutchick, Abraham M., Corker, Katherine S., Tanuka Ghoshal, Karabati, Serdar, Hasselman, Fred, Huajian Cai, Kamiloglu, Roza, Carmichael, Cheryl L, Smith-Castro, Vanessa, Schönbrodt, Felix, Sacco, Airi, Edlund, John, Pilati, Ronaldo, Zelenski, John M., Kurtz, Jaime, Tang, Andrew, Nelson, Anthony J., Pérez, Rolando, Kakul Hai, Vázquez, Alexandra, Verniers, Catherine, Alper, Sinan, Vranka, Marek A., Durrheim, Kevin, Marotta, Satia, Klein, Richard A., Gnambs, Timo, Chatard, Armand, IJzerman, Hans, Packard, Grant, Maassen, Esther, Innes-Ker, Åse, Vásquez-Echeverría, Alejandro, Theriault, Jordan, Sundfelt, Oskar, Schmidt, Kathleen, Lins, Samuel, Vianello, Michelangelo, Inbar, Yoel, Kappes, Andreas, Coen, Sharon, Young, Liane, Štěpán Bahník, Wronska, Marta Katarzyna, Nichols, Austin Lee, Kurapov, German, Kappes, Heather, Wichman, Aaron, Vaughn, Leigh Ann, Sowden, Walter J., English, Alexander Scott, Szumowska, Ewa, Yarrow Dunham, Huntsinger, Jeffrey R., Doğulu, Canay, Coleman, Jennifer A., Pinter, Brad, Hall, Michael P., Joy-Gaba, Jennifer, Frankowska, Natalia, Steiner, Troy G., Cambier, Fanny, Neto, Felix, Adams, Reginald B., Sirlopu, David Ricardo, Brandt, Mark, Nerisa Dozo, Levitan, Carmel, Curran, Paul G, Conway, Morgan, Bocian, Konrad, Busching, Robert, Cushman, Fiery, Melissa-Sue John, Axt, Jordan, Van Assen, Marcel A.L.M., Finck, Carolyn, Graham, Jesse, Berry, Daniel R., Grahek, Ivan, Green, Eva, Van Der Hulst, Marije, Kervyn, Nicolas, Morris, Wendy, Bialobrzeska, Olga, Mallett, Robyn, Gomez, Angel, Oikawa, Masanori, Traczyk, Jakub, De Bruijn, Maaike, Malgorzata Osowiecka, Maitner, Angela, Haines, Elizabeth L., Ilker Dalgar, Davis, William E., Stouten, Jeroen, Saeri, Alexander K, Chandler, Jesse J., Kende, Anna, Mayowa Babaloia, Međedović, Janko, Salomon, Erika, Lakens, Daniel, Tear, Morgan, Knezevic, Goran, Podesta, Lysandra, O'Donnell, Susan L., Haigh, Matthew, Skorinko, Jeanine, Krueger, Lacy Elise, Houdek, Petr, Ujhelyi, Adrienn, Aveyard, Mark, Keller, Victor N., Ruggs, Enrica N., Jen-Ho Chang, Tanzer, Norbert, Mihaly Berkics, Huynh, Ho Phi, Miguel-Ángel Freyre, Torres, David, Devos, Thierry, Voermans, Ingrid, Myachykov, Andriy, Gonzalez, Roberto, Sobkow, Agata, Kovacs, Carrie, CHEN, Eva, Woodzicka, Julie A., Milfont, Taciano L., Rosa, Anna Dalla, Jimenez-Leal, William, Orosz, Gabor, Murphy, Sean, Welch, Cheryl, Winnee Cheong, Heffernan, Marie E., Williams, Lisa A., Winfrida Malingumu, Collisson, Brian, Spachtholz, Philipp, Patricio Saavedra, M., Eller, Anja, Verschoor, Mark, McIntyre, Jason, Adams, Byron Gregory, Anna Van 'T Veer, Tybur, Joshua M., Petrovic, Boban, Lazarevic, Lili, Karick, Haruna, Nosek, Brian A., Friedman, Mike, Cantarero, Katarzyna, Dukes, Kristin, Grahe, Jon, Tanzer, Norbert K., Hicks, Joshua A., Cicero, David C, Ebersole, Charles R., Neijenhuijs, Koen Ilja, Tripat Gill, Cemalcilar, Zeynep, Maciek Sekerdej, De Vries, Marieke, Street, Chris N. H., Smith, Michael A., Bernstein, Michael Jason, Lewis, Neil, and Thomae, Manuela
- Published
- 2013
- Full Text
- View/download PDF
38. The effects of emotions on creative performance: a review
- Author
-
Galliani, ELISA MARIA and Vianello, Michelangelo
- Subjects
Creativity ,Affect ,Emotions ,Mood - Published
- 2012
39. Theories and Measures of Occupational Calling: a Review and Research Agenda
- Author
-
Dalla Rosa, Anna, primary, Galliani, Elisa Maria, additional, and Vianello, Michelangelo, additional
- Published
- 2015
- Full Text
- View/download PDF
40. Data from investigating variation in replicability: A 'Many Labs' replication project
- Author
-
Klein, Richard, Ratliff, K., Vianello, M., Adams Jr., R.B., Bahnik, S., Bernstein, M.J., Brandt, M.J., Ijzerman, H., Bocian, Konrad, Brooks, Beach, Brumbaugh, Claudia Chloe, Cemalcilar, Z., Chandler, Jesse, Cheong, Winnee, Davis, William E., Devos, Thierry, Eisner, Matthew, Frankowska, Natalia, Furrow, David, Galliani, Elisa Maria, Hasselman, Fred, Hicks, Joshua A., Hovermale, James F., Hunt, S. Jane, Huntsinger, Jeffrey R., John, Melissa-Sue, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Krueger, Lacy E., Kurtz, Jamie, Levitan, Carmel A., Mallett, Robyn K., Morris, Wendy L., Nelson, Anthony J., Nier, Jason A., Packard, Grant, Pilati, Ronaldo, Rutchick, Abraham M., Schmidt, Kathleen, Skorinko, Jeanine L., Smith, Robert, Steiner, Troy G., Storbeck, Justin, Van Swol, Lyn M., Thompson, Donna, van 't Veer, Anna, Vaughn, Leigh Ann, Vranka, Marek, Wichman, Aaron L., Woodzicka, Julie A., Nosek, Brian A., Klein, Richard, Ratliff, K., Vianello, M., Adams Jr., R.B., Bahnik, S., Bernstein, M.J., Brandt, M.J., Ijzerman, H., Bocian, Konrad, Brooks, Beach, Brumbaugh, Claudia Chloe, Cemalcilar, Z., Chandler, Jesse, Cheong, Winnee, Davis, William E., Devos, Thierry, Eisner, Matthew, Frankowska, Natalia, Furrow, David, Galliani, Elisa Maria, Hasselman, Fred, Hicks, Joshua A., Hovermale, James F., Hunt, S. Jane, Huntsinger, Jeffrey R., John, Melissa-Sue, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Krueger, Lacy E., Kurtz, Jamie, Levitan, Carmel A., Mallett, Robyn K., Morris, Wendy L., Nelson, Anthony J., Nier, Jason A., Packard, Grant, Pilati, Ronaldo, Rutchick, Abraham M., Schmidt, Kathleen, Skorinko, Jeanine L., Smith, Robert, Steiner, Troy G., Storbeck, Justin, Van Swol, Lyn M., Thompson, Donna, van 't Veer, Anna, Vaughn, Leigh Ann, Vranka, Marek, Wichman, Aaron L., Woodzicka, Julie A., and Nosek, Brian A.
- Abstract
This dataset is from the Many Labs Replication Project in which 13 effects were replicated across 36 samples and over 6,000 participants. Data from the replications are included, along with demographic variables about the participants and contextual information about the environment in which the replication was conducted. Data were collected in-lab and online through a standardized procedure administered via an online link. The dataset is stored on the Open Science Framework website. These data could be used to further investigate the results of the included 13 effects or to study replication and generalizability more broadly. Keywords: replication, generalizability, context
- Published
- 2014
41. Investigating variation in replicability: A “Many Labs” replication project
- Author
-
Klein, Richard, Ratliff, K., Vianello, M., Adams Jr., R.B., Bahnik, S., Bernstein, M.J., Bocian, Konrad, Brandt, M.J., Brooks, Beach, Brumbaugh, Claudia Chloe, Cemalcilar, Zeynep, Chandler, Jesse, Cheong, Winnee, Davis, William E., Devos, Thierry, Eisner, Matthew, Frankowska, Natalia, Furrow, David, Galliani, Elisa Maria, Hasselman, Fred, Hicks, Joshua A., Hovermale, James F., Hunt, S. Jane, Huntsinger, Jeffrey R., Ijzerman, H., John, Melissa-Sue, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Krueger, Lacy E., Kurtz, Jamie, Levitan, Carmel A., Mallett, Robyn K., Morris, Wendy L., Nelson, Anthony J., Schmidt, Kathleen, Skorinko, Jeanine L., Smith, Robert, Nier, Jason A., Packard, Grant, Pilati, Ronaldo, Rutchick, Abraham M., Steiner, Troy G., Storbeck, Justin, Van Swol, Lyn M., Thompson, Donna, van 't Veer, Anna, Vaughn, Leigh Ann, Vranka, Marek, Wichman, Aaron L., Woodzicka, Julie A., Nosek, Brian A., Klein, Richard, Ratliff, K., Vianello, M., Adams Jr., R.B., Bahnik, S., Bernstein, M.J., Bocian, Konrad, Brandt, M.J., Brooks, Beach, Brumbaugh, Claudia Chloe, Cemalcilar, Zeynep, Chandler, Jesse, Cheong, Winnee, Davis, William E., Devos, Thierry, Eisner, Matthew, Frankowska, Natalia, Furrow, David, Galliani, Elisa Maria, Hasselman, Fred, Hicks, Joshua A., Hovermale, James F., Hunt, S. Jane, Huntsinger, Jeffrey R., Ijzerman, H., John, Melissa-Sue, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Krueger, Lacy E., Kurtz, Jamie, Levitan, Carmel A., Mallett, Robyn K., Morris, Wendy L., Nelson, Anthony J., Schmidt, Kathleen, Skorinko, Jeanine L., Smith, Robert, Nier, Jason A., Packard, Grant, Pilati, Ronaldo, Rutchick, Abraham M., Steiner, Troy G., Storbeck, Justin, Van Swol, Lyn M., Thompson, Donna, van 't Veer, Anna, Vaughn, Leigh Ann, Vranka, Marek, Wichman, Aaron L., Woodzicka, Julie A., and Nosek, Brian A.
- Abstract
Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, 10 effects replicated consistently. One effect – imagined contact reducing prejudice – showed weak support for replicability. And two effects – flag priming influencing conservatism and currency priming influencing system justification – did not replicate. We compared whether the conditions such as lab versus online or US versus international sample predicted effect magnitudes. By and large they did not. The results of this small sample of effects suggest that replicability is more dependent on the effect itself than on the sample and setting used to investigate the effect. Keywords: replication, reproducibility, generalizability, cross-cultural, variation
- Published
- 2014
42. Emotional labor, burnout and emotional well-being in educational professions: a research on Italian public and private school teachers and sports instructors
- Author
-
Galliani, ELISA MARIA, DAL CORSO, Laura, and Falco, Alessandra
- Subjects
Emotional well-being ,Emotional Labor ,Educational profession ,Job Burnout - Published
- 2009
43. Implicit contrast and explicit assimilation effects following subtle and blatant advertisings
- Author
-
Vianello, Michelangelo, Galliani, ELISA MARIA, and DE CARLO, Nicola
- Subjects
Implicit Attitude Change ,Reverse Priming ,Advertising ,Assimilation ,Contrast - Published
- 2009
44. Emozioni e Creatività
- Author
-
Galliani, ELISA MARIA and Vianello, Michelangelo
- Subjects
Emozioni ,Creatività ,Elevazione ,Problem Solving - Published
- 2009
45. Implicit and explicit changes following subtle and blatant advertisings
- Author
-
Vianello, Michelangelo, Galliani, ELISA MARIA, and DE CARLO, Nicola
- Subjects
Implicit Attitude Change ,Contrast effect ,Reverse Priming ,Advertising effectiveness - Published
- 2008
46. Test di valutazione del rischio stress lavoro-correlato nella prospettiva del benessere organizzativo (Q-Bo)
- Author
-
DE CARLO, Nicola, Falco, Alessandra, Capozza, Dora, DAL CORSO, Laura, DI SIPIO, A. M., Galliani, ELISA MARIA, Lombardo, Anna, Piccirelli, A., Ranieri, L., Rolli, Cristina, Siragusa, A., Vianello, Michelangelo, Sarto, F., Vianello, L., and Zanella, D.
- Subjects
Modello multidimensionale ,Rischio stress lavoro-correlato ,Benessere organizzativo - Published
- 2008
47. Consequent variables of organizational well-being/disease: some new measurement scales in relation to organizational values in the italian cultural context
- Author
-
Falco, Alessandra, Galliani, ELISA MARIA, Piccirelli, A, Santisi, G, and DE CARLO, Nicola
- Subjects
Organizational well-being ,Organizational values ,Intangible assets ,Economic outcomes - Published
- 2007
48. Constructing a Cross-Cultural Measure of Conflict in Organizations: a Comparison between an Italian and a Spanish Sample
- Author
-
Rolli, Cristina, Vianello, Michelangelo, Lombardo, Anna, Galliani, ELISA MARIA, and Santisi, G.
- Subjects
Organizational Conflict ,Measure ,Cross-culture - Published
- 2007
49. Un case study: l' apprendimento di competenze tacite nel Distretto Termale Euganeo
- Author
-
Falco, Alessandra, Galliani, ELISA MARIA, and Zaggia, Cristina
- Subjects
intervista narrativa ,distretto ,competenze tacite ,apprendimento organizzativo - Published
- 2007
50. Variabili individuali e organizzative del burnout: un’indagine empirica nei servizi di vigilanza privata
- Author
-
DAL CORSO, Laura and Galliani, ELISA MARIA
- Published
- 2006
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.