Search

Your search keyword '"Galliani, Elisa"' showing total 133 results
Start Over Author "Galliani, Elisa"
133 results on '"Galliani, Elisa"'

1. Moderators of Career Calling and Job-Search Behaviors Among Unemployed Individuals

Author

Rosa, Anna Dalla, Vianello, Michelangelo, Galliani, Elisa Maria, and Duffy, Ryan D.

Subjects
Job hunting -- Analysis, Business, Human resources and labor relations
Abstract

We examined the relationship between calling, job-search clarity, and job-search intensity in a cross-sectional study of Italian unemployed job seekers (N = 315). Structural equation modeling with observed variables and [...]

Published
2020
Full Text
View/download PDF

2. Investigating variation in replicability: A 'Many Labs' Replication Project

Author

Klein, Richard, Ratliff, Kate, Nosek, Brian, Vianello, Michelangelo, Pilati, Ronaldo, Cemalcilar, Zeynep, Chandler, Jesse, Devos, Thierry, Galliani, Elisa, Brandt, Mark, van 't Veer, Anna, Levitan, Carmel, Kurtz, Jaime, Joy-Gaba, Jennifer, Ehrlinger, Joyce, Bernstein, Michael, Morris, Wendy, Vaughn, Leigh Ann, Wichman, Aaron, Rutchick, Abraham, Kappes, Heather, Brumbaugh, Claudia, Nelson, Anthony, Eisner, Matthew, Smith, Robert, Woodzicka, Julie, Bocian, Konrad, Frankowska, Natalia, Schmidt, Kathleen, Skorinko, Jeanine, Storbeck, Justin, Thompson, Donna, Packard, Grant, van Swol, Lyn, Nier, Jason, Cheong, Winnee, Davis, William, Mallett, Robyn, Huntsinger, Jeffrey, Bahník, Štěpán, Vranka, Marek, Hasselman, Fred, IJzerman, Hans, and Krueger, Lacy

Subjects
replication, psychology
Abstract

We will attempt to replicate 12 effects in a single experimental package across numerous labs. Variations between lab conditions and sample characteristics will be analyzed to investigate how these factors might influence replication success.

Published
2022
Full Text
View/download PDF

3. Analysis Scripts

Author

Vianello, Michelangelo, Klein, Richard, Ratliff, Kate, Nosek, Brian, Pilati, Ronaldo, Devos, Thierry, Galliani, Elisa, Brandt, Mark, van 't Veer, Anna, Rutchick, Abraham, Schmidt, Kathleen, Bahník, Štěpán, Vranka, Marek, IJzerman, Hans, Hasselman, Fred, Joy-Gaba, Jennifer, Chandler, Jesse, Vaughn, Leigh Ann, Brumbaugh, Claudia, van Swol, Lyn, Wichman, Aaron, Packard, Grant, Brooks, Beach, Cemalcilar, Zeynep, Storbeck, Justin, Bocian, Konrad, Levitan, Carmel, Bernstein, Michael, Krueger, Lacy, Eisner, Matthew, Davis, William, Nier, Jason, Nelson, Anthony, and Steiner, Troy

Published
2022
Full Text
View/download PDF

6. Data

Author

Klein, Richard, Ratliff, Kate, Nosek, Brian, Vianello, Michelangelo, Pilati, Ronaldo, Devos, Thierry, Galliani, Elisa, Brandt, Mark, van 't Veer, Anna, Rutchick, Abraham, Schmidt, Kathleen, Bahník, Štěpán, Vranka, Marek, IJzerman, Hans, Hasselman, Fred, Joy-Gaba, Jennifer, Chandler, Jesse, Vaughn, Leigh Ann, Brumbaugh, Claudia, van Swol, Lyn, Wichman, Aaron, Packard, Grant, Brooks, Beach, Cemalcilar, Zeynep, Storbeck, Justin, Bocian, Konrad, Levitan, Carmel, Bernstein, Michael, Krueger, Lacy, Eisner, Matthew, Davis, William, Nier, Jason, Nelson, Anthony, and Steiner, Troy

Published
2022
Full Text
View/download PDF

7. Methods and Study Materials

Author

Klein, Richard, Ratliff, Kate, Nosek, Brian, Vianello, Michelangelo, Pilati, Ronaldo, Devos, Thierry, Galliani, Elisa, Brandt, Mark, van 't Veer, Anna, Rutchick, Abraham, Schmidt, Kathleen, Bahník, Štěpán, Vranka, Marek, IJzerman, Hans, Hasselman, Fred, Joy-Gaba, Jennifer, Chandler, Jesse, Vaughn, Leigh Ann, Brumbaugh, Claudia, van Swol, Lyn, Wichman, Aaron, Packard, Grant, Brooks, Beach, Cemalcilar, Zeynep, Storbeck, Justin, Bocian, Konrad, Levitan, Carmel, Bernstein, Michael, Krueger, Lacy, Eisner, Matthew, Davis, William, Nier, Jason, Nelson, Anthony, and Steiner, Troy

Published
2022
Full Text
View/download PDF

8. Mock Session Videos

Author

Klein, Richard, Ratliff, Kate, Nosek, Brian, Vianello, Michelangelo, Pilati, Ronaldo, Devos, Thierry, Galliani, Elisa, Brandt, Mark, van 't Veer, Anna, Rutchick, Abraham, Schmidt, Kathleen, Bahník, Štěpán, Vranka, Marek, IJzerman, Hans, Hasselman, Fred, Joy-Gaba, Jennifer, Chandler, Jesse, Vaughn, Leigh Ann, Brumbaugh, Claudia, van Swol, Lyn, Wichman, Aaron, Packard, Grant, Brooks, Beach, Cemalcilar, Zeynep, Storbeck, Justin, Bocian, Konrad, Levitan, Carmel, Bernstein, Michael, Krueger, Lacy, Eisner, Matthew, Davis, William, Nier, Jason, Nelson, Anthony, and Steiner, Troy

Published
2022
Full Text
View/download PDF

10. Site and Sample Characteristics

Author

Klein, Richard, Ratliff, Kate, Nosek, Brian, Vianello, Michelangelo, Pilati, Ronaldo, Devos, Thierry, Galliani, Elisa, Brandt, Mark, van 't Veer, Anna, Rutchick, Abraham, Schmidt, Kathleen, Bahník, Štěpán, Vranka, Marek, IJzerman, Hans, Hasselman, Fred, Joy-Gaba, Jennifer, Chandler, Jesse, Vaughn, Leigh Ann, Brumbaugh, Claudia, van Swol, Lyn, Wichman, Aaron, Packard, Grant, Brooks, Beach, Cemalcilar, Zeynep, Storbeck, Justin, Bocian, Konrad, Levitan, Carmel, Bernstein, Michael, Krueger, Lacy, Eisner, Matthew, Davis, William, Nier, Jason, Nelson, Anthony, and Steiner, Troy

Published
2022
Full Text
View/download PDF

11. ML2: The Effects

Author

Klein, Richard, Grahe, Jon, Levitan, Carmel, Schmidt, Kathleen, Vianello, Michelangelo, Axt, Jordan, Bahník, Štěpán, Bernstein, Michael, Bocian, Konrad, Brandt, Mark, Chandler, Jesse, Chatard, Armand, CHEN, Eva, Coen, Sharon, Conway, Morgan, Corker, Katherine, Davis, William, Devos, Thierry, Dunham, Yarrow, Galliani, Elisa, Haines, Elizabeth, Hasselman, Fred, Hicks, Joshua, Huntsinger, Jeffrey, IJzerman, Hans, Joy-Gaba, Jennifer, Kappes, Andreas, Keller, Victor, Krueger, Lacy, Lakens, Daniel, Mallett, Robyn, Morris, Wendy, Oikawa, Masanori, Pilati, Ronaldo, Rutchick, Abraham, Skorinko, Jeanine, van 't Veer, Anna, Vaughn, Leigh Ann, Vranka, Marek, Wichman, Aaron, Woodzicka, Julie, Zelenski, John, Nosek, Brian, Heffernan, Marie, Dalla Rosa, Anna, van Assen, Marcel, Innes-Ker, Åse, Lins, Samuel, Chang, Jen-Ho, Houdek, Petr, Pollmann, Monique, Tybur, Joshua, Stouten, Jeroen, Green, Eva, Busching, Robert, Ujhelyi, Adrienn, Kende, Anna, Berkics, Mihaly, Orosz, Gabor, Maitner, Angela, Street, Chris, Ebersole, Charles, Collisson, Brian, Thomae, Manuela, Cantarero, Katarzyna, Sobkow, Agata, Traczyk, Jakub, Neto, Felix, English, Alexander, Sirlopu, David, John, Melissa-Sue, Eller, Anja, Freyre, Miguel-Ángel, Smith-Castro, Vanessa, Pérez, Rolando, Torres-Fernández, David, Nichols, Austin, Sundfelt, Oskar, Karabati, Serdar, Cemalcilar, Zeynep, Kamiloglu, Roza, Theriault, Jordan, Young, Liane, Easterbrook, Matthew, Babalola, Mayowa, Barlow, Fiona, McIntyre, Jason, Marotta, Satia, Salomon, Erika, Vásquez-Echeverría, Alejandro, Packard, Grant, Gill, Tripat, Adams, Byron, Adams, Reginald, Nelson, Anthony, Steiner, Troy, Cai, Huajian, Tang, Andrew, Giessner, Steffen, Hai, Kakul, Verniers, Catherine, Kervyn, Nicolas, Friedman, Mike, Schönbrodt, Felix, Gnambs, Timo, Karick, Haruna, Cheong, Winnee, Carmichael, Cheryl, Curran, Paul, Kappes, Heather, Haigh, Matthew, Myachykov, Andriy, Smith, Michael, Malingumu, Winfrida, Aveyard, Mark, Ghoshal, Tanuka, Tear, Morgan, Saeri, Alexander, Murphy, Sean, Dozo, Nerisa, Sekerdej, Maciek, Sacco, Airi, Gonzalez, Roberto, Gomez, Angel, Vázquez, Alexandra, Vega, Diego, Doğulu, Canay, Alper, Sinan, Dalgar, Ilker, Huynh, Ho, Kurtz, Jaime, Welch, Cheryl, Berry, Daniel, Coleman, Jennifer, O'Donnell, Susan, Cushman, Fiery, Pinter, Brad, Edlund, John, Dukes, Kristin, Ruggs, Enrica, Finck, Carolyn, Jimenez-Leal, William, Durrheim, Kevin, Williams, Lisa, Govia, Ishtar, Inbar, Yoel, Verschoor, Mark, de Vries, Marieke, de Bruijn, Maaike, Maassen, Esther, Kurapov, German, Milfont, Taciano, Frankowska, Natalia, Bialobrzeska, Olga, Wronska, Marta, Lazarevic, Ljiljana, Knezevic, Goran, Petrovic, Boban, Međedović, Janko, Grahek, Ivan, Cicero, David, Sowden, Walter, Lewis, Neil, and Hall, Michael

Published
2022
Full Text
View/download PDF

13. Raw data: Workers

Author

Galliani, Elisa, Dalla Rosa, Anna, Vianello, Michelangelo, and Anselmi, Pasquale

Subjects
predictors, longitudinal, consequences, college, development, calling
Abstract

Cross-sectional data collected in a sample of 205 Italian workers (106 teachers and 99 public and private employees) who completed a self-administered paper questionnaire. The dataset includes observations of calling, work orientation, need for calling, origin of calling, occupational and organizational commitment, living a calling, work and life satisfaction, turnover intention, religiosity, spirituality, perceived organizational support, burnout, age, gender, seniority in their organization.

Published
2022
Full Text
View/download PDF

14. Clusters of Developmental Trajectories and Latent Growth Models

Author

Vianello, Michelangelo, Dalla Rosa, Anna, Galliani, Elisa, and Anselmi, Pasquale

Subjects
predictors, longitudinal, consequences, college, development, calling
Abstract

In this project, we provide supplementary materials to Vianello, Galliani, Dalla Rosa and Anselmi (under review), in which we present the results of a three-year longitudinal study that sheds new light on the origin of calling. We identified nine developmental trajectories that are typical across facets of calling, and found a reciprocal longitudinal relationships between having and living a calling. Furthermore, we observed that the initial level and the rate of change in calling predict participants’ mean grade, satisfaction, and dropout intentions at Time 3.

Published
2022
Full Text
View/download PDF

15. Career Calling and Job Seeking Behaviors

Author

Dalla Rosa, Anna, Vianello, Michelangelo, Galliani, Elisa, and Duffy, Ryan

Abstract

Searching for a work opportunity that aligns with one’s calling is one possible mechanism by which individuals find a way to live out their calling. The present study investigated the effects of calling and the moderating effects of self-esteem, optimism, and perseverance on job search intensity and clarity among a sample of unemployed job seekers (N = 315).

Published
2022
Full Text
View/download PDF

19. Raw data: Longitudinal

Author

Vianello, Michelangelo, Dalla Rosa, Anna, Galliani, Elisa, and Anselmi, Pasquale

Abstract

Data collected in three-waves using a non-experimental online survey on a sample of 6370 Italian college students. Participants were active bachelor or master students enrolled in 24 different study domains. The dataset is organized in wide format and includes longitudinal observations of calling, calling orientation, vocation, living a calling, intention to continue studying, satisfaction, engaged learning, clarity of professional identity, social support, vocation, age, gender, study domain.

Published
2022
Full Text
View/download PDF

20. Summary Results

Author

Klein, Richard, Ratliff, Kate, Nosek, Brian, Vianello, Michelangelo, Pilati, Ronaldo, Devos, Thierry, Galliani, Elisa, Brandt, Mark, van 't Veer, Anna, Rutchick, Abraham, Schmidt, Kathleen, Bahník, Štěpán, Vranka, Marek, IJzerman, Hans, Hasselman, Fred, Joy-Gaba, Jennifer, Chandler, Jesse, Vaughn, Leigh Ann, Brumbaugh, Claudia, van Swol, Lyn, Wichman, Aaron, Packard, Grant, Brooks, Beach, Cemalcilar, Zeynep, Storbeck, Justin, Bocian, Konrad, Levitan, Carmel, Bernstein, Michael, Krueger, Lacy, Eisner, Matthew, Davis, William, Nier, Jason, Nelson, Anthony, Steiner, Troy, Mallett, Robyn, Thompson, Donna, Huntsinger, Jeffrey, Morris, Wendy, Skorinko, Jeanine, and Kappes, Heather

Published
2022
Full Text
View/download PDF

21. Reproducibility Project: Psychology

Author

Anderson, Christopher, Anderson, Joanna, van Assen, Marcel, Attridge, Peter, Attwood, Angela, Axt, Jordan, Babel, Molly, Bahník, Štěpán, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, van den Bergh, Don, Beyan, Leah, den Bezemer, Bobby, Borsboom, Denny, Bosch, Annick, Bosco, Frank, Bowman, Sara, Brandt, Mark, Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin, Brown, Kristina, Brüning, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon, Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher, Cheung, Felix, Chu, Phuonguyen, Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark, Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Costantini, Giulio, Cramblet Alvarez, Leslie, Cremata, Edward, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle, Della Penna, Nicolás, Deserno, Marie, Devitt, Olivia, Dewitte, Laura, DiGiacomo, Philip, Dobolyi, David, Dodson, Geneva, Donnellan, Brent, Donohue, Ryan, van Dooren, Roel, van Doorn, Johnny, Dore, Rebecca, Dorrough, Angela, Dorsthorst, Anniek, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth, Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy, Estel, Vivien, Farach, Frank, Feather, Jenelle, Fedor, Anna, Fernández, Belén, Fiedler, Susann, Field, James, Fitneva, Stanka, Flagan, Taru, Forest, Amanda, Forsell, Eskil, Foster, Joshua, Frank, Michael, Frazier, Rebecca, Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Glöckner, Andreas, Goellner, Lars, Goh, Jin, Goldberg, Rebecca, Goldinger, Stephen, Goodbourn, Patrick, Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Gray, Jeremy, Hartgerink, Chris, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hicks, Grace, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Geertje, van der Hulst, Marije, Humphries, Denise, Hung, Cathy, Immelman, Nathali, Irsik, Vanessa, Jahn, Georg, Jäkel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, David, Johnson-Grey, Kate, Johnson, Larissa, Johnston, William, Jonas, Kai, Joy-Gaba, Jennifer, Kappes, Heather, Kelso, Kim, Kidwell, Mallory, Kim, Seung, Kirkhart, Matthew, Kleinberg, Bennett, Knezevic, Goran, Kolorz, Franziska, Krause, Robert, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram, Kyc, Megan, Lai, Calvin, Laique, Aamir, Lakens, Daniel, Lane, Kristin, Lassetter, Bethany, Lazarevic, Ljiljana, LeBel, Etienne, Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel, Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Lumian, Daniel, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather, Marigold, Denise, Martin, Daniel, Martinez, Tylar, Masicampo, E.J., Matacotta, Joshua, Mathur, Maya, May, Michael, McRae, Kateri, McElroy, Todd, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy, Smith, Mallorie, Moore, Katherine, Möschl, Marcus, Motyl, Matt, Müller, Stephanie, Munafo, Marcus, Muñoz, Alisa, Neijenhuijs, Koen, Nervi, Taylor, Nicolas, Gandalf, Nilsonne, Gustav, Nosek, Brian, Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason, Ratliff, Kate, Reinhard, David, Renkewitz, Frank, van Renswoude, Daan, Ricker, Ashley, Rigney, Anastasia, van Rijn, Hedderik, Rivers, Andrew, Roebke, Mark, Rutchick, Abraham, Ryan, Robert, Sahin, Onur, Saide, Anondah, Sandstrom, Gillian, Santos, David, Saxe, Rebecca, Schlegelmilch, René, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan, Shaki, Samuel, Simpson, William, Sinclair, H., Skorinko, Jeanine, Slowik, Agnieszka, Snyder, Joel, Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nicholas, Spies, Jeffrey, Staples, Angela, steegen, sara, Steinberg, Mia, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin, Talhelm, Thomas, Tapia, Megan, Thomae, Manuela, Toton, Sarah, Tibboel, Helen, Tio, Pia, Traets, Frits, Tsang, Steve, tuerlinckx, francis, Tullett, Alexa, Turchan, Paul, vanpaemel, wolf, Vásquez-Echeverría, Alejandro, van 't Veer, Anna, Vélez, Natalia, van de Ven, Mathijs, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Johanna, Welsh, Ashlee, Westgate, Erin, Wissink, Joeri, Wood, Michael, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, Hartshorne, Joshua, and Grange, James

Subjects
reproduction, metascience, replication, psychological science, open science, psychology, crowdsource, reproducibility
Abstract

Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available.

Published
2022
Full Text
View/download PDF

22. Many Labs 2: Investigating Variation in Replicability Across Sample and Setting

Author

Salomon , Erika, Smith-Castro , Vanessa, Chang , Jen-Ho, Collisson , Brian, Malingumu , Winfrida, Karick , Haruna, Cambier , Fanny, Eller , Anja, Coleman , Jennifer, Kovacs , Carrie, Williams , Lisa, Pinter , Brad, Vranka , Marek, Packard , Grant, Zelenski , John, Sundfelt , Oskar, Hall , Michael, Thomae , Manuela, Schmidt , Kathleen, Haigh , Matthew, Finck , Carolyn, Galliani , Elisa, Steiner , Troy, Bernstein , Michael, Ebersole , Charles, Tybur , Joshua, Dunham , Yarrow, Stouten , Jeroen, Coen , Sharon, Smith , Michael, Gnambs , Timo, Hicks , Joshua, Giessner , Steffen, Osowiecka , Malgorzata, Devos , Thierry, Mallett , Robyn, English , Alexander, Nelson , Anthony, Cheong , Winnee, Petrovic , Boban, Ujhelyi , Adrienn, Gonzalez , Roberto, Berkics , Mihaly, Graham , Jesse, Nichols , Austin, Dozo , Nerisa, Tang , Andrew, Szumowska , Ewa, Skorinko , Jeanine, Rosa , Anna, Haines , Elizabeth, Myachykov , Andriy, Carmichael , Cheryl, Maitner , Angela, Vega , Diego, Van Der Hulst , Marije, Oikawa , Masanori, Ghoshal , Tanuka, Frankowska , Natalia, Saavedra , Patricio, Keller , Victor, Torres-Fernández , David, Huntsinger , Jeffrey, Sirlopu , David, ODonnell , Susan, Bialobrzeska , Olga, Levitan , Carmel, Berry , Daniel, Spachtholz , Philipp, Curran , Paul, Traczyk , Jakub, Kurapov , German, Kurtz , Jaime, Lakens , Daniel, Sacco , Airi, Corker , Katherine, Durrheim , Kevin, Chandler , Jesse, Cai , Huajian, Jimenez-Leal , William, Easterbrook , Matthew, Maassen , Esther, Saeri , Alexander, Brandt , Mark, Cantarero , Katarzyna, Hai , Kakul, Heffernan , Marie, Kende , Anna, Doğulu , Canay, Karabati , Serdar, Freyre , Miguel-Ángel, Voermans, Ingrid, Huynh , Ho, Busching , Robert, Nosek , Brian, Woodzicka , Julie, John , Melissa-Sue, Orosz , Gabor, Coen, Sharon, Van T Veer , Anna, Joy-Gaba , Jennifer, Dukes , Kristin, Marotta , Satia, Welch , Cheryl, Tear , Morgan, Lazarevic , Ljiljana, Kamiloglu , Roza, Van Assen , Marcel, Međedović , Janko, Podesta , Lysandra, Pollmann , Monique, Schönbrodt , Felix, Theriault , Jordan, De Bruijn , Maaike, Sekerdej , Maciek, Ms Ms, Alexandra, Pr. Pr., Nicolas, Grahe , Jon, Neto , Felix, Conway , Morgan, Klein , Richard, Mcintyre , Jason, Murphy , Sean, Adams Jr., Reginald, Kappes , Heather, Cushman , Fiery, Street , Chris, Wichman , Aaron, Lewis Jr., Neil, Babalola , Mayowa, Alper , Sinan, Hasselman , Fred, Aveyard , Mark, Saavedra, Patricio, Babalola, Mayowa, Torres-Fernández, David, Vianello , Michelangelo, Adams , Byron, Barlow , Fiona, Axt , Jordan, Bahník , Štěpán, Young , Liane, Sowden, Walter, Knezevic , Goran, Verschoor , Mark, Tanzer , Norbert, Edlund , John, De Vries, Marieke, Vaughn , Leigh, Morris , Wendy, Lins , Samuel, Rutchick , Abraham, Krueger , Lacy, Ijzerman , Hans, Green , Eva, Davis , William, Inbar , Yoel, Sobkow , Agata, Cicero , David, Bocian , Konrad, Houdek , Petr, Chatard , Armand, Gomez , Angel, Innes-Ker , Åse, Dalgar , Ilker, Echeverría , Alejandro, Milfont , Taciano, Cemalcilar , Zeynep, Wronska , Marta, Gill , Tripat, Verniers , Catherine, Pilati , Ronaldo, Friedman , Mike, Grahek , Ivan, Chen , Eva, Neijenhuijs , Koen, Pérez , Rolando, Kappes , Andreas, and Coen, S

Subjects
manylabs, PsyArXiv|Social and Behavioral Sciences, replication, bepress|Social and Behavioral Sciences, PsyArXiv|Social and Behavioral Sciences|Cognitive Psychology, bepress|Social and Behavioral Sciences|Psychology|Personality and Social Contexts, bepress|Social and Behavioral Sciences|Psychology|Quantitative Psychology, PsyArXiv|Social and Behavioral Sciences|Quantitative Methods, psychology, PsyArXiv|Social and Behavioral Sciences|Social and Personality Psychology, WEIRD, bepress|Social and Behavioral Sciences|Psychology|Cognitive Psychology
Abstract

We conducted preregistered replications of 28 classic and contemporary published findings with protocols that were peer reviewed in advance to examine variation in effect magnitudes across sample and setting. Each protocol was administered to approximately half of 125 samples and 15,305 total participants from 36 countries and territories. Using conventional statistical significance (p < .05), fifteen (54%) of the replications provided evidence in the same direction and statistically significant as the original finding. With a strict significance criterion (p < .0001), fourteen (50%) provide such evidence reflecting the extremely high powered design. Seven (25%) of the replications had effect sizes larger than the original finding and 21 (75%) had effect sizes smaller than the original finding. The median comparable Cohen’s d effect sizes for original findings was 0.60 and for replications was 0.15. Sixteen replications (57%) had small effect sizes (< .20) and 9 (32%) were in the opposite direction from the original finding. Across settings, 11 (39%) showed significant heterogeneity using the Q statistic and most of those were among the findings eliciting the largest overall effect sizes; only one effect that was near zero in the aggregate showed significant heterogeneity. Only one effect showed a Tau > 0.20 indicating moderate heterogeneity. Nine others had a Tau near or slightly above 0.10 indicating slight heterogeneity. In moderation tests, very little heterogeneity was attributable to task order, administration in lab versus online, and exploratory WEIRD versus less WEIRD culture comparisons. Cumulatively, variability in observed effect sizes was more attributable to the effect being studied than the sample or setting in which it was studied.\ud \ud Data, materials and code available at: https://osf.io/8cd4r/

Published
2022
Full Text
View/download PDF

23. Theory Building through Replication: Response to Commentaries on the “Many Labs” Replication Project

Author

Klein, Richard Anthony, primary, Ratliff, Kate A., additional, Vianello, Michelangelo, additional, Adams, Reginald B., additional, Bahník, Štěpán, additional, Bernstein, Michael, additional, Bocian, Konrad, additional, Brandt, Mark, additional, Brooks, Beach Smith, additional, Brumbaugh, Claudia Chloe, additional, Cemalcilar, Zeynep, additional, Chandler, Jesse J., additional, Cheong, Winnee, additional, Davis, William E., additional, Devos, Thierry, additional, Eisner, Matthew, additional, Frankowska, Natalia, additional, Furrow, David, additional, Galliani, Elisa Maria, additional, Hasselman, Fred, additional, Hicks, Joshua A., additional, Hovermale, James F., additional, Hunt, S. Jane, additional, Huntsinger, Jeffrey R., additional, IJzerman, Hans, additional, John, Melissa-Sue, additional, Joy-Gaba, Jennifer, additional, Kappes, Heather Barry, additional, Krueger, Lacy Elise, additional, Kurtz, Jaime, additional, Levitan, Carmel, additional, Mallett, Robyn, additional, Morris, Wendy, additional, Nelson, Anthony J., additional, Nier, Jason A., additional, Packard, Grant, additional, Pilati, Ronaldo, additional, Rutchick, Abraham M., additional, Schmidt, Kathleen, additional, Skorinko, Jeanine, additional, Smith, Robert, additional, Steiner, Troy G., additional, Storbeck, Justin, additional, van Swol, Lyn, additional, Thompson, Donna, additional, van 't Veer, Anna Elisabeth, additional, Vaughn, Leigh Ann, additional, Vranka, Marek Albert, additional, Wichman, Aaron Lee, additional, Woodzicka, Julie A., additional, and Nosek, Brian A., additional

Published
2022
Full Text
View/download PDF

24. Data from Investigating Variation in Replicability: A “Many Labs” Replication Project

Author

Klein, Richard Anthony, primary, Ratliff, Kate A., additional, Vianello, Michelangelo, additional, Adams, Reginald B., additional, Bahník, Štěpán, additional, Bernstein, Michael Jason, additional, Bocian, Konrad, additional, Brandt, Mark John, additional, Brooks, Beach Smith, additional, Brumbaugh, Claudia Chloe, additional, Cemalcilar, Zeynep, additional, Chandler, Jesse J., additional, Cheong, Winnee, additional, Davis, William E., additional, Devos, Thierry, additional, Eisner, Matthew, additional, Frankowska, Natalia, additional, Furrow, David, additional, Galliani, Elisa Maria, additional, Hasselman, Fred, additional, Hicks, Joshua A., additional, Hovermale, James F., additional, Hunt, S. Jane, additional, Huntsinger, Jeffrey R., additional, IJzerman, Hans, additional, John, Melissa-Sue, additional, Joy-Gaba, Jennifer Alana, additional, Kappes, Heather Barry, additional, Krueger, Lacy Elise, additional, Kurtz, Jaime, additional, Levitan, Carmel, additional, Mallett, Robyn, additional, Morris, Wendy, additional, Nelson, Anthony J., additional, Nier, Jason A., additional, Packard, Grant, additional, Pilati, Ronaldo, additional, Rutchick, Abraham M., additional, Schmidt, Kathleen, additional, Skorinko, Jeanine, additional, Smith, Robert, additional, Steiner, Troy G., additional, Storbeck, Justin, additional, van Swol, Lyn, additional, Thompson, Donna, additional, van 't Veer, Anna Elisabeth, additional, Vaughn, Leigh Ann, additional, Vranka, Marek Albert, additional, Wichman, Aaron Lee, additional, Woodzicka, Julie A., additional, and Nosek, Brian A., additional

Published
2022
Full Text
View/download PDF

25. Investigating Variation in Replicability: A “Many Labs” Replication Project

Author

Klein, Richard Anthony, primary, Ratliff, Kate A., additional, Vianello, Michelangelo, additional, Adams, Reginald B., additional, Bahník, Štěpán, additional, Bernstein, Michael, additional, Bocian, Konrad, additional, Brandt, Mark, additional, Brooks, Beach Smith, additional, Brumbaugh, Claudia Chloe, additional, Cemalcilar, Zeynep, additional, Chandler, Jesse J., additional, Cheong, Winnee, additional, Davis, William E., additional, Devos, Thierry, additional, Eisner, Matthew, additional, Frankowska, Natalia, additional, Furrow, David, additional, Galliani, Elisa Maria, additional, Hasselman, Fred, additional, Hicks, Joshua A., additional, Hovermale, James F., additional, Hunt, S. Jane, additional, Huntsinger, Jeffrey R., additional, IJzerman, Hans, additional, John, Melissa-Sue, additional, Joy-Gaba, Jennifer Alana, additional, Kappes, Heather Barry, additional, Krueger, Lacy Elise, additional, Kurtz, Jaime, additional, Levitan, Carmel, additional, Mallett, Robyn, additional, Morris, Wendy, additional, Nelson, Anthony J., additional, Nier, Jason A., additional, Packard, Grant, additional, Pilati, Ronaldo, additional, Rutchick, Abraham M., additional, Schmidt, Kathleen, additional, Skorinko, Jeanine, additional, Steiner, Troy G., additional, Storbeck, Justin, additional, van Swol, Lyn, additional, Thompson, Donna, additional, van 't Veer, Anna Elisabeth, additional, Vaughn, Leigh Ann, additional, Vranka, Marek Albert, additional, Wichman, Aaron Lee, additional, Woodzicka, Julie A., additional, and Nosek, Brian A., additional

Published
2022
Full Text
View/download PDF

27. Theory Building Through Replication: Response to Commentaries on the “Many Labs” Replication Project

Author

Klein, Richard A., Ratliff, Kate A., Vianello, Michelangelo, Adams, Reginald B., Jr., Bahník, Štěpán, Bernstein, Michael J., Bocian, Konrad, Brandt, Mark J., Brooks, Beach, Brumbaugh, Claudia Chloe, Cemalcilar, Zeynep, Chandler, Jesse, Cheong, Winnee, Davis, William E., Devos, Thierry, Eisner, Matthew, Frankowska, Natalia, Furrow, David, Galliani, Elisa Maria, Hasselman, Fred, Hicks, Joshua A., Hovermale, James F., Hunt, Jane S., Huntsinger, Jeffrey R., IJzerman, Hans, John, Melissa-Sue, Joy-Gaba, Jennifer A., Kappes, Heather Barry, Krueger, Lacy E., Kurtz, Jaime, Levitan, Carmel A., Mallett, Robyn K, Morris, Wendy L., Nelson, Anthony J., Nier, Jason A., Packard, Grant, Pilati, Ronaldo, Rutchick, Abraham M., Schmidt, Kathleen, Skorinko, Jeanine L., Smith, Robert, Steiner, Troy G., Storbeck, Justin, Van Swol, Lyn M., Thompson, Donna, van ʼt Veer, A. E., Vaughn, Leigh Ann, Vranka, Marek, Wichman, Aaron L., Woodzicka, Julie A., and Nosek, Brian A

Published
2014

28. Investigating Variation in Replicability: A “Many Labs” Replication Project

Author

Klein, Richard A., Ratliff, Kate A., Vianello, Michelangelo, Adams, Reginald B., Jr., Bahník, Štěpán, Bernstein, Michael J., Bocian, Konrad, Brandt, Mark J., Brooks, Beach, Brumbaugh, Claudia Chloe, Cemalcilar, Zeynep, Chandler, Jesse, Cheong, Winnee, Davis, William E., Devos, Thierry, Eisner, Matthew, Frankowska, Natalia, Furrow, David, Galliani, Elisa Maria, Hasselman, Fred, Hicks, Joshua A., Hovermale, James F., Hunt, Jane S., Huntsinger, Jeffrey R., IJzerman, Hans, John, Melissa-Sue, Joy-Gaba, Jennifer A., Barry Kappes, Heather, Krueger, Lacy E., Kurtz, Jaime, Levitan, Carmel A., Mallett, Robyn K., Morris, Wendy L., Nelson, Anthony J., Nier, Jason A., Packard, Grant, Pilati, Ronaldo, Rutchick, Abraham M., Schmidt, Kathleen, Skorinko, Jeanine L., Smith, Robert, Steiner, Troy G., Storbeck, Justin, Van Swol, Lyn M., Thompson, Donna, van ʼt Veer, A. E., Vaughn, Leigh Ann, Vranka, Marek, Wichman, Aaron L., Woodzicka, Julie A., and Nosek, Brian A.

Published
2014
Full Text
View/download PDF

31. The Developmental Trajectories of Calling: Predictors and Outcomes

Author

Vianello, Michelangelo, Galliani, Elisa, Dalla Rosa, Anna, and Anselmi, Pasquale

Subjects
longitudinal design, Organizational Behavior and Human Resource Management, Psychology (all), Disease cluster, Developmental psychology, career, change, Empirical evidence, Psychology, cluster, calling, development, Applied Psychology, General Psychology
Abstract

There are many open questions concerning the development of calling, and longitudinal empirical evidence is limited. We know that a calling is associated with many beneficial outcomes, but we do not know how it changes through time and what predicts these changes. Previous studies have shown that calling is relatively stable at the sample level. We show that, at the individual level, calling shows huge variations through time. We identified nine developmental trajectories that are typical across facets of calling, and we found evidence that the development of a calling is fostered by the extent to which individuals have lived it out. We also observed that the more a calling has grown over a 2-year period, the more it is lived out during the third year. These results provide support for a developmental model of calling according to which having a calling and living it out reciprocally influence each other. The practical and theoretical implications of these results are discussed.

Published
2018

32. CallingDevelopment_2017_PrePrint

Author

Vianello, Michelangelo, Galliani, Elisa, Dalla Rosa, Anna, and Anselmi, Pasquale

Subjects
FOS: Psychology, Counseling Psychology, Psychology, Social and Behavioral Sciences, Industrial and Organizational Psychology
Abstract

There are many open questions on the development of calling, and longitudinal empirical evidence is limited. We know that a calling is associated with many beneficial outcomes, but we do not know how it changes through time and, most importantly, what predicts these changes. In this article, we present the results of a three-wave longitudinal study that sheds new light on these questions. We identified nine developmental trajectories that are typical across facets of a calling, and found evidence that the development of a calling is fostered by living it out. We also observed an inverse longitudinal relationship: the more a calling has grown over two years, the more it is lived out during the third year. These results provide support for a developmental model of calling according to which living out and having a calling reciprocally influence each other. The practical and theoretical implications of these results are discussed.

Published
2018
Full Text
View/download PDF

33. Klein_Open_Practices_Disclosure – Supplemental material for Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

Author

Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Mayowa T. Babalola, Štěpán Bahník, Rishtee Batra, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Evans Dami Binan, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Huajian Cai, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Jen-Ho Chang, Chatard, Armand, Chen, Eva E., Winnee Cheong, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Fiery Cushman, Zubairu K. Dagona, Ilker Dalgar, Rosa, Anna Dalla, Davis, William E., Bruijn, Maaike De, Schutter, Leander De, Devos, Thierry, Vries, Marieke De, Canay Doğulu, Nerisa Dozo, Dukes, Kristin Nicole, Yarrow Dunham, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Miguel-Ángel Freyre, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Tanuka Ghoshal, Giessner, Steffen R., Tripat Gill, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G. T., Kakul Hai, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, IJzerman, Hans, Inbar, Yoel, Innes-Ker, Åse H., Jiménez-Leal, William, Melissa-Sue John, Joy-Gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Nikolette P. Lipsey, Losee, Joy E., Maassen, Esther, Maitner, Angela T., Winfrida Malingumu, Mallett, Robyn K., Satia A. Marotta, Međedović, Janko, Mena-Pacheco, Fernando, Taciano L. Milfont, Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Nichols, Austin Lee, Ocampo, Aaron, O’Donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Malgorzata Osowiecka, Packard, Grant, Pérez-Sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M. H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L. M., Smith, Michael A., Smith-Castro, Vanessa, Smolders, Karin C. H. J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Manini Srivastava, Steiner, Troy G., Stouten, Jeroen, Street, Chris N. H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C. W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, Aert, Robbie C. M. Van, Assen, Marcel A. L. M. Van, Hulst, Marije Van Der, Lange, Paul A. M. Van, Anna Elisabeth Van ’T Veer, Echeverría, Alejandro Vásquez, Vaughn, Leigh Ann, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P. J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, and Nosek, Brian A.

Subjects
FOS: Psychology, FOS: Clinical medicine, 170199 Psychology not elsewhere classified, 110319 Psychiatry (incl. Psychotherapy)
Abstract

Supplemental material, Klein_Open_Practices_Disclosure for Many Labs 2: Investigating Variation in Replicability Across Samples and Settings by Richard A. Klein, Michelangelo Vianello, Fred Hasselman, Byron G. Adams, Reginald B. Adams, Sinan Alper, Mark Aveyard, Jordan R. Axt, Mayowa T. Babalola, Štěpán Bahník, Rishtee Batra, Mihály Berkics, Michael J. Bernstein, Daniel R. Berry, Olga Bialobrzeska, Evans Dami Binan, Konrad Bocian, Mark J. Brandt, Robert Busching, Anna Cabak Rédei, Huajian Cai, Fanny Cambier, Katarzyna Cantarero, Cheryl L. Carmichael, Francisco Ceric, Jesse Chandler, Jen-Ho Chang, Armand Chatard, Eva E. Chen, Winnee Cheong, David C. Cicero, Sharon Coen, Jennifer A. Coleman, Brian Collisson, Morgan A. Conway, Katherine S. Corker, Paul G. Curran, Fiery Cushman, Zubairu K. Dagona, Ilker Dalgar, Anna Dalla Rosa, William E. Davis, Maaike de Bruijn, Leander De Schutter, Thierry Devos, Marieke de Vries, Canay Doğulu, Nerisa Dozo, Kristin Nicole Dukes, Yarrow Dunham, Kevin Durrheim, Charles R. Ebersole, John E. Edlund, Anja Eller, Alexander Scott English, Carolyn Finck, Natalia Frankowska, Miguel-Ángel Freyre, Mike Friedman, Elisa Maria Galliani, Joshua C. Gandi, Tanuka Ghoshal, Steffen R. Giessner, Tripat Gill, Timo Gnambs, Ángel Gómez, Roberto González, Jesse Graham, Jon E. Grahe, Ivan Grahek, Eva G. T. Green, Kakul Hai, Matthew Haigh, Elizabeth L. Haines, Michael P. Hall, Marie E. Heffernan, Joshua A. Hicks, Petr Houdek, Jeffrey R. Huntsinger, Ho Phi Huynh, Hans IJzerman, Yoel Inbar, Åse H. Innes-Ker, William Jiménez-Leal, Melissa-Sue John, Jennifer A. Joy-Gaba, Roza G. Kamiloğlu, Heather Barry Kappes, Serdar Karabati, Haruna Karick, Victor N. Keller, Anna Kende, Nicolas Kervyn, Goran Knežević, Carrie Kovacs, Lacy E. Krueger, German Kurapov, Jamie Kurtz, Daniël Lakens, Ljiljana B. Lazarević, Carmel A. Levitan, Neil A. Lewis, Samuel Lins, Nikolette P. Lipsey, Joy E. Losee, Esther Maassen, Angela T. Maitner, Winfrida Malingumu, Robyn K. Mallett, Satia A. Marotta, Janko Međedović, Fernando Mena-Pacheco, Taciano L. Milfont, Wendy L. Morris, Sean C. Murphy, Andriy Myachykov, Nick Neave, Koen Neijenhuijs, Anthony J. Nelson, Félix Neto, Austin Lee Nichols, Aaron Ocampo, Susan L. O’Donnell, Haruka Oikawa, Masanori Oikawa, Elsie Ong, Gábor Orosz, Malgorzata Osowiecka, Grant Packard, Rolando Pérez-Sánchez, Boban Petrović, Ronaldo Pilati, Brad Pinter, Lysandra Podesta, Gabrielle Pogge, Monique M. H. Pollmann, Abraham M. Rutchick, Patricio Saavedra, Alexander K. Saeri, Erika Salomon, Kathleen Schmidt, Felix D. Schönbrodt, Maciej B. Sekerdej, David Sirlopú, Jeanine L. M. Skorinko, Michael A. Smith, Vanessa Smith-Castro, Karin C. H. J. Smolders, Agata Sobkow, Walter Sowden, Philipp Spachtholz, Manini Srivastava, Troy G. Steiner, Jeroen Stouten, Chris N. H. Street, Oskar K. Sundfelt, Stephanie Szeto, Ewa Szumowska, Andrew C. W. Tang, Norbert Tanzer, Morgan J. Tear, Jordan Theriault, Manuela Thomae, David Torres, Jakub Traczyk, Joshua M. Tybur, Adrienn Ujhelyi, Robbie C. M. van Aert, Marcel A. L. M. van Assen, Marije van der Hulst, Paul A. M. van Lange, Anna Elisabeth van ’t Veer, Alejandro Vásquez- Echeverría, Leigh Ann Vaughn, Alexandra Vázquez, Luis Diego Vega, Catherine Verniers, Mark Verschoor, Ingrid P. J. Voermans, Marek A. Vranka, Cheryl Welch, Aaron L. Wichman, Lisa A. Williams, Michael Wood, Julie A. Woodzicka, Marta K. Wronska, Liane Young, John M. Zelenski, Zeng Zhijia and Brian A. Nosek in Advances in Methods and Practices in Psychological Science

Published
2018
Full Text
View/download PDF

34. Career Calling: Toward a Common Model

Author

Vianello, Michelangelo, Dalla Rosa, Anna, Anselmi, Pasquale, and Galliani, Elisa

Subjects
FOS: Psychology, Psychology, Social and Behavioral Sciences, Industrial and Organizational Psychology
Abstract

The accumulation of scientific knowledge on calling is limited by the absence of a common theoretical and measurement framework. Many different models of calling have been proposed, and we do not know how much research results that refer to a specific model are generalizable to different theoretical accounts of calling. In this article, we investigate whether two leading models of calling tackle the same construct. The two models were merged into a more comprehensive framework that measures calling across seven facets: Passion, Purposefulness, Sacrifice, Pervasiveness, Prosocial Orientation, Transcendent Summons, and Identity. A second-order Confirmatory Factor Analysis proved the unified model of calling to be valid in a sample of adult employees. College students showed weaker relationships between Transcendent Summons, Prosocial Orientation and the other facets of calling. We then confirmed that the seven-facet model of calling is invariant across time and calling domains. Finally, we observed that facets of calling have very different relationships with outcomes and concurrent measures, suggesting that results obtained with a smaller set of facets are not generalizable to the higher-order construct of calling or to a different model that does not share the same facets.

Published
2018
Full Text
View/download PDF

38. Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

Author

Klein, Richard A., primary, Vianello, Michelangelo, additional, Hasselman, Fred, additional, Adams, Byron G., additional, Adams, Reginald B., additional, Alper, Sinan, additional, Aveyard, Mark, additional, Axt, Jordan R., additional, Babalola, Mayowa T., additional, Bahník, Štěpán, additional, Batra, Rishtee, additional, Berkics, Mihály, additional, Bernstein, Michael J., additional, Berry, Daniel R., additional, Bialobrzeska, Olga, additional, Binan, Evans Dami, additional, Bocian, Konrad, additional, Brandt, Mark J., additional, Busching, Robert, additional, Rédei, Anna Cabak, additional, Cai, Huajian, additional, Cambier, Fanny, additional, Cantarero, Katarzyna, additional, Carmichael, Cheryl L., additional, Ceric, Francisco, additional, Chandler, Jesse, additional, Chang, Jen-Ho, additional, Chatard, Armand, additional, Chen, Eva E., additional, Cheong, Winnee, additional, Cicero, David C., additional, Coen, Sharon, additional, Coleman, Jennifer A., additional, Collisson, Brian, additional, Conway, Morgan A., additional, Corker, Katherine S., additional, Curran, Paul G., additional, Cushman, Fiery, additional, Dagona, Zubairu K., additional, Dalgar, Ilker, additional, Dalla Rosa, Anna, additional, Davis, William E., additional, de Bruijn, Maaike, additional, De Schutter, Leander, additional, Devos, Thierry, additional, de Vries, Marieke, additional, Doğulu, Canay, additional, Dozo, Nerisa, additional, Dukes, Kristin Nicole, additional, Dunham, Yarrow, additional, Durrheim, Kevin, additional, Ebersole, Charles R., additional, Edlund, John E., additional, Eller, Anja, additional, English, Alexander Scott, additional, Finck, Carolyn, additional, Frankowska, Natalia, additional, Freyre, Miguel-Ángel, additional, Friedman, Mike, additional, Galliani, Elisa Maria, additional, Gandi, Joshua C., additional, Ghoshal, Tanuka, additional, Giessner, Steffen R., additional, Gill, Tripat, additional, Gnambs, Timo, additional, Gómez, Ángel, additional, González, Roberto, additional, Graham, Jesse, additional, Grahe, Jon E., additional, Grahek, Ivan, additional, Green, Eva G. T., additional, Hai, Kakul, additional, Haigh, Matthew, additional, Haines, Elizabeth L., additional, Hall, Michael P., additional, Heffernan, Marie E., additional, Hicks, Joshua A., additional, Houdek, Petr, additional, Huntsinger, Jeffrey R., additional, Huynh, Ho Phi, additional, IJzerman, Hans, additional, Inbar, Yoel, additional, Innes-Ker, Åse H., additional, Jiménez-Leal, William, additional, John, Melissa-Sue, additional, Joy-Gaba, Jennifer A., additional, Kamiloğlu, Roza G., additional, Kappes, Heather Barry, additional, Karabati, Serdar, additional, Karick, Haruna, additional, Keller, Victor N., additional, Kende, Anna, additional, Kervyn, Nicolas, additional, Knežević, Goran, additional, Kovacs, Carrie, additional, Krueger, Lacy E., additional, Kurapov, German, additional, Kurtz, Jamie, additional, Lakens, Daniël, additional, Lazarević, Ljiljana B., additional, Levitan, Carmel A., additional, Lewis, Neil A., additional, Lins, Samuel, additional, Lipsey, Nikolette P., additional, Losee, Joy E., additional, Maassen, Esther, additional, Maitner, Angela T., additional, Malingumu, Winfrida, additional, Mallett, Robyn K., additional, Marotta, Satia A., additional, Međedović, Janko, additional, Mena-Pacheco, Fernando, additional, Milfont, Taciano L., additional, Morris, Wendy L., additional, Murphy, Sean C., additional, Myachykov, Andriy, additional, Neave, Nick, additional, Neijenhuijs, Koen, additional, Nelson, Anthony J., additional, Neto, Félix, additional, Lee Nichols, Austin, additional, Ocampo, Aaron, additional, O’Donnell, Susan L., additional, Oikawa, Haruka, additional, Oikawa, Masanori, additional, Ong, Elsie, additional, Orosz, Gábor, additional, Osowiecka, Malgorzata, additional, Packard, Grant, additional, Pérez-Sánchez, Rolando, additional, Petrović, Boban, additional, Pilati, Ronaldo, additional, Pinter, Brad, additional, Podesta, Lysandra, additional, Pogge, Gabrielle, additional, Pollmann, Monique M. H., additional, Rutchick, Abraham M., additional, Saavedra, Patricio, additional, Saeri, Alexander K., additional, Salomon, Erika, additional, Schmidt, Kathleen, additional, Schönbrodt, Felix D., additional, Sekerdej, Maciej B., additional, Sirlopú, David, additional, Skorinko, Jeanine L. M., additional, Smith, Michael A., additional, Smith-Castro, Vanessa, additional, Smolders, Karin C. H. J., additional, Sobkow, Agata, additional, Sowden, Walter, additional, Spachtholz, Philipp, additional, Srivastava, Manini, additional, Steiner, Troy G., additional, Stouten, Jeroen, additional, Street, Chris N. H., additional, Sundfelt, Oskar K., additional, Szeto, Stephanie, additional, Szumowska, Ewa, additional, Tang, Andrew C. W., additional, Tanzer, Norbert, additional, Tear, Morgan J., additional, Theriault, Jordan, additional, Thomae, Manuela, additional, Torres, David, additional, Traczyk, Jakub, additional, Tybur, Joshua M., additional, Ujhelyi, Adrienn, additional, van Aert, Robbie C. M., additional, van Assen, Marcel A. L. M., additional, van der Hulst, Marije, additional, van Lange, Paul A. M., additional, van ’t Veer, Anna Elisabeth, additional, Vásquez- Echeverría, Alejandro, additional, Ann Vaughn, Leigh, additional, Vázquez, Alexandra, additional, Vega, Luis Diego, additional, Verniers, Catherine, additional, Verschoor, Mark, additional, Voermans, Ingrid P. J., additional, Vranka, Marek A., additional, Welch, Cheryl, additional, Wichman, Aaron L., additional, Williams, Lisa A., additional, Wood, Michael, additional, Woodzicka, Julie A., additional, Wronska, Marta K., additional, Young, Liane, additional, Zelenski, John M., additional, Zhijia, Zeng, additional, and Nosek, Brian A., additional

Published
2018
Full Text
View/download PDF

39. Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

Author

Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Babalola, Mayowa T., Bahník, Štěpán, Batra, Rishtee, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Binan, Evans Dami, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Cai, Huajian, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Chang, Jen-Ho, Chatard, Armand, Chen, Eva E., Cheong, Winnee, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Cushman, Fiery, Dagona, Zubairu K., Dalgar, Ilker, Dalla Rosa, Anna, Davis, William E., de Bruijn, Maaike, De Schutter, Leander, Devos, Thierry, de Vries, Marieke, Doğulu, Canay, Dozo, Nerisa, Dukes, Kristin Nicole, Dunham, Yarrow, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Freyre, Miguel-ángel, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Ghoshal, Tanuka, Giessner, Steffen R., Gill, Tripat, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G.T., Hai, Kakul, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, Ijzerman, Hans, Inbar, Yoel, Innes-ker, Åse H., Jiménez-leal, William, John, Melissa-sue, Joy-gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Lipsey, Nikolette P., Losee, Joy E., Maassen, Esther, Maitner, Angela T., Malingumu, Winfrida, Mallett, Robyn K., Marotta, Satia A., Međedović, Janko, Mena-pacheco, Fernando, Milfont, Taciano L., Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Lee Nichols, Austin, Ocampo, Aaron, O’donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Osowiecka, Malgorzata, Packard, Grant, Pérez-sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M. H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L. M., Smith, Michael A., Smith-castro, Vanessa, Smolders, Karin C.H.J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Srivastava, Manini, Steiner, Troy G., Stouten, Jeroen, Street, Chris N.H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C.W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, Van Aert, Robbie C. M., Van Assen, Marcel A. L. M., Van Der Hulst, Marije, Van Lange, Paul A. M., Van ’t Veer, Anna Elisabeth, Vásquez- Echeverría, Alejandro, Ann Vaughn, Leigh, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P. J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, Nosek, Brian A., Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Babalola, Mayowa T., Bahník, Štěpán, Batra, Rishtee, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Binan, Evans Dami, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Cai, Huajian, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Chang, Jen-Ho, Chatard, Armand, Chen, Eva E., Cheong, Winnee, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Cushman, Fiery, Dagona, Zubairu K., Dalgar, Ilker, Dalla Rosa, Anna, Davis, William E., de Bruijn, Maaike, De Schutter, Leander, Devos, Thierry, de Vries, Marieke, Doğulu, Canay, Dozo, Nerisa, Dukes, Kristin Nicole, Dunham, Yarrow, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Freyre, Miguel-ángel, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Ghoshal, Tanuka, Giessner, Steffen R., Gill, Tripat, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G.T., Hai, Kakul, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, Ijzerman, Hans, Inbar, Yoel, Innes-ker, Åse H., Jiménez-leal, William, John, Melissa-sue, Joy-gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Lipsey, Nikolette P., Losee, Joy E., Maassen, Esther, Maitner, Angela T., Malingumu, Winfrida, Mallett, Robyn K., Marotta, Satia A., Međedović, Janko, Mena-pacheco, Fernando, Milfont, Taciano L., Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Lee Nichols, Austin, Ocampo, Aaron, O’donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Osowiecka, Malgorzata, Packard, Grant, Pérez-sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M. H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L. M., Smith, Michael A., Smith-castro, Vanessa, Smolders, Karin C.H.J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Srivastava, Manini, Steiner, Troy G., Stouten, Jeroen, Street, Chris N.H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C.W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, Van Aert, Robbie C. M., Van Assen, Marcel A. L. M., Van Der Hulst, Marije, Van Lange, Paul A. M., Van ’t Veer, Anna Elisabeth, Vásquez- Echeverría, Alejandro, Ann Vaughn, Leigh, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P. J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, and Nosek, Brian A.

Abstract

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p < .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p < .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely high-powered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relati

Published
2018

40. Many labs 2:Investigating variation in replicability across samples and settings

Author

Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Babalola, Mayowa T., Bahník, Štěpán, Batra, Rishtee, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Binan, Evans Dami, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Cai, Huajian, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Chang, Jen Ho, Chatard, Armand, Chen, Eva E., Cheong, Winnee, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Cushman, Fiery, Dagona, Zubairu K., Dalgar, Ilker, Dalla Rosa, Anna, Davis, William E., de Bruijn, Maaike, De Schutter, Leander, Devos, Thierry, de Vries, Marieke, Doğulu, Canay, Dozo, Nerisa, Dukes, Kristin Nicole, Dunham, Yarrow, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Freyre, Miguel Ángel, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Ghoshal, Tanuka, Giessner, Steffen R., Gill, Tripat, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G.T., Hai, Kakul, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, Ijzerman, Hans, Inbar, Yoel, Innes-Ker, Åse H., Jiménez-Leal, William, John, Melissa Sue, Joy-Gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Lipsey, Nikolette P., Losee, Joy E., Maassen, Esther, Maitner, Angela T., Malingumu, Winfrida, Mallett, Robyn K., Marotta, Satia A., Međedović, Janko, Mena-Pacheco, Fernando, Milfont, Taciano L., Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Nichols, Austin Lee, Ocampo, Aaron, O’donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Osowiecka, Malgorzata, Packard, Grant, Pérez-Sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M.H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L.M., Smith, Michael A., Smith-Castro, Vanessa, Smolders, Karin C.H.J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Srivastava, Manini, Steiner, Troy G., Stouten, Jeroen, Street, Chris N.H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C.W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, van Aert, Robbie C.M., van Assen, Marcel A.L.M., van der Hulst, Marije, van Lange, Paul A.M., van ’t Veer, Anna Elisabeth, Vásquez-Echeverría, Alejandro, Vaughn, Leigh Ann, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P.J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, Nosek, Brian A., Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Babalola, Mayowa T., Bahník, Štěpán, Batra, Rishtee, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Binan, Evans Dami, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Cai, Huajian, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Chang, Jen Ho, Chatard, Armand, Chen, Eva E., Cheong, Winnee, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Cushman, Fiery, Dagona, Zubairu K., Dalgar, Ilker, Dalla Rosa, Anna, Davis, William E., de Bruijn, Maaike, De Schutter, Leander, Devos, Thierry, de Vries, Marieke, Doğulu, Canay, Dozo, Nerisa, Dukes, Kristin Nicole, Dunham, Yarrow, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Freyre, Miguel Ángel, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Ghoshal, Tanuka, Giessner, Steffen R., Gill, Tripat, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G.T., Hai, Kakul, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, Ijzerman, Hans, Inbar, Yoel, Innes-Ker, Åse H., Jiménez-Leal, William, John, Melissa Sue, Joy-Gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Lipsey, Nikolette P., Losee, Joy E., Maassen, Esther, Maitner, Angela T., Malingumu, Winfrida, Mallett, Robyn K., Marotta, Satia A., Međedović, Janko, Mena-Pacheco, Fernando, Milfont, Taciano L., Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Nichols, Austin Lee, Ocampo, Aaron, O’donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Osowiecka, Malgorzata, Packard, Grant, Pérez-Sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M.H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L.M., Smith, Michael A., Smith-Castro, Vanessa, Smolders, Karin C.H.J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Srivastava, Manini, Steiner, Troy G., Stouten, Jeroen, Street, Chris N.H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C.W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, van Aert, Robbie C.M., van Assen, Marcel A.L.M., van der Hulst, Marije, van Lange, Paul A.M., van ’t Veer, Anna Elisabeth, Vásquez-Echeverría, Alejandro, Vaughn, Leigh Ann, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P.J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, and Nosek, Brian A.

Abstract

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p <.05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p <.0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely highpowered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than.20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above.10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relative

Published
2018

41. Data and Results (per site, etc.)

Author

Huajian Cai, Vázquez, Alexandra, Voermans, Ingrid, Spachtholz, Philipp, English, Alexander Scott, Adams, Byron Gregory, Conway, Morgan, Stouten, Jeroen, Ruggs, Enrica N., Bocian, Konrad, Cicero, David C, Pinter, Brad, Štěpán Bahník, Van Aert, Robbie C. M., Chatard, Armand, Sacco, Airi, Kende, Anna, Aveyard, Mark, Vranka, Marek A., Ujhelyi, Adrienn, Zelenski, John M., Patricio Saavedra, M., Young, Liane, Bernstein, Michael Jason, Theriault, Jordan, Neto, Felix, De Bruijn, Maaike, Lewis, Neil, Berry, Daniel R., Gnambs, Timo, Busching, Robert, Tanuka Ghoshal, Houdek, Petr, Kappes, Andreas, Kakul Hai, Vaughn, Leigh Ann, Pilati, Ronaldo, Giessner, Steffen Robert, Green, Eva, Malgorzata Osowiecka, Mayowa Babaloia, Mihaly Berkics, Krueger, Lacy Elise, Joy-Gaba, Jennifer, Melissa-Sue John, Verniers, Catherine, Yarrow Dunham, Vásquez-Echeverría, Alejandro, Winfrida Malingumu, Coen, Sharon, Woodzicka, Julie A., Morris, Wendy, Ilker Dalgar, Van Assen, Marcel A.L.M., Tanzer, Norbert K., Collisson, Brian, Dukes, Kristin, Bialobrzeska, Olga, Durrheim, Kevin, Jen-Ho Chang, Welch, Cheryl, Orosz, Gabor, Huynh, Ho Phi, Thomae, Manuela, Friedman, Mike, Kappes, Heather, Jimenez-Leal, William, CHEN, Eva, Karabati, Serdar, Corker, Katherine S., Grahe, Jon, Pérez, Rolando, Alper, Sinan, Haines, Elizabeth L., Sundfelt, Oskar, De Vries, Marieke, Innes-Ker, Åse, Međedović, Janko, Eller, Anja, Curran, Paul G, Nerisa Dozo, Steiner, Troy G., Tanzer, Norbert, Karick, Haruna, Schmidt, Kathleen, Maitner, Angela, Davis, William E., Sowden, Walter J., Tripat Gill, Gonzalez, Roberto, Murphy, Sean, Doğulu, Canay, Wronska, Marta Katarzyna, Huntsinger, Jeffrey R., Lakens, Daniel, Graham, Jesse, Carmichael, Cheryl L, Kovacs, Carrie, IJzerman, Hans, Cemalcilar, Zeynep, O'Donnell, Susan L., Maciek Sekerdej, Maassen, Esther, Traczyk, Jakub, Tang, Andrew, Rosa, Anna Dalla, Smith-Castro, Vanessa, Tybur, Joshua M., Vega, Diego, Sobkow, Agata, Kervyn, Nicolas, Easterbrook, Matthew, Wichman, Aaron, Nosek, Brian A., Hall, Michael P., Nelson, Anthony J., Edlund, John, Williams, Lisa A., Finck, Carolyn, Myachykov, Andriy, Brandt, Mark, Heffernan, Marie E., Verschoor, Mark, Nichols, Austin Lee, Coleman, Jennifer A., Winnee Cheong, Petrovic, Boban, Inbar, Yoel, Van Der Hulst, Marije, Levitan, Carmel, Lazarevic, Lili, Galliani, Elisa Maria, Packard, Grant, McIntyre, Jason, Haigh, Matthew, Skorinko, Jeanine, Frankowska, Natalia, Szumowska, Ewa, Keller, Victor N., Podesta, Lysandra, Adams, Reginald B., Klein, Richard A., Knezevic, Goran, Saeri, Alexander K, Torres, David, Sirlopu, David Ricardo, Salomon, Erika, Anna Van 'T Veer, Tear, Morgan, Lins, Samuel, Neijenhuijs, Koen Ilja, Vianello, Michelangelo, Marotta, Satia, Street, Chris N. H., Mallett, Robyn, Kurapov, German, Pollmann, Monique, Kamiloglu, Roza, Ebersole, Charles R., Cambier, Fanny, Gomez, Angel, Smith, Michael A., Chandler, Jesse J., Kurtz, Jaime, Oikawa, Masanori, Devos, Thierry, Schönbrodt, Felix, Milfont, Taciano L., Miguel-Ángel Freyre, Rutchick, Abraham M., Axt, Jordan, Hasselman, Fred, Hicks, Joshua A., Grahek, Ivan, Cantarero, Katarzyna, and Cushman, Fiery

Abstract

Data from Many Labs 2 Replication Project

Published
2017
Full Text
View/download PDF

42. Analysis Scripts

Author

Bernstein, Michael Jason, De Bruijn, Maaike, Huntsinger, Jeffrey R., Young, Liane, Lazarevic, Lili, Milfont, Taciano L., Nerisa Dozo, Heffernan, Marie E., Alper, Sinan, Jimenez-Leal, William, Torres, David, Vásquez-Echeverría, Alejandro, Keller, Victor N., Friedman, Mike, Corker, Katherine S., Verniers, Catherine, Cushman, Fiery, Pinter, Brad, Collisson, Brian, Sacco, Airi, Maassen, Esther, Pilati, Ronaldo, Carmichael, Cheryl L, Haigh, Matthew, Chatard, Armand, Durrheim, Kevin, Verschoor, Mark, Traczyk, Jakub, Innes-Ker, Åse, Sowden, Walter J., Yarrow Dunham, Huajian Cai, Winnee Cheong, Nosek, Brian A., English, Alexander Scott, Schmidt, Kathleen, Inbar, Yoel, Ujhelyi, Adrienn, Kovacs, Carrie, Vranka, Marek A., Tanzer, Norbert K., Kende, Anna, Podesta, Lysandra, Vaughn, Leigh Ann, Tanzer, Norbert, Houdek, Petr, Curran, Paul G, Haines, Elizabeth L., Rosa, Anna Dalla, Nelson, Anthony J., Vega, Diego, Maciek Sekerdej, Kurtz, Jaime, Williams, Lisa A., Cemalcilar, Zeynep, CHEN, Eva, Skorinko, Jeanine, Grahe, Jon, Murphy, Sean, Sirlopu, David Ricardo, Kervyn, Nicolas, Smith-Castro, Vanessa, Karabati, Serdar, Patricio Saavedra, M., Van Der Hulst, Marije, Coen, Sharon, Miguel-Ángel Freyre, Graham, Jesse, Neijenhuijs, Koen Ilja, Winfrida Malingumu, Maitner, Angela, Adams, Byron Gregory, Morris, Wendy, IJzerman, Hans, Smith, Michael A., Vianello, Michelangelo, Bialobrzeska, Olga, Davis, William E., Tripat Gill, Huynh, Ho Phi, Orosz, Gabor, Tybur, Joshua M., Gnambs, Timo, Myachykov, Andriy, Lakens, Daniel, Van Assen, Marcel A.L.M., Cantarero, Katarzyna, Brandt, Mark, Oikawa, Masanori, Tang, Andrew, Finck, Carolyn, Gonzalez, Roberto, Stouten, Jeroen, Ebersole, Charles R., Cambier, Fanny, Klein, Richard A., Galliani, Elisa Maria, Štěpán Bahník, Ruggs, Enrica N., Adams, Reginald B., Aveyard, Mark, Petrovic, Boban, Conway, Morgan, McIntyre, Jason, Giessner, Steffen Robert, Rutchick, Abraham M., Axt, Jordan, Levitan, Carmel, Međedović, Janko, Packard, Grant, Hall, Michael P., Wichman, Aaron, Mayowa Babaloia, Woodzicka, Julie A., Busching, Robert, Theriault, Jordan, Kurapov, German, Berry, Daniel R., Frankowska, Natalia, Chandler, Jesse J., Kakul Hai, Szumowska, Ewa, Marotta, Satia, Pollmann, Monique, Mallett, Robyn, Vázquez, Alexandra, Salomon, Erika, Knezevic, Goran, Kamiloglu, Roza, Dukes, Kristin, Devos, Thierry, Zelenski, John M., Lins, Samuel, Green, Eva, Anna Van 'T Veer, Cicero, David C, Joy-Gaba, Jennifer, Sobkow, Agata, Doğulu, Canay, Sundfelt, Oskar, Ilker Dalgar, Wronska, Marta Katarzyna, Malgorzata Osowiecka, Schönbrodt, Felix, Gomez, Angel, O'Donnell, Susan L., Tear, Morgan, Spachtholz, Philipp, Eller, Anja, Voermans, Ingrid, Tanuka Ghoshal, Mihaly Berkics, Melissa-Sue John, Easterbrook, Matthew, Saeri, Alexander K, Edlund, John, Kappes, Heather, Neto, Felix, Welch, Cheryl, Steiner, Troy G., Karick, Haruna, Lewis, Neil, Street, Chris N. H., Hicks, Joshua A., Pérez, Rolando, Krueger, Lacy Elise, Kappes, Andreas, Thomae, Manuela, De Vries, Marieke, Grahek, Ivan, Bocian, Konrad, Nichols, Austin Lee, Hasselman, Fred, Coleman, Jennifer A., and Jen-Ho Chang

Published
2017
Full Text
View/download PDF

44. Data

Author

Cemalcilar, Zeynep, Klein, Richard A., Kurtz, Jaime, Huntsinger, Jeffrey R., Melissa-Sue John, Eisner, Matthew, Rutchick, Abraham M., Frankowska, Natalia, Galliani, Elisa Maria, Woodzicka, Julie A., Wichman, Aaron, Bernstein, Michael Jason, Kappes, Heather, Mallett, Robyn, Hasselman, Fred, Levitan, Carmel, Chandler, Jesse J., Nosek, Brian A., Van Swol, Lyn, Beach Brooks, Adams, Reginald B., Skorinko, Jeanine, Nelson, Anthony J., Packard, Grant, Vranka, Marek A., Bocian, Konrad, Davis, William E., Devos, Thierry, Smith, Robert W., Vaughn, Leigh Ann, Brumbaugh, Claudia, Winnee Cheong, Nier, Jason A., Vianello, Michelangelo, Pilati, Ronaldo, Thompson, Donna, Morris, Wendy, Ratliff, Kate, Krueger, Lacy Elise, Anna Van 'T Veer, Hicks, Joshua A., Schmidt, Kathleen, S. Jane Hunt, Hovermale, James F., Joy-Gaba, Jennifer, Brandt, Mark, Storbeck, Justin, IJzerman, Hans, Furrow, David, Štěpán Bahník, and Steiner, Troy G.

Abstract

Dataset and codebook from the project are available for download below, under "files". Datasets.zip contains the data files in both .csv and .sav (SPSS) format. For any issues, please contact Rick Klein (raklein@ufl.edu).

Published
2017
Full Text
View/download PDF

45. The Development of Occupational Calling

Author

Vianello, Michelangelo, Dalla Rosa, Anna, Anselmi, Pasquale, and Galliani, Elisa

Subjects
FOS: Psychology, predictors, longitudinal, Counseling Psychology, consequences, college, Psychology, Social and Behavioral Sciences, development, calling, Industrial and Organizational Psychology
Abstract

This project investigates occupational calling in college students by means of a longitudinal design involving 4 waves of data collection.

Published
2017
Full Text
View/download PDF

46. The Developmental Trajectories of Calling: Predictors and Outcomes.

Author

Vianello, Michelangelo, Galliani, Elisa Maria, Rosa, Anna Dalla, and Anselmi, Pasquale

Subjects
*OPEN-ended questions
Abstract

There are many open questions concerning the development of calling, and longitudinal empirical evidence is limited. We know that a calling is associated with many beneficial outcomes, but we do not know how it changes through time and what predicts these changes. Previous studies have shown that calling is relatively stable at the sample level. We show that, at the individual level, calling shows huge variations through time. We identified nine developmental trajectories that are typical across facets of calling, and we found evidence that the development of a calling is fostered by the extent to which individuals have lived it out. We also observed that the more a calling has grown over a 2-year period, the more it is lived out during the third year. These results provide support for a developmental model of calling according to which having a calling and living it out reciprocally influence each other. The practical and theoretical implications of these results are discussed. [ABSTRACT FROM AUTHOR]

Published
2020
Full Text
View/download PDF

47. Many Labs 2: Investigating Variation in Replicability Across Sample and Setting

Author

Klein, Richard Anthony, primary, Vianello, Michelangelo, additional, Hasselman, Fred, additional, Adams, Byron Gregory, additional, Adams, Reginald B., additional, Alper, Sinan, additional, Aveyard, Mark, additional, Axt, Jordan, additional, Babalola, Mayowa Tosin, additional, Bahník, Štěpán, additional, Berkics, Mihaly, additional, Bernstein, Michael Jason, additional, Berry, Daniel R., additional, Bialobrzeska, Olga, additional, Bocian, Konrad, additional, Brandt, Mark, additional, Busching, Robert, additional, Cai, Huajian, additional, Cambier, Fanny, additional, Cantarero, Katarzyna, additional, Carmichael, Cheryl L, additional, Cemalcilar, Zeynep, additional, Chandler, Jesse J., additional, Chang, Jen-Ho, additional, Chatard, Armand, additional, CHEN, Eva, additional, Cheong, Winnee, additional, Cicero, David C, additional, Coen, Sharon, additional, Coleman, Jennifer A., additional, Collisson, Brian, additional, Conway, Morgan Anna, additional, Corker, Katherine S., additional, Curran, Paul G, additional, Cushman, Fiery Andrews, additional, Dalgar, Ilker, additional, Davis, William E., additional, de Bruijn, Maaike Jolise, additional, de Vries, Marieke, additional, Devos, Thierry, additional, Doğulu, Canay, additional, Dozo, Nerisa, additional, Dukes, Kristin Nicole, additional, Dunham, Yarrow, additional, Durrheim, Kevin, additional, Easterbrook, Matthew, additional, Ebersole, Charles R., additional, Edlund, John, additional, English, Alexander Scott, additional, Eller, Anja, additional, Finck, Carolyn, additional, Freyre, Miguel-Ángel, additional, Friedman, Mike, additional, Frankowska, Natalia, additional, Galliani, Elisa Maria, additional, Ghoshal, Tanuka, additional, Giessner, Steffen Robert, additional, Gill, Tripat, additional, Gnambs, Timo, additional, Gomez, Angel, additional, Gonzalez, Roberto, additional, Graham, Jesse, additional, Grahe, Jon E., additional, Grahek, Ivan, additional, Green, Eva, additional, Hai, Kakul, additional, Haigh, Matthew, additional, Haines, Elizabeth L., additional, Hall, Michael P., additional, Heffernan, Marie E., additional, Hicks, Joshua A., additional, Houdek, Petr, additional, van der Hulst, Marije, additional, Huntsinger, Jeffrey R., additional, Huynh, Ho Phi, additional, IJzerman, Hans, additional, Inbar, Yoel, additional, Innes-Ker, Åse, additional, Jimenez-Leal, William, additional, John, Melissa-Sue, additional, Joy-Gaba, Jennifer Alana, additional, Kamiloglu, Roza Gizem, additional, Kappes, Andreas, additional, Kappes, Heather Barry, additional, Karabati, Serdar, additional, Karick, Haruna, additional, Keller, Victor N., additional, Kende, Anna, additional, Kervyn, Nicolas /, additional, Knezevic, Goran, additional, Kovacs, Carrie, additional, Krueger, Lacy Elise, additional, Kurapov, German, additional, Kurtz, Jaime, additional, Lakens, Daniel, additional, Lazarevic, Ljiljana B., additional, Levitan, Carmel, additional, Lewis, Neil Anthony, additional, Lins, Samuel, additional, Maassen, Esther, additional, Maitner, Angela, additional, Malingumu, Winfrida, additional, Mallett, Robyn, additional, Marotta, Satia Adele, additional, McIntyre, Jason Cameron, additional, Međedović, Janko Mileta, additional, Milfont, Taciano L, additional, Morris, Wendy, additional, Myachykov, Andriy, additional, Murphy, Sean Christopher, additional, Neijenhuijs, Koen Ilja, additional, Nelson, Anthony J., additional, Neto, Felix Fernando Monteiro, additional, Nichols, Austin Lee, additional, O'Donnell, Susan L., additional, Oikawa, Masanori, additional, Orosz, Gabor, additional, Osowiecka, Malgorzata, additional, Packard, Grant, additional, Pérez, Rolando, additional, Petrovic, Boban, additional, Pilati, Ronaldo, additional, Pinter, Brad, additional, Podesta, Lysandra Maria, additional, Pollmann, Monique Maria Henriettte, additional, Dalla Rosa, Anna, additional, Rutchick, Abraham M., additional, Saavedra, Patricio, additional, Sacco, Airi, additional, Saeri, Alexander K, additional, Salomon, Erika, additional, Schmidt, Kathleen, additional, Schönbrodt, Felix D., additional, Sekerdej, Maciek Borys, additional, Sirlopu, David Ricardo, additional, Skorinko, Jeanine, additional, Smith, Michael A., additional, Smith-Castro, Vanessa, additional, Sobkow, Agata, additional, Sowden, Walter J., additional, Spachtholz, Philipp, additional, Steiner, Troy G., additional, Stouten, Jeroen, additional, Street, Chris N. H., additional, Sundfelt, Oskar, additional, Szumowska, Ewa, additional, Tang, Andrew, additional, Tanzer, Norbert K., additional, Tear, Morgan James, additional, Theriault, Jordan E., additional, Thomae, Manuela, additional, Torres-Fernández, David, additional, Traczyk, Jakub, additional, Tybur, Joshua M., additional, Ujhelyi, Adrienn, additional, van Assen, Marcel A. L. M., additional, van 't Veer, Anna Elisabeth, additional, Vásquez-Echeverría, Alejandro, additional, Vaughn, Leigh Ann, additional, Vázquez, Alexandra ., additional, Vega, Diego, additional, Verniers, Catherine, additional, Verschoor, Mark, additional, Voermans, Ingrid, additional, Vranka, Marek Albert, additional, Welch, Cheryl Alyssa, additional, Wichman, Aaron Lee, additional, Williams, Lisa A., additional, Woodzicka, Julie A., additional, Wronska, Marta Katarzyna, additional, Young, Liane, additional, Zelenski, John M., additional, and Nosek, Brian A., additional

Published
2018
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results