Search

Your search keyword '"Wichman, Aaron"' showing total 4 results
Start Over Author "Wichman, Aaron" Publication Type Magazines
4 results on '"Wichman, Aaron"'

1. In COVID-19 Health Messaging, Loss Framing Increases Anxiety with Little-to-No Concomitant Benefits: Experimental Evidence from 84 Countries

Author

Dorison, Charles A., Lerner, Jennifer S., Heller, Blake H., Rothman, Alexander J., Kawachi, Ichiro I., Wang, Ke, Rees, Vaughan W., Gill, Brian P., Gibbs, Nancy, Ebersole, Charles R., Vally, Zahir, Tajchman, Zuzanna, Zsido, Andras N., Zrimsek, Mija, Chen, Zhang, Ziano, Ignazio, Gialitaki, Zoi, Ceary, Chris D., Lin, Yijun, Kunisato, Yoshihiko, Yamada, Yuki, Xiao, Qinyu, Jiang, Xiaoming, Du, Xinkai, Yao, Elvin, Wilson, John Paul, Cyrus-Lai, Wilson, Jimenez-Leal, William, Law, Wilbert, Collins, W. Matthew, Richard, Karley L., Vranka, Marek, Ankushev, Vladislav, Schei, Vidar, Križanić, Valerija, Kadreva, Veselina Hristova, Adoric, Vera Cubela, Tran, Ulrich S., Yeung, Siu Kit, Hassan, Widad, Houston, Ralph, Lima, Tiago J. S., Ostermann, Thomas, Frizzo, Thomas, Sverdrup, Therese E., House, Thea, Gill, Tripat, Fedotov, Maksim, Paltrow, Tamar, Jernsäther, Teodor, Koptjevskaja-Tamm, Maria, Hostler, Thomas J., Ishii, Tatsunori, Szaszi, Barnabas, Adamus, Sylwia, Suter, Lilian, Habib, Sumaiya, Studzinska, Anna, Stojanovska, Dragana, Janssen, Steve M. J., Stieger, Stefan, Schulenberg, Stefan E., Tatachari, Srinivasan, Azouaghe, Soufian, Sorokowski, Piotr, Sorokowska, Agnieszka, Song, Xin, Lewis, Savannah C., Sinkolova, Sladjana, Grigoryev, Dmitry, Drexler, Shira Meir, Daches, Shimrit, Geniole, Shawn N., Vračar, Selena, Massoni, Sébastien, Zorjan, Saša, Sarıoğuz, Eylül, Izquierdo, Sara Morales, Alves, Sara G., Pöntinen, Sara, Solas, Sara Álvarez, Ordoñez-Riaño, Santiago, Očovaj, Sanja Batić, Onie, Sandersan, Lins, Samuel, Çoksan, Sami, Sacakli, Asli, Ruiz-Fernández, Susana, Geiger, Sandra J., FatahModares, Saeideh, Walczak, Radoslaw B., Betlehem, Ruben, Vilar, Roosevelt, Cárcamo, Rodrigo, Ross, Robert M., McCarthy, Randy, Ballantyne, Tonia, Westgate, Erin C., Afhami, Reza, Ren, Dongning, Monteiro, Renan P., Reips, Ulf-Dietrich, Reggev, Niv, Calin-Jageman, Robert J., Pourafshari, Razieh, Oliveira, Raquel, Nedelcheva-Datsova, Mina, Rahal, Rima-Maria, Ribeiro, Rafael R., Radtke, Theda, Searston, Rachel, Habte, Redeate, Zdybek, Przemysław, Chen, Sau-Chin, Maturan, Princess Lovella G., Perillo, Jennifer T., Isager, Peder Mortvedt, Kačmár, Pavol, Macapagal, Paulo Manuel, Szwed, Paulina, Hanel, Paul H. P., Forbes, Paul A. G., Arriaga, Patrícia, Paris, Bastien, Papachristopoulos, Konstantinos, Correa, Pablo Sebastián, Kácha, Ondřej, Bernardo, Márcia, Campos, Olatz, Bravo, Olalla Niño, Galindo-Caballero, Oscar J., Ogbonnaya, Chisom Esther, Bialobrzeska, Olga, Kiselnikova, Natalia, Simonovic, Nicolle, Cohen, Noga, Nock, Nora L., Johannes, Niklas, Albayrak-Aydemir, Nihan, Say, Nicolas, Torunsky, Nathan, Van Doren, Natalia, Sunami, Naoyuki, Rachev, Nikolay R., Majeed, Nadyanna M., Schmidt, Nadya-Daniela, Nadif, Khaoula, Corral-Frías, Nadia S., Ouherrou, Nihal, Pantazi, Myrto, Lucas, Marc Y., Vasilev, Martin R., Ortiz, María Victoria, Butt, Muhammad Mussaffa, Kabir, Muhib, Muda, Rafał, Tejada Rivera, Maria del Carmen MC, Sirota, Miroslav, Seehuus, Martin, Parzuchowski, Michal, Toro, Mónica, Hricova, Monika, Maldonado, Mónica Alarcón, Marszalek, Magdalena, Karekla, Maria, Mioni, Giovanna, Bosma, Minke Jasmijn, Westerlund, Minja, Vdovic, Milica, Bialek, Michal, Silan, Miguel A., Anne, Michele, Misiak, Michal, Grinberg, Maurice, Capizzi, Mariagrazia, Espinoza Barría, Mauricio F., Kurfali, Merve A., Mensink, Michael C., Harutyunyan, Mikayel, Khosla, Meetu, Korbmacher, Max, Adamkovič, Matúš, Ribeiro, Matheus Fernando Felix, Terskova, Maria, Hruška, Matej, Martončik, Marcel, Voracek, Martin, Čadek, Martin, Frías-Armenta, Martha, Kowal, Marta, Topor, Marta, Roczniewska, Marta, Oosterlinck, Marlies, Kohlová, Markéta Braun, Paruzel-Czachura, Mariola, Romanova, Marina, Papadatou-Pastou, Marietta, Lund, Maria Louise, Antoniadi, Maria, Jones, Marc V., Ortiz, Manuel S., Manavalan, Mathi, Muminov, Abdumalik, Kossowska, Małgorzata, Friedemann, Maja, Wielgus, Magdalena, Varella, Marco A. C., Colloff, Melissa F., Bradford, Maria, Vaughn, Leigh Ann, Eudave, Luis, Vieira, Luc, Pineda, Lina Maria Sanabria, Pérez, Laura Calderón, Lazarevic, Ljiljana B., Jaremka, Lisa M., Kushnir, Elizaveta, Anton-Boicuk, Lisa, de Holanda Coelho, Gabriel Lins, Ahlgren, Lina, Levitan, Carmel A., Micheli, Leticia, Volz, Leonhard, Stojanovska, Marija, Boucher, Leanne, Samojlenko, Lara, Delgado, Lady Grey Javela, Kaliska, Lada, Warmelink, Lara, Rojas-Berscia, Luis Miguel, Yu, Karen, Wachowicz, Jakub, Desai, Kermeka, Barzykowski, Krystian, Kozma, Luca, Evans, Kortnee, Kirgizova, Komila, Agesin, Bamikole Emmanuel, Koehn, Monica A, Wolfe, Kelly, Korobova, Tatiana, Klevjer, Kristoffer, van Schie, Kevin, Vezirian, Kevin, Damnjanović, Kaja, Thommesen, Katrine Krabbe, Schmidt, Kathleen, Filip, Katarzyna, Grzech, Karolina, Hoyer, Karlijn, Moon, Karis, Rana, Kafeel, Janjić, Kristina, Suchow, Jordan W., Kielińska, Julita, Cruz Vásquez, Julio E, Beitner, Julia, Vargas-Nieto, Juan Camilo, Roxas, Jose Carlos T., Taber, Jennifer, Urriago-Rayo, Joan, Pavlacic, Jeffrey M., Bavolar, Jozef, Soto, José A., Olofsson, Jonas K., Vilsmeier, Johannes K., Messerschmidt, Johanna, Czamanski-Cohen, Johanna, Boudesseul, Jordane, Lee, Jeong Min, Kamburidis, Julia, Zickfeld, Janis, Miranda, Jacob F., Verharen, Jeroen P. H., Hristova, Evgeniya, Beshears, Julie E., Đorđević, Jasna Milošević, Bosch, Jasmijn, Valentova, Jaroslava Varella, Antfolk, Jan, Berkessel, Jana B., Schrötter, Jana, Urban, Jan, Röer, Jan Philipp, Norton, James O, Silva, Jaime R., Pickering, Jade S., Vintr, Jáchym, Uttley, Jim, Kunst, Jonas R., Ndukaihe, Izuchukwu L. G., Iyer, Aishwarya, Vilares, Iris, Ivanov, Aleksandr, Ropovik, Ivan, Sula, Isabela, Sarieva, Irena, Metin-Orta, Irem, Prusova, Irina, Pinto, Isabel, Bozdoc, Andreea Ioana, Almeida, Inês A. T., Pit, Ilse L., Dalgar, Ilker, Zakharov, Ilya, Arinze, Azuka Ikechukwu, Ihaya, Keiko, Stephen, Ian D., Gjoneska, Biljana, Brohmer, Hilmar, Flowe, Heather, Godbersen, Hendrik, Kocalar, Halil Emre, Hedgebeth, Mattie V., Chuan-Peng, Hu, Sharifian, MohammadHasan, Manley, Harry, Akkas, Handan, Hajdu, Nandor, Azab, Habiba, Kaminski, Gwenael, Nilsonne, Gustav, Anjum, Gulnaz, Travaglino, Giovanni A., Feldman, Gilad, Pfuhl, Gerit, Czarnek, Gabriela, Marcu, Gabriela Mariana, Hofer, Gabriela, Banik, Gabriel, Adetula, Gabriel Agboola, Bijlstra, Gijsbert, Verbruggen, Frederick, Kung, Franki Y. H., Foroni, Francesco, Singer, Gage, Muchembled, Fany, Azevedo, Flavio, Mosannenzadeh, Farnaz, Marinov, Evelina, Štrukelj, Eva, Etebari, Zahra, Baskin, Ernest, Garcia, Elkin Oswaldo Luis, Musser, Erica, van Steenkiste, I.M.M., Ahn, El Rim, Pronizius, Ekaterina, Jackson, Emily A, Manunta, Efisio, Agadullina, Elena, Šakan, Dušana, Dursun, Pinar, Dujols, Olivier, Dubrov, Dmitrii, Willis, Megan, Tümer, Murat, Beaudry, Jennifer L., Popović, Dora, Dunleavy, Daniel, Djamai, Ikhlas, Krupić, Dino, Vega, Diego, Du, Hongfei, Mola, Débora, Davis, William E., Holford, Dawn Liu, Lewis, David M. G., Vaidis, David C., Ozery, Daphna Hausman, Ricaurte, Danilo Zambrano, Storage, Daniel, Sousa, Daniela, Alvarez, Daniela Serrato, Rosa, Anna Dalla, Krupić, Dajana, Marko, Dafne, Moreau, David, Reeck, Crystal, Correia, Rita C., Whitt, Cassie M., Lamm, Claus, Solorzano, Claudio Singh, von Bastian, Claudia C., Sutherland, Clare AM, Overkott, Clara, Aberson, Christopher L., Wang, Chunhui, Karashiali, Christiana, Noone, Chris, Chiu, Faith, Picciocchi, Chiara, Karaarslan, Cemre, Cellini, Nicola, Esteban-Serna, Celia, Reyna, Cecilia, Batres, Carlota, Li, Ranran, Grano, Caterina, Carpentier, Joelle, Tamnes, Christian K., Fu, Cynthia H.Y., Ishkhanyan, Byurakn, Bylinina, Lisa, Jaeger, Bastian, Bundt, Carsten, Allred, Tara Bulut, Bokkour, Ahmed, Bogatyreva, Natalia, Chopik, William J., Antazo, Benedict, Behzadnia, Behzad, Becker, Maja, Cocco, Beatrice, Chou, Wei-Lun, Hubena, Barbora, Žuro, Barbara, Aczel, Balazs, Baklanova, Ekaterina, Bai, Hui, Balci, Busra Bahar, Babinčák, Peter, Dixson, Barnaby James Wyld, Mokady, Aviv, Kappes, Heather Barry, Atari, Mohammad, Szala, Anna, Szabelska, Anna, Aruta, John Jamir Benzon, Domurat, Artur, Arinze, Nwadiogo Chisom, Modena, Arianna, Adiguzel, Arca, Monajem, Arash, ARABI, Kanza AIT EL, Özdoğru, Asil Ali, Olaya Torres, Adriana Julieth, Theodoropoulou, Andriana, Jurković, Anita Penić, Kassianos, Angelos P., Findor, Andrej, Hartanto, Andree, Thibault Landry, Anais, Ferreira, Ana, Santos, Anabela Caetano, De la Rosa-Gomez, Anabel, Gourdon-Kanhukamwe, Amélie, Todsen, Anna Louise, Karababa, Alper, Janak, Allison, Bran, Alexandre, Tullett, Alexa M., Kuzminska, Anna O., Krafnick, Anthony J, Urooj, Anum, Khaoudi, Ahmed, Ahmed, Afroja, Groyecka-Bernard, Agata, Askelund, Adrian Dahl, Adetula, Adeyemi, Belaus, Anabel, Charyate, Abdelilah Ca, Wichman, Aaron L., Stoyanova, Alina, Greenburgh, Anna, Thomas, Andrew G., Arvanitis, Alexios, Forscher, Patrick S., Mallik, Peter R, Primbs, Maximilian A., Miller, Jeremy K., Moshontz, Hannah, Urry, Heather L., IJzerman, Hans, Basnight-Brown, Dana M., Chartier, Christopher R., Buchanan, Erin M., and Coles, Nicholas A.

Abstract

The COVID-19 pandemic (and its aftermath) highlights a critical need to communicate health information effectively to the global public. Given that subtle differences in information framing can have meaningful effects on behavior, behavioral science research highlights a pressing question: Is it more effective to frame COVID-19 health messages in terms of potential losses (e.g., “If you do not practice these steps, you can endanger yourself and others”) or potential gains (e.g., “If you practice these steps, you can protect yourself and others”)? Collecting data in 48 languages from 15,929 participants in 84 countries, we experimentally tested the effects of message framing on COVID-19-related judgments, intentions, and feelings. Loss- (vs. gain-) framed messages increased self-reported anxiety among participants cross-nationally with little-to-no impact on policy attitudes, behavioral intentions, or information seeking relevant to pandemic risks. These results were consistent across 84 countries, three variations of the message framing wording, and 560 data processing and analytic choices. Thus, results provide an empirical answer to a global communication question and highlight the emotional toll of loss-framed messages. Critically, this work demonstrates the importance of considering unintended affective consequences when evaluating nudge-style interventions.

Published
2022
Full Text
View/download PDF

2. Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability

Author

Ebersole, Charles R., Mathur, Maya B., Baranski, Erica, Bart-Plange, Diane-Jo, Buttrick, Nicholas R., Chartier, Christopher R., Corker, Katherine S., Corley, Martin, Hartshorne, Joshua K., IJzerman, Hans, Lazarević, Ljiljana B., Rabagliati, Hugh, Ropovik, Ivan, Aczel, Balazs, Aeschbach, Lena F., Andrighetto, Luca, Arnal, Jack D., Arrow, Holly, Babincak, Peter, Bakos, Bence E., Baník, Gabriel, Baskin, Ernest, Belopavlović, Radomir, Bernstein, Michael H., Białek, Michał, Bloxsom, Nicholas G., Bodroža, Bojana, Bonfiglio, Diane B. V., Boucher, Leanne, Brühlmann, Florian, Brumbaugh, Claudia C., Casini, Erica, Chen, Yiling, Chiorri, Carlo, Chopik, William J., Christ, Oliver, Ciunci, Antonia M., Claypool, Heather M., Coary, Sean, Čolić, Marija V., Collins, W. Matthew, Curran, Paul G., Day, Chris R., Dering, Benjamin, Dreber, Anna, Edlund, John E., Falcão, Filipe, Fedor, Anna, Feinberg, Lily, Ferguson, Ian R., Ford, Máire, Frank, Michael C., Fryberger, Emily, Garinther, Alexander, Gawryluk, Katarzyna, Ashbaugh, Kayla, Giacomantonio, Mauro, Giessner, Steffen R., Grahe, Jon E., Guadagno, Rosanna E., Hałasa, Ewa, Hancock, Peter J. B., Hilliard, Rias A., Hüffmeier, Joachim, Hughes, Sean, Idzikowska, Katarzyna, Inzlicht, Michael, Jern, Alan, Jiménez-Leal, William, Johannesson, Magnus, Joy-Gaba, Jennifer A., Kauff, Mathias, Kellier, Danielle J., Kessinger, Grecia, Kidwell, Mallory C., Kimbrough, Amanda M., King, Josiah P. J., Kolb, Vanessa S., Kołodziej, Sabina, Kovacs, Marton, Krasuska, Karolina, Kraus, Sue, Krueger, Lacy E., Kuchno, Katarzyna, Lage, Caio Ambrosio, Langford, Eleanor V., Levitan, Carmel A., de Lima, Tiago Jessé Souza, Lin, Hause, Lins, Samuel, Loy, Jia E., Manfredi, Dylan, Markiewicz, Łukasz, Menon, Madhavi, Mercier, Brett, Metzger, Mitchell, Meyet, Venus, Millen, Ailsa E., Miller, Jeremy K., Montealegre, Andres, Moore, Don A., Muda, Rafał, Nave, Gideon, Nichols, Austin Lee, Novak, Sarah A., Nunnally, Christian, Orlić, Ana, Palinkas, Anna, Panno, Angelo, Parks, Kimberly P., Pedović, Ivana, Pękala, Emilian, Penner, Matthew R., Pessers, Sebastiaan, Petrović, Boban, Pfeiffer, Thomas, Pieńkosz, Damian, Preti, Emanuele, Purić, Danka, Ramos, Tiago, Ravid, Jonathan, Razza, Timothy S., Rentzsch, Katrin, Richetin, Juliette, Rife, Sean C., Rosa, Anna Dalla, Rudy, Kaylis Hase, Salamon, Janos, Saunders, Blair, Sawicki, Przemysław, Schmidt, Kathleen, Schuepfer, Kurt, Schultze, Thomas, Schulz-Hardt, Stefan, Schütz, Astrid, Shabazian, Ani N., Shubella, Rachel L., Siegel, Adam, Silva, Rúben, Sioma, Barbara, Skorb, Lauren, de Souza, Luana Elayne Cunha, Steegen, Sara, Stein, L. A. R., Sternglanz, R. Weylin, Stojilović, Darko, Storage, Daniel, Sullivan, Gavin Brent, Szaszi, Barnabas, Szecsi, Peter, Szöke, Orsolya, Szuts, Attila, Thomae, Manuela, Tidwell, Natasha D., Tocco, Carly, Torka, Ann-Kathrin, Tuerlinckx, Francis, Vanpaemel, Wolf, Vaughn, Leigh Ann, Vianello, Michelangelo, Viganola, Domenico, Vlachou, Maria, Walker, Ryan J., Weissgerber, Sophia C., Wichman, Aaron L., Wiggins, Bradford J., Wolf, Daniel, Wood, Michael J., Zealley, David, Žeželj, Iris, Zrubka, Mark, and Nosek, Brian A.

Abstract

Replication studies in psychological science sometimes fail to reproduce prior findings. If these studies use methods that are unfaithful to the original study or ineffective in eliciting the phenomenon of interest, then a failure to replicate may be a failure of the protocol rather than a challenge to the original finding. Formal pre-data-collection peer review by experts may address shortcomings and increase replicability rates. We selected 10 replication studies from the Reproducibility Project: Psychology (RP:P; Open Science Collaboration, 2015) for which the original authors had expressed concerns about the replication designs before data collection; only one of these studies had yielded a statistically significant effect (p< .05). Commenters suggested that lack of adherence to expert review and low-powered tests were the reasons that most of these RP:P studies failed to replicate the original effects. We revised the replication protocols and received formal peer review prior to conducting new replication studies. We administered the RP:P and revised protocols in multiple laboratories (median number of laboratories per original study = 6.5, range = 3–9; median total sample = 1,279.5, range = 276–3,512) for high-powered tests of each original finding with both protocols. Overall, following the preregistered analysis plan, we found that the revised protocols produced effect sizes similar to those of the RP:P protocols (Δr= .002 or .014, depending on analytic approach). The median effect size for the revised protocols (r= .05) was similar to that of the RP:P protocols (r= .04) and the original RP:P replications (r= .11), and smaller than that of the original studies (r= .37). Analysis of the cumulative evidence across the original studies and the corresponding three replication attempts provided very precise estimates of the 10 tested effects and indicated that their effect sizes (median r= .07, range = .00–.15) were 78% smaller, on average, than the original effect sizes (median r= .37, range = .19–.50).

Published
2020
Full Text
View/download PDF

3. Many Labs 5: Registered Replication of Shnabel and Nadler (2008), Study 4

Author

Baranski, Erica, Baskin, Ernest, Coary, Sean, Ebersole, Charles R., Krueger, Lacy E., Lazarević, Ljiljana B., Miller, Jeremy K., Orlić, Ana, Penner, Matthew R., Purić, Danka, Rife, Sean C., Vaughn, Leigh Ann, Wichman, Aaron L., and Žeželj, Iris

Abstract

Shnabel and Nadler (2008) assessed a needs-based model of reconciliation suggesting that in conflicts, victims and perpetrators have different psychological needs that when satisfied increase the chances of reconciliation. For instance, Shnabel and Nadler found that after a conflict, perpetrators indicated that they had a need for social acceptance and were more likely to reconcile after their sense of social acceptance was restored, whereas victims indicated that they had a need for power and were more likely to reconcile after their sense of power was restored. Gilbert (2016), as a part of the Reproducibility Project: Psychology (RP:P), attempted to replicate these findings using different study materials but did not find support for the original effect. In an attempt to reconcile these discrepant findings, we conducted two new sets of replications—one using the RP:P protocol and another using modified materials meant to be more relatable to undergraduate participants. Teams from eight universities contributed to data collection (N= 2,738). We did find moderation by protocol; the focal interaction from the revised protocol, but not from the RP:P protocol, replicated the interaction in the original study. We discuss differences in, and possible explanations for, the patterns of results across protocols.

Published
2020
Full Text
View/download PDF

4. Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

Author

Klein, Richard A., Vianello, Michelangelo, Hasselman, Fred, Adams, Byron G., Adams, Reginald B., Alper, Sinan, Aveyard, Mark, Axt, Jordan R., Babalola, Mayowa T., Bahník, Štěpán, Batra, Rishtee, Berkics, Mihály, Bernstein, Michael J., Berry, Daniel R., Bialobrzeska, Olga, Binan, Evans Dami, Bocian, Konrad, Brandt, Mark J., Busching, Robert, Rédei, Anna Cabak, Cai, Huajian, Cambier, Fanny, Cantarero, Katarzyna, Carmichael, Cheryl L., Ceric, Francisco, Chandler, Jesse, Chang, Jen-Ho, Chatard, Armand, Chen, Eva E., Cheong, Winnee, Cicero, David C., Coen, Sharon, Coleman, Jennifer A., Collisson, Brian, Conway, Morgan A., Corker, Katherine S., Curran, Paul G., Cushman, Fiery, Dagona, Zubairu K., Dalgar, Ilker, Dalla Rosa, Anna, Davis, William E., de Bruijn, Maaike, De Schutter, Leander, Devos, Thierry, de Vries, Marieke, Doğulu, Canay, Dozo, Nerisa, Dukes, Kristin Nicole, Dunham, Yarrow, Durrheim, Kevin, Ebersole, Charles R., Edlund, John E., Eller, Anja, English, Alexander Scott, Finck, Carolyn, Frankowska, Natalia, Freyre, Miguel-Ángel, Friedman, Mike, Galliani, Elisa Maria, Gandi, Joshua C., Ghoshal, Tanuka, Giessner, Steffen R., Gill, Tripat, Gnambs, Timo, Gómez, Ángel, González, Roberto, Graham, Jesse, Grahe, Jon E., Grahek, Ivan, Green, Eva G. T., Hai, Kakul, Haigh, Matthew, Haines, Elizabeth L., Hall, Michael P., Heffernan, Marie E., Hicks, Joshua A., Houdek, Petr, Huntsinger, Jeffrey R., Huynh, Ho Phi, IJzerman, Hans, Inbar, Yoel, Innes-Ker, Åse H., Jiménez-Leal, William, John, Melissa-Sue, Joy-Gaba, Jennifer A., Kamiloğlu, Roza G., Kappes, Heather Barry, Karabati, Serdar, Karick, Haruna, Keller, Victor N., Kende, Anna, Kervyn, Nicolas, Knežević, Goran, Kovacs, Carrie, Krueger, Lacy E., Kurapov, German, Kurtz, Jamie, Lakens, Daniël, Lazarević, Ljiljana B., Levitan, Carmel A., Lewis, Neil A., Lins, Samuel, Lipsey, Nikolette P., Losee, Joy E., Maassen, Esther, Maitner, Angela T., Malingumu, Winfrida, Mallett, Robyn K., Marotta, Satia A., Međedović, Janko, Mena-Pacheco, Fernando, Milfont, Taciano L., Morris, Wendy L., Murphy, Sean C., Myachykov, Andriy, Neave, Nick, Neijenhuijs, Koen, Nelson, Anthony J., Neto, Félix, Lee Nichols, Austin, Ocampo, Aaron, O’Donnell, Susan L., Oikawa, Haruka, Oikawa, Masanori, Ong, Elsie, Orosz, Gábor, Osowiecka, Malgorzata, Packard, Grant, Pérez-Sánchez, Rolando, Petrović, Boban, Pilati, Ronaldo, Pinter, Brad, Podesta, Lysandra, Pogge, Gabrielle, Pollmann, Monique M. H., Rutchick, Abraham M., Saavedra, Patricio, Saeri, Alexander K., Salomon, Erika, Schmidt, Kathleen, Schönbrodt, Felix D., Sekerdej, Maciej B., Sirlopú, David, Skorinko, Jeanine L. M., Smith, Michael A., Smith-Castro, Vanessa, Smolders, Karin C. H. J., Sobkow, Agata, Sowden, Walter, Spachtholz, Philipp, Srivastava, Manini, Steiner, Troy G., Stouten, Jeroen, Street, Chris N. H., Sundfelt, Oskar K., Szeto, Stephanie, Szumowska, Ewa, Tang, Andrew C. W., Tanzer, Norbert, Tear, Morgan J., Theriault, Jordan, Thomae, Manuela, Torres, David, Traczyk, Jakub, Tybur, Joshua M., Ujhelyi, Adrienn, van Aert, Robbie C. M., van Assen, Marcel A. L. M., van der Hulst, Marije, van Lange, Paul A. M., van ’t Veer, Anna Elisabeth, Vásquez- Echeverría, Alejandro, Ann Vaughn, Leigh, Vázquez, Alexandra, Vega, Luis Diego, Verniers, Catherine, Verschoor, Mark, Voermans, Ingrid P. J., Vranka, Marek A., Welch, Cheryl, Wichman, Aaron L., Williams, Lisa A., Wood, Michael, Woodzicka, Julie A., Wronska, Marta K., Young, Liane, Zelenski, John M., Zhijia, Zeng, and Nosek, Brian A.

Abstract

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p< .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p< .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely high-powered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Qstatistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied.

Published
2018
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results