Search

Your search keyword '"Ebersole CR"' showing total 21 results
Start Over Author "Ebersole CR"
21 results on '"Ebersole CR"'

1. A global experiment on motivating social distancing during the COVID-19 pandemic

Author

Legate, N, Nguyen, T, Weinstein, N, Moller, A, Legault, L, Vally, Z, Tajchman, Z, Zsido, A, Zrimsek, M, Chen, Z, Ziano, I, Gialitaki, Z, Ceary, C, Jang, Y, Lin, Y, Kunisato, Y, Yamada, Y, Xiao, Q, Jiang, X, Du, X, Yao, E, Ryan, W, Wilson, J, Cyrus-Lai, W, Jimenez-Leal, W, Law, W, Unanue, W, Collins, W, Richard, K, Vranka, M, Ankushev, V, Schei, V, Lerche, V, Kovic, V, Krizanic, V, Kadreva, V, Adoric, V, Tran, U, Yeung, S, Hassan, W, Houston, R, Machin, M, Lima, T, Ostermann, T, Frizzo, T, Sverdrup, T, House, T, Gill, T, Fedotov, M, Paltrow, T, Jernsather, T, Rahman, T, Machin, T, Koptjevskaja-Tamm, M, Hostler, T, Ishii, T, Szaszi, B, Adamus, S, Suter, L, von Bormann, S, Habib, S, Studzinska, A, Stojanovska, D, Janssen, S, Stieger, S, Schulenberg, S, Tatachari, S, Azouaghe, S, Sorokowski, P, Sorokowska, A, Song, X, Morbee, S, Lewis, S, Sinkolova, S, Grigoryev, D, Drexler, S, Daches, S, Levine, S, Geniole, S, Akter, S, Vracar, S, Massoni, S, Costa, S, Zorjan, S, Sarioguz, E, Izquierdo, S, Tshonda, S, Alves, S, Pontinen, S, Solas, S, Ordonez-Riano, S, Ocovaj, S, Onie, S, Lins, S, Biberauer, T, Coksan, S, Khumkom, S, Sacakli, A, Ruiz-Fernandez, S, Geiger, S, Modares, S, Walczak, R, Betlehem, R, Vilar, R, Carcamo, R, Ross, R, Mccarthy, R, Ballantyne, T, Westgate, E, Ryan, R, Gargurevich, R, Afhami, R, Ren, D, Monteiro, R, Reips, U, Reggev, N, Calin-Jagema, R, Pourafshari, R, Oliveira, R, Nedelcheva-Datsova, M, Rahal, R, Ribeiro, R, Radtke, T, Searston, R, Jai-ai, R, Habte, R, Zdybek, P, Chen, S, Wajanatinapart, P, Maturan, P, Perillo, J, Isager, P, Kacmar, P, Macapagal, P, Maniaci, M, Szwed, P, Hanel, P, Forbes, P, Arriaga, P, Paris, B, Parashar, N, Papachristopoulos, K, Correa, P, Kacha, O, Bernardo, M, Campos, O, Bravo, O, Galindo-Caballero, O, Ogbonnaya, C, Bialobrzeska, O, Kiselnikova, N, Simonovic, N, Cohen, N, Nock, N, Hernandez, A, Thogersen-Ntouma, C, Ntoumanis, N, Johannes, N, Albayrak-Aydemir, N, Say, N, Neubauer, A, Martin, N, Torunsky, N, van Antwerpen, N, Van Doren, N, Sunami, N, Rachev, N, Majeed, N, Schmidt, N, Nadif, K, Corral-Frias, N, Ouherrou, N, Abbas, N, Pantazi, M, Lucas, M, Vasilev, M, Ortiz, M, Butt, M, Kurfali, M, Kabir, M, Muda, R, Rivera, M, Sirota, M, Seehuus, M, Parzuchowski, M, Toro, M, Hricova, M, Maldonado, M, Rentzelas, P, Vansteenkiste, M, Metz, M, Marszalek, M, Karekla, M, Mioni, G, Bosma, M, Westerlund, M, Vdovic, M, Bialek, M, Silan, M, Anne, M, Misiak, M, Gugliandolo, M, Grinberg, M, Capizzi, M, Barria, M, Mensink, M, Harutyunyan, M, Khosla, M, Dunn, M, Korbmacher, M, Adamkovic, M, Ribeiro, M, Terskova, M, Hruska, M, Martoncik, M, Voracek, M, Cadek, M, Frias-Armenta, M, Kowal, M, Topor, M, Roczniewska, M, Oosterlinck, M, Kohlova, M, Paruzel-Czachura, M, Sabristov, M, Romanova, M, Papadatou-Pastou, M, Lund, M, Antoniadi, M, Magrin, M, Jones, M, Li, M, Manavalan, M, Muminov, A, Kossowska, M, Friedemann, M, Wielgus, M, van Hooff, M, Varella, M, Standage, M, Nicolotti, M, Colloff, M, Bradford, M, Vaughn, L, Eudave, L, Vieira, L, Lu, J, Pineda, L, Matos, L, Perez, L, Lazarevic, L, Jaremka, L, Smit, E, Kushnir, E, Ferguson, L, Anton-Boicuk, L, Coelho, G, Ahlgren, L, Liga, F, Levitan, C, Micheli, L, Gunton, L, Volz, L, Stojanovska, M, Boucher, L, Samojlenko, L, Delgado, L, Kaliska, L, Beatrix, L, Warmelink, L, Rojas-Berscia, L, Yu, K, Wylie, K, Wachowicz, J, Desai, K, Barzykowski, K, Kozma, L, Evans, K, Kirgizova, K, Agesin, B, Koehn, M, Wolfe, K, Korobova, T, Morris, K, Klevjer, K, van Schie, K, Vezirian, K, Damnjanovic, K, Thommesen, K, Schmidt, K, Filip, K, Staniaszek, K, Grzech, K, Hoyer, K, Moon, K, Khaobunmasiri, S, Rana, K, Janjic, K, Suchow, J, Kielinska, J, Vasquez, J, Chanal, J, Beitner, J, Vargas-Nieto, J, Roxas, J, Taber, J, Urriago-Rayo, J, Pavlacic, J, Benka, J, Bavolar, J, Soto, J, Olofsson, J, Vilsmeier, J, Messerschmidt, J, Czamanski-Cohen, J, Waterschoot, J, Moss, J, Boudesseul, J, Lee, J, Kamburidis, J, Joy-Gaba, J, Zickfeld, J, Miranda, J, Verharen, J, Hristova, E, Beshears, J, Djordjevic, J, Bosch, J, Valentova, J, Antfolk, J, Berkessel, J, Schrotter, J, Urban, J, Roer, J, Norton, J, Silva, J, Pickering, J, Vintr, J, Uttley, J, Kunst, J, Ndukaihe, I, Iyer, A, Vilares, I, Ivanov, A, Ropovik, I, Sula, I, Sarieva, I, Metin-Orta, I, Prusova, I, Pinto, I, Bozdoc, A, Almeida, I, Pit, I, Dalgar, I, Zakharov, I, Arinze, A, Ihaya, K, Stephen, I, Gjoneska, B, Brohmer, H, Flowe, H, Godbersen, H, Kocalar, H, Hedgebeth, M, Chuan-Peng, H, Sharifian, M, Manley, H, Akkas, H, Hajdu, N, Azab, H, Kaminski, G, Nilsonne, G, Anjum, G, Travaglino, G, Feldman, G, Pfuhl, G, Czarnek, G, Marcu, G, Hofer, G, Banik, G, Adetula, G, Bijlstra, G, Verbruggen, F, Kung, F, Martela, F, Foroni, F, Forest, J, Singer, G, Muchembled, F, Azevedo, F, Mosannenzadeh, F, Marinova, E, Strukelj, E, Etebari, Z, Bradshaw, E, Baskin, E, Garcia, E, Musser, E, van Steenkiste, I, Ahn, E, Quested, E, Pronizius, E, Jackson, E, Manunta, E, Agadullina, E, Sakan, D, Dursun, P, Dujols, O, Dubrov, D, Willis, M, Tumer, M, Beaudry, J, Popovic, D, Dunleavy, D, Djamai, I, Krupic, D, Herrera, D, Vega, D, Du, H, Mola, D, Chakarova, D, Davis, W, Holford, D, Lewis, D, Vaidis, D, Ozery, D, Ricaurte, D, Storage, D, Sousa, D, Alvarez, D, Boller, D, Dalla Rosa, A, Dimova, D, Marko, D, Moreau, D, Reeck, C, Correia, R, Whitt, C, Lamm, C, Solorzano, C, von Bastian, C, Sutherland, C, Overkott, C, Aberson, C, Wang, C, Niemiec, C, Karashiali, C, Noone, C, Chiu, F, Picciocchi, C, Brownlow, C, Karaarslan, C, Cellini, N, Esteban-Serna, C, Reyna, C, Ferreyra, C, Batres, C, Li, R, Grano, C, Carpentier, J, Tamnes, C, Fu, C, Ishkhanyan, B, Bylinina, L, Jaeger, B, Bundt, C, Allred, T, Vermote, B, Bokkour, A, Bogatyreva, N, Shi, J, Chopik, W, Antazo, B, Behzadnia, B, Becker, M, Bayyat, M, Cocco, B, Chou, W, Barkoukis, V, Hubena, B, Zuro, B, Aczel, B, Baklanova, E, Bai, H, Balci, B, Babincak, P, Soenens, B, Dixson, B, Mokady, A, Kappes, H, Atari, M, Szala, A, Szabelska, A, Aruta, J, Domurat, A, Arinze, N, Modena, A, Adiguzel, A, Monajem, A, El Arabi, K, Ozdogru, A, Rothbaum, A, Torres, A, Theodoropoulou, A, Skowronek, A, Jurkovic, A, Singh, A, Kassianos, A, Findor, A, Hartanto, A, Landry, A, Ferreira, A, Santos, A, De la Rosa-Gomez, A, Gourdon-Kanhukamwe, A, Luxon, A, Todsen, A, Karababa, A, Janak, A, Pilato, A, Bran, A, Tullett, A, Kuzminska, A, Krafnick, A, Urooj, A, Khaoudi, A, Ahmed, A, Groyecka-Bernard, A, Askelund, A, Adetula, A, Belaus, A, Charyate, A, Wichman, A, Stoyanova, A, Greenburgh, A, Thomas, A, Arvanitis, A, Forscher, P, Mallik, P, Coles, N, Miller, J, Moshontz, H, Urry, H, Ijzerman, H, Basnight-Brown, D, Ebersole, C, Chartier, C, Buchanan, E, Primbs, M, Nguyen, TV, Zsido, AN, Ceary, CD, Jang, YN, Lin, YJ, Xiao, QY, Jiang, XM, Du, XK, Ryan, WS, Wilson, JP, Collins, WM, Richard, KL, Kadreva, VH, Adoric, VC, Tran, US, Yeung, SK, Machin, MA, Lima, TJS, Sverdrup, TE, Hostler, TJ, von Bormann, SM, Janssen, SMJ, Schulenberg, SE, Drexler, SM, Levine, SL, Geniole, SN, Izquierdo, SM, Tshonda, SS, Alves, SG, Solas, SA, Ocovaj, SB, Geiger, SJ, Modares, SF, Walczak, RB, Carcamo, RA, Ross, RM, McCarthy, R, Westgate, EC, Ryan, RM, Ren, DN, Monteiro, RP, Reips, UD, Calin-Jagema, RJ, Rahal, RM, Ribeiro, RR, Chen, SC, Maturan, PLG, Perillo, JT, Isager, PM, Macapagal, PM, Maniaci, MR, Hanel, PHP, Forbes, PAG, Correa, PS, Bravo, ON, Galindo-Caballero, OJ, Ogbonnaya, CE, Nock, NL, Neubauer, AB, Martin, NI, Rachev, NR, Majeed, NM, Schmidt, ND, Corral-Frias, NS, Lucas, MY, Vasilev, MR, Ortiz, MV, Butt, MM, Rivera, MDT, Maldonado, MA, Metz, MA, Bosma, MJ, Silan, MA, Gugliandolo, MC, Barria, MFE, Kurfali, MA, Mensink, MC, Dunn, MR, Ribeiro, MFF, Kohlova, MB, Lund, ML, Magrin, ME, Jones, MV, Li, MY, Ortiz, MS, van Hooff, MLM, Varella, MAC, Colloff, MF, Vaughn, LA, Lu, JG, Pineda, LMS, Perez, LC, Lazarevic, LB, Jaremka, LM, Smit, ES, Ferguson, LJ, Coelho, GLD, Levitan, CA, Gunton, LA, Delgado, LGJ, Rojas-Berscia, LM, Agesin, BBE, Koehn, MA, Thommesen, KK, Suchow, JW, Vasquez, JEC, Vargas-Nieto, JC, Roxas, JCT, Pavlacic, JM, Soto, JA, Olofsson, JK, Vilsmeier, JK, Moss, JD, Lee, JM, Joy-Gaba, JA, Miranda, JF, Verharen, JPH, Beshears, JE, Djordjevic, JM, Valentova, JV, Berkessel, JB, Roer, JP, Norton, JO, Silva, JR, Pickering, JS, Kunst, JR, Ndukaihe, ILG, Bozdoc, AI, Almeida, IAT, Pit, IL, Arinze, AI, Stephen, ID, Kocalar, HE, Hedgebeth, MV, Travaglino, GA, Marcu, GM, Adetula, GA, Kung, FYH, Bradshaw, EL, Garcia, EOL, van Steenkiste, IMM, Ahn, ER, Jackson, EA, Beaudry, JL, Du, HF, Davis, WE, Holford, DL, Lewis, DMG, Vaidis, DC, Ozery, DH, Ricaurte, DZ, Alvarez, DS, Correia, RC, Whitt, CM, Solorzano, CS, von Bastian, CC, Sutherland, CAM, Aberson, CL, Wang, CH, Niemiec, CP, Li, RR, Tamnes, CK, Fu, CHY, Allred, TB, Vermote, BJ, Shi, JX, Chopik, WJ, Bayyat, MM, Chou, WL, Balci, BB, Dixson, BJW, Kappes, HB, Aruta, JJB, Arinze, NC, El Arabi, KA, Ozdogru, AA, Rothbaum, AO, Torres, AO, Jurkovic, AP, Kassianos, AP, Landry, AT, Santos, AC, Luxon, AM, Todsen, AL, Tullett, AM, Kuzminska, AO, Krafnick, AJ, Askelund, AD, Charyate, AC, Wichman, AL, Thomas, AG, Forscher, PS, Mallik, PR, Coles, NA, Miller, JK, Urry, HL, IJzerman, H, Basnight-Brown, DM, Ebersole, CR, Chartier, CR, Buchanan, EM, Primbs, MA, Legate, N, Nguyen, T, Weinstein, N, Moller, A, Legault, L, Vally, Z, Tajchman, Z, Zsido, A, Zrimsek, M, Chen, Z, Ziano, I, Gialitaki, Z, Ceary, C, Jang, Y, Lin, Y, Kunisato, Y, Yamada, Y, Xiao, Q, Jiang, X, Du, X, Yao, E, Ryan, W, Wilson, J, Cyrus-Lai, W, Jimenez-Leal, W, Law, W, Unanue, W, Collins, W, Richard, K, Vranka, M, Ankushev, V, Schei, V, Lerche, V, Kovic, V, Krizanic, V, Kadreva, V, Adoric, V, Tran, U, Yeung, S, Hassan, W, Houston, R, Machin, M, Lima, T, Ostermann, T, Frizzo, T, Sverdrup, T, House, T, Gill, T, Fedotov, M, Paltrow, T, Jernsather, T, Rahman, T, Machin, T, Koptjevskaja-Tamm, M, Hostler, T, Ishii, T, Szaszi, B, Adamus, S, Suter, L, von Bormann, S, Habib, S, Studzinska, A, Stojanovska, D, Janssen, S, Stieger, S, Schulenberg, S, Tatachari, S, Azouaghe, S, Sorokowski, P, Sorokowska, A, Song, X, Morbee, S, Lewis, S, Sinkolova, S, Grigoryev, D, Drexler, S, Daches, S, Levine, S, Geniole, S, Akter, S, Vracar, S, Massoni, S, Costa, S, Zorjan, S, Sarioguz, E, Izquierdo, S, Tshonda, S, Alves, S, Pontinen, S, Solas, S, Ordonez-Riano, S, Ocovaj, S, Onie, S, Lins, S, Biberauer, T, Coksan, S, Khumkom, S, Sacakli, A, Ruiz-Fernandez, S, Geiger, S, Modares, S, Walczak, R, Betlehem, R, Vilar, R, Carcamo, R, Ross, R, Mccarthy, R, Ballantyne, T, Westgate, E, Ryan, R, Gargurevich, R, Afhami, R, Ren, D, Monteiro, R, Reips, U, Reggev, N, Calin-Jagema, R, Pourafshari, R, Oliveira, R, Nedelcheva-Datsova, M, Rahal, R, Ribeiro, R, Radtke, T, Searston, R, Jai-ai, R, Habte, R, Zdybek, P, Chen, S, Wajanatinapart, P, Maturan, P, Perillo, J, Isager, P, Kacmar, P, Macapagal, P, Maniaci, M, Szwed, P, Hanel, P, Forbes, P, Arriaga, P, Paris, B, Parashar, N, Papachristopoulos, K, Correa, P, Kacha, O, Bernardo, M, Campos, O, Bravo, O, Galindo-Caballero, O, Ogbonnaya, C, Bialobrzeska, O, Kiselnikova, N, Simonovic, N, Cohen, N, Nock, N, Hernandez, A, Thogersen-Ntouma, C, Ntoumanis, N, Johannes, N, Albayrak-Aydemir, N, Say, N, Neubauer, A, Martin, N, Torunsky, N, van Antwerpen, N, Van Doren, N, Sunami, N, Rachev, N, Majeed, N, Schmidt, N, Nadif, K, Corral-Frias, N, Ouherrou, N, Abbas, N, Pantazi, M, Lucas, M, Vasilev, M, Ortiz, M, Butt, M, Kurfali, M, Kabir, M, Muda, R, Rivera, M, Sirota, M, Seehuus, M, Parzuchowski, M, Toro, M, Hricova, M, Maldonado, M, Rentzelas, P, Vansteenkiste, M, Metz, M, Marszalek, M, Karekla, M, Mioni, G, Bosma, M, Westerlund, M, Vdovic, M, Bialek, M, Silan, M, Anne, M, Misiak, M, Gugliandolo, M, Grinberg, M, Capizzi, M, Barria, M, Mensink, M, Harutyunyan, M, Khosla, M, Dunn, M, Korbmacher, M, Adamkovic, M, Ribeiro, M, Terskova, M, Hruska, M, Martoncik, M, Voracek, M, Cadek, M, Frias-Armenta, M, Kowal, M, Topor, M, Roczniewska, M, Oosterlinck, M, Kohlova, M, Paruzel-Czachura, M, Sabristov, M, Romanova, M, Papadatou-Pastou, M, Lund, M, Antoniadi, M, Magrin, M, Jones, M, Li, M, Manavalan, M, Muminov, A, Kossowska, M, Friedemann, M, Wielgus, M, van Hooff, M, Varella, M, Standage, M, Nicolotti, M, Colloff, M, Bradford, M, Vaughn, L, Eudave, L, Vieira, L, Lu, J, Pineda, L, Matos, L, Perez, L, Lazarevic, L, Jaremka, L, Smit, E, Kushnir, E, Ferguson, L, Anton-Boicuk, L, Coelho, G, Ahlgren, L, Liga, F, Levitan, C, Micheli, L, Gunton, L, Volz, L, Stojanovska, M, Boucher, L, Samojlenko, L, Delgado, L, Kaliska, L, Beatrix, L, Warmelink, L, Rojas-Berscia, L, Yu, K, Wylie, K, Wachowicz, J, Desai, K, Barzykowski, K, Kozma, L, Evans, K, Kirgizova, K, Agesin, B, Koehn, M, Wolfe, K, Korobova, T, Morris, K, Klevjer, K, van Schie, K, Vezirian, K, Damnjanovic, K, Thommesen, K, Schmidt, K, Filip, K, Staniaszek, K, Grzech, K, Hoyer, K, Moon, K, Khaobunmasiri, S, Rana, K, Janjic, K, Suchow, J, Kielinska, J, Vasquez, J, Chanal, J, Beitner, J, Vargas-Nieto, J, Roxas, J, Taber, J, Urriago-Rayo, J, Pavlacic, J, Benka, J, Bavolar, J, Soto, J, Olofsson, J, Vilsmeier, J, Messerschmidt, J, Czamanski-Cohen, J, Waterschoot, J, Moss, J, Boudesseul, J, Lee, J, Kamburidis, J, Joy-Gaba, J, Zickfeld, J, Miranda, J, Verharen, J, Hristova, E, Beshears, J, Djordjevic, J, Bosch, J, Valentova, J, Antfolk, J, Berkessel, J, Schrotter, J, Urban, J, Roer, J, Norton, J, Silva, J, Pickering, J, Vintr, J, Uttley, J, Kunst, J, Ndukaihe, I, Iyer, A, Vilares, I, Ivanov, A, Ropovik, I, Sula, I, Sarieva, I, Metin-Orta, I, Prusova, I, Pinto, I, Bozdoc, A, Almeida, I, Pit, I, Dalgar, I, Zakharov, I, Arinze, A, Ihaya, K, Stephen, I, Gjoneska, B, Brohmer, H, Flowe, H, Godbersen, H, Kocalar, H, Hedgebeth, M, Chuan-Peng, H, Sharifian, M, Manley, H, Akkas, H, Hajdu, N, Azab, H, Kaminski, G, Nilsonne, G, Anjum, G, Travaglino, G, Feldman, G, Pfuhl, G, Czarnek, G, Marcu, G, Hofer, G, Banik, G, Adetula, G, Bijlstra, G, Verbruggen, F, Kung, F, Martela, F, Foroni, F, Forest, J, Singer, G, Muchembled, F, Azevedo, F, Mosannenzadeh, F, Marinova, E, Strukelj, E, Etebari, Z, Bradshaw, E, Baskin, E, Garcia, E, Musser, E, van Steenkiste, I, Ahn, E, Quested, E, Pronizius, E, Jackson, E, Manunta, E, Agadullina, E, Sakan, D, Dursun, P, Dujols, O, Dubrov, D, Willis, M, Tumer, M, Beaudry, J, Popovic, D, Dunleavy, D, Djamai, I, Krupic, D, Herrera, D, Vega, D, Du, H, Mola, D, Chakarova, D, Davis, W, Holford, D, Lewis, D, Vaidis, D, Ozery, D, Ricaurte, D, Storage, D, Sousa, D, Alvarez, D, Boller, D, Dalla Rosa, A, Dimova, D, Marko, D, Moreau, D, Reeck, C, Correia, R, Whitt, C, Lamm, C, Solorzano, C, von Bastian, C, Sutherland, C, Overkott, C, Aberson, C, Wang, C, Niemiec, C, Karashiali, C, Noone, C, Chiu, F, Picciocchi, C, Brownlow, C, Karaarslan, C, Cellini, N, Esteban-Serna, C, Reyna, C, Ferreyra, C, Batres, C, Li, R, Grano, C, Carpentier, J, Tamnes, C, Fu, C, Ishkhanyan, B, Bylinina, L, Jaeger, B, Bundt, C, Allred, T, Vermote, B, Bokkour, A, Bogatyreva, N, Shi, J, Chopik, W, Antazo, B, Behzadnia, B, Becker, M, Bayyat, M, Cocco, B, Chou, W, Barkoukis, V, Hubena, B, Zuro, B, Aczel, B, Baklanova, E, Bai, H, Balci, B, Babincak, P, Soenens, B, Dixson, B, Mokady, A, Kappes, H, Atari, M, Szala, A, Szabelska, A, Aruta, J, Domurat, A, Arinze, N, Modena, A, Adiguzel, A, Monajem, A, El Arabi, K, Ozdogru, A, Rothbaum, A, Torres, A, Theodoropoulou, A, Skowronek, A, Jurkovic, A, Singh, A, Kassianos, A, Findor, A, Hartanto, A, Landry, A, Ferreira, A, Santos, A, De la Rosa-Gomez, A, Gourdon-Kanhukamwe, A, Luxon, A, Todsen, A, Karababa, A, Janak, A, Pilato, A, Bran, A, Tullett, A, Kuzminska, A, Krafnick, A, Urooj, A, Khaoudi, A, Ahmed, A, Groyecka-Bernard, A, Askelund, A, Adetula, A, Belaus, A, Charyate, A, Wichman, A, Stoyanova, A, Greenburgh, A, Thomas, A, Arvanitis, A, Forscher, P, Mallik, P, Coles, N, Miller, J, Moshontz, H, Urry, H, Ijzerman, H, Basnight-Brown, D, Ebersole, C, Chartier, C, Buchanan, E, Primbs, M, Nguyen, TV, Zsido, AN, Ceary, CD, Jang, YN, Lin, YJ, Xiao, QY, Jiang, XM, Du, XK, Ryan, WS, Wilson, JP, Collins, WM, Richard, KL, Kadreva, VH, Adoric, VC, Tran, US, Yeung, SK, Machin, MA, Lima, TJS, Sverdrup, TE, Hostler, TJ, von Bormann, SM, Janssen, SMJ, Schulenberg, SE, Drexler, SM, Levine, SL, Geniole, SN, Izquierdo, SM, Tshonda, SS, Alves, SG, Solas, SA, Ocovaj, SB, Geiger, SJ, Modares, SF, Walczak, RB, Carcamo, RA, Ross, RM, McCarthy, R, Westgate, EC, Ryan, RM, Ren, DN, Monteiro, RP, Reips, UD, Calin-Jagema, RJ, Rahal, RM, Ribeiro, RR, Chen, SC, Maturan, PLG, Perillo, JT, Isager, PM, Macapagal, PM, Maniaci, MR, Hanel, PHP, Forbes, PAG, Correa, PS, Bravo, ON, Galindo-Caballero, OJ, Ogbonnaya, CE, Nock, NL, Neubauer, AB, Martin, NI, Rachev, NR, Majeed, NM, Schmidt, ND, Corral-Frias, NS, Lucas, MY, Vasilev, MR, Ortiz, MV, Butt, MM, Rivera, MDT, Maldonado, MA, Metz, MA, Bosma, MJ, Silan, MA, Gugliandolo, MC, Barria, MFE, Kurfali, MA, Mensink, MC, Dunn, MR, Ribeiro, MFF, Kohlova, MB, Lund, ML, Magrin, ME, Jones, MV, Li, MY, Ortiz, MS, van Hooff, MLM, Varella, MAC, Colloff, MF, Vaughn, LA, Lu, JG, Pineda, LMS, Perez, LC, Lazarevic, LB, Jaremka, LM, Smit, ES, Ferguson, LJ, Coelho, GLD, Levitan, CA, Gunton, LA, Delgado, LGJ, Rojas-Berscia, LM, Agesin, BBE, Koehn, MA, Thommesen, KK, Suchow, JW, Vasquez, JEC, Vargas-Nieto, JC, Roxas, JCT, Pavlacic, JM, Soto, JA, Olofsson, JK, Vilsmeier, JK, Moss, JD, Lee, JM, Joy-Gaba, JA, Miranda, JF, Verharen, JPH, Beshears, JE, Djordjevic, JM, Valentova, JV, Berkessel, JB, Roer, JP, Norton, JO, Silva, JR, Pickering, JS, Kunst, JR, Ndukaihe, ILG, Bozdoc, AI, Almeida, IAT, Pit, IL, Arinze, AI, Stephen, ID, Kocalar, HE, Hedgebeth, MV, Travaglino, GA, Marcu, GM, Adetula, GA, Kung, FYH, Bradshaw, EL, Garcia, EOL, van Steenkiste, IMM, Ahn, ER, Jackson, EA, Beaudry, JL, Du, HF, Davis, WE, Holford, DL, Lewis, DMG, Vaidis, DC, Ozery, DH, Ricaurte, DZ, Alvarez, DS, Correia, RC, Whitt, CM, Solorzano, CS, von Bastian, CC, Sutherland, CAM, Aberson, CL, Wang, CH, Niemiec, CP, Li, RR, Tamnes, CK, Fu, CHY, Allred, TB, Vermote, BJ, Shi, JX, Chopik, WJ, Bayyat, MM, Chou, WL, Balci, BB, Dixson, BJW, Kappes, HB, Aruta, JJB, Arinze, NC, El Arabi, KA, Ozdogru, AA, Rothbaum, AO, Torres, AO, Jurkovic, AP, Kassianos, AP, Landry, AT, Santos, AC, Luxon, AM, Todsen, AL, Tullett, AM, Kuzminska, AO, Krafnick, AJ, Askelund, AD, Charyate, AC, Wichman, AL, Thomas, AG, Forscher, PS, Mallik, PR, Coles, NA, Miller, JK, Urry, HL, IJzerman, H, Basnight-Brown, DM, Ebersole, CR, Chartier, CR, Buchanan, EM, and Primbs, MA

Abstract

Finding communication strategies that effectively motivate social distancing continues to be a global public health priority during the COVID-19 pandemic. This crosscountry, preregistered experiment (n = 25,718 from 89 countries) tested hypotheses concerning generalizable positive and negative outcomes of social distancing messages that promoted personal agency and reflective choices (i.e., an autonomy-supportive message) or were restrictive and shaming (i.e., a controlling message) compared with no message at all. Results partially supported experimental hypotheses in that the controlling message increased controlled motivation (a poorly internalized form of motivation relying on shame, guilt, and fear of social consequences) relative to no message. On the other hand, the autonomy-supportive message lowered feelings of defiance compared with the controlling message, but the controlling message did not differ from receiving no message at all. Unexpectedly, messages did not influence autonomous motivation (a highly internalized form of motivation relying on one's core values) or behavioral intentions. Results supported hypothesized associations between people's existing autonomous and controlled motivations and self-reported behavioral intentions to engage in social distancing. Controlled motivation was associated with more defiance and less long-term behavioral intention to engage in social distancing, whereas autonomous motivation was associated with less defiance and more short- and long-term intentions to social distance. Overall, this work highlights the potential harm of using shaming and pressuring language in public health communication, with implications for the current and future global health challenges.

Published
2022

2. A creative destruction approach to replication: implicit work and sex morality across cultures

Author

Tierney, W, Hardy, J, Ebersole, CR, Viganola, D, Clemente, EG, Gordon, M, Hoogeveen, S, Haaf, J, Dreber, A, Johannesson, M, Pfeiffer, T, Huang, JL, Vaughn, LA, DeMarree, K, Igou, ER, Chapman, H, Gantman, A, Vanaman, M, Wylie, J, Storbeck, J, Andreychik, MR, McPhetres, J, Uhlmann, EL, Abraham, AT, Adamkovic, M, Adam-Troian, J, Agadullina, E, Akkas, H, Amir, D, Anne, M, Arbeau, KJ, Arnestad, MN, Aruta, JJB, Ashraf, M, Azar, OH, Baker, BJ, Baník, G, Barbosa, S, Mendes, AB, Baskin, E, Bauman, CW, Bavolar, J, Beckman, SE, Bendixen, T, Benjamin, AS, Berkers, RMWJ, Bhattacharjee, A, Bodily, SE, Bottom, V, Brick, C, Brigden, N, Brown, SEV, Buckley, J, Butterfield, ME, Caton, NR, Chen, Z, Chen, JF, Chen, F, Christensen, I, Cicerali, EE, Columbus, S, Cox, DJ, Cracco, E, Crafa, D, Cummins, J, Cutler, J, Dahms, ZO, Danvers, AF, Daum-Avital, L, Dawson, IGJ, Day, MV, Deprez, PO, Dietl, E, Dimant, E, Dogan, G, Domurat, A, Dores Cruz, TD, du Plessis, C, Dubrov, D, Dwibedi, E, Elbaek, CT, Elsherif, MM, Evans, TR, Field, SM, Firat, M, Francis, Z, Ganzach, Y, Gautam, R, Gearin, B, Geiger, SJ, Ghasemi, O, Graf-Vlachy, L, Gram, L, Grigoryev, D, Guadagno, RE, Hafenbrack, AC, Hafenbrädl, S, Hagen, L, Hagmann, D, Hammersley, JJ, and Apollo - University of Cambridge Repository

Subjects
Theory testing, Work values, Priming, Culture, Implicit social cognition, Replication, Falsification
Abstract

How can we maximize what is learned from a replication study? In the creative destruction approach to replication, the original hypothesis is compared not only to the null hypothesis, but also to predictions derived from multiple alternative theoretical accounts of the phenomenon. To this end, new populations and measures are included in the design in addition to the original ones, to help determine which theory best accounts for the results across multiple key outcomes and contexts. The present pre-registered empirical project compared the Implicit Puritanism account of intuitive work and sex morality to theories positing regional, religious, and social class differences; explicit rather than implicit cultural differences in values; self-expression vs. survival values as a key cultural fault line; the general moralization of work; and false positive effects. Contradicting Implicit Puritanism's core theoretical claim of a distinct American work morality, a number of targeted findings replicated across multiple comparison cultures, whereas several failed to replicate in all samples and were identified as likely false positives. No support emerged for theories predicting regional variability and specific individual-differences moderators (religious affiliation, religiosity, and education level). Overall, the results provide evidence that work is intuitively moralized across cultures.

Published
2022
Full Text
View/download PDF

3. Many Labs 5: Registered Replication Report of Payne, Burkley, & Stokes (2008), Study 4

Author

Ebersole, CR, Andrighetto, L, Casini, E, Chiorri, C, Dalla Rosa, A, Domaneschi, F, Ferguson, I, Fryberger, E, Giacomantonio, M, Grahe, J, Joy-Gaba, J, Langford, EV, Nichols, AL, Panno, A, Parks, KP, Preti, E, Richetin, J, Vianello, M, Ebersole, C, Andrighetto, L, Casini, E, Chiorri, C, Dalla Rosa, A, Domaneschi, F, Ferguson, I, Fryberger, E, Giacomantonio, M, Grahe, J, Joy-Gaba, J, Langford, E, Nichols, A, Panno, A, Parks, K, Preti, E, Richetin, J, and Vianello, M

Subjects
attitudes, direct replication, reproducibility, open data, open materials, preregistered
Abstract

To rule out an alternative to their structural-fit hypothesis, Payne, Burkley, and Stokes (2008) demonstrated that correlations between implicit and explicit race attitudes were weaker when participants were put under high pressure to respond without bias than when they were placed under low pressure. This effect was replicated in Italy by Vianello (2015), although the replication effect was smaller than the original effect. In the current investigation, we examined the possibility that the source of a study’s sample moderates this effect. Teams from eight universities, four in the United States and four in Italy, replicated the original study (replication N = 1,103). Although we did detect moderation by the sample’s country, it was due to a reversal of the original effect in the United States and a lack of the original effect in Italy. We discuss this curious finding and possible explanations.

Published
2020

4. Many Labs 5: Registered Replication Report of Payne, Burkley, & Stokes (2008), Study 4

Author

Ebersole, C, Andrighetto, L, Casini, E, Chiorri, C, Dalla Rosa, A, Domaneschi, F, Ferguson, I, Fryberger, E, Giacomantonio, M, Grahe, J, Joy-Gaba, J, Langford, E, Nichols, A, Panno, A, Parks, K, Preti, E, Richetin, J, Vianello, M, Ebersole, CR, Langford, EV, Nichols, AL, Parks, KP, Ebersole, C, Andrighetto, L, Casini, E, Chiorri, C, Dalla Rosa, A, Domaneschi, F, Ferguson, I, Fryberger, E, Giacomantonio, M, Grahe, J, Joy-Gaba, J, Langford, E, Nichols, A, Panno, A, Parks, K, Preti, E, Richetin, J, Vianello, M, Ebersole, CR, Langford, EV, Nichols, AL, and Parks, KP

Abstract

To rule out an alternative to their structural-fit hypothesis, Payne, Burkley, and Stokes (2008) demonstrated that correlations between implicit and explicit race attitudes were weaker when participants were put under high pressure to respond without bias than when they were placed under low pressure. This effect was replicated in Italy by Vianello (2015), although the replication effect was smaller than the original effect. In the current investigation, we examined the possibility that the source of a study’s sample moderates this effect. Teams from eight universities, four in the United States and four in Italy, replicated the original study (replication N = 1,103). Although we did detect moderation by the sample’s country, it was due to a reversal of the original effect in the United States and a lack of the original effect in Italy. We discuss this curious finding and possible explanations.

Published
2020

5. Many labs 2: Investigating variation in replicability across samples and settings

Author

Klein, RA, Vianello, M, Hasselman, F, Adams, BG, Adams, RB, Alper, S, Aveyard, M, Axt, JR, Babalola, MT, Bahník, Š, Batra, R, Berkics, M, Bernstein, MJ, Berry, DR, Bialobrzeska, O, Binan, ED, Bocian, K, Brandt, MJ, Busching, R, Rédei, AC, Cai, H, Cambier, F, Cantarero, K, Carmichael, CL, Ceric, F, Chandler, J, Chang, JH, Chatard, A, Chen, EE, Cheong, W, Cicero, DC, Coen, S, Coleman, JA, Collisson, B, Conway, MA, Corker, KS, Curran, PG, Cushman, F, Dagona, ZK, Dalgar, I, Dalla Rosa, A, Davis, WE, de Bruijn, M, De Schutter, L, Devos, T, de Vries, M, Doğulu, C, Dozo, N, Dukes, KN, Dunham, Y, Durrheim, K, Ebersole, CR, Edlund, JE, Eller, A, English, AS, Finck, C, Frankowska, N, Freyre, MÁ, Friedman, M, Galliani, EM, Gandi, JC, Ghoshal, T, Giessner, SR, Gill, T, Gnambs, T, Gómez, Á, González, R, Graham, J, Grahe, JE, Grahek, I, Green, EGT, Hai, K, Haigh, M, Haines, EL, Hall, MP, Heffernan, ME, Hicks, JA, Houdek, P, Huntsinger, JR, Huynh, HP, Ijzerman, H, Inbar, Y, Innes-Ker, ÅH, Jiménez-Leal, W, John, MS, Joy-Gaba, JA, Kamiloğlu, RG, Kappes, HB, Karabati, S, Karick, H, Keller, VN, Kende, A, Kervyn, N, Knežević, G, Kovacs, C, Krueger, LE, Kurapov, G, Kurtz, J, Lakens, D, Lazarević, LB, Williams, Lisa ; https://orcid.org/0000-0002-0021-5613, Klein, RA, Vianello, M, Hasselman, F, Adams, BG, Adams, RB, Alper, S, Aveyard, M, Axt, JR, Babalola, MT, Bahník, Š, Batra, R, Berkics, M, Bernstein, MJ, Berry, DR, Bialobrzeska, O, Binan, ED, Bocian, K, Brandt, MJ, Busching, R, Rédei, AC, Cai, H, Cambier, F, Cantarero, K, Carmichael, CL, Ceric, F, Chandler, J, Chang, JH, Chatard, A, Chen, EE, Cheong, W, Cicero, DC, Coen, S, Coleman, JA, Collisson, B, Conway, MA, Corker, KS, Curran, PG, Cushman, F, Dagona, ZK, Dalgar, I, Dalla Rosa, A, Davis, WE, de Bruijn, M, De Schutter, L, Devos, T, de Vries, M, Doğulu, C, Dozo, N, Dukes, KN, Dunham, Y, Durrheim, K, Ebersole, CR, Edlund, JE, Eller, A, English, AS, Finck, C, Frankowska, N, Freyre, MÁ, Friedman, M, Galliani, EM, Gandi, JC, Ghoshal, T, Giessner, SR, Gill, T, Gnambs, T, Gómez, Á, González, R, Graham, J, Grahe, JE, Grahek, I, Green, EGT, Hai, K, Haigh, M, Haines, EL, Hall, MP, Heffernan, ME, Hicks, JA, Houdek, P, Huntsinger, JR, Huynh, HP, Ijzerman, H, Inbar, Y, Innes-Ker, ÅH, Jiménez-Leal, W, John, MS, Joy-Gaba, JA, Kamiloğlu, RG, Kappes, HB, Karabati, S, Karick, H, Keller, VN, Kende, A, Kervyn, N, Knežević, G, Kovacs, C, Krueger, LE, Kurapov, G, Kurtz, J, Lakens, D, Lazarević, LB, and Williams, Lisa ; https://orcid.org/0000-0002-0021-5613

Abstract

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p <.05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p <.0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely highpowered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than.20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above.10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and

Published
2018

7. High replicability of newly discovered social-behavioural findings is achievable.

Author

Protzko J, Krosnick J, Nelson L, Nosek BA, Axt J, Berent M, Buttrick N, DeBell M, Ebersole CR, Lundmark S, MacInnis B, O'Donnell M, Perfecto H, Pustejovsky JE, Roeder SS, Walleczek J, and Schooler JW

Subjects
Humans, Prospective Studies, Reproducibility of Results, Sample Size, Research Design, Social Behavior
Abstract

Failures to replicate evidence of new discoveries have forced scientists to ask whether this unreliability is due to suboptimal implementation of methods or whether presumptively optimal methods are not, in fact, optimal. This paper reports an investigation by four coordinated laboratories of the prospective replicability of 16 novel experimental findings using rigour-enhancing practices: confirmatory tests, large sample sizes, preregistration and methodological transparency. In contrast to past systematic replication efforts that reported replication rates averaging 50%, replication attempts here produced the expected effects with significance testing (P < 0.05) in 86% of attempts, slightly exceeding the maximum expected replicability based on observed effect sizes and sample sizes. When one lab attempted to replicate an effect discovered by another lab, the effect size in the replications was 97% that in the original study. This high replication rate justifies confidence in rigour-enhancing methods to increase the replicability of new discoveries., (© 2023. The Author(s).)

Published
2024
Full Text
View/download PDF

8. Stepping Up to the Mic: Gender Gaps in Participation in Live Question-and-Answer Sessions at Academic Conferences.

Author

Jarvis SN, Ebersole CR, Nguyen CQ, Zhu M, and Kray LJ

Subjects
Male, Humans, Female, Sex Factors, Men
Abstract

Question-and-answer (Q&A) sessions following research talks provide key opportunities for the audience to engage in scientific discourse. Gender inequities persist in academia, where women are underrepresented as faculty and their contributions are less valued than men's. In the present research, we tested how this gender difference translates to face-to-face Q&A-session participation and its psychological correlates. Across two studies examining participation in three conferences, men disproportionately participated in Q&A sessions in a live, recorded conference ( N = 189 Q&A interactions), and women were less comfortable participating in Q&A sessions and more likely to fear backlash for their participation ( N = 234 conference attendees). Additionally, women were more likely to hold back questions because of anxiety, whereas men were more likely to hold back questions to make space for others to participate. To the extent that men engage more than women in Q&A sessions, men may continue to have more influence over the direction of science.

Published
2022
Full Text
View/download PDF

9. In COVID-19 Health Messaging, Loss Framing Increases Anxiety with Little-to-No Concomitant Benefits: Experimental Evidence from 84 Countries.

Author

Dorison CA, Lerner JS, Heller BH, Rothman AJ, Kawachi II, Wang K, Rees VW, Gill BP, Gibbs N, Ebersole CR, Vally Z, Tajchman Z, Zsido AN, Zrimsek M, Chen Z, Ziano I, Gialitaki Z, Ceary CD, Lin Y, Kunisato Y, Yamada Y, Xiao Q, Jiang X, Du X, Yao E, Wilson JP, Cyrus-Lai W, Jimenez-Leal W, Law W, Collins WM, Richard KL, Vranka M, Ankushev V, Schei V, Križanić V, Kadreva VH, Adoric VC, Tran US, Yeung SK, Hassan W, Houston R, Lima TJS, Ostermann T, Frizzo T, Sverdrup TE, House T, Gill T, Fedotov M, Paltrow T, Jernsäther T, Koptjevskaja-Tamm M, Hostler TJ, Ishii T, Szaszi B, Adamus S, Suter L, Habib S, Studzinska A, Stojanovska D, Janssen SMJ, Stieger S, Schulenberg SE, Tatachari S, Azouaghe S, Sorokowski P, Sorokowska A, Song X, Lewis SC, Sinkolova S, Grigoryev D, Drexler SM, Daches S, Geniole SN, Vračar S, Massoni S, Zorjan S, Sarıoğuz E, Izquierdo SM, Alves SG, Pöntinen S, Solas SÁ, Ordoñez-Riaño S, Očovaj SB, Onie S, Lins S, Çoksan S, Sacakli A, Ruiz-Fernández S, Geiger SJ, FatahModares S, Walczak RB, Betlehem R, Vilar R, Cárcamo R, Ross RM, McCarthy R, Ballantyne T, Westgate EC, Afhami R, Ren D, Monteiro RP, Reips UD, Reggev N, Calin-Jageman RJ, Pourafshari R, Oliveira R, Nedelcheva-Datsova M, Rahal RM, Ribeiro RR, Radtke T, Searston R, Habte R, Zdybek P, Chen SC, Maturan PLG, Perillo JT, Isager PM, Kačmár P, Macapagal PM, Szwed P, Hanel PHP, Forbes PAG, Arriaga P, Paris B, Papachristopoulos K, Correa PS, Kácha O, Bernardo M, Campos O, Bravo ON, Galindo-Caballero OJ, Ogbonnaya CE, Bialobrzeska O, Kiselnikova N, Simonovic N, Cohen N, Nock NL, Johannes N, Albayrak-Aydemir N, Say N, Torunsky N, Van Doren N, Sunami N, Rachev NR, Majeed NM, Schmidt ND, Nadif K, Corral-Frías NS, Ouherrou N, Pantazi M, Lucas MY, Vasilev MR, Ortiz MV, Butt MM, Kabir M, Muda R, Tejada Rivera MDCM, Sirota M, Seehuus M, Parzuchowski M, Toro M, Hricova M, Maldonado MA, Marszalek M, Karekla M, Mioni G, Bosma MJ, Westerlund M, Vdovic M, Bialek M, Silan MA, Anne M, Misiak M, Grinberg M, Capizzi M, Espinoza Barría MF, Kurfali MA, Mensink MC, Harutyunyan M, Khosla M, Korbmacher M, Adamkovič M, Ribeiro MFF, Terskova M, Hruška M, Martončik M, Voracek M, Čadek M, Frías-Armenta M, Kowal M, Topor M, Roczniewska M, Oosterlinck M, Kohlová MB, Paruzel-Czachura M, Romanova M, Papadatou-Pastou M, Lund ML, Antoniadi M, Jones MV, Ortiz MS, Manavalan M, Muminov A, Kossowska M, Friedemann M, Wielgus M, Varella MAC, Colloff MF, Bradford M, Vaughn LA, Eudave L, Vieira L, Pineda LMS, Pérez LC, Lazarevic LB, Jaremka LM, Kushnir E, Anton-Boicuk L, de Holanda Coelho GL, Ahlgren L, Levitan CA, Micheli L, Volz L, Stojanovska M, Boucher L, Samojlenko L, Delgado LGJ, Kaliska L, Warmelink L, Rojas-Berscia LM, Yu K, Wachowicz J, Desai K, Barzykowski K, Kozma L, Evans K, Kirgizova K, Agesin BE, Koehn MA, Wolfe K, Korobova T, Klevjer K, van Schie K, Vezirian K, Damnjanović K, Thommesen KK, Schmidt K, Filip K, Grzech K, Hoyer K, Moon K, Rana K, Janjić K, Suchow JW, Kielińska J, Cruz Vásquez JE, Beitner J, Vargas-Nieto JC, Roxas JCT, Taber J, Urriago-Rayo J, Pavlacic JM, Bavolar J, Soto JA, Olofsson JK, Vilsmeier JK, Messerschmidt J, Czamanski-Cohen J, Boudesseul J, Lee JM, Kamburidis J, Zickfeld J, Miranda JF, Verharen JPH, Hristova E, Beshears JE, Đorđević JM, Bosch J, Valentova JV, Antfolk J, Berkessel JB, Schrötter J, Urban J, Röer JP, Norton JO, Silva JR, Pickering JS, Vintr J, Uttley J, Kunst JR, Ndukaihe ILG, Iyer A, Vilares I, Ivanov A, Ropovik I, Sula I, Sarieva I, Metin-Orta I, Prusova I, Pinto I, Bozdoc AI, Almeida IAT, Pit IL, Dalgar I, Zakharov I, Arinze AI, Ihaya K, Stephen ID, Gjoneska B, Brohmer H, Flowe H, Godbersen H, Kocalar HE, Hedgebeth MV, Chuan-Peng H, Sharifian M, Manley H, Akkas H, Hajdu N, Azab H, Kaminski G, Nilsonne G, Anjum G, Travaglino GA, Feldman G, Pfuhl G, Czarnek G, Marcu GM, Hofer G, Banik G, Adetula GA, Bijlstra G, Verbruggen F, Kung FYH, Foroni F, Singer G, Muchembled F, Azevedo F, Mosannenzadeh F, Marinov E, Štrukelj E, Etebari Z, Baskin E, Garcia EOL, Musser E, van Steenkiste IMM, Ahn ER, Pronizius E, Jackson EA, Manunta E, Agadullina E, Šakan D, Dursun P, Dujols O, Dubrov D, Willis M, Tümer M, Beaudry JL, Popović D, Dunleavy D, Djamai I, Krupić D, Vega D, Du H, Mola D, Davis WE, Holford DL, Lewis DMG, Vaidis DC, Ozery DH, Ricaurte DZ, Storage D, Sousa D, Alvarez DS, Rosa AD, Krupić D, Marko D, Moreau D, Reeck C, Correia RC, Whitt CM, Lamm C, Solorzano CS, von Bastian CC, Sutherland CA, Overkott C, Aberson CL, Wang C, Karashiali C, Noone C, Chiu F, Picciocchi C, Karaarslan C, Cellini N, Esteban-Serna C, Reyna C, Batres C, Li R, Grano C, Carpentier J, Tamnes CK, Fu CHY, Ishkhanyan B, Bylinina L, Jaeger B, Bundt C, Allred TB, Bokkour A, Bogatyreva N, Chopik WJ, Antazo B, Behzadnia B, Becker M, Cocco B, Chou WL, Hubena B, Žuro B, Aczel B, Baklanova E, Bai H, Balci BB, Babinčák P, Dixson BJW, Mokady A, Kappes HB, Atari M, Szala A, Szabelska A, Aruta JJB, Domurat A, Arinze NC, Modena A, Adiguzel A, Monajem A, Arabi KAE, Özdoğru AA, Olaya Torres AJ, Theodoropoulou A, Jurković AP, Kassianos AP, Findor A, Hartanto A, Thibault Landry A, Ferreira A, Santos AC, De la Rosa-Gomez A, Gourdon-Kanhukamwe A, Todsen AL, Karababa A, Janak A, Bran A, Tullett AM, Kuzminska AO, Krafnick AJ, Urooj A, Khaoudi A, Ahmed A, Groyecka-Bernard A, Askelund AD, Adetula A, Belaus A, Charyate AC, Wichman AL, Stoyanova A, Greenburgh A, Thomas AG, Arvanitis A, Forscher PS, Mallik PR, Primbs MA, Miller JK, Moshontz H, Urry HL, IJzerman H, Basnight-Brown DM, Chartier CR, Buchanan EM, and Coles NA

Abstract

The COVID-19 pandemic (and its aftermath) highlights a critical need to communicate health information effectively to the global public. Given that subtle differences in information framing can have meaningful effects on behavior, behavioral science research highlights a pressing question: Is it more effective to frame COVID-19 health messages in terms of potential losses (e.g., "If you do not practice these steps, you can endanger yourself and others") or potential gains (e.g., "If you practice these steps, you can protect yourself and others")? Collecting data in 48 languages from 15,929 participants in 84 countries, we experimentally tested the effects of message framing on COVID-19-related judgments, intentions, and feelings. Loss- (vs. gain-) framed messages increased self-reported anxiety among participants cross-nationally with little-to-no impact on policy attitudes, behavioral intentions, or information seeking relevant to pandemic risks. These results were consistent across 84 countries, three variations of the message framing wording, and 560 data processing and analytic choices. Thus, results provide an empirical answer to a global communication question and highlight the emotional toll of loss-framed messages. Critically, this work demonstrates the importance of considering unintended affective consequences when evaluating nudge-style interventions., Competing Interests: Conflict of InterestThe authors declare no conflict of interest., (© The Society for Affective Science 2022.)

Published
2022
Full Text
View/download PDF

10. Author Correction: A multi-country test of brief reappraisal interventions on emotions during the COVID-19 pandemic.

Author

Wang K, Goldenberg A, Dorison CA, Miller JK, Uusberg A, Lerner JS, Gross JJ, Agesin BB, Bernardo M, Campos O, Eudave L, Grzech K, Ozery DH, Jackson EA, Garcia EOL, Drexler SM, Jurković AP, Rana K, Wilson JP, Antoniadi M, Desai K, Gialitaki Z, Kushnir E, Nadif K, Bravo ON, Nauman R, Oosterlinck M, Pantazi M, Pilecka N, Szabelska A, van Steenkiste IMM, Filip K, Bozdoc AI, Marcu GM, Agadullina E, Adamkovič M, Roczniewska M, Reyna C, Kassianos AP, Westerlund M, Ahlgren L, Pöntinen S, Adetula GA, Dursun P, Arinze AI, Arinze NC, Ogbonnaya CE, Ndukaihe ILG, Dalgar I, Akkas H, Macapagal PM, Lewis S, Metin-Orta I, Foroni F, Willis M, Santos AC, Mokady A, Reggev N, Kurfali MA, Vasilev MR, Nock NL, Parzuchowski M, Espinoza Barría MF, Vranka M, Kohlová MB, Ropovik I, Harutyunyan M, Wang C, Yao E, Becker M, Manunta E, Kaminski G, Boudesseul J, Marko D, Evans K, Lewis DMG, Findor A, Landry AT, Aruta JJB, Ortiz MS, Vally Z, Pronizius E, Voracek M, Lamm C, Grinberg M, Li R, Valentova JV, Mioni G, Cellini N, Chen SC, Zickfeld J, Moon K, Azab H, Levy N, Karababa A, Beaudry JL, Boucher L, Collins WM, Todsen AL, van Schie K, Vintr J, Bavolar J, Kaliska L, Križanić V, Samojlenko L, Pourafshari R, Geiger SJ, Beitner J, Warmelink L, Ross RM, Stephen ID, Hostler TJ, Azouaghe S, McCarthy R, Szala A, Grano C, Solorzano CS, Anjum G, Jimenez-Leal W, Bradford M, Pérez LC, Cruz Vásquez JE, Galindo-Caballero OJ, Vargas-Nieto JC, Kácha O, Arvanitis A, Xiao Q, Cárcamo R, Zorjan S, Tajchman Z, Vilares I, Pavlacic JM, Kunst JR, Tamnes CK, von Bastian CC, Atari M, Sharifian M, Hricova M, Kačmár P, Schrötter J, Rahal RM, Cohen N, FatahModares S, Zrimsek M, Zakharov I, Koehn MA, Esteban-Serna C, Calin-Jageman RJ, Krafnick AJ, Štrukelj E, Isager PM, Urban J, Silva JR, Martončik M, Očovaj SB, Šakan D, Kuzminska AO, Djordjevic JM, Almeida IAT, Ferreira A, Lazarevic LB, Manley H, Ricaurte DZ, Monteiro RP, Etabari Z, Musser E, Dunleavy D, Chou W, Godbersen H, Ruiz-Fernández S, Reeck C, Batres C, Kirgizova K, Muminov A, Azevedo F, Alvarez DS, Butt MM, Lee JM, Chen Z, Verbruggen F, Ziano I, Tümer M, Charyate ACA, Dubrov D, Tejada Rivera MDCMC, Aberson C, Pálfi B, Maldonado MA, Hubena B, Sacakli A, Ceary CD, Richard KL, Singer G, Perillo JT, Ballantyne T, Cyrus-Lai W, Fedotov M, Du H, Wielgus M, Pit IL, Hruška M, Sousa D, Aczel B, Hajdu N, Szaszi B, Adamus S, Barzykowski K, Micheli L, Schmidt ND, Zsido AN, Paruzel-Czachura M, Muda R, Bialek M, Kowal M, Sorokowska A, Misiak M, Mola D, Ortiz MV, Correa PS, Belaus A, Muchembled F, Ribeiro RR, Arriaga P, Oliveira R, Vaughn LA, Szwed P, Kossowska M, Czarnek G, Kielińska J, Antazo B, Betlehem R, Stieger S, Nilsonne G, Simonovic N, Taber J, Gourdon-Kanhukamwe A, Domurat A, Ihaya K, Yamada Y, Urooj A, Gill T, Čadek M, Bylinina L, Messerschmidt J, Kurfalı M, Adetula A, Baklanova E, Albayrak-Aydemir N, Kappes HB, Gjoneska B, House T, Jones MV, Berkessel JB, Chopik WJ, Çoksan S, Seehuus M, Khaoudi A, Bokkour A, El Arabi KA, Djamai I, Iyer A, Parashar N, Adiguzel A, Kocalar HE, Bundt C, Norton JO, Papadatou-Pastou M, De la Rosa-Gomez A, Ankushev V, Bogatyreva N, Grigoryev D, Ivanov A, Prusova I, Romanova M, Sarieva I, Terskova M, Hristova E, Kadreva VH, Janak A, Schei V, Sverdrup TE, Askelund AD, Pineda LMS, Krupić D, Levitan CA, Johannes N, Ouherrou N, Say N, Sinkolova S, Janjić K, Stojanovska M, Stojanovska D, Khosla M, Thomas AG, Kung FYH, Bijlstra G, Mosannenzadeh F, Balci BB, Reips UD, Baskin E, Ishkhanyan B, Czamanski-Cohen J, Dixson BJW, Moreau D, Sutherland CAM, Chuan-Peng H, Noone C, Flowe H, Anne M, Janssen SMJ, Topor M, Majeed NM, Kunisato Y, Yu K, Daches S, Hartanto A, Vdovic M, Anton-Boicuk L, Forbes PAG, Kamburidis J, Marinova E, Nedelcheva-Datsova M, Rachev NR, Stoyanova A, Schmidt K, Suchow JW, Koptjevskaja-Tamm M, Jernsäther T, Olofsson JK, Bialobrzeska O, Marszalek M, Tatachari S, Afhami R, Law W, Antfolk J, Žuro B, Van Doren N, Soto JA, Searston R, Miranda J, Damnjanović K, Yeung SK, Krupić D, Hoyer K, Jaeger B, Ren D, Pfuhl G, Klevjer K, Corral-Frías NS, Frias-Armenta M, Lucas MY, Torres AO, Toro M, Delgado LGJ, Vega D, Solas SÁ, Vilar R, Massoni S, Frizzo T, Bran A, Vaidis DC, Vieira L, Paris B, Capizzi M, Coelho GLH, Greenburgh A, Whitt CM, Tullett AM, Du X, Volz L, Bosma MJ, Karaarslan C, Sarıoğuz E, Allred TB, Korbmacher M, Colloff MF, Lima TJS, Ribeiro MFF, Verharen JPH, Karekla M, Karashiali C, Sunami N, Jaremka LM, Storage D, Habib S, Studzinska A, Hanel PHP, Holford DL, Sirota M, Wolfe K, Chiu F, Theodoropoulou A, Ahn ER, Lin Y, Westgate EC, Brohmer H, Hofer G, Dujols O, Vezirian K, Feldman G, Travaglino GA, Ahmed A, Li M, Bosch J, Torunsky N, Bai H, Manavalan M, Song X, Walczak RB, Zdybek P, Friedemann M, Rosa AD, Kozma L, Alves SG, Lins S, Pinto IR, Correia RC, Babinčák P, Banik G, Rojas-Berscia LM, Varella MAC, Uttley J, Beshears JE, Thommesen KK, Behzadnia B, Geniole SN, Silan MA, Maturan PLG, Vilsmeier JK, Tran US, Izquierdo SM, Mensink MC, Sorokowski P, Groyecka-Bernard A, Radtke T, Adoric VC, Carpentier J, Özdoğru AA, Joy-Gaba JA, Hedgebeth MV, Ishii T, Wichman AL, Röer JP, Ostermann T, Davis WE, Suter L, Papachristopoulos K, Zabel C, Onie S, Ebersole CR, Chartier CR, Mallik PR, Urry HL, Buchanan EM, Coles NA, Primbs MA, Basnight-Brown DM, IJzerman H, Forscher PS, and Moshontz H

Published
2022
Full Text
View/download PDF

11. The Role of Clearinghouses in Promoting Transparent Research: A Methodological Study of Transparency Practices for Preventive Interventions.

Author

Buckley PR, Ebersole CR, Steeger CM, Michaelson LE, Hill KG, and Gardner F

Subjects
Adolescent, Humans, Research Design, Research Report
Abstract

Transparency of research methods is vital to science, though incentives are variable, with only some journals and funders adopting transparency policies. Clearinghouses are also important stakeholders; however, to date none have implemented formal procedures that facilitate transparent research. Using data from the longest standing clearinghouse, we examine transparency practices for preventive interventions to explore the role of online clearinghouses in incentivizing researchers to make their research more transparent. We conducted a descriptive analysis of 88 evaluation reports reviewed in 2018-2019 by Blueprints for Healthy Youth Development, when the clearinghouse began checking for trial registrations, and expanded on these efforts by applying broader transparency standards to interventions eligible for an endorsement on the Blueprints website during the study period. Reports were recent, with 84% published between 2010 and 2019. We found that few reports had data, code, or research materials that were publicly available. Meanwhile, 40% had protocols that were registered, but only 8% were registered prospectively, while one-quarter were registered before conducting analyses. About one-third included details in a registered protocol describing the treatment contrast and planned inclusions, and less than 5% had a registered statistical analysis plan (e.g., planned analytical methods, pre-specified covariates). Confirmatory research was distinguished from exploratory work in roughly 40% of reports. Reports published more recently (after 2015) had higher rates of transparency. Preventive intervention research needs to be more transparent. Since clearinghouses rely on robust findings to make well-informed decisions and researchers are incentivized to meet clearinghouse standards, clearinghouses should consider policies that encourage transparency to improve the credibility of evidence-based interventions., (© 2021. Society for Prevention Research.)

Published
2022
Full Text
View/download PDF

12. A multi-country test of brief reappraisal interventions on emotions during the COVID-19 pandemic.

Author

Wang K, Goldenberg A, Dorison CA, Miller JK, Uusberg A, Lerner JS, Gross JJ, Agesin BB, Bernardo M, Campos O, Eudave L, Grzech K, Ozery DH, Jackson EA, Garcia EOL, Drexler SM, Jurković AP, Rana K, Wilson JP, Antoniadi M, Desai K, Gialitaki Z, Kushnir E, Nadif K, Bravo ON, Nauman R, Oosterlinck M, Pantazi M, Pilecka N, Szabelska A, van Steenkiste IMM, Filip K, Bozdoc AI, Marcu GM, Agadullina E, Adamkovič M, Roczniewska M, Reyna C, Kassianos AP, Westerlund M, Ahlgren L, Pöntinen S, Adetula GA, Dursun P, Arinze AI, Arinze NC, Ogbonnaya CE, Ndukaihe ILG, Dalgar I, Akkas H, Macapagal PM, Lewis S, Metin-Orta I, Foroni F, Willis M, Santos AC, Mokady A, Reggev N, Kurfali MA, Vasilev MR, Nock NL, Parzuchowski M, Espinoza Barría MF, Vranka M, Kohlová MB, Ropovik I, Harutyunyan M, Wang C, Yao E, Becker M, Manunta E, Kaminski G, Boudesseu J, Marko D, Evans K, Lewis DMG, Findor A, Landry AT, Aruta JJB, Ortiz MS, Vally Z, Pronizius E, Voracek M, Lamm C, Grinberg M, Li R, Valentova JV, Mioni G, Cellini N, Chen SC, Zickfeld J, Moon K, Azab H, Levy N, Karababa A, Beaudry JL, Boucher L, Collins WM, Todsen AL, van Schie K, Vintr J, Bavolar J, Kaliska L, Križanić V, Samojlenko L, Pourafshari R, Geiger SJ, Beitner J, Warmelink L, Ross RM, Stephen ID, Hostler TJ, Azouaghe S, McCarthy R, Szala A, Grano C, Solorzano CS, Anjum G, Jimenez-Leal W, Bradford M, Pérez LC, Cruz Vásquez JE, Galindo-Caballero OJ, Vargas-Nieto JC, Kácha O, Arvanitis A, Xiao Q, Cárcamo R, Zorjan S, Tajchman Z, Vilares I, Pavlacic JM, Kunst JR, Tamnes CK, von Bastian CC, Atari M, Sharifian M, Hricova M, Kačmár P, Schrötter J, Rahal RM, Cohen N, FatahModares S, Zrimsek M, Zakharov I, Koehn MA, Esteban-Serna C, Calin-Jageman RJ, Krafnick AJ, Štrukelj E, Isager PM, Urban J, Silva JR, Martončik M, Očovaj SB, Šakan D, Kuzminska AO, Djordjevic JM, Almeida IAT, Ferreira A, Lazarevic LB, Manley H, Ricaurte DZ, Monteiro RP, Etabari Z, Musser E, Dunleavy D, Chou W, Godbersen H, Ruiz-Fernández S, Reeck C, Batres C, Kirgizova K, Muminov A, Azevedo F, Alvarez DS, Butt MM, Lee JM, Chen Z, Verbruggen F, Ziano I, Tümer M, Charyate ACA, Dubrov D, Tejada Rivera MDCMC, Aberson C, Pálfi B, Maldonado MA, Hubena B, Sacakli A, Ceary CD, Richard KL, Singer G, Perillo JT, Ballantyne T, Cyrus-Lai W, Fedotov M, Du H, Wielgus M, Pit IL, Hruška M, Sousa D, Aczel B, Hajdu N, Szaszi B, Adamus S, Barzykowski K, Micheli L, Schmidt ND, Zsido AN, Paruzel-Czachura M, Muda R, Bialek M, Kowal M, Sorokowska A, Misiak M, Mola D, Ortiz MV, Correa PS, Belaus A, Muchembled F, Ribeiro RR, Arriaga P, Oliveira R, Vaughn LA, Szwed P, Kossowska M, Czarnek G, Kielińska J, Antazo B, Betlehem R, Stieger S, Nilsonne G, Simonovic N, Taber J, Gourdon-Kanhukamwe A, Domurat A, Ihaya K, Yamada Y, Urooj A, Gill T, Čadek M, Bylinina L, Messerschmidt J, Kurfalı M, Adetula A, Baklanova E, Albayrak-Aydemir N, Kappes HB, Gjoneska B, House T, Jones MV, Berkessel JB, Chopik WJ, Çoksan S, Seehuus M, Khaoudi A, Bokkour A, El Arabi KA, Djamai I, Iyer A, Parashar N, Adiguzel A, Kocalar HE, Bundt C, Norton JO, Papadatou-Pastou M, De la Rosa-Gomez A, Ankushev V, Bogatyreva N, Grigoryev D, Ivanov A, Prusova I, Romanova M, Sarieva I, Terskova M, Hristova E, Kadreva VH, Janak A, Schei V, Sverdrup TE, Askelund AD, Pineda LMS, Krupić D, Levitan CA, Johannes N, Ouherrou N, Say N, Sinkolova S, Janjić K, Stojanovska M, Stojanovska D, Khosla M, Thomas AG, Kung FYH, Bijlstra G, Mosannenzadeh F, Balci BB, Reips UD, Baskin E, Ishkhanyan B, Czamanski-Cohen J, Dixson BJW, Moreau D, Sutherland CAM, Chuan-Peng H, Noone C, Flowe H, Anne M, Janssen SMJ, Topor M, Majeed NM, Kunisato Y, Yu K, Daches S, Hartanto A, Vdovic M, Anton-Boicuk L, Forbes PAG, Kamburidis J, Marinova E, Nedelcheva-Datsova M, Rachev NR, Stoyanova A, Schmidt K, Suchow JW, Koptjevskaja-Tamm M, Jernsäther T, Olofsson JK, Bialobrzeska O, Marszalek M, Tatachari S, Afhami R, Law W, Antfolk J, Žuro B, Van Doren N, Soto JA, Searston R, Miranda J, Damnjanović K, Yeung SK, Krupić D, Hoyer K, Jaeger B, Ren D, Pfuhl G, Klevjer K, Corral-Frías NS, Frias-Armenta M, Lucas MY, Torres AO, Toro M, Delgado LGJ, Vega D, Solas SÁ, Vilar R, Massoni S, Frizzo T, Bran A, Vaidis DC, Vieira L, Paris B, Capizzi M, Coelho GLH, Greenburgh A, Whitt CM, Tullett AM, Du X, Volz L, Bosma MJ, Karaarslan C, Sarıoğuz E, Allred TB, Korbmacher M, Colloff MF, Lima TJS, Ribeiro MFF, Verharen JPH, Karekla M, Karashiali C, Sunami N, Jaremka LM, Storage D, Habib S, Studzinska A, Hanel PHP, Holford DL, Sirota M, Wolfe K, Chiu F, Theodoropoulou A, Ahn ER, Lin Y, Westgate EC, Brohmer H, Hofer G, Dujols O, Vezirian K, Feldman G, Travaglino GA, Ahmed A, Li M, Bosch J, Torunsky N, Bai H, Manavalan M, Song X, Walczak RB, Zdybek P, Friedemann M, Rosa AD, Kozma L, Alves SG, Lins S, Pinto IR, Correia RC, Babinčák P, Banik G, Rojas-Berscia LM, Varella MAC, Uttley J, Beshears JE, Thommesen KK, Behzadnia B, Geniole SN, Silan MA, Maturan PLG, Vilsmeier JK, Tran US, Izquierdo SM, Mensink MC, Sorokowski P, Groyecka-Bernard A, Radtke T, Adoric VC, Carpentier J, Özdoğru AA, Joy-Gaba JA, Hedgebeth MV, Ishii T, Wichman AL, Röer JP, Ostermann T, Davis WE, Suter L, Papachristopoulos K, Zabel C, Onie S, Ebersole CR, Chartier CR, Mallik PR, Urry HL, Buchanan EM, Coles NA, Primbs MA, Basnight-Brown DM, IJzerman H, Forscher PS, and Moshontz H

Subjects
Adult, Female, Humans, Male, COVID-19 psychology, Emotional Regulation, Emotions
Abstract

The COVID-19 pandemic has increased negative emotions and decreased positive emotions globally. Left unchecked, these emotional changes might have a wide array of adverse impacts. To reduce negative emotions and increase positive emotions, we tested the effectiveness of reappraisal, an emotion-regulation strategy that modifies how one thinks about a situation. Participants from 87 countries and regions (n = 21,644) were randomly assigned to one of two brief reappraisal interventions (reconstrual or repurposing) or one of two control conditions (active or passive). Results revealed that both reappraisal interventions (vesus both control conditions) consistently reduced negative emotions and increased positive emotions across different measures. Reconstrual and repurposing interventions had similar effects. Importantly, planned exploratory analyses indicated that reappraisal interventions did not reduce intentions to practice preventive health behaviours. The findings demonstrate the viability of creating scalable, low-cost interventions for use around the world. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on 12 May 2020. The protocol, as accepted by the journal, can be found at https://doi.org/10.6084/m9.figshare.c.4878591.v1., (© 2021. The Author(s), under exclusive licence to Springer Nature Limited.)

Published
2021
Full Text
View/download PDF

13. Happiness, Meaning, and Psychological Richness.

Author

Oishi S, Choi H, Koo M, Galinha I, Ishii K, Komiya A, Luhmann M, Scollon C, Shin JE, Lee H, Suh EM, Vittersø J, Heintzelman SJ, Kushlev K, Westgate EC, Buttrick N, Tucker J, Ebersole CR, Axt J, Gilbert E, Ng BW, Kurtz J, and Besser LL

Abstract

What kind of life do people want? In psychology, a good life has typically been conceptualized in terms of either hedonic or eudaimonic well-being. We propose that psychological richness is another neglected aspect of what people consider a good life. In study 1 (9-nation cross-cultural study), we asked participants whether they ideally wanted a happy, a meaningful, or a psychologically rich life. Roughly 7 to 17% of participants chose the psychologically rich life. In study 2, we asked 1611 Americans and 680 Koreans what they regret most in their lives; then, if they could undo or reverse the regretful event, whether their lives would have been happier, more meaningful, or psychologically richer as a result. Roughly 28% of Americans and 35% of Koreans reported their lives would have been psychologically richer. Together, this work provides a foundation for the study of psychological richness as another dimension of a good life., Competing Interests: Conflict of InterestThe authors declare that there are no conflicts of interest., (© The Society for Affective Science 2020.)

Published
2020
Full Text
View/download PDF

14. Crowdsourcing hypothesis tests: Making transparent how design choices shape research results.

Author

Landy JF, Jia ML, Ding IL, Viganola D, Tierney W, Dreber A, Johannesson M, Pfeiffer T, Ebersole CR, Gronau QF, Ly A, van den Bergh D, Marsman M, Derks K, Wagenmakers EJ, Proctor A, Bartels DM, Bauman CW, Brady WJ, Cheung F, Cimpian A, Dohle S, Donnellan MB, Hahn A, Hall MP, Jiménez-Leal W, Johnson DJ, Lucas RE, Monin B, Montealegre A, Mullen E, Pang J, Ray J, Reinero DA, Reynolds J, Sowden W, Storage D, Su R, Tworek CM, Van Bavel JJ, Walco D, Wills J, Xu X, Yam KC, Yang X, Cunningham WA, Schweinsberg M, Urwitz M, The Crowdsourcing Hypothesis Tests Collaboration, and Uhlmann EL

Subjects
Adult, Humans, Random Allocation, Crowdsourcing, Psychology methods, Research Design
Abstract

To what extent are research results influenced by subjective decisions that scientists make as they design studies? Fifteen research teams independently designed studies to answer five original research questions related to moral judgments, negotiations, and implicit cognition. Participants from 2 separate large samples (total N > 15,000) were then randomly assigned to complete 1 version of each study. Effect sizes varied dramatically across different sets of materials designed to test the same hypothesis: Materials from different teams rendered statistically significant effects in opposite directions for 4 of 5 hypotheses, with the narrowest range in estimates being d = -0.37 to + 0.26. Meta-analysis and a Bayesian perspective on the results revealed overall support for 2 hypotheses and a lack of support for 3 hypotheses. Overall, practically none of the variability in effect sizes was attributable to the skill of the research team in designing materials, whereas considerable variability was attributable to the hypothesis being tested. In a forecasting survey, predictions of other scientists were significantly correlated with study results, both across and within hypotheses. Crowdsourced testing of research hypotheses helps reveal the true consistency of empirical support for a scientific claim. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Published
2020
Full Text
View/download PDF

15. A meta-analysis of procedures to change implicit measures.

Author

Forscher PS, Lai CK, Axt JR, Ebersole CR, Herman M, Devine PG, and Nosek BA

Subjects
Humans, Psychological Tests, Psychology, Social, Social Perception
Abstract

Using a novel technique known as network meta-analysis, we synthesized evidence from 492 studies (87,418 participants) to investigate the effectiveness of procedures in changing implicit measures, which we define as response biases on implicit tasks. We also evaluated these procedures' effects on explicit and behavioral measures. We found that implicit measures can be changed, but effects are often relatively weak (| d s| < .30). Most studies focused on producing short-term changes with brief, single-session manipulations. Procedures that associate sets of concepts, invoke goals or motivations, or tax mental resources changed implicit measures the most, whereas procedures that induced threat, affirmation, or specific moods/emotions changed implicit measures the least. Bias tests suggested that implicit effects could be inflated relative to their true population values. Procedures changed explicit measures less consistently and to a smaller degree than implicit measures and generally produced trivial changes in behavior. Finally, changes in implicit measures did not mediate changes in explicit measures or behavior. Our findings suggest that changes in implicit measures are possible, but those changes do not necessarily translate into changes in explicit measures or behavior. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Published
2019
Full Text
View/download PDF

16. Scientific Utopia III: Crowdsourcing Science.

Author

Uhlmann EL, Ebersole CR, Chartier CR, Errington TM, Kidwell MC, Lai CK, McCarthy RJ, Riegelman A, Silberzahn R, and Nosek BA

Subjects
Cooperative Behavior, Data Analysis, Data Collection methods, Humans, Peer Review, Publishing, Research Design, Writing, Crowdsourcing methods, Interprofessional Relations, Science methods, Utopias
Abstract

Most scientific research is conducted by small teams of investigators who together formulate hypotheses, collect data, conduct analyses, and report novel findings. These teams operate independently as vertically integrated silos. Here we argue that scientific research that is horizontally distributed can provide substantial complementary value, aiming to maximize available resources, promote inclusiveness and transparency, and increase rigor and reliability. This alternative approach enables researchers to tackle ambitious projects that would not be possible under the standard model. Crowdsourced scientific initiatives vary in the degree of communication between project members from largely independent work curated by a coordination team to crowd collaboration on shared activities. The potential benefits and challenges of large-scale collaboration span the entire research process: ideation, study design, data collection, data analysis, reporting, and peer review. Complementing traditional small science with crowdsourced approaches can accelerate the progress of science and improve the quality of scientific research.

Published
2019
Full Text
View/download PDF

17. The Psychological Science Accelerator: Advancing Psychology through a Distributed Collaborative Network.

Author

Moshontz H, Campbell L, Ebersole CR, IJzerman H, Urry HL, Forscher PS, Grahe JE, McCarthy RJ, Musser ED, Antfolk J, Castille CM, Evans TR, Fiedler S, Flake JK, Forero DA, Janssen SMJ, Keene JR, Protzko J, Aczel B, Solas SÁ, Ansari D, Awlia D, Baskin E, Batres C, Borras-Guevara ML, Brick C, Chandel P, Chatard A, Chopik WJ, Clarance D, Coles NA, Corker KS, Dixson BJW, Dranseika V, Dunham Y, Fox NW, Gardiner G, Garrison SM, Gill T, Hahn AC, Jaeger B, Kačmár P, Kaminski G, Kanske P, Kekecs Z, Kline M, Koehn MA, Kujur P, Levitan CA, Miller JK, Okan C, Olsen J, Oviedo-Trespalacios O, Özdoğru AA, Pande B, Parganiha A, Parveen N, Pfuhl G, Pradhan S, Ropovik I, Rule NO, Saunders B, Schei V, Schmidt K, Singh MM, Sirota M, Steltenpohl CN, Stieger S, Storage D, Sullivan GB, Szabelska A, Tamnes CK, Vadillo MA, Valentova JV, Vanpaemel W, Varella MAC, Vergauwe E, Verschoor M, Vianello M, Voracek M, Williams GP, Wilson JP, Zickfeld JH, Arnal JD, Aydin B, Chen SC, DeBruine LM, Fernandez AM, Horstmann KT, Isager PM, Jones B, Kapucu A, Lin H, Mensink MC, Navarrete G, Silan MA, and Chartier CR

Abstract

Concerns have been growing about the veracity of psychological research. Many findings in psychological science are based on studies with insufficient statistical power and nonrepresentative samples, or may otherwise be limited to specific, ungeneralizable settings or populations. Crowdsourced research, a type of large-scale collaboration in which one or more research projects are conducted across multiple lab sites, offers a pragmatic solution to these and other current methodological challenges. The Psychological Science Accelerator (PSA) is a distributed network of laboratories designed to enable and support crowdsourced research projects. These projects can focus on novel research questions, or attempt to replicate prior research, in large, diverse samples. The PSA's mission is to accelerate the accumulation of reliable and generalizable evidence in psychological science. Here, we describe the background, structure, principles, procedures, benefits, and challenges of the PSA. In contrast to other crowdsourced research networks, the PSA is ongoing (as opposed to time-limited), efficient (in terms of re-using structures and principles for different projects), decentralized, diverse (in terms of participants and researchers), and inclusive (of proposals, contributions, and other relevant input from anyone inside or outside of the network). The PSA and other approaches to crowdsourced psychological science will advance our understanding of mental processes and behaviors by enabling rigorous research and systematically examining its generalizability.

Published
2018
Full Text
View/download PDF

18. Reply to Ledgerwood: Predictions without analysis plans are inert.

Author

Nosek BA, Ebersole CR, DeHaven AC, and Mellor DT

Abstract

Competing Interests: Conflict of interest statement: B.A.N., A.C.D., and D.T.M. are employees of the Center for Open Science, a nonprofit organization that operates the Open Science Framework (https://osf.io/), an open-source service supporting preregistration of research.

Published
2018
Full Text
View/download PDF

19. The preregistration revolution.

Author

Nosek BA, Ebersole CR, DeHaven AC, and Mellor DT

Subjects
Humans, Laboratory Personnel standards, Predictive Value of Tests, Workforce, Research standards, Science standards
Abstract

Progress in science relies in part on generating hypotheses with existing observations and testing hypotheses with new observations. This distinction between postdiction and prediction is appreciated conceptually but is not respected in practice. Mistaking generation of postdictions with testing of predictions reduces the credibility of research findings. However, ordinary biases in human reasoning, such as hindsight bias, make it hard to avoid this mistake. An effective solution is to define the research questions and analysis plan before observing the research outcomes-a process called preregistration. Preregistration distinguishes analyses and outcomes that result from predictions from those that result from postdictions. A variety of practical strategies are available to make the best possible use of preregistration in circumstances that fall short of the ideal application, such as when the data are preexisting. Services are now available for preregistration across all disciplines, facilitating a rapid increase in the practice. Widespread adoption of preregistration will increase distinctiveness between hypothesis generation and hypothesis testing and will improve the credibility of research findings., Competing Interests: Conflict of interest statement: B.A.N., A.C.D., and D.T.M. are employed by the nonprofit Center for Open Science that has as its mission to increase openness, integrity, and reproducibility of research.

Published
2018
Full Text
View/download PDF

20. Scientists' Reputations Are Based on Getting It Right, Not Being Right.

Author

Ebersole CR, Axt JR, and Nosek BA

Subjects
Humans, Inventions, Motivation, Public Opinion, Reproducibility of Results, Reward, United States, Research Personnel psychology, Research Personnel statistics & numerical data, Science statistics & numerical data
Abstract

Replication is vital for increasing precision and accuracy of scientific claims. However, when replications "succeed" or "fail," they could have reputational consequences for the claim's originators. Surveys of United States adults (N = 4,786), undergraduates (N = 428), and researchers (N = 313) showed that reputational assessments of scientists were based more on how they pursue knowledge and respond to replication evidence, not whether the initial results were true. When comparing one scientist that produced boring but certain results with another that produced exciting but uncertain results, opinion favored the former despite researchers' belief in more rewards for the latter. Considering idealized views of scientific practices offers an opportunity to address incentives to reward both innovation and verification.

Published
2016
Full Text
View/download PDF

21. The rules of implicit evaluation by race, religion, and age.

Author

Axt JR, Ebersole CR, and Nosek BA

Subjects
Adolescent, Adult, Female, Humans, Male, Middle Aged, Prejudice, Young Adult, Ageism, Attitude, Ethnicity, Hierarchy, Social, Racism, Religion, Social Perception
Abstract

The social world is stratified. Social hierarchies are known but often disavowed as anachronisms or unjust. Nonetheless, hierarchies may persist in social memory. In three studies (total N > 200,000), we found evidence of social hierarchies in implicit evaluation by race, religion, and age. Participants implicitly evaluated their own racial group most positively and the remaining racial groups in accordance with the following hierarchy: Whites > Asians > Blacks > Hispanics. Similarly, participants implicitly evaluated their own religion most positively and the remaining religions in accordance with the following hierarchy: Christianity > Judaism > Hinduism or Buddhism > Islam. In a final study, participants of all ages implicitly evaluated age groups following this rule: children > young adults > middle-age adults > older adults. These results suggest that the rules of social evaluation are pervasively embedded in culture and mind., (© The Author(s) 2014.)

Published
2014
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results