Search

Your search keyword '"Mercier, Brett"' showing total 81 results
Start Over Author "Mercier, Brett"
81 results on '"Mercier, Brett"'

1. Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability

Author

Ebersole, Charles R, Mathur, Maya B, Baranski, Erica, Bart-Plange, Diane-Jo, Buttrick, Nicholas R, Chartier, Christopher R, Corker, Katherine S, Corley, Martin, Hartshorne, Joshua K, IJzerman, Hans, Lazarević, Ljiljana B, Rabagliati, Hugh, Ropovik, Ivan, Aczel, Balazs, Aeschbach, Lena F, Andrighetto, Luca, Arnal, Jack D, Arrow, Holly, Babincak, Peter, Bakos, Bence E, Baník, Gabriel, Baskin, Ernest, Belopavlović, Radomir, Bernstein, Michael H, Białek, Michał, Bloxsom, Nicholas G, Bodroža, Bojana, Bonfiglio, Diane BV, Boucher, Leanne, Brühlmann, Florian, Brumbaugh, Claudia C, Casini, Erica, Chen, Yiling, Chiorri, Carlo, Chopik, William J, Christ, Oliver, Ciunci, Antonia M, Claypool, Heather M, Coary, Sean, Čolić, Marija V, Collins, W Matthew, Curran, Paul G, Day, Chris R, Dering, Benjamin, Dreber, Anna, Edlund, John E, Falcão, Filipe, Fedor, Anna, Feinberg, Lily, Ferguson, Ian R, Ford, Máire, Frank, Michael C, Fryberger, Emily, Garinther, Alexander, Gawryluk, Katarzyna, Ashbaugh, Kayla, Giacomantonio, Mauro, Giessner, Steffen R, Grahe, Jon E, Guadagno, Rosanna E, Hałasa, Ewa, Hancock, Peter JB, Hilliard, Rias A, Hüffmeier, Joachim, Hughes, Sean, Idzikowska, Katarzyna, Inzlicht, Michael, Jern, Alan, Jiménez-Leal, William, Johannesson, Magnus, Joy-Gaba, Jennifer A, Kauff, Mathias, Kellier, Danielle J, Kessinger, Grecia, Kidwell, Mallory C, Kimbrough, Amanda M, King, Josiah PJ, Kolb, Vanessa S, Kołodziej, Sabina, Kovacs, Marton, Krasuska, Karolina, Kraus, Sue, Krueger, Lacy E, Kuchno, Katarzyna, Lage, Caio Ambrosio, Langford, Eleanor V, Levitan, Carmel A, de Lima, Tiago Jessé Souza, Lin, Hause, Lins, Samuel, Loy, Jia E, Manfredi, Dylan, Markiewicz, Łukasz, Menon, Madhavi, Mercier, Brett, Metzger, Mitchell, Meyet, Venus, Millen, Ailsa E, Miller, Jeremy K, and Montealegre, Andres

Subjects
Psychology, Cognitive and Computational Psychology, Applied and Developmental Psychology, Behavioral and Social Science, replication, reproducibility, metascience, peer review, Registered Reports, open data, preregistered, Applied and developmental psychology, Cognitive and computational psychology
Abstract

Replication studies in psychological science sometimes fail to reproduce prior findings. If these studies use methods that are unfaithful to the original study or ineffective in eliciting the phenomenon of interest, then a failure to replicate may be a failure of the protocol rather than a challenge to the original finding. Formal pre-data-collection peer review by experts may address shortcomings and increase replicability rates. We selected 10 replication studies from the Reproducibility Project: Psychology (RP:P; Open Science Collaboration, 2015) for which the original authors had expressed concerns about the replication designs before data collection; only one of these studies had yielded a statistically significant effect (p

Published
2020

3. Anticipated Affect Predicts Moral Praise and Character Judgments.

Author

Amormino, Paige, Mercier, Brett, and Inbar, Yoel

Subjects
*PERCEIVED benefit, *PERCEIVED control (Psychology), *EMOTIONS, *MORAL judgment, *EMOTIONAL experience, *PRAISE
Abstract

In four preregistered studies (total N = 5,067), we investigated whether people use their own anticipated affective responses to a situation to make judgments about the praiseworthiness of helping and the moral character of helpers. We found that helpers in more affectively arousing scenarios were seen as more morally motivated, received greater praise, and were seen as having more positive moral character, even when controlling for the perceived benefits of helping. Describing helpers as unemotional reduced the effect of observers' anticipated affect on character judgments. These results suggest that when making praise and character judgments, people not only consider the consequences of a helper's actions but also the emotions they experience when engaging in them—and that they use their own anticipated emotional experience to do this. [ABSTRACT FROM AUTHOR]

Published
2024
Full Text
View/download PDF

8. Media Coverage of Mass shootings and Attitudes Towards Muslims

Author

Mercier, Brett Gregory

Subjects
Social psychology, Anti-Muslim Prejudice, Islamophobia, Media, News, Prejudice, Stereotypes
Abstract

Using television news coverage of American mass shootings, I examine how Muslim perpetrators of violence are covered differently in liberal and conservative media. Furthermore, I examine the consequences of this coverage, including its effects on prejudice towards Muslims and beliefs about the extent to which Muslims are responsible for acts of violence. In Study 1, I show that between 2010 and 2020, television news networks allocated more coverage to Muslim than non-Muslim mass shooters, even when statistically controlling for other factors influencing coverage (e.g. fatalities, location). The increase in coverage for Muslim shooters was larger for more politically conservative news networks. In Study 2, I test whether news coverage of Muslim mass shootings can increase negative attitudes towards Muslims. Across five different experiments with a total of 3331 participants, I did not find evidence that this is the case. The remaining studies examine whether media coverage can impact beliefs about the role Muslims play in mass shootings. In Study 3, I find that public beliefs about mass shootings mirror the picture presented in television news: people overestimate the percentage of mass shooters who are Muslim, and this overestimation is largest among frequent viewers of news networks that allocate more coverage to Muslim shooters. Study 4 used an experiment to demonstrate that exposure to news coverage of a Muslim mass shooter increases the extent to which people overestimate the percentage of mass shooters who are Muslim. Study 5 replicates this finding by comparing responses to media coverage of the 2021 shootings in Boulder, Colorado and Atlanta, Georgia, two contemporaneous mass shootings with Muslim and Christian perpetrators. Finally, Study 6A and 6B find that, because many people assume an unidentified mass shooter is likely to be Muslim, exposure to news coverage of an unidentified shooter also increases the extent to which people overestimate of the percentage of mass shooters who are Muslim. Overall, I demonstrate that major news networks provide systematically different media coverage of mass shootings when the perpetrator is Muslim. This coverage fuels misperceptions about the role Muslims play in causing mass shootings and may misdirect efforts to effectively address mass violence.

Published
2021

10. A many-analysts approach to the relation between religiosity and well-being

Author

Hoogeveen, Suzanne, Sarafoglou, Alexandra, Aczel, Balazs, Aditya, Yonathan, Alayan, Alexandra J., Allen, Peter J., Altay, Sacha, Alzahawi, Shilaan, Amir, Yulmaida, Anthony, Francis-Vincent, Appiah, Obed Kwame, Atkinson, Quentin D., Baimel, Adam, Balkaya-Ince, Merve, Balsamo, Michela, Banker, Sachin, Bartos, Frantisek, Becerra, Mario, Beffara, Bertrand, Beitner, Julia, Bendixen, Theiss, Berkessel, Jana B., Berniunas, Renatas, Billet, Matthew, Billingsley, Joseph, Bortolini, Tiago, Breitsohl, Heiko, Bret, Amelie, Brown, Faith L., Brown, Jennifer, Brumbaugh, Claudia C., Buczny, Jacek, Bulbulia, Joseph, Caballero, Saul, Carlucci, Leonardo, Carmichael, Cheryl L., Cattaneo, Marco E. G., Charles, Sarah J., Claessens, Scott, Panagopoulos, Maxinne C., Costa, Angelo Brandelli, Crone, Damien L., Czoschke, Stefan, Czymara, Christian, D'Urso, E. Damiano, Dahlstrom, Orjan, Dalla Rosa, Anna, Danielsson, Henrik, De Ron, Jill, de Vries, Ymkje Anna, Dean, Kristy K., Dik, Bryan J., Disabato, David J., Doherty, Jaclyn K., Draws, Tim, Drouhot, Lucas, Dujmovic, Marin, Dunham, Yarrow, Ebert, Tobias, Edelsbrunner, Peter A., Eerland, Anita, Elbaek, Christian T., Farahmand, Shole, Farahmand, Hooman, Farias, Miguel, Feliccia, Abrey A., Fischer, Kyle, Fischer, Ronald, Fisher-Thompson, Donna, Francis, Zoe, Frick, Susanne, Frisch, Lisa K., Geraldes, Diogo, Gerdin, Emily, Geven, Linda, Ghasemi, Omid, Gielens, Erwin, Gligoric, Vukasin, Hagel, Kristin, Hajdu, Nandor, Hamilton, Hannah R., Hamzah, Imaduddin, Hanel, Paul H. P., Hawk, Christopher E., Himawan, Karel K., Holding, Benjamin C., Homman, Lina E., Ingendahl, Moritz, Inkila, Hilla, Inman, Mary L., Islam, Chris-Gabriel, Isler, Ozan, Izydorczyk, David, Jaeger, Bastian, Johnson, Kathryn A., Jong, Jonathan, Karl, Johannes A., Kaszubowski, Erikson, Katz, Benjamin A., Keefer, Lucas A., Kelchtermans, Stijn, Kelly, John M., Klein, Richard A., Kleinberg, Bennett, Knowles, Megan L., Kolczynska, Marta, Koller, Dave, Krasko, Julia, Kritzler, Sarah, Krypotos, Angelos-Miltiadis, Kyritsis, Thanos, Landes, Todd L., Laukenmann, Ruben, Forsyth, Guy A. Lavender, Lazar, Aryeh, Lehman, Barbara J., Levy, Neil, Lo, Ronda F., Lodder, Paul, Lorenz, Jennifer, Lowicki, Pawel, Ly, Albert L., Maassen, Esther, Magyar-Russell, Gina M., Maier, Maximilian, Marsh, Dylan R., Martinez, Nuria, Martinie, Marcellin, Martoyo, Ihan, Mason, Susan E., Mauritsen, Anne Lundahl, McAleer, Phil, McCauley, Thomas, McCullough, Michael, McKay, Ryan, McMahon, Camilla M., McNamara, Amelia A., Means, Kira K., Mercier, Brett, Mitkidis, Panagiotis, Monin, Benoit, Moon, Jordan W., Moreau, David, Morgan, Jonathan, Murphy, James, Muscatt, George, Nagel, Christof, Nagy, Tamas, Nalborczyk, Ladislas, Nilsonne, Gustav, Noack, Pamina, Norenzayan, Ara, Nuijten, Michele B., Olsson-Collentine, Anton, Oviedo, Lluis, Pavlov, Yuri G., Pawelski, James O., Pearson, Hannah, Pedder, Hugo, Peetz, Hannah K., Pinus, Michael, Pirutinsky, Steven, Polito, Vince, Porubanova, Michaela, Poulin, Michael J., Prenoveau, Jason M., Prince, Mark A., Protzko, John, Pryor, Campbell, Purzycki, Benjamin G., Qiu, Lin, Putter, Julian Quevedo, Rabelo, Andre, Radell, Milen L., Ramsay, Jonathan E., Reid, Graham, Roberts, Andrew J., Luna, Lindsey M. Root, Ross, Robert M., Roszak, Piotr, Roy, Nirmal, Saarelainen, Suvi-Maria K., Sasaki, Joni Y., Schaumans, Catherine, Schivinski, Bruno, Schmitt, Marcel C., Schnitker, Sarah A., Schnuerch, Martin, Schreiner, Marcel R., Schuttengruber, Victoria, Sebben, Simone, Segerstrom, Suzanne C., Seryczynska, Berenika, Shjoedt, Uffe, Simsek, Muge, Sleegers, Willem W. A., Smith, Eliot R., Sowden, Walter J., Spath, Marion, Sporlein, Christoph, Stedden, William, Stoevenbelt, Andrea H., Stuber, Simon, Sulik, Justin, Suwartono, Christiany, Syropoulos, Stylianos, Szaszi, Barnabas, Szecsi, Peter, Tappin, Ben M., Tay, Louis, Thibault, Robert T., Thompson, Burt, Thurn, Christian M., Torralba, Josefa, Tuthill, Shelby D., Ullein, Ann-Marie, Van Aert, Robbie C. M., van Assen, Marcel A. L. M., Van Cappellen, Patty, van den Akker, Olmo R., Van der Cruyssen, Ine, Van der Noll, Jolanda, van Dongen, Noah N. N., Van Lissa, Caspar J., van Mulukom, Valerie, van Ravenzwaaij, Don, van Zyl, Casper J. J., Vaughn, Leigh Ann, Verschuere, Bruno, Vianello, Michelangelo, Vilanova, Felipe, Vishkin, Allon, Vogel, Vera, Vogelsmeier, Leonie V. D. E., Watanabe, Shoko, White, Cindel J. M., Wiebels, Kristina, Wiechert, Sera, Willett, Zachary Z., Witkowiak, Maciej, Witvliet, Charlotte V. O., Wiwad, Dylan, Wuyts, Robin, Xygalatas, Dimitris, Yang, Xin, Yeo, Darren J., Yilmaz, Onurcan, Zarzeczna, Natalia, Zhao, Yitong, Zijlmans, Josjan, van Elk, Michiel, Wagenmakers, Eric-Jan, Hoogeveen, Suzanne, Sarafoglou, Alexandra, Aczel, Balazs, Aditya, Yonathan, Alayan, Alexandra J., Allen, Peter J., Altay, Sacha, Alzahawi, Shilaan, Amir, Yulmaida, Anthony, Francis-Vincent, Appiah, Obed Kwame, Atkinson, Quentin D., Baimel, Adam, Balkaya-Ince, Merve, Balsamo, Michela, Banker, Sachin, Bartos, Frantisek, Becerra, Mario, Beffara, Bertrand, Beitner, Julia, Bendixen, Theiss, Berkessel, Jana B., Berniunas, Renatas, Billet, Matthew, Billingsley, Joseph, Bortolini, Tiago, Breitsohl, Heiko, Bret, Amelie, Brown, Faith L., Brown, Jennifer, Brumbaugh, Claudia C., Buczny, Jacek, Bulbulia, Joseph, Caballero, Saul, Carlucci, Leonardo, Carmichael, Cheryl L., Cattaneo, Marco E. G., Charles, Sarah J., Claessens, Scott, Panagopoulos, Maxinne C., Costa, Angelo Brandelli, Crone, Damien L., Czoschke, Stefan, Czymara, Christian, D'Urso, E. Damiano, Dahlstrom, Orjan, Dalla Rosa, Anna, Danielsson, Henrik, De Ron, Jill, de Vries, Ymkje Anna, Dean, Kristy K., Dik, Bryan J., Disabato, David J., Doherty, Jaclyn K., Draws, Tim, Drouhot, Lucas, Dujmovic, Marin, Dunham, Yarrow, Ebert, Tobias, Edelsbrunner, Peter A., Eerland, Anita, Elbaek, Christian T., Farahmand, Shole, Farahmand, Hooman, Farias, Miguel, Feliccia, Abrey A., Fischer, Kyle, Fischer, Ronald, Fisher-Thompson, Donna, Francis, Zoe, Frick, Susanne, Frisch, Lisa K., Geraldes, Diogo, Gerdin, Emily, Geven, Linda, Ghasemi, Omid, Gielens, Erwin, Gligoric, Vukasin, Hagel, Kristin, Hajdu, Nandor, Hamilton, Hannah R., Hamzah, Imaduddin, Hanel, Paul H. P., Hawk, Christopher E., Himawan, Karel K., Holding, Benjamin C., Homman, Lina E., Ingendahl, Moritz, Inkila, Hilla, Inman, Mary L., Islam, Chris-Gabriel, Isler, Ozan, Izydorczyk, David, Jaeger, Bastian, Johnson, Kathryn A., Jong, Jonathan, Karl, Johannes A., Kaszubowski, Erikson, Katz, Benjamin A., Keefer, Lucas A., Kelchtermans, Stijn, Kelly, John M., Klein, Richard A., Kleinberg, Bennett, Knowles, Megan L., Kolczynska, Marta, Koller, Dave, Krasko, Julia, Kritzler, Sarah, Krypotos, Angelos-Miltiadis, Kyritsis, Thanos, Landes, Todd L., Laukenmann, Ruben, Forsyth, Guy A. Lavender, Lazar, Aryeh, Lehman, Barbara J., Levy, Neil, Lo, Ronda F., Lodder, Paul, Lorenz, Jennifer, Lowicki, Pawel, Ly, Albert L., Maassen, Esther, Magyar-Russell, Gina M., Maier, Maximilian, Marsh, Dylan R., Martinez, Nuria, Martinie, Marcellin, Martoyo, Ihan, Mason, Susan E., Mauritsen, Anne Lundahl, McAleer, Phil, McCauley, Thomas, McCullough, Michael, McKay, Ryan, McMahon, Camilla M., McNamara, Amelia A., Means, Kira K., Mercier, Brett, Mitkidis, Panagiotis, Monin, Benoit, Moon, Jordan W., Moreau, David, Morgan, Jonathan, Murphy, James, Muscatt, George, Nagel, Christof, Nagy, Tamas, Nalborczyk, Ladislas, Nilsonne, Gustav, Noack, Pamina, Norenzayan, Ara, Nuijten, Michele B., Olsson-Collentine, Anton, Oviedo, Lluis, Pavlov, Yuri G., Pawelski, James O., Pearson, Hannah, Pedder, Hugo, Peetz, Hannah K., Pinus, Michael, Pirutinsky, Steven, Polito, Vince, Porubanova, Michaela, Poulin, Michael J., Prenoveau, Jason M., Prince, Mark A., Protzko, John, Pryor, Campbell, Purzycki, Benjamin G., Qiu, Lin, Putter, Julian Quevedo, Rabelo, Andre, Radell, Milen L., Ramsay, Jonathan E., Reid, Graham, Roberts, Andrew J., Luna, Lindsey M. Root, Ross, Robert M., Roszak, Piotr, Roy, Nirmal, Saarelainen, Suvi-Maria K., Sasaki, Joni Y., Schaumans, Catherine, Schivinski, Bruno, Schmitt, Marcel C., Schnitker, Sarah A., Schnuerch, Martin, Schreiner, Marcel R., Schuttengruber, Victoria, Sebben, Simone, Segerstrom, Suzanne C., Seryczynska, Berenika, Shjoedt, Uffe, Simsek, Muge, Sleegers, Willem W. A., Smith, Eliot R., Sowden, Walter J., Spath, Marion, Sporlein, Christoph, Stedden, William, Stoevenbelt, Andrea H., Stuber, Simon, Sulik, Justin, Suwartono, Christiany, Syropoulos, Stylianos, Szaszi, Barnabas, Szecsi, Peter, Tappin, Ben M., Tay, Louis, Thibault, Robert T., Thompson, Burt, Thurn, Christian M., Torralba, Josefa, Tuthill, Shelby D., Ullein, Ann-Marie, Van Aert, Robbie C. M., van Assen, Marcel A. L. M., Van Cappellen, Patty, van den Akker, Olmo R., Van der Cruyssen, Ine, Van der Noll, Jolanda, van Dongen, Noah N. N., Van Lissa, Caspar J., van Mulukom, Valerie, van Ravenzwaaij, Don, van Zyl, Casper J. J., Vaughn, Leigh Ann, Verschuere, Bruno, Vianello, Michelangelo, Vilanova, Felipe, Vishkin, Allon, Vogel, Vera, Vogelsmeier, Leonie V. D. E., Watanabe, Shoko, White, Cindel J. M., Wiebels, Kristina, Wiechert, Sera, Willett, Zachary Z., Witkowiak, Maciej, Witvliet, Charlotte V. O., Wiwad, Dylan, Wuyts, Robin, Xygalatas, Dimitris, Yang, Xin, Yeo, Darren J., Yilmaz, Onurcan, Zarzeczna, Natalia, Zhao, Yitong, Zijlmans, Josjan, van Elk, Michiel, and Wagenmakers, Eric-Jan

Abstract

The relation between religiosity and well-being is one of the most researched topics in the psychology of religion, yet the directionality and robustness of the effect remains debated. Here, we adopted a many-analysts approach to assess the robustness of this relation based on a new cross-cultural dataset (N = 10, 535 participants from 24 countries). We recruited 120 analysis teams to investigate (1) whether religious people self-report higher well-being, and (2) whether the relation between religiosity and self-reported well-being depends on perceived cultural norms of religion (i.e., whether it is considered normal and desirable to be religious in a given country). In a two-stage procedure, the teams first created an analysis plan and then executed their planned analysis on the data. For the first research question, all but 3 teams reported positive effect sizes with credible/confidence intervals excluding zero (median reported beta = 0.120). For the second research question, this was the case for 65% of the teams (median reported beta = 0.039). While most teams applied (multilevel) linear regression models, there was considerable variability in the choice of items used to construct the independent variables, the dependent variable, and the included covariates.

Published
2023

11. Muslim Mass Shooters are Seen as Less Mentally Ill and More Motivated by Religion

Author

Mercier, Brett Gregory

Subjects
Psychology, Religion, Anti-Muslim Prejudice, Islam, Mass Shootings, Mental illness, Terrorism
Abstract

Objective: We test whether prejudice can influence lay attributions of mental illness to perpetrators of violence. Specifically, we examine whether people with negative attitudes towards Muslims perceive Muslim mass shooters as less mentally ill than non-Muslim shooters. Method: Study 1 compares attributions of mental illness to Muslim and non-Muslim perpetrators of recent mass shootings. Studies 2 and 3 experimentally test whether a mass shooter described in a news article is seen as less mentally ill when described as being a Muslim, compared to when described as a Christian (Study 2) and to when religion is not mentioned (Study 3). Study 4 tests whether a Muslim shooter is seen as less mentally ill than a Christian shooter, even when both shooters have symptoms of mental illness. Results: In all studies, Muslim shooters were seen as less mentally ill than non-Muslim shooters, but only by those with negative views towards Muslims. Conclusion: Those with anti-Muslim prejudices perceive Muslim mass shooters as less mentally ill, likely to maintain culpability and fit narratives about terrorism. This may reinforce anti-Muslim attitudes by leading those with anti-Muslim prejudice to overestimate the amount of violence inspired by groups like ISIS relative to extremist groups from other ideologies.

Published
2019

14. Data

Author

Wiwad, Dylan, Mercier, Brett, Robinson, Angela, Aknin, Lara, Shariff, Azim, and Piff, Paul

Published
2022
Full Text
View/download PDF

15. Materials

Author

Wiwad, Dylan, Mercier, Brett, Robinson, Angela, Aknin, Lara, Shariff, Azim, and Piff, Paul

Published
2022
Full Text
View/download PDF

20. A many-analysts approach to the relation between religiosity and well-being

Author

Hoogeveen, Suzanne, primary, Sarafoglou, Alexandra, additional, Aczel, Balazs, additional, Aditya, Yonathan, additional, Alayan, Alexandra J., additional, Allen, Peter J., additional, Altay, Sacha, additional, Alzahawi, Shilaan, additional, Amir, Yulmaida, additional, Anthony, Francis-Vincent, additional, Kwame Appiah, Obed, additional, Atkinson, Quentin D., additional, Baimel, Adam, additional, Balkaya-Ince, Merve, additional, Balsamo, Michela, additional, Banker, Sachin, additional, Bartoš, František, additional, Becerra, Mario, additional, Beffara, Bertrand, additional, Beitner, Julia, additional, Bendixen, Theiss, additional, Berkessel, Jana B., additional, Berniūnas, Renatas, additional, Billet, Matthew I., additional, Billingsley, Joseph, additional, Bortolini, Tiago, additional, Breitsohl, Heiko, additional, Bret, Amélie, additional, Brown, Faith L., additional, Brown, Jennifer, additional, Brumbaugh, Claudia C., additional, Buczny, Jacek, additional, Bulbulia, Joseph, additional, Caballero, Saúl, additional, Carlucci, Leonardo, additional, Carmichael, Cheryl L., additional, Cattaneo, Marco E. G. V., additional, Charles, Sarah J., additional, Claessens, Scott, additional, Panagopoulos, Maxinne C., additional, Costa, Angelo Brandelli, additional, Crone, Damien L., additional, Czoschke, Stefan, additional, Czymara, Christian, additional, D'Urso, E. Damiano, additional, Dahlström, Örjan, additional, Rosa, Anna Dalla, additional, Danielsson, Henrik, additional, De Ron, Jill, additional, de Vries, Ymkje Anna, additional, Dean, Kristy K., additional, Dik, Bryan J., additional, Disabato, David J., additional, Doherty, Jaclyn K., additional, Draws, Tim, additional, Drouhot, Lucas, additional, Dujmovic, Marin, additional, Dunham, Yarrow, additional, Ebert, Tobias, additional, Edelsbrunner, Peter A., additional, Eerland, Anita, additional, Elbaek, Christian T., additional, Farahmand, Shole, additional, Farahmand, Hooman, additional, Farias, Miguel, additional, Feliccia, Abrey A., additional, Fischer, Kyle, additional, Fischer, Ronald, additional, Fisher-Thompson, Donna, additional, Francis, Zoë, additional, Frick, Susanne, additional, Frisch, Lisa K., additional, Geraldes, Diogo, additional, Gerdin, Emily, additional, Geven, Linda, additional, Ghasemi, Omid, additional, Gielens, Erwin, additional, Gligorić, Vukašin, additional, Hagel, Kristin, additional, Hajdu, Nandor, additional, Hamilton, Hannah R., additional, Hamzah, Imaduddin, additional, Hanel, Paul H. P., additional, Hawk, Christopher E., additional, K. Himawan, Karel, additional, Holding, Benjamin C., additional, Homman, Lina E., additional, Ingendahl, Moritz, additional, Inkilä, Hilla, additional, Inman, Mary L., additional, Islam, Chris-Gabriel, additional, Isler, Ozan, additional, Izydorczyk, David, additional, Jaeger, Bastian, additional, Johnson, Kathryn A., additional, Jong, Jonathan, additional, Karl, Johannes A., additional, Kaszubowski, Erikson, additional, Katz, Benjamin A., additional, Keefer, Lucas A., additional, Kelchtermans, Stijn, additional, Kelly, John M., additional, Klein, Richard A., additional, Kleinberg, Bennett, additional, Knowles, Megan L., additional, Kołczyńska, Marta, additional, Koller, Dave, additional, Krasko, Julia, additional, Kritzler, Sarah, additional, Krypotos, Angelos-Miltiadis, additional, Kyritsis, Thanos, additional, L. Landes, Todd, additional, Laukenmann, Ruben, additional, Forsyth, Guy A. Lavender, additional, Lazar, Aryeh, additional, Lehman, Barbara J., additional, Levy, Neil, additional, Lo, Ronda F., additional, Lodder, Paul, additional, Lorenz, Jennifer, additional, Łowicki, Paweł, additional, Ly, Albert L., additional, Maassen, Esther, additional, Magyar-Russell, Gina M., additional, Maier, Maximilian, additional, Marsh, Dylan R., additional, Martinez, Nuria, additional, Martinie, Marcellin, additional, Martoyo, Ihan, additional, Mason, Susan E., additional, Mauritsen, Anne Lundahl, additional, McAleer, Phil, additional, McCauley, Thomas, additional, McCullough, Michael, additional, McKay, Ryan, additional, McMahon, Camilla M., additional, McNamara, Amelia A., additional, Means, Kira K., additional, Mercier, Brett, additional, Mitkidis, Panagiotis, additional, Monin, Benoît, additional, Moon, Jordan W., additional, Moreau, David, additional, Morgan, Jonathan, additional, Murphy, James, additional, Muscatt, George, additional, Nägel, Christof, additional, Nagy, Tamás, additional, Nalborczyk, Ladislas, additional, Nilsonne, Gustav, additional, Noack, Pamina, additional, Norenzayan, Ara, additional, Nuijten, Michèle B., additional, Olsson-Collentine, Anton, additional, Oviedo, Lluis, additional, Pavlov, Yuri G., additional, Pawelski, James O., additional, Pearson, Hannah I., additional, Pedder, Hugo, additional, Peetz, Hannah K., additional, Pinus, Michael, additional, Pirutinsky, Steven, additional, Polito, Vince, additional, Porubanova, Michaela, additional, Poulin, Michael J., additional, Prenoveau, Jason M., additional, Prince, Mark A., additional, Protzko, John, additional, Pryor, Campbell, additional, Purzycki, Benjamin G., additional, Qiu, Lin, additional, Pütter, Julian Quevedo, additional, Rabelo, André, additional, Radell, Milen L., additional, Ramsay, Jonathan E., additional, Reid, Graham, additional, J. Roberts, Andrew, additional, Luna, Lindsey M. Root, additional, Ross, Robert M., additional, Roszak, Piotr, additional, Roy, Nirmal, additional, Saarelainen, Suvi-Maria K., additional, Sasaki, Joni Y., additional, Schaumans, Catherine, additional, Schivinski, Bruno, additional, Schmitt, Marcel C., additional, Schnitker, Sarah A., additional, Schnuerch, Martin, additional, Schreiner, Marcel R., additional, Schüttengruber, Victoria, additional, Sebben, Simone, additional, Segerstrom, Suzanne C., additional, Seryczyńska, Berenika, additional, Shjoedt, Uffe, additional, Simsek, Müge, additional, Sleegers, Willem W. A., additional, Smith, Eliot R., additional, Sowden, Walter J., additional, Späth, Marion, additional, Spörlein, Christoph, additional, Stedden, William, additional, Stoevenbelt, Andrea H., additional, Stuber, Simon, additional, Sulik, Justin, additional, Suwartono, Christiany, additional, Syropoulos, Stylianos, additional, Szaszi, Barnabas, additional, Szecsi, Peter, additional, Tappin, Ben M., additional, Tay, Louis, additional, Thibault, Robert T., additional, Thompson, Burt, additional, Thurn, Christian M., additional, Torralba, Josefa, additional, Tuthill, Shelby D., additional, Ullein, Ann-Marie, additional, Van Aert, Robbie C. M., additional, van Assen, Marcel A. L. M., additional, Van Cappellen, Patty, additional, van den Akker, Olmo R., additional, Van der Cruyssen, Ine, additional, Van der Noll, Jolanda, additional, van Dongen, Noah N. N., additional, Van Lissa, Caspar J., additional, van Mulukom, Valerie, additional, van Ravenzwaaij, Don, additional, van Zyl, Casper J. J., additional, Ann Vaughn, Leigh, additional, Većkalov, Bojana, additional, Verschuere, Bruno, additional, Vianello, Michelangelo, additional, Vilanova, Felipe, additional, Vishkin, Allon, additional, Vogel, Vera, additional, Vogelsmeier, Leonie V. D. E., additional, Watanabe, Shoko, additional, White, Cindel J. M., additional, Wiebels, Kristina, additional, Wiechert, Sera, additional, Willett, Zachary Z., additional, Witkowiak, Maciej, additional, Witvliet, Charlotte V. O., additional, Wiwad, Dylan, additional, Wuyts, Robin, additional, Xygalatas, Dimitris, additional, Yang, Xin, additional, Yeo, Darren J., additional, Yilmaz, Onurcan, additional, Zarzeczna, Natalia, additional, Zhao, Yitong, additional, Zijlmans, Josjan, additional, van Elk, Michiel, additional, and Wagenmakers, Eric-Jan, additional

Published
2022
Full Text
View/download PDF

22. A many-analysts approach to the relation between religiosity and well-being

Author

Hoogeveen, Suzanne, Sarafoglou, Alexandra, Aczel, Balazs, Aditya, Yonathan, Alayan, Alexandra J., Allen, Peter J., Altay, Sacha, Alzahawi, Shilaan, Amir, Yulmaida, Anthony, Francis-Vincent, Appiah, Obed Kwame, Atkinson, Quentin D., Baimel, Adam, Balkaya-Ince, Merve, Balsamo, Michela, Banker, Sachin, Bartos, Frantisek, Becerra, Mario, Beffara, Bertrand, Beitner, Julia, Bendixen, Theiss, Berkessel, Jana B., Berniunas, Renatas, Billet, Matthew, Billingsley, Joseph, Bortolini, Tiago, Breitsohl, Heiko, Bret, Amelie, Brown, Faith L., Brown, Jennifer, Brumbaugh, Claudia C., Buczny, Jacek, Bulbulia, Joseph, Caballero, Saul, Carlucci, Leonardo, Carmichael, Cheryl L., Cattaneo, Marco E. G., Charles, Sarah J., Claessens, Scott, Panagopoulos, Maxinne C., Costa, Angelo Brandelli, Crone, Damien L., Czoschke, Stefan, Czymara, Christian, D'Urso, E. Damiano, Dahlstrom, Orjan, Dalla Rosa, Anna, Danielsson, Henrik, De Ron, Jill, de Vries, Ymkje Anna, Dean, Kristy K., Dik, Bryan J., Disabato, David J., Doherty, Jaclyn K., Draws, Tim, Drouhot, Lucas, Dujmovic, Marin, Dunham, Yarrow, Ebert, Tobias, Edelsbrunner, Peter A., Eerland, Anita, Elbaek, Christian T., Farahmand, Shole, Farahmand, Hooman, Farias, Miguel, Feliccia, Abrey A., Fischer, Kyle, Fischer, Ronald, Fisher-Thompson, Donna, Francis, Zoe, Frick, Susanne, Frisch, Lisa K., Geraldes, Diogo, Gerdin, Emily, Geven, Linda, Ghasemi, Omid, Gielens, Erwin, Gligoric, Vukasin, Hagel, Kristin, Hajdu, Nandor, Hamilton, Hannah R., Hamzah, Imaduddin, Hanel, Paul H. P., Hawk, Christopher E., Himawan, Karel K., Holding, Benjamin C., Homman, Lina E., Ingendahl, Moritz, Inkila, Hilla, Inman, Mary L., Islam, Chris-Gabriel, Isler, Ozan, Izydorczyk, David, Jaeger, Bastian, Johnson, Kathryn A., Jong, Jonathan, Karl, Johannes A., Kaszubowski, Erikson, Katz, Benjamin A., Keefer, Lucas A., Kelchtermans, Stijn, Kelly, John M., Klein, Richard A., Kleinberg, Bennett, Knowles, Megan L., Kolczynska, Marta, Koller, Dave, Krasko, Julia, Kritzler, Sarah, Krypotos, Angelos-Miltiadis, Kyritsis, Thanos, Landes, Todd L., Laukenmann, Ruben, Forsyth, Guy A. Lavender, Lazar, Aryeh, Lehman, Barbara J., Levy, Neil, Lo, Ronda F., Lodder, Paul, Lorenz, Jennifer, Lowicki, Pawel, Ly, Albert L., Maassen, Esther, Magyar-Russell, Gina M., Maier, Maximilian, Marsh, Dylan R., Martinez, Nuria, Martinie, Marcellin, Martoyo, Ihan, Mason, Susan E., Mauritsen, Anne Lundahl, McAleer, Phil, McCauley, Thomas, McCullough, Michael, McKay, Ryan, McMahon, Camilla M., McNamara, Amelia A., Means, Kira K., Mercier, Brett, Mitkidis, Panagiotis, Monin, Benoit, Moon, Jordan W., Moreau, David, Morgan, Jonathan, Murphy, James, Muscatt, George, Nagel, Christof, Nagy, Tamas, Nalborczyk, Ladislas, Nilsonne, Gustav, Noack, Pamina, Norenzayan, Ara, Nuijten, Michele B., Olsson-Collentine, Anton, Oviedo, Lluis, Pavlov, Yuri G., Pawelski, James O., Pearson, Hannah, Pedder, Hugo, Peetz, Hannah K., Pinus, Michael, Pirutinsky, Steven, Polito, Vince, Porubanova, Michaela, Poulin, Michael J., Prenoveau, Jason M., Prince, Mark A., Protzko, John, Pryor, Campbell, Purzycki, Benjamin G., Qiu, Lin, Putter, Julian Quevedo, Rabelo, Andre, Radell, Milen L., Ramsay, Jonathan E., Reid, Graham, Roberts, Andrew J., Luna, Lindsey M. Root, Ross, Robert M., Roszak, Piotr, Roy, Nirmal, Saarelainen, Suvi-Maria K., Sasaki, Joni Y., Schaumans, Catherine, Schivinski, Bruno, Schmitt, Marcel C., Schnitker, Sarah A., Schnuerch, Martin, Schreiner, Marcel R., Schuttengruber, Victoria, Sebben, Simone, Segerstrom, Suzanne C., Seryczynska, Berenika, Shjoedt, Uffe, Simsek, Muge, Sleegers, Willem W. A., Smith, Eliot R., Sowden, Walter J., Spath, Marion, Sporlein, Christoph, Stedden, William, Stoevenbelt, Andrea H., Stuber, Simon, Sulik, Justin, Suwartono, Christiany, Syropoulos, Stylianos, Szaszi, Barnabas, Szecsi, Peter, Tappin, Ben M., Tay, Louis, Thibault, Robert T., Thompson, Burt, Thurn, Christian M., Torralba, Josefa, Tuthill, Shelby D., Ullein, Ann-Marie, Van Aert, Robbie C. M., van Assen, Marcel A. L. M., Van Cappellen, Patty, van den Akker, Olmo R., Van der Cruyssen, Ine, Van der Noll, Jolanda, van Dongen, Noah N. N., Van Lissa, Caspar J., van Mulukom, Valerie, van Ravenzwaaij, Don, van Zyl, Casper J. J., Vaughn, Leigh Ann, Verschuere, Bruno, Vianello, Michelangelo, Vilanova, Felipe, Vishkin, Allon, Vogel, Vera, Vogelsmeier, Leonie V. D. E., Watanabe, Shoko, White, Cindel J. M., Wiebels, Kristina, Wiechert, Sera, Willett, Zachary Z., Witkowiak, Maciej, Witvliet, Charlotte V. O., Wiwad, Dylan, Wuyts, Robin, Xygalatas, Dimitris, Yang, Xin, Yeo, Darren J., Yilmaz, Onurcan, Zarzeczna, Natalia, Zhao, Yitong, Zijlmans, Josjan, van Elk, Michiel, Wagenmakers, Eric-Jan, Hoogeveen, Suzanne, Sarafoglou, Alexandra, Aczel, Balazs, Aditya, Yonathan, Alayan, Alexandra J., Allen, Peter J., Altay, Sacha, Alzahawi, Shilaan, Amir, Yulmaida, Anthony, Francis-Vincent, Appiah, Obed Kwame, Atkinson, Quentin D., Baimel, Adam, Balkaya-Ince, Merve, Balsamo, Michela, Banker, Sachin, Bartos, Frantisek, Becerra, Mario, Beffara, Bertrand, Beitner, Julia, Bendixen, Theiss, Berkessel, Jana B., Berniunas, Renatas, Billet, Matthew, Billingsley, Joseph, Bortolini, Tiago, Breitsohl, Heiko, Bret, Amelie, Brown, Faith L., Brown, Jennifer, Brumbaugh, Claudia C., Buczny, Jacek, Bulbulia, Joseph, Caballero, Saul, Carlucci, Leonardo, Carmichael, Cheryl L., Cattaneo, Marco E. G., Charles, Sarah J., Claessens, Scott, Panagopoulos, Maxinne C., Costa, Angelo Brandelli, Crone, Damien L., Czoschke, Stefan, Czymara, Christian, D'Urso, E. Damiano, Dahlstrom, Orjan, Dalla Rosa, Anna, Danielsson, Henrik, De Ron, Jill, de Vries, Ymkje Anna, Dean, Kristy K., Dik, Bryan J., Disabato, David J., Doherty, Jaclyn K., Draws, Tim, Drouhot, Lucas, Dujmovic, Marin, Dunham, Yarrow, Ebert, Tobias, Edelsbrunner, Peter A., Eerland, Anita, Elbaek, Christian T., Farahmand, Shole, Farahmand, Hooman, Farias, Miguel, Feliccia, Abrey A., Fischer, Kyle, Fischer, Ronald, Fisher-Thompson, Donna, Francis, Zoe, Frick, Susanne, Frisch, Lisa K., Geraldes, Diogo, Gerdin, Emily, Geven, Linda, Ghasemi, Omid, Gielens, Erwin, Gligoric, Vukasin, Hagel, Kristin, Hajdu, Nandor, Hamilton, Hannah R., Hamzah, Imaduddin, Hanel, Paul H. P., Hawk, Christopher E., Himawan, Karel K., Holding, Benjamin C., Homman, Lina E., Ingendahl, Moritz, Inkila, Hilla, Inman, Mary L., Islam, Chris-Gabriel, Isler, Ozan, Izydorczyk, David, Jaeger, Bastian, Johnson, Kathryn A., Jong, Jonathan, Karl, Johannes A., Kaszubowski, Erikson, Katz, Benjamin A., Keefer, Lucas A., Kelchtermans, Stijn, Kelly, John M., Klein, Richard A., Kleinberg, Bennett, Knowles, Megan L., Kolczynska, Marta, Koller, Dave, Krasko, Julia, Kritzler, Sarah, Krypotos, Angelos-Miltiadis, Kyritsis, Thanos, Landes, Todd L., Laukenmann, Ruben, Forsyth, Guy A. Lavender, Lazar, Aryeh, Lehman, Barbara J., Levy, Neil, Lo, Ronda F., Lodder, Paul, Lorenz, Jennifer, Lowicki, Pawel, Ly, Albert L., Maassen, Esther, Magyar-Russell, Gina M., Maier, Maximilian, Marsh, Dylan R., Martinez, Nuria, Martinie, Marcellin, Martoyo, Ihan, Mason, Susan E., Mauritsen, Anne Lundahl, McAleer, Phil, McCauley, Thomas, McCullough, Michael, McKay, Ryan, McMahon, Camilla M., McNamara, Amelia A., Means, Kira K., Mercier, Brett, Mitkidis, Panagiotis, Monin, Benoit, Moon, Jordan W., Moreau, David, Morgan, Jonathan, Murphy, James, Muscatt, George, Nagel, Christof, Nagy, Tamas, Nalborczyk, Ladislas, Nilsonne, Gustav, Noack, Pamina, Norenzayan, Ara, Nuijten, Michele B., Olsson-Collentine, Anton, Oviedo, Lluis, Pavlov, Yuri G., Pawelski, James O., Pearson, Hannah, Pedder, Hugo, Peetz, Hannah K., Pinus, Michael, Pirutinsky, Steven, Polito, Vince, Porubanova, Michaela, Poulin, Michael J., Prenoveau, Jason M., Prince, Mark A., Protzko, John, Pryor, Campbell, Purzycki, Benjamin G., Qiu, Lin, Putter, Julian Quevedo, Rabelo, Andre, Radell, Milen L., Ramsay, Jonathan E., Reid, Graham, Roberts, Andrew J., Luna, Lindsey M. Root, Ross, Robert M., Roszak, Piotr, Roy, Nirmal, Saarelainen, Suvi-Maria K., Sasaki, Joni Y., Schaumans, Catherine, Schivinski, Bruno, Schmitt, Marcel C., Schnitker, Sarah A., Schnuerch, Martin, Schreiner, Marcel R., Schuttengruber, Victoria, Sebben, Simone, Segerstrom, Suzanne C., Seryczynska, Berenika, Shjoedt, Uffe, Simsek, Muge, Sleegers, Willem W. A., Smith, Eliot R., Sowden, Walter J., Spath, Marion, Sporlein, Christoph, Stedden, William, Stoevenbelt, Andrea H., Stuber, Simon, Sulik, Justin, Suwartono, Christiany, Syropoulos, Stylianos, Szaszi, Barnabas, Szecsi, Peter, Tappin, Ben M., Tay, Louis, Thibault, Robert T., Thompson, Burt, Thurn, Christian M., Torralba, Josefa, Tuthill, Shelby D., Ullein, Ann-Marie, Van Aert, Robbie C. M., van Assen, Marcel A. L. M., Van Cappellen, Patty, van den Akker, Olmo R., Van der Cruyssen, Ine, Van der Noll, Jolanda, van Dongen, Noah N. N., Van Lissa, Caspar J., van Mulukom, Valerie, van Ravenzwaaij, Don, van Zyl, Casper J. J., Vaughn, Leigh Ann, Verschuere, Bruno, Vianello, Michelangelo, Vilanova, Felipe, Vishkin, Allon, Vogel, Vera, Vogelsmeier, Leonie V. D. E., Watanabe, Shoko, White, Cindel J. M., Wiebels, Kristina, Wiechert, Sera, Willett, Zachary Z., Witkowiak, Maciej, Witvliet, Charlotte V. O., Wiwad, Dylan, Wuyts, Robin, Xygalatas, Dimitris, Yang, Xin, Yeo, Darren J., Yilmaz, Onurcan, Zarzeczna, Natalia, Zhao, Yitong, Zijlmans, Josjan, van Elk, Michiel, and Wagenmakers, Eric-Jan

Abstract

The relation between religiosity and well-being is one of the most researched topics in the psychology of religion, yet the directionality and robustness of the effect remains debated. Here, we adopted a many-analysts approach to assess the robustness of this relation based on a new cross-cultural dataset (N = 10, 535 participants from 24 countries). We recruited 120 analysis teams to investigate (1) whether religious people self-report higher well-being, and (2) whether the relation between religiosity and self-reported well-being depends on perceived cultural norms of religion (i.e., whether it is considered normal and desirable to be religious in a given country). In a two-stage procedure, the teams first created an analysis plan and then executed their planned analysis on the data. For the first research question, all but 3 teams reported positive effect sizes with credible/confidence intervals excluding zero (median reported beta = 0.120). For the second research question, this was the case for 65% of the teams (median reported beta = 0.039). While most teams applied (multilevel) linear regression models, there was considerable variability in the choice of items used to construct the independent variables, the dependent variable, and the included covariates.

Published
2022

25. Overestimating Reported Prejudice Causes Democrats to Believe Disadvantaged Groups Are Less Electable.

Author

Mercier, Brett, Celniker, Jared B., and Shariff, Azim F.

Subjects
*DEMOCRATS (United States), *PREJUDICES, *PRIMARIES, *PRESIDENTIAL candidates, *POLITICAL psychology
Abstract

Four studies show that Democrats overestimate the explicit prejudice reported by the American electorate, leading them to perceive presidential candidates from disadvantaged groups as less electable. Study 1 (MTurk; n = 728) found that Democrats overestimated the percentage of Americans who say they would not vote for presidential candidates from disadvantaged groups. Study 2 (MTurk; n = 597) replicated this finding and demonstrated that Democrats who perceive high levels of explicit prejudice toward a group also believe presidential candidates from that group are less electable. Moreover, Democrats who more frequently interacted with Republicans were more accurate in estimating the amount of explicit prejudice reported by Republicans, Democrats, and Americans in general. Studies 3A (Prolific; n = 930) and 3B (YouGov; n = 747) found that presenting information about true levels of reported prejudice made Democrats believe generic presidential candidates from disadvantaged groups would be more electable. We did not find evidence that information about true levels of reported prejudice affected Democrats' beliefs about the electability of specific candidates in the 2020 Democratic Primary or their support for these candidates. [ABSTRACT FROM AUTHOR]

Published
2023
Full Text
View/download PDF

28. Crowdsourcing hypothesis tests:Making transparent how design choices shape research results

Author

Landy, Justin F., Miaolei (Liam) Jia, Isabel, Ding, Domenico, Viganola, Warren, Tierney, Anna, Dreber, Magnus, Johannesson, Thomas, Pfeiffer, Ebersole, Charles R., Gronau, Quentin F., Alexander, Ly, Don van den Bergh, Maarten, Marsman, Eric-Jan, Wagenmakers, Bartels, Daniel M., Bauman, Christopher W., William, Brady, Felix, Cheung, Andrei, Cimpian, Simone, Dohle, Brent Donnellan, M., Adam, Hahn, Michael, Hall, William, Jiménez-Leal, Johnson, David J., Lucas, Richard E., Benoît, Monin, Andres, Montealegre, Elizabeth, Mullen, Jun, Pang, Jennifer, Ray, Reinero, Diego A., Jesse, Reynolds, Walter, Sowden, Daniel, Storage, Runkun, Su, Tworek, Christina M., Van Bavel, Jay J., Daniel, Walco, Julian, Wills, Xiaobing, Xu, Kai Chi Yam, Xiaoyu, Yang, Martin, Schweinsberg, Molly, Urwitz, Matúš, Adamkovič, Ravin, Alaei, Albers, Casper J., Aurélien, Allard, Anderson, Ian A., Andreychik, Michael R., Peter, Babinčák, Baker, Bradley J., Gabriel, Baník, Ernest, Baskin, Jozef, Bavolar, Berkers, Ruud M. W. J., Michał, Białek, Joel, Blanke, Johannes, Breuer, Ambra, Brizi, Brown, Stephanie E. V., Florian, Brühlmann, Hendrik, Bruns, Leigh, Caldwell, Jean-François, Campourcy, Chan, Eugene Y., Yen-Ping, Chang, Cheung, Benjamin Y., Alycia, Chin, Cho, Kit W., Simon, Columbus, Paul, Conway, Corretti, Conrad A., Craig, Adam W., Curran, Paul G., Danvers, Alexander F., Dawson, Ian G. J., Day, Martin V., Erik, Dietl, Doerflinger, Johannes T., Alice, Dominici, Vilius, Dranseika, Edelsbrunner, Peter A., Edlund, John E., Matthew, Fisher, Anna, Fung, Oliver, Genschow, Timo, Gnambs, Goldberg, Matthew H., Lorenz, Graf-Vlachy, Hafenbrack, Andrew C., Sebastian, Hafenbrädl, Andree, Hartanto, Heck, Patrick R., Heffner, Joseph P., Joseph, Hilgard, Felix, Holzmeister, Horchak, Oleksandr V., Huang, Tina S. -T., Joachim, Hüffmeier, Sean, Hughes, Ian, Hussey, Roland, Imhoff, Bastian, Jaeger, Konrad, Jamro, Johnson, Samuel G. B., Andrew, Jones, Lucas, Keller, Olga, Kombeiz, Krueger, Lacy E., Anthony, Lantian, Laplante, Justin P., Lazarevic, Ljiljana B., Jonathan, Leclerc, Nicole, Legate, Leonhardt, James M., Leung, Desmond W., Levitan, Carmel A., Hause, Lin, Qinglan, Liu, Marco Tullio Liuzza, Locke, Kenneth D., Albert L., Ly, Maceacheron, Melanie D., Madan, Christopher R., Harry, Manley, Silvia, Mari, Marcel, Martončik, Mclean, Scott L., Jonathon, Mcphetres, Mercier, Brett G., Corinna, Michels, Mullarkey, Michael C., Musser, Erica D., Ladislas, Nalborczyk, Gustav, Nilsonne, Otis, Nicholas G., Otner, Sarah M. G., Otto, Philipp E., Oscar, Oviedo-Trespalacios, Mariola Paruzel- Czachura, Francesco, Pellegrini, Pereira, Vitor M. D., Hannah, Perfecto, Gerit, Pfuhl, Phillips, Mark H., Ori, Plonsky, Pozzi, Maura, Purić, Danka B., Brett, Raymond-Barker, Redman, David E., Reynolds, Caleb J., Ivan, Ropovik, Lukas, Röseler, Ruessmann, Janna K., Ryan, William H., Nika, Sablaturova, Schuepfer, Kurt J., Astrid, Schütz, Miroslav, Sirota, Matthias, Stefan, Stocks, Eric L., Strosser, Garrett L., Suchow, Jordan W., Anna, Szabelska, Tey, Kian-Siong S., Leonid, Tiokhin, Jais, Troian, Till, Utesch, Alejandro, Vásquez-Echeverría, Leigh Ann Vaughn, Mark, Verschoor, Bettina von Helversen, Pascal, Wallisch, Weissgerber, Sophia C., Wichman, Aaron L., Woike, Jan K., Iris, Žeželj, Zickfeld, Janis H., Yeonsin, Ahn, Blaettchen, Philippe F., Kang, Xi, Yoo Jin Lee, Parker, Philip M., Parker, Paul A., Song, Jamie S., May-Anne, Very, Lynn, Wong, Uhlmann, Eric L., Psychometrics and Statistics, The Crowdsourcing Hypothesis Tests Collaboration [Member of the MPIB: Jan K. Woike], Laboratoire Parisien de Psychologie Sociale (LAPPS), Université Paris Nanterre (UPN)-Université Paris 8 Vincennes-Saint-Denis (UP8), Human Technology Interaction, Psychologische Methodenleer (Psychologie, FMG), Psychology Other Research (FMG), Université Paris 8 Vincennes-Saint-Denis (UP8)-Université Paris Nanterre (UPN), Organizational Psychology, Department of Social Psychology, Landy, J, Jia, M, Ding, I, Viganola, D, Tierney, W, Dreber, A, Johannesson, M, Pfeiffer, T, Ebersole, C, Gronau, Q, Ly, A, van den Bergh, D, Marsman, M, Derks, K, Wagenmakers, E, Proctor, A, Bartels, D, Bauman, C, Brady, W, Cheung, F, Cimpian, A, Dohle, S, Donnellan, M, Hahn, A, Hall, M, Jiménez-Leal, W, Johnson, D, Lucas, R, Monin, B, Montealegre, A, Mullen, E, Pang, J, Ray, J, Reinero, D, Reynolds, J, Sowden, W, Storage, D, Su, R, Tworek, C, Van Bavel, J, Walco, D, Wills, J, Xu, X, Yam, K, Yang, X, Cunningham, W, Schweinsberg, M, Urwitz, M, The Crowdsourcing Hypothesis Tests, C, Uhlmann, E, Mari, S, and Imperial College London

Subjects
Research design, 1ST OFFERS, 1702 Cognitive Sciences, Social Sciences, 050109 social psychology, Ciências Sociais::Psicologia [Domínio/Área Científica], CONCEPTUAL REPLICATIONS, Random Allocation, Empirical research, Crowdsourcing Hypothesis Tests Collaboration, Psychology, research robustness, Psychology(all), General Psychology, ComputingMilieux_MISCELLANEOUS, Marketing, 05 social sciences, SCIENCE, Settore M-PSI/05 - PSICOLOGIA SOCIALE, scientific transparency, Research Design, VDP::Samfunnsvitenskap: 200::Psykologi: 260, [SCCO.PSYC]Cognitive science/Psychology, Crowdsourcing, Cognitive Sciences, crowdsourcing, Cognitive psychology, Adult, replication, Conceptual replications, Social Psychology, Implicit cognition, VDP::Social science: 200::Psychology: 260, Bayesian probability, forecasting, stimulus sampling, INDIVIDUAL-DIFFERENCES, Scientific transparency, Consistency (negotiation), History and Philosophy of Science, Psychology, Multidisciplinary, IMPLICIT, Humans, conceptual replications, crowdsourcing, forecasting, research robustness, scientific transparency, 0501 psychology and cognitive sciences, ATTITUDES, 1505 Marketing, METAANALYSIS, M-PSI/05 - PSICOLOGIA SOCIALE, Statistical hypothesis testing, CONSEQUENCES, business.industry, Crowdsourced testing, SOCIAL-PSYCHOLOGY, M-PSI/03 - PSICOMETRIA, 1701 Psychology, REPLICABILITY, Research robustness, business, Forecasting
Abstract

©American Psychological Association, 2020. This paper is not the copy of record and may not exactly replicate the authoritative document published in the APA journal. Please do not copy or cite without author's permission. The final article is available, upon publication, at: https://doi.apa.org/doi/10.1037/bul0000220 To what extent are research results influenced by subjective decisions that scientists make as they design studies? Fifteen research teams independently designed studies to answer five original research questions related to moral judgments, negotiations, and implicit cognition. Participants from 2 separate large samples (total N 15,000) were then randomly assigned to complete 1 version of each study. Effect sizes varied dramatically across different sets of materials designed to test the same hypothesis: Materials from different teams rendered statistically significant effects in opposite directions for 4 of 5 hypotheses, with the narrowest range in estimates being d = 0.37 to 0.26. Meta-analysis and a Bayesian perspective on the results revealed overall support for 2 hypotheses and a lack of support for 3 hypotheses. Overall, practically none of the variability in effect sizes was attributable to the skill of the research team in designing materials, whereas considerable variability was attributable to the hypothesis being tested. In a forecasting survey, predictions of other scientists were significantly correlated with study results, both across and within hypotheses. Crowdsourced testing of research hypotheses helps reveal the true consistency of empirical support for a scientific claim.

Published
2020

29. Chartier_Rev_Open_Practices_Disclosure – Supplemental material for Many Labs 5: Registered Replication of Albarracín et al. (2008), Experiment 5

Author

Chartier, Christopher R., Arnal, Jack D., Arrow, Holly, Bloxsom, Nicholas G., Bonfiglio, Diane B. V., Brumbaugh, Claudia C., Corker, Katherine S., Ebersole, Charles R., Garinther, Alexander, Giessner, Steffen R., Hughes, Sean, Inzlicht, Michael, Hause Lin, Mercier, Brett, Metzger, Mitchell, Rangel, Derek, Saunders, Blair, Schmidt, Kathleen, Storage, Daniel, and Tocco, Carly

Subjects
FOS: Psychology, FOS: Clinical medicine, 170199 Psychology not elsewhere classified, 110319 Psychiatry (incl. Psychotherapy)
Abstract

Supplemental material, Chartier_Rev_Open_Practices_Disclosure for Many Labs 5: Registered Replication of Albarracín et al. (2008), Experiment 5 by Christopher R. Chartier, Jack D. Arnal, Holly Arrow, Nicholas G. Bloxsom, Diane B. V. Bonfiglio, Claudia C. Brumbaugh, Katherine S. Corker, Charles R. Ebersole, Alexander Garinther, Steffen R. Giessner, Sean Hughes, Michael Inzlicht, Hause Lin, Brett Mercier, Mitchell Metzger, Derek Rangel, Blair Saunders, Kathleen Schmidt, Daniel Storage and Carly Tocco in Advances in Methods and Practices in Psychological Science

Published
2020
Full Text
View/download PDF

30. ML5_Overview_Open_Practices_Disclosure_Rev – Supplemental material for Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability

Author

Ebersole, Charles R., Mathur, Maya B., Baranski, Erica, Diane-Jo Bart-Plange, Buttrick, Nicholas R., Chartier, Christopher R., Corker, Katherine S., Corley, Martin, Hartshorne, Joshua K., IJzerman, Hans, Lazarević, Ljiljana B., Rabagliati, Hugh, Ropovik, Ivan, Balazs Aczel, Aeschbach, Lena F., Andrighetto, Luca, Arnal, Jack D., Arrow, Holly, Babincak, Peter, Bakos, Bence E., Baník, Gabriel, Baskin, Ernest, Belopavlović, Radomir, Bernstein, Michael H., Michał Białek, Bloxsom, Nicholas G., Bodroža, Bojana, Bonfiglio, Diane B. V., Boucher, Leanne, Brühlmann, Florian, Brumbaugh, Claudia C., Casini, Erica, Yiling Chen, Chiorri, Carlo, Chopik, William J., Christ, Oliver, Ciunci, Antonia M., Claypool, Heather M., Coary, Sean, Čolić, Marija V., W. Matthew Collins, Curran, Paul G., Day, Chris R., Dering, Benjamin, Dreber, Anna, Edlund, John E., Falcão, Filipe, Fedor, Anna, Feinberg, Lily, Ferguson, Ian R., Ford, Máire, Frank, Michael C., Fryberger, Emily, Garinther, Alexander, Gawryluk, Katarzyna, Ashbaugh, Kayla, Giacomantonio, Mauro, Giessner, Steffen R., Grahe, Jon E., Guadagno, Rosanna E., Hałasa, Ewa, Hancock, Peter J. B., Rias A. Hilliard, Hüffmeier, Joachim, Hughes, Sean, Idzikowska, Katarzyna, Inzlicht, Michael, Jern, Alan, Jiménez-Leal, William, Johannesson, Magnus, Joy-Gaba, Jennifer A., Kauff, Mathias, Kellier, Danielle J., Grecia Kessinger, Kidwell, Mallory C., Kimbrough, Amanda M., King, Josiah P. J., Kolb, Vanessa S., Kołodziej, Sabina, Marton Kovacs, Krasuska, Karolina, Kraus, Sue, Krueger, Lacy E., Kuchno, Katarzyna, Lage, Caio Ambrosio, Langford, Eleanor V., Levitan, Carmel A., Lima, Tiago Jessé Souza De, Hause Lin, Lins, Samuel, Loy, Jia E., Manfredi, Dylan, Łukasz Markiewicz, Menon, Madhavi, Mercier, Brett, Metzger, Mitchell, Meyet, Venus, Millen, Ailsa E., Miller, Jeremy K., Montealegre, Andres, Moore, Don A., Rafał Muda, Nave, Gideon, Nichols, Austin Lee, Novak, Sarah A., Nunnally, Christian, Orlić, Ana, Palinkas, Anna, Panno, Angelo, Parks, Kimberly P., Pedović, Ivana, Pękala, Emilian, Penner, Matthew R., Pessers, Sebastiaan, Petrović, Boban, Pfeiffer, Thomas, Pieńkosz, Damian, Preti, Emanuele, Purić, Danka, Ramos, Tiago, Ravid, Jonathan, Razza, Timothy S., Rentzsch, Katrin, Richetin, Juliette, Rife, Sean C., Rosa, Anna Dalla, Kaylis Hase Rudy, Janos Salamon, Saunders, Blair, Przemysław Sawicki, Schmidt, Kathleen, Schuepfer, Kurt, Schultze, Thomas, Schulz-Hardt, Stefan, Schütz, Astrid, Shabazian, Ani N., Shubella, Rachel L., Siegel, Adam, Rúben Silva, Sioma, Barbara, Skorb, Lauren, Souza, Luana Elayne Cunha De, Steegen, Sara, L. A. R. Stein, R. Weylin Sternglanz, Stojilović, Darko, Storage, Daniel, Sullivan, Gavin Brent, Szaszi, Barnabas, Szecsi, Peter, Szöke, Orsolya, Szuts, Attila, Thomae, Manuela, Tidwell, Natasha D., Tocco, Carly, Ann-Kathrin Torka, Tuerlinckx, Francis, Vanpaemel, Wolf, Vaughn, Leigh Ann, Vianello, Michelangelo, Viganola, Domenico, Vlachou, Maria, Walker, Ryan J., Weissgerber, Sophia C., Wichman, Aaron L., Wiggins, Bradford J., Wolf, Daniel, Wood, Michael J., Zealley, David, Žeželj, Iris, Zrubka, Mark, and Nosek, Brian A.

Subjects
FOS: Psychology, FOS: Clinical medicine, 170199 Psychology not elsewhere classified, 110319 Psychiatry (incl. Psychotherapy)
Abstract

Supplemental material, ML5_Overview_Open_Practices_Disclosure_Rev for Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability by Charles R. Ebersole, Maya B. Mathur, Erica Baranski, Diane-Jo Bart-Plange, Nicholas R. Buttrick, Christopher R. Chartier, Katherine S. Corker, Martin Corley, Joshua K. Hartshorne, Hans IJzerman, Ljiljana B. Lazarević, Hugh Rabagliati, Ivan Ropovik, Balazs Aczel, Lena F. Aeschbach, Luca Andrighetto, Jack D. Arnal, Holly Arrow, Peter Babincak, Bence E. Bakos, Gabriel Baník, Ernest Baskin, Radomir Belopavlović, Michael H. Bernstein, Michał Białek, Nicholas G. Bloxsom, Bojana Bodroža, Diane B. V. Bonfiglio, Leanne Boucher, Florian Brühlmann, Claudia C. Brumbaugh, Erica Casini, Yiling Chen, Carlo Chiorri, William J. Chopik, Oliver Christ, Antonia M. Ciunci, Heather M. Claypool, Sean Coary, Marija V. Čolić, W. Matthew Collins, Paul G. Curran, Chris R. Day, Benjamin Dering, Anna Dreber, John E. Edlund, Filipe Falcão, Anna Fedor, Lily Feinberg, Ian R. Ferguson, Máire Ford, Michael C. Frank, Emily Fryberger, Alexander Garinther, Katarzyna Gawryluk, Kayla Ashbaugh, Mauro Giacomantonio, Steffen R. Giessner, Jon E. Grahe, Rosanna E. Guadagno, Ewa Hałasa, Peter J. B. Hancock, Rias A. Hilliard, Joachim Hüffmeier, Sean Hughes, Katarzyna Idzikowska, Michael Inzlicht, Alan Jern, William Jiménez-Leal, Magnus Johannesson, Jennifer A. Joy-Gaba, Mathias Kauff, Danielle J. Kellier, Grecia Kessinger, Mallory C. Kidwell, Amanda M. Kimbrough, Josiah P. J. King, Vanessa S. Kolb, Sabina Kołodziej, Marton Kovacs, Karolina Krasuska, Sue Kraus, Lacy E. Krueger, Katarzyna Kuchno, Caio Ambrosio Lage, Eleanor V. Langford, Carmel A. Levitan, Tiago Jessé Souza de Lima, Hause Lin, Samuel Lins, Jia E. Loy, Dylan Manfredi, Łukasz Markiewicz, Madhavi Menon, Brett Mercier, Mitchell Metzger, Venus Meyet, Ailsa E. Millen, Jeremy K. Miller, Andres Montealegre, Don A. Moore, Rafał Muda, Gideon Nave, Austin Lee Nichols, Sarah A. Novak, Christian Nunnally, Ana Orlić, Anna Palinkas, Angelo Panno, Kimberly P. Parks, Ivana Pedović, Emilian Pękala, Matthew R. Penner, Sebastiaan Pessers, Boban Petrović, Thomas Pfeiffer, Damian Pieńkosz, Emanuele Preti, Danka Purić, Tiago Ramos, Jonathan Ravid, Timothy S. Razza, Katrin Rentzsch, Juliette Richetin, Sean C. Rife, Anna Dalla Rosa, Kaylis Hase Rudy, Janos Salamon, Blair Saunders, Przemysław Sawicki, Kathleen Schmidt, Kurt Schuepfer, Thomas Schultze, Stefan Schulz-Hardt, Astrid Schütz, Ani N. Shabazian, Rachel L. Shubella, Adam Siegel, Rúben Silva, Barbara Sioma, Lauren Skorb, Luana Elayne Cunha de Souza, Sara Steegen, L. A. R. Stein, R. Weylin Sternglanz, Darko Stojilović, Daniel Storage, Gavin Brent Sullivan, Barnabas Szaszi, Peter Szecsi, Orsolya Szöke, Attila Szuts, Manuela Thomae, Natasha D. Tidwell, Carly Tocco, Ann-Kathrin Torka, Francis Tuerlinckx, Wolf Vanpaemel, Leigh Ann Vaughn, Michelangelo Vianello, Domenico Viganola, Maria Vlachou, Ryan J. Walker, Sophia C. Weissgerber, Aaron L. Wichman, Bradford J. Wiggins, Daniel Wolf, Michael J. Wood, David Zealley, Iris Žeželj, Mark Zrubka and Brian A. Nosek in Advances in Methods and Practices in Psychological Science

Published
2020
Full Text
View/download PDF

31. Many Labs 5:Registered Replication of Albarracín et al. (2008), Experiment 5

Author

Chartier, Christopher R., Arnal, Jack D., Arrow, Holly, Bloxsom, Nicholas G., Bonfiglio, Diane B.V., Brumbaugh, Claudia C., Corker, Katherine S., Ebersole, Charles R., Garinther, Alexander, Giessner, Steffen R., Hughes, Sean, Inzlicht, Michael, Lin, Hause, Mercier, Brett, Metzger, Mitchell, Rangel, Derek, Saunders, Blair, Schmidt, Kathleen, Storage, Daniel, Tocco, Carly, Chartier, Christopher R., Arnal, Jack D., Arrow, Holly, Bloxsom, Nicholas G., Bonfiglio, Diane B.V., Brumbaugh, Claudia C., Corker, Katherine S., Ebersole, Charles R., Garinther, Alexander, Giessner, Steffen R., Hughes, Sean, Inzlicht, Michael, Lin, Hause, Mercier, Brett, Metzger, Mitchell, Rangel, Derek, Saunders, Blair, Schmidt, Kathleen, Storage, Daniel, and Tocco, Carly

Abstract

In Experiment 5 of Albarracín et al. (2008), participants primed with words associated with action performed better on a subsequent cognitive task than did participants primed with words associated with inaction. A direct replication attempt by Frank, Kim, and Lee (2016) as part of the Reproducibility Project: Psychology (RP:P) failed to find evidence for this effect. In this article, we discuss several potential explanations for these discrepant findings: the source of participants (Amazon’s Mechanical Turk vs. traditional undergraduate-student pool), the setting of participation (online vs. in lab), and the possible moderating role of affect. We tested Albarracín et al.’s original hypothesis in two new samples: For the first sample, we followed the protocol developed by Frank et al. and recruited participants via Amazon’s Mechanical Turk (n = 580). For the second sample, we used a revised protocol incorporating feedback from the original authors and recruited participants from eight universities (n = 884). We did not detect moderation by protocol; patterns in the revised protocol resembled those in our implementation of the RP:P protocol, but the estimate of the focal effect size was smaller than that found originally by Albarracín et al. and larger than that found in Frank et al.’s replication attempt. We discuss these findings and possible explanations.

Published
2020

32. Crowdsourcing hypothesis tests: Making transparent how design choices shape research results

Author

Landy, Justin F., (Liam) Jia, Miaolei, Ding, Isabel, Viganola, Domenico, Tierney, Warren, Dreber, Anna, Johannesson, Magnu, Pfeiffer, Thoma, Ebersole, Charles R., Gronau, Quentin F., Ly, Alexander, van den Bergh, Don, Marsman, Maarten, Wagenmakers, Eric-Jan, Bartels, Daniel M., Bauman, Christopher W., Brady, William, Cheung, Felix, Cimpian, Andrei, Dohle, Simone, Brent Donnellan, M., Hahn, Adam, Hall, Michael, Jiménez-Leal, William, Johnson, David J., Lucas, Richard E., Monin, Benoît, Montealegre, Andre, Mullen, Elizabeth, Pang, Jun, Ray, Jennifer, Reinero, Diego A., Reynolds, Jesse, Sowden, Walter, Storage, Daniel, Su, Runkun, Tworek, Christina M., Van Bavel, Jay J., Walco, Daniel, Wills, Julian, Xu, Xiaobing, Chi Yam, Kai, Yang, Xiaoyu, Schweinsberg, Martin, Urwitz, Molly, Adamkovič, Matúš, Alaei, Ravin, Albers, Casper J., Allard, Aurélien, Anderson, Ian A., Andreychik, Michael R., Babinčák, Peter, Baker, Bradley J., Baník, Gabriel, Baskin, Ernest, Bavolar, Jozef, Berkers, Ruud M. W. J., Białek, Michał, Blanke, Joel, Breuer, Johanne, Brizi, Ambra, Brown, Stephanie E. V., Brühlmann, Florian, Bruns, Hendrik, Caldwell, Leigh, Campourcy, Jean-Françoi, Chan, Eugene Y., Chang, Yen-Ping, Cheung, Benjamin Y., Chin, Alycia, Cho, Kit W., Columbus, Simon, Conway, Paul, Corretti, Conrad A., Craig, Adam W., Curran, Paul G., Danvers, Alexander F., Dawson, Ian G. J., Day, Martin V., Dietl, Erik, Doerflinger, Johannes T., Dominici, Alice, Dranseika, Viliu, Edelsbrunner, Peter A., Edlund, John E., Fisher, Matthew, Fung, Anna, Genschow, Oliver, Gnambs, Timo, Goldberg, Matthew H., Graf-Vlachy, Lorenz, Hafenbrack, Andrew C., Hafenbrädl, Sebastian, Hartanto, Andree, Heck, Patrick R., Heffner, Joseph P., Hilgard, Joseph, Holzmeister, Felix, Horchak, Oleksandr V., Huang, Tina S. -T., Hüffmeier, Joachim, Hughes, Sean, Hussey, Ian, Imhoff, Roland, Jaeger, Bastian, Jamro, Konrad, Johnson, Samuel G. B., Jones, Andrew, Keller, Luca, Kombeiz, Olga, Krueger, Lacy E., Lantian, Anthony, Laplante, Justin P., Lazarevic, Ljiljana B., Leclerc, Jonathan, Legate, Nicole, Leonhardt, James M., Leung, Desmond W., Levitan, Carmel A., Lin, Hause, Liu, Qinglan, Tullio Liuzza, Marco, Locke, Kenneth D., Ly, Albert L., MacEacheron, Melanie D., Madan, Christopher R., Manley, Harry, Mari, Silvia, Martončik, Marcel, McLean, Scott L., McPhetres, Jonathon, Mercier, Brett G., Michels, Corinna, Mullarkey, Michael C., Musser, Erica D., Nalborczyk, Ladisla, Nilsonne, Gustav, Otis, Nicholas G., Otner, Sarah M. G., Otto, Philipp E., Oviedo-Trespalacios, Oscar, Paruzel- Czachura, Mariola, Pellegrini, Francesco, Pereira, Vitor M. D., Perfecto, Hannah, Pfuhl, Gerit, Phillips, Mark H., Plonsky, Ori, Pozzi, Maura, Purić, Danka B., Raymond-Barker, Brett, Redman, David E., Reynolds, Caleb J., Ropovik, Ivan, Röseler, Luka, Ruessmann, Janna K., Ryan, William H., Sablaturova, Nika, Schuepfer, Kurt J., Schütz, Astrid, Sirota, Miroslav, Stefan, Matthia, Stocks, Eric L., Strosser, Garrett L., Suchow, Jordan W., Szabelska, Anna, Tey, Kian-Siong S., Tiokhin, Leonid, Troian, Jai, Utesch, Till, Vásquez-Echeverría, Alejandro, Ann Vaughn, Leigh, Verschoor, Mark, von Helversen, Bettina, Wallisch, Pascal, Weissgerber, Sophia C., Wichman, Aaron L., Woike, Jan K., Žeželj, Iri, Zickfeld, Janis H., Ahn, Yeonsin, Blaettchen, Philippe F., Kang, Xi, Jin Lee, Yoo, Parker, Philip M., Parker, Paul A., Song, Jamie S., Very, May-Anne, Wong, Lynn, Uhlmann, Eric L., Maura Pozzi (ORCID:0000-0003-2849-9344), Landy, Justin F., (Liam) Jia, Miaolei, Ding, Isabel, Viganola, Domenico, Tierney, Warren, Dreber, Anna, Johannesson, Magnu, Pfeiffer, Thoma, Ebersole, Charles R., Gronau, Quentin F., Ly, Alexander, van den Bergh, Don, Marsman, Maarten, Wagenmakers, Eric-Jan, Bartels, Daniel M., Bauman, Christopher W., Brady, William, Cheung, Felix, Cimpian, Andrei, Dohle, Simone, Brent Donnellan, M., Hahn, Adam, Hall, Michael, Jiménez-Leal, William, Johnson, David J., Lucas, Richard E., Monin, Benoît, Montealegre, Andre, Mullen, Elizabeth, Pang, Jun, Ray, Jennifer, Reinero, Diego A., Reynolds, Jesse, Sowden, Walter, Storage, Daniel, Su, Runkun, Tworek, Christina M., Van Bavel, Jay J., Walco, Daniel, Wills, Julian, Xu, Xiaobing, Chi Yam, Kai, Yang, Xiaoyu, Schweinsberg, Martin, Urwitz, Molly, Adamkovič, Matúš, Alaei, Ravin, Albers, Casper J., Allard, Aurélien, Anderson, Ian A., Andreychik, Michael R., Babinčák, Peter, Baker, Bradley J., Baník, Gabriel, Baskin, Ernest, Bavolar, Jozef, Berkers, Ruud M. W. J., Białek, Michał, Blanke, Joel, Breuer, Johanne, Brizi, Ambra, Brown, Stephanie E. V., Brühlmann, Florian, Bruns, Hendrik, Caldwell, Leigh, Campourcy, Jean-Françoi, Chan, Eugene Y., Chang, Yen-Ping, Cheung, Benjamin Y., Chin, Alycia, Cho, Kit W., Columbus, Simon, Conway, Paul, Corretti, Conrad A., Craig, Adam W., Curran, Paul G., Danvers, Alexander F., Dawson, Ian G. J., Day, Martin V., Dietl, Erik, Doerflinger, Johannes T., Dominici, Alice, Dranseika, Viliu, Edelsbrunner, Peter A., Edlund, John E., Fisher, Matthew, Fung, Anna, Genschow, Oliver, Gnambs, Timo, Goldberg, Matthew H., Graf-Vlachy, Lorenz, Hafenbrack, Andrew C., Hafenbrädl, Sebastian, Hartanto, Andree, Heck, Patrick R., Heffner, Joseph P., Hilgard, Joseph, Holzmeister, Felix, Horchak, Oleksandr V., Huang, Tina S. -T., Hüffmeier, Joachim, Hughes, Sean, Hussey, Ian, Imhoff, Roland, Jaeger, Bastian, Jamro, Konrad, Johnson, Samuel G. B., Jones, Andrew, Keller, Luca, Kombeiz, Olga, Krueger, Lacy E., Lantian, Anthony, Laplante, Justin P., Lazarevic, Ljiljana B., Leclerc, Jonathan, Legate, Nicole, Leonhardt, James M., Leung, Desmond W., Levitan, Carmel A., Lin, Hause, Liu, Qinglan, Tullio Liuzza, Marco, Locke, Kenneth D., Ly, Albert L., MacEacheron, Melanie D., Madan, Christopher R., Manley, Harry, Mari, Silvia, Martončik, Marcel, McLean, Scott L., McPhetres, Jonathon, Mercier, Brett G., Michels, Corinna, Mullarkey, Michael C., Musser, Erica D., Nalborczyk, Ladisla, Nilsonne, Gustav, Otis, Nicholas G., Otner, Sarah M. G., Otto, Philipp E., Oviedo-Trespalacios, Oscar, Paruzel- Czachura, Mariola, Pellegrini, Francesco, Pereira, Vitor M. D., Perfecto, Hannah, Pfuhl, Gerit, Phillips, Mark H., Plonsky, Ori, Pozzi, Maura, Purić, Danka B., Raymond-Barker, Brett, Redman, David E., Reynolds, Caleb J., Ropovik, Ivan, Röseler, Luka, Ruessmann, Janna K., Ryan, William H., Sablaturova, Nika, Schuepfer, Kurt J., Schütz, Astrid, Sirota, Miroslav, Stefan, Matthia, Stocks, Eric L., Strosser, Garrett L., Suchow, Jordan W., Szabelska, Anna, Tey, Kian-Siong S., Tiokhin, Leonid, Troian, Jai, Utesch, Till, Vásquez-Echeverría, Alejandro, Ann Vaughn, Leigh, Verschoor, Mark, von Helversen, Bettina, Wallisch, Pascal, Weissgerber, Sophia C., Wichman, Aaron L., Woike, Jan K., Žeželj, Iri, Zickfeld, Janis H., Ahn, Yeonsin, Blaettchen, Philippe F., Kang, Xi, Jin Lee, Yoo, Parker, Philip M., Parker, Paul A., Song, Jamie S., Very, May-Anne, Wong, Lynn, Uhlmann, Eric L., and Maura Pozzi (ORCID:0000-0003-2849-9344)

Abstract

To what extent are the results of research investigations influenced by subjective decisions that scientists make as they design studies? Fifteen research teams independently designed studies to answer five original research questions related to moral judgments, negotiations, and implicit cognition. Participants from two separate, large samples (total N > 15,000) were then randomly assigned to complete one version of each study. Effect sizes varied dramatically across different sets of materials designed to test the same hypothesis: materials from different teams rendered significant effects in opposite directions for four out of five hypotheses, with the narrowest range in estimates being d = -0.37 to 0.26. Meta-analysis indicated a lack of overall support for two original hypotheses, mixed support for one hypothesis, and significant support for two hypotheses. Overall, none of the variability in effect sizes was attributable to the skill of the research team in designing materials, while some variability was attributable to the hypothesis being tested. In a forecasting survey, predictions of other scientists were strongly correlated with study results, and average predictions were similar to observed outcomes. Crowdsourced testing of research hypotheses helps reveal the true consistency of empirical support for a scientific claim.

Published
2020

34. Many Labs 5: Registered Replication of Albarracín et al. (2008), Experiment 5

Author

Chartier, Christopher R., primary, Arnal, Jack D., additional, Arrow, Holly, additional, Bloxsom, Nicholas G., additional, Bonfiglio, Diane B. V., additional, Brumbaugh, Claudia C., additional, Corker, Katherine S., additional, Ebersole, Charles R., additional, Garinther, Alexander, additional, Giessner, Steffen R., additional, Hughes, Sean, additional, Inzlicht, Michael, additional, Lin, Hause, additional, Mercier, Brett, additional, Metzger, Mitchell, additional, Rangel, Derek, additional, Saunders, Blair, additional, Schmidt, Kathleen, additional, Storage, Daniel, additional, and Tocco, Carly, additional

Published
2020
Full Text
View/download PDF

38. Many Labs 5: Testing pre-data collection peer review as an intervention to increase replicability (results-blind manuscript)

Author

Pessers, Sebastiaan, Petrovic , Boban, Nichols , Austin, Metzger, Mitchell, Manfredi , Dylan, Mercier , Brett, Montealegre , Andres, Kuchno, Katarzyna, Millen , Ailsa, Levitan , Carmel, Nave , Gideon, Lage, Caio, Pedović, Ivana, Krueger , Lacy, Krasuska, Karolina, Kraus, Sue, Kovacs , Marton, Inzlicht , Michael, Hałasa, Ewa, Idzikowska, Katarzyna, Kołodziej, Sabina, Kimbrough, Amanda, Kauff , Mathias, Hancock , Peter, Jern, Alan, Kellier, Danielle, Leal, Wlliam, Hüffmeier, Joachim, Hughes , Sean, King , Josiah, Kidwell , Mallory, Johannesson , Magnus, Joy-Gaba , Jennifer, PęKala, Emilian, Penner, Matthew, Moore , Don, Menon, Madhavi, Langford, Eleanor, Panno, Angelo, Lima , Tiago, Lins , Samuel, Parks, Kimberly, Miller, Jeremy, Novak, Sarah, Markiewicz, Lukasz, Loy , J, Orlic, Ana, Lin , Hause, Guadagno, Rosanna, Grahe , Jon, Giessner , Steffen, Giacomantonio , Mauro, Gawryluk, Katarzyna, Garinther, Alexander, Fryberger, Emily, Frank , Michael, Ford, Máire, Ferguson, Ian, Feinberg, Lily, Fedor , Anna, Falcão, Filipe, Edlund , John, Dreber , Anna, Dering , Benjamin, Day, Chris, Curran , Paul, Collins, W., Čolić , Marija, Coary, Sean, Claypool, Heather, Christ , Oliver, Chopik , William, Chiorri, Carlo, Chen, Yiling, Casini, Erica, Brumbaugh , Claudia, Brühlmann, Florian, Boucher, Leanne, Bonfiglio, Diane, Bodroža, Bojana, Bialek , Michal, Bloxsom , Nicholas, Bernstein, Michael, Belopavlović, Radomir, Baskin, Ernest, Baník , Gabriel, Bakos, Bence, Babincak , Peter, Arrow, Holly, Arnal , Jack, Andrighetto, Luca, Aeschbach, Lena, Ropovik , Ivan, Lazarevic , Ljiljana, Aczel , Balazs, Ijzerman , Hans, Hartshorne , Joshua, Corker , Katherine, Corley , Martin, Buttrick , Nick, Baranski , Erica, Bart-Plange, Diane-Jo, Mathur , Maya, Chartier , Christopher, Rabagliati , Hugh, Campbell , Lorne, Ebersole , Charles, Salamon, Janos, Rife , Sean, Stojilović , Darko, Szecsi , Peter, Schulz-Hardt , Stefan, Weissgerber , Sophia, Tocco, Carly, Wichman , Aaron, Zrubka , Mark, Sullivan, Gavin, Schuepfer, Kurt, Rosa , Anna, Schultze , Thomas, Storage , Daniel, Schütz , Astrid, Stein, Lar, Schmidt , Kathleen, Razza, Timothy, Wolf, Daniel, Vaughn , Leigh, Saunders , Blair, Richetin , Juliette, Jimenez-Leal , William, Silva, Rúben, Sioma, Barbara, Viganola, Domenico, Vlachou, Maria, Szaszi , Barnabas, Rentzsch, Katrin, Vianello , Michelangelo, Szoke, Orsolya, Nosek , Brian, Ravid, Jon, Torka, Ann-Kathrin, Walker, Ryan, Skorb , Lauren, Sternglanz, R., Szuts , Attila, Tidwell, Natasha, Thomae , Manuela, De Souza, Luana, Zealley, David, Tuerlinckx , Francis, Steegen, Sara, Shabazian, Ani, Zezelj , Iris, Preti , Emanuele, Purić , Danka, Ramos, Tiago, Pieńkosz , Damian, Pfeiffer, Thomas, Wood, Michael, Sawicki, Przemyslaw, Wiggins , Bradford, and Vanpaemel , Wolf

Subjects
PsyArXiv|Social and Behavioral Sciences, bepress|Social and Behavioral Sciences, bepress|Social and Behavioral Sciences|Psychology|Personality and Social Contexts, PsyArXiv|Social and Behavioral Sciences|Social and Personality Psychology
Abstract

Replication efforts in psychological science sometimes fail to replicate prior findings. If replications use methods that are unfaithful to the original study or ineffective in eliciting the phenomenon of interest, then a failure to replicate may be a failure of the replication protocol rather than a challenge to the original finding. Formal pre-data collection peer review by experts may address shortcomings and increase replicability rates. We selected 10 replications from the Reproducibility Project: Psychology (RP:P; Open Science Collaboration, 2015) in which the original authors had expressed concerns about the replication designs before data collection and only one of which was “statistically significant” (p < .05). Commenters on RP:P suggested that lack of adherence to expert review and low-powered tests were the reasons that most of these failed to replicate (Gilbert et al., 2016). We revised the replication protocols and received formal peer review prior to conducting new replications. We administered the RP:P and Revised replication protocols in multiple laboratories (Median number of laboratories per original study = XX; Range XX to YY; Median total sample = XX; Range XX to YY) for high-powered tests of each original finding with both protocols. Overall, XX of 10 RP:P protocols and XX of 10 Revised protocols showed significant evidence in the same direction as the original finding (p < .05), compared to an expected XX. The median effect size was [larger/smaller/similar] for Revised protocols (ES = .XX) compared to RP:P protocols (ES = .XX), and [larger/smaller/similar] compared to the original studies (ES = .XX) and [larger/smaller/similar] compared to the original RP:P replications (ES = .XX). Overall, Revised protocols produced [much larger/somewhat larger/similar] effect sizes compared to RP:P protocols (ES = .XX). We also elicited peer beliefs about the replications through prediction markets and surveys of a group of researchers in psychology. The peer researchers predicted that the Revised protocols would [decrease/not affect/increase] the replication rate, [consistent with/not consistent with] the observed replication results. The results suggest that the lack of replicability of these findings observed in RP:P was [partly/completely/not] due to discrepancies in the RP:P protocols that could be resolved with expert peer review.

Published
2019

39. Support for Economic Inequality Scale: Development and Adjudication

Author

Wiwad, Dylan, Mercier, Brett, Shariff, Azim, aknin, Lara, and Robinson, Angela

Subjects
FOS: Psychology, Social Psychology, Psychology, Quantitative Psychology, Social and Behavioral Sciences
Abstract

Economic inequality is a defining issue of the 21st century. Past research has documented myriad pernicious psychological effects of high inequality, and prompted interest into how people perceive, evaluate, and react to economic inequality. Here we propose, refine, and validate the Support for Economic Inequality Scale (SEIS) – a novel measure of attitudes towards economic inequality. In Study 1, we distill eighteen items down to five, providing evidence for unidimensionality and reliability. In Study 2, we replicate the scale’s unidimensionality and reliability and demonstrate its validity. In Study 3, we evaluate a United States version of the SEIS. Finally, in Study 4, we show predictive validity by relating the SEIS to behavioral support for an inequality reducing social policy. The SEIS is a valid and reliable instrument for assessing perceptions of and reactions to economic inequality, and provides a useful tool for researchers investigating the psychological underpinnings of economic inequality.

Published
2018

40. Many Labs 5: Testing pre-data collection peer review as an intervention to increase replicability

Author

Ebersole, Charles R., primary, Mathur, Maya B, additional, Baranski, Erica, additional, Bart-Plange, Diane-Jo, additional, Buttrick, Nick, additional, Chartier, Christopher R., additional, Corker, Katherine S., additional, Corley, Martin, additional, Hartshorne, Joshua K., additional, IJzerman, Hans, additional, Lazarevic, Ljiljana B., additional, Rabagliati, Hugh, additional, Ropovik, Ivan, additional, Aczel, Balazs, additional, Aeschbach, Lena Fanya, additional, Andrighetto, Luca, additional, Arnal, Jack Dennis, additional, Arrow, Holly, additional, Babincak, Peter, additional, Bakos, Bence Endre, additional, Baník, Gabriel, additional, Baskin, Ernest, additional, Belopavlović, Radomir, additional, Bernstein, Michael, additional, Bialek, Michal, additional, Bloxsom, Nicholas, additional, Bodroža, Bojana, additional, Bonfiglio, Diane B. V., additional, Boucher, Leanne, additional, Brühlmann, Florian, additional, Brumbaugh, Claudia Chloe, additional, Casini, Erica, additional, Chen, Yiling, additional, Chiorri, Carlo, additional, Chopik, William J., additional, Christ, Oliver, additional, Claypool, Heather M., additional, coary, Sean, additional, Čolić, Marija V., additional, Collins, W. Matthew, additional, Curran, Paul G, additional, Day, Chris, additional, Dering, Benjamin, additional, Dreber, Anna, additional, Edlund, John, additional, Falcão, Filipe, additional, Fedor, Anna, additional, Feinberg, Lily, additional, Ferguson, Ian, additional, Ford, Máire, additional, Frank, Michael C., additional, Fryberger, Emily, additional, Garinther, Alexander, additional, Gawryluk, Katarzyna, additional, Giacomantonio, Mauro, additional, Giessner, Steffen Robert, additional, Grahe, Jon E., additional, Guadagno, Rosanna Elizabeth, additional, Hałasa, Ewa, additional, Hancock, Peter, additional, Hüffmeier, Joachim, additional, Hughes, Sean, additional, Idzikowska, Katarzyna, additional, Inzlicht, Michael, additional, Jern, Alan, additional, Jimenez-Leal, William, additional, Johannesson, Magnus, additional, Joy-Gaba, Jennifer Alana, additional, Kauff, Mathias, additional, Kellier, Danielle, additional, Kidwell, Mallory, additional, Kimbrough, Amanda, additional, King, Josiah, additional, Kołodziej, Sabina, additional, Kovacs, Marton, additional, Krasuska, Karolina, additional, Kraus, Sue, additional, Krueger, Lacy Elise, additional, Kuchno, Katarzyna, additional, Lage, Caio Ambrosio, additional, Langford, Eleanor V., additional, Levitan, Carmel, additional, Lima, Tiago Jessé Souza, additional, Lin, Hause, additional, Lins, Samuel, additional, Loy, J E, additional, Manfredi, Dylan, additional, Markiewicz, Lukasz, additional, Menon, Madhavi, additional, Mercier, Brett, additional, Metzger, Mitchell, additional, Millen, Ailsa E, additional, Miller, Jeremy K., additional, Montealegre, Andres, additional, Moore, Don A, additional, Nave, Gideon, additional, Nichols, Austin Lee, additional, Novak, Sarah Ann, additional, Orlic, Ana, additional, Panno, Angelo, additional, Parks, Kimberly P., additional, Pedović, Ivana, additional, Pękala, Emilian, additional, Penner, Matthew R., additional, Pessers, Sebastiaan, additional, Petrovic, Boban, additional, Pfeiffer, Thomas, additional, Pieńkosz, Damian, additional, Preti, Emanuele, additional, Purić, Danka, additional, Ramos, Tiago Silva, additional, Ravid, Jon, additional, Razza, Timothy, additional, Rentzsch, Katrin, additional, Richetin, Juliette, additional, Rife, Sean Chandler, additional, Dalla Rosa, Anna, additional, Salamon, Janos, additional, Saunders, Blair, additional, Sawicki, Przemyslaw, additional, Schmidt, Kathleen, additional, Schuepfer, Kurt, additional, Schultze, Thomas, additional, Schulz-Hardt, Stefan, additional, Schütz, Astrid, additional, Shabazian, Ani, additional, Silva, Rúben Filipe Lopes, additional, Sioma, Barbara, additional, Skorb, Lauren, additional, Souza, Luana Elayne Cunha, additional, steegen, sara, additional, Stein, LAR, additional, Sternglanz, R. Weylin, additional, Stojilović, Darko, additional, Storage, Daniel, additional, Sullivan, Gavin Brent, additional, Szaszi, Barnabas, additional, Szecsi, Peter, additional, Szoke, Orsolya, additional, Szuts, Attila, additional, Thomae, Manuela, additional, Tidwell, Natasha Davis, additional, tocco, Carly, additional, Torka, Ann-Kathrin, additional, tuerlinckx, francis, additional, vanpaemel, wolf, additional, Vaughn, Leigh Ann, additional, Vianello, Michelangelo, additional, Viganola, Domenico, additional, Vlachou, Maria, additional, Walker, Ryan J., additional, Weissgerber, Sophia Christin, additional, Wichman, Aaron Lee, additional, Wiggins, Bradford Jay, additional, Wolf, Daniel, additional, Wood, Michael James, additional, Zealley, David A., additional, Zezelj, Iris, additional, Zrubka, Mark, additional, and Nosek, Brian A., additional

Published
2019
Full Text
View/download PDF

42. Support for Economic Inequality Scale

Author

Wiwad, Dylan, primary, Mercier, Brett, additional, Maraun, Michael D., additional, Robinson, Angela R., additional, Piff, Paul K., additional, Aknin, Lara B., additional, and Sharif, Azim F., additional

Published
2019
Full Text
View/download PDF

43. Supplemental Material, SPPS712034_suppl_mat - False Polarization and False Moderation: Political Opponents Overestimate the Extremity of Each Other’s Ideologies but Underestimate Each Other’s Certainty

Author

Blatz, Craig W. and Mercier, Brett

Subjects
FOS: Psychology, 170199 Psychology not elsewhere classified
Abstract

Supplemental Material, SPPS712034_suppl_mat for False Polarization and False Moderation: Political Opponents Overestimate the Extremity of Each Other’s Ideologies but Underestimate Each Other’s Certainty by Craig W. Blatz, and Brett Mercier in Social Psychological and Personality Science

Published
2017
Full Text
View/download PDF

50. False Polarization and False Moderation: Political Opponents Overestimate the Extremity of Each Other’s Ideologies but Underestimate Each Other’s Certainty

Author

Blatz, Craig W. and Mercier, Brett

Abstract

Past research finds that people hold moderate views on political issues while believing others are extreme. This false polarization has been demonstrated across a variety of different attitude dimensions and is explained by naive realism, the belief that one holds an unbiased view of reality. We argue that because people believe they see the world objectively, they should be very certain about their opinions, more certain than others expect. In three studies, we tested this false moderation of attitude certainty hypothesis and attempted to replicate past research on false polarization of attitude stance and perceived ideology of others. All three studies revealed a false moderation effect on judgements of certainty. Additionally, we replicate the finding that people false polarize others’ ideology but do not find evidence for false polarization of specific stance.

Published
2018
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results