Search

Your search keyword '"Balazs Aczel"' showing total 107 results
Start Over Author "Balazs Aczel" Publication Year Range Last 10 years
107 results on '"Balazs Aczel"'

1. Structural Validity Evidence for the Oxford Utilitarianism Scale Across 15 Languages

Author

Briana Oshiro, William H. B. McAuliffe, Raymond Luong, Anabela C. Santos, Andrej Findor, Anna O. Kuzminska, Anthony Lantian, Asil A. Özdoğru, Balazs Aczel, Bojana M. Dinić, Christopher R. Chartier, Jasper Hidding, Job A. M. de Grefte, John Protzko, Mairead Shaw, Maximilian A. Primbs, Nicholas A. Coles, Patricia Arriaga, Patrick S. Forscher, Savannah C. Lewis, Tamás Nagy, Wieteke C. de Vries, William Jimenez-Leal, Yansong Li, and Jessica Kay Flake

Subjects
Oxford Utilitarianism Scale, translation, measurement invariance, reliability, Psychological Science Accelerator, Psychology, BF1-990
Abstract

Abstract: Background: The Psychological Science Accelerator (PSA) recently completed a large-scale moral psychology study using translated versions of the Oxford Utilitarianism Scale (OUS). However, the translated versions have no validity evidence. Objective: The study investigated the structural validity evidence of the OUS across 15 translated versions and produced version-specific validity reports. Methods: We analyzed OUS data from the PSA, which was collected internationally on a centralized online questionnaire. We also collected qualitative feedback from experts for each translated version. Results: For each version, we produced version-specific psychometric reports which include the following: (1) descriptive item and demographics analyses, (2) factor structure evidence using confirmatory factor analyses, (3) measurement invariance testing across languages using multiple-group confirmatory factor analyses and alignment optimization, and (4) reliability analyses using coefficients α and ω.

Published
2024
Full Text
View/download PDF

2. Subjective evidence evaluation survey for many-analysts studies

Author

Alexandra Sarafoglou, Suzanne Hoogeveen, Don van den Bergh, Balazs Aczel, Casper J. Albers, Tim Althoff, Rotem Botvinik-Nezer, Niko A. Busch, Andrea M. Cataldo, Berna Devezer, Noah N. N. van Dongen, Anna Dreber, Eiko I. Fried, Rink Hoekstra, Sabine Hoffman, Felix Holzmeister, Jürgen Huber, Nick Huntington-Klein, John Ioannidis, Magnus Johannesson, Michael Kirchler, Eric Loken, Jan-Francois Mangin, Dora Matzke, Albert J. Menkveld, Gustav Nilsonne, Don van Ravenzwaaij, Martin Schweinsberg, Hannah Schulz-Kuempel, David R. Shanks, Daniel J. Simons, Barbara A. Spellman, Andrea H. Stoevenbelt, Barnabas Szaszi, Darinka Trübutschek, Francis Tuerlinckx, Eric L. Uhlmann, Wolf Vanpaemel, Jelte Wicherts, and Eric-Jan Wagenmakers

Subjects
open science, team science, scientific transparency, metascience, crowdsourcing analysis, Science
Abstract

Many-analysts studies explore how well an empirical claim withstands plausible alternative analyses of the same dataset by multiple, independent analysis teams. Conclusions from these studies typically rely on a single outcome metric (e.g. effect size) provided by each analysis team. Although informative about the range of plausible effects in a dataset, a single effect size from each team does not provide a complete, nuanced understanding of how analysis choices are related to the outcome. We used the Delphi consensus technique with input from 37 experts to develop an 18-item subjective evidence evaluation survey (SEES) to evaluate how each analysis team views the methodological appropriateness of the research design and the strength of evidence for the hypothesis. We illustrate the usefulness of the SEES in providing richer evidence assessment with pilot data from a previous many-analysts study.

Published
2024
Full Text
View/download PDF

3. Cognitive control adjustments are dependent on the level of conflict

Author

Miklos Bognar, Zsuzsa Szekely, Marton A. Varga, Kinga Nagy, Giacomo Spinelli, Andree Hartanto, Nadyanna M. Majeed, Nicole Rui Ying Chen, Mate Gyurkovics, and Balazs Aczel

Subjects
Medicine, Science
Abstract

Abstract The congruency sequence effect (CSE) is one of the most investigated effects in the cognitive control literature. The conflict monitoring theory suggests that the CSE is the result of adjustments in cognitive control based on perceived conflict. A recent paper by Zhang and colleagues, has investigated whether the manipulation of conflict level by changing distractor incompatibility in a flanker task affects the amount of adjustments in cognitive control. Their study produced mixed findings, somewhat supporting the original conflict monitoring theory, but also suggesting other explanations, such as the repetition expectancy account. We replicated the experimental design in a multisite online study (N = 347), with Hungarian, Italian, and Singaporean participants. Our results supported the prediction that changes in the level of conflict trigger conflict adaptation, revealing that increasing conflict levels induced stronger adaptive control. Bayesian hypothesis testing indicated a monotonic reduction in congruency effects as a function of previous conflict strength. This finding is in line with the extension of the traditional conflict monitoring theory, as well as other theories like affective signaling and expected value of control, implying that the relationship between conflict and interference effects is gradual, rather than a binary function.

Published
2024
Full Text
View/download PDF

4. The Replication Database: Documenting the Replicability of Psychological Science

Author

Lukas Röseler, Leonard Kaiser, Christopher Doetsch, Noah Klett, Christian Seida, Astrid Schütz, Balazs Aczel, Nadia Adelina, Valeria Agostini, Samuel Alarie, Nihan Albayrak-Aydemir, Alaa Aldoh, Ali H. Al-Hoorie, Flavio Azevedo, Bradley J. Baker, Charlotte Lilian Barth, Julia Beitner, Cameron Brick, Hilmar Brohmer, Subramanya Prasad Chandrashekar, Kai Li Chung, Jamie P. Cockcroft, Jamie Cummins, Veronica Diveica, Tsvetomira Dumbalska, Emir Efendic, Mahmoud Elsherif, Thomas Evans, Gilad Feldman, Adrien Fillon, Nico Förster, Joris Frese, Oliver Genschow, Vaitsa Giannouli, Biljana Gjoneska, Timo Gnambs, Amélie Gourdon-Kanhukamwe, Christopher J. Graham, Helena Hartmann, Clove Haviva, Alina Herderich, Leon P. Hilbert, Darías Holgado, Ian Hussey, Zlatomira G. Ilchovska, Tamara Kalandadze, Veli-Matti Karhulahti, Leon Kasseckert, Maren Klingelhöfer-Jens, Alina Koppold, Max Korbmacher, Louisa Kulke, Niclas Kuper, Annalise LaPlume, Gavin Leech, Feline Lohkamp, Nigel Mantou Lou, Dermot Lynott, Maximilian Maier, Maria Meier, Maria Montefinese, David Moreau, Kellen Mrkva, Monika Nemcova, Danna Oomen, Julian Packheiser, Shubham Pandey, Frank Papenmeier, Mariola Paruzel-Czachura, Yuri G. Pavlov, Zoran Pavlović, Charlotte R. Pennington, Merle-Marie Pittelkow, Willemijn Plomp, Paul E. Plonski, Ekaterina Pronizius, Andrew Adrian Pua, Katarzyna Pypno-Blajda, Manuel Rausch, Tobias R. Rebholz, Elena Richert, Jan Philipp Röer, Robert Ross, Kathleen Schmidt, Aleksandrina Skvortsova, Matthias F. J. Sperl, Alvin W. M. Tan, J. Lukas Thürmer, Aleksandra Tołopiło, Wolf Vanpaemel, Leigh Ann Vaughn, Steven Verheyen, Lukas Wallrich, Lucia Weber, Julia K. Wolska, Mirela Zaneva, and Yikang Zhang

Subjects
replication, replication crisis, database, open science, collaborative, credibility revolution, meta science, Psychology, BF1-990
Abstract

In psychological science, replicability—repeating a study with a new sample achieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://forrt-replications.shinyapps.io/fred_explorer), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.

Published
2024
Full Text
View/download PDF

5. Extending the Choice Architecture Toolbox: The Choice Context Exploration

Author

Nandor Hajdu, Balazs Aczel, and Barnabas Szaszi

Subjects
History of scholarship and learning. The humanities, AZ20-999, Social Sciences
Abstract

The importance of context in behavioral interventions is undeniable, yet few intervention studies begin with a systematic investigation of the contextual factors that influence the behavior in question. This is largely due to the lack of a reliable method for doing so. In recognition of this gap in the field, we have developed a procedure called the Choice Context Exploration that uses machine learning tools to examine the contextual factors that influence a targeted behavior. We demonstrate the steps of Choice Context Exploration using the example of the behavioral choice between using stairs or an elevator. Potential contextual factors were identified by laypeople and experts, and two surveys were created to measure both the behavior and choice, as well as the beliefs of participants. We estimated the effect of contextual factors on participants’ behavior and were able to identify the most influential ones in relation to the studied choice. We achieved an accurate prediction of whether participants would choose the stairs or the elevator based on contextual information in 91.43% of cases on previously unseen data. We also found that participants had different beliefs about what influenced their choice in this situation and that they could be divided into different groups based on these beliefs. Our results suggest that the Choice Context Exploration is a useful procedure for collecting and assessing contextual factors in a given choice setting, which can aid in the planning of behavioral interventions by significantly reducing the number of potential interventions that are likely to be effective.

Published
2023
Full Text
View/download PDF

6. The Psychological Science Accelerator’s COVID-19 rapid-response dataset

Author

Erin M. Buchanan, Savannah C. Lewis, Bastien Paris, Patrick S. Forscher, Jeffrey M. Pavlacic, Julie E. Beshears, Shira Meir Drexler, Amélie Gourdon-Kanhukamwe, Peter R Mallik, Miguel Alejandro A. Silan, Jeremy K. Miller, Hans IJzerman, Hannah Moshontz, Jennifer L. Beaudry, Jordan W. Suchow, Christopher R. Chartier, Nicholas A. Coles, MohammadHasan Sharifian, Anna Louise Todsen, Carmel A. Levitan, Flávio Azevedo, Nicole Legate, Blake Heller, Alexander J. Rothman, Charles A. Dorison, Brian P. Gill, Ke Wang, Vaughan W. Rees, Nancy Gibbs, Amit Goldenberg, Thuy-vy Thi Nguyen, James J. Gross, Gwenaêl Kaminski, Claudia C. von Bastian, Mariola Paruzel-Czachura, Farnaz Mosannenzadeh, Soufian Azouaghe, Alexandre Bran, Susana Ruiz-Fernandez, Anabela Caetano Santos, Niv Reggev, Janis H. Zickfeld, Handan Akkas, Myrto Pantazi, Ivan Ropovik, Max Korbmacher, Patrícia Arriaga, Biljana Gjoneska, Lara Warmelink, Sara G. Alves, Gabriel Lins de Holanda Coelho, Stefan Stieger, Vidar Schei, Paul H. P. Hanel, Barnabas Szaszi, Maksim Fedotov, Jan Antfolk, Gabriela-Mariana Marcu, Jana Schrötter, Jonas R. Kunst, Sandra J. Geiger, Adeyemi Adetula, Halil Emre Kocalar, Julita Kielińska, Pavol Kačmár, Ahmed Bokkour, Oscar J. Galindo-Caballero, Ikhlas Djamai, Sara Johanna Pöntinen, Bamikole Emmanuel AGESIN, Teodor Jernsäther, Anum Urooj, Nikolay R. Rachev, Maria Koptjevskaja-Tamm, Murathan Kurfalı, Ilse L. Pit, Ranran Li, Sami Çoksan, Dmitrii Dubrov, Tamar Elise Paltrow, Gabriel Baník, Tatiana Korobova, Anna Studzinska, Xiaoming Jiang, John Jamir Benzon R. Aruta, Jáchym Vintr, Faith Chiu, Lada Kaliska, Jana B. Berkessel, Murat Tümer, Sara Morales-Izquierdo, Hu Chuan-Peng, Kevin Vezirian, Anna Dalla Rosa, Olga Bialobrzeska, Martin R. Vasilev, Julia Beitner, Ondřej Kácha, Barbara Žuro, Minja Westerlund, Mina Nedelcheva-Datsova, Andrej Findor, Dajana Krupić, Marta Kowal, Adrian Dahl Askelund, Razieh Pourafshari, Jasna Milošević Đorđević, Nadya-Daniela Schmidt, Ekaterina Baklanova, Anna Szala, Ilya Zakharov, Marek A. Vranka, Keiko Ihaya, Caterina Grano, Nicola Cellini, Michał Białek, Lisa Anton-Boicuk, Ilker Dalgar, Arca Adıgüzel, Jeroen P. H. Verharen, Princess Lovella G. Maturan, Angelos P. Kassianos, Raquel Oliveira, Martin Čadek, Vera Cubela Adoric, Asil Ali Özdoğru, Therese E. Sverdrup, Balazs Aczel, Danilo Zambrano, Afroja Ahmed, Christian K. Tamnes, Yuki Yamada, Leonhard Volz, Naoyuki Sunami, Lilian Suter, Luc Vieira, Agata Groyecka-Bernard, Julia Arhondis Kamburidis, Ulf-Dietrich Reips, Mikayel Harutyunyan, Gabriel Agboola Adetula, Tara Bulut Allred, Krystian Barzykowski, Benedict G Antazo, Andras N. Zsido, Dušana Dušan Šakan, Wilson Cyrus-Lai, Lina Pernilla Ahlgren, Matej Hruška, Diego Vega, Efisio Manunta, Aviv Mokady, Mariagrazia Capizzi, Marcel Martončik, Nicolas Say, Katarzyna Filip, Roosevelt Vilar, Karolina Staniaszek, Milica Vdovic, Matus Adamkovic, Niklas Johannes, Nandor Hajdu, Noga Cohen, Clara Overkott, Dino Krupić, Barbora Hubena, Gustav Nilsonne, Giovanna Mioni, Claudio Singh Solorzano, Tatsunori Ishii, Zhang Chen, Elizaveta Kushnir, Cemre Karaarslan, Rafael R. Ribeiro, Ahmed Khaoudi, Małgorzata Kossowska, Jozef Bavolar, Karlijn Hoyer, Marta Roczniewska, Alper Karababa, Maja Becker, Renan P. Monteiro, Yoshihiko Kunisato, Irem Metin-Orta, Sylwia Adamus, Luca Kozma, Gabriela Czarnek, Artur Domurat, Eva Štrukelj, Daniela Serrato Alvarez, Michal Parzuchowski, Sébastien Massoni, Johanna Czamanski-Cohen, Ekaterina Pronizius, Fany Muchembled, Kevin van Schie, Aslı Saçaklı, Evgeniya Hristova, Anna O. Kuzminska, Abdelilah Charyate, Gijsbert Bijlstra, Reza Afhami, Nadyanna M. Majeed, Erica D. Musser, Miroslav Sirota, Robert M. Ross, Siu Kit Yeung, Marietta Papadatou-Pastou, Francesco Foroni, Inês A. T. Almeida, Dmitry Grigoryev, David M. G. Lewis, Dawn L. Holford, Steve M. J. Janssen, Srinivasan Tatachari, Carlota Batres, Jonas K. Olofsson, Shimrit Daches, Anabel Belaus, Gerit Pfuhl, Nadia Sarai Corral-Frias, Daniela Sousa, Jan Philipp Röer, Peder Mortvedt Isager, Hendrik Godbersen, Radoslaw B. Walczak, Natalia Van Doren, Dongning Ren, Tripat Gill, Martin Voracek, Lisa M. DeBruine, Michele Anne, Sanja Batić Očovaj, Andrew G. Thomas, Alexios Arvanitis, Thomas Ostermann, Kelly Wolfe, Nwadiogo Chisom Arinze, Carsten Bundt, Claus Lamm, Robert J Calin-Jageman, William E. Davis, Maria Karekla, Saša Zorjan, Lisa M. Jaremka, Jim Uttley, Monika Hricova, Monica A Koehn, Natalia Kiselnikova, Hui Bai, Anthony J. Krafnick, Busra Bahar Balci, Tonia Ballantyne, Samuel Lins, Zahir Vally, Celia Esteban-Serna, Kathleen Schmidt, Paulo Manuel L. Macapagal, Paulina Szwed, Przemysław Marcin Zdybek, David Moreau, W. Matthew Collins, Jennifer A. Joy-Gaba, Iris Vilares, Ulrich S. Tran, Jordane Boudesseul, Nihan Albayrak-Aydemir, Barnaby James Wyld Dixson, Jennifer T Perillo, Ana Ferreira, Erin C. Westgate, Christopher L. Aberson, Azuka Ikechukwu Arinze, Bastian Jaeger, Muhammad Mussaffa Butt, Jaime R. Silva, Daniel Shafik Storage, Allison P Janak, William Jiménez-Leal, Jose A. Soto, Agnieszka Sorokowska, Randy McCarthy, Alexa M Tullett, Martha Frias-Armenta, Matheus Fernando Felix Ribeiro, Andree Hartanto, Paul A. G. Forbes, Megan L. Willis, María del Carmen Tejada R, Adriana Julieth Olaya Torres, Ian D Stephen, David C. Vaidis, Anabel de la Rosa-Gómez, Karen Yu, Clare A. M. Sutherland, Mathi Manavalan, Behzad Behzadnia, Jan Urban, Ernest Baskin, Joseph P. McFall, Chisom Esther Ogbonnaya, Cynthia H. Y. Fu, Rima-Maria Rahal, Izuchukwu L. G. Ndukaihe, Thomas J. Hostler, Heather Barry Kappes, Piotr Sorokowski, Meetu Khosla, Ljiljana B. Lazarevic, Luis Eudave, Johannes K. Vilsmeier, Elkin O. Luis, Rafał Muda, Elena Agadullina, Rodrigo A. Cárcamo, Crystal Reeck, Gulnaz Anjum, Mónica Camila Toro Venegas, Michal Misiak, Richard M. Ryan, Nora L. Nock, Giovanni A. Travaglino, Michael C. Mensink, Gilad Feldman, Aaron L. Wichman, Weilun Chou, Ignazio Ziano, Martin Seehuus, William J. Chopik, Franki Y. H. Kung, Joelle Carpentier, Leigh Ann Vaughn, Hongfei Du, Qinyu Xiao, Tiago J. S. Lima, Chris Noone, Sandersan Onie, Frederick Verbruggen, Theda Radtke, and Maximilian A. Primbs

Subjects
Science
Abstract

Measurement(s) COVID-19 Protocols, Restrictions • Health Behaviors • Personality and Behavioral Change, CTCAE • Emotion • Message Framing • Self-Determination Technology Type(s) Survey • Experiment Design Type Factor Type(s) COVID-19 Protocols, Restrictions • Health Behaviors • Loss-Gain Framing • Cognitive Reappraisal • Self-Determination Messaging Sample Characteristic - Organism Homo Sample Characteristic - Environment Daily Life Sample Characteristic - Location North America • South America • Africa • Australia • Europe • United Kingdom • Asia

Published
2023
Full Text
View/download PDF

7. Correction to: ‘Raising the value of research studies in psychological science by increasing the credibility of research reports: The Transparent Psi Project’ (2023) by Kekecs et al.

Author

Zoltan Kekecs, Bence Palfi, Barnabas Szaszi, Peter Szecsi, Mark Zrubka, Marton Kovacs, Bence E. Bakos, Denis Cousineau, Patrizio Tressoldi, Kathleen Schmidt, Massimo Grassi, Thomas Rhys Evans, Yuki Yamada, Jeremy K. Miller, Huanxu Liu, Fumiya Yonemitsu, Dmitrii Dubrov, Jan Philipp Röer, Marvin Becker, Roxane Schnepper, Atsunori Ariga, Patrícia Arriaga, Raquel Oliveira, Nele Põldver, Kairi Kreegipuu, Braeden Hall, Sera Wiechert, Bruno Verschuere, Kyra Girán, and Balazs Aczel

Subjects
Science
Published
2023
Full Text
View/download PDF

8. A machine learning analysis of the relationship of demographics and social gathering attendance from 41 countries during pandemic

Author

Barnabas Szaszi, Nandor Hajdu, Peter Szecsi, Elizabeth Tipton, and Balazs Aczel

Subjects
Medicine, Science
Abstract

Abstract Knowing who to target with certain messages is the prerequisite of efficient public health campaigns during pandemics. Using the COVID-19 pandemic situation, we explored which facets of the society—defined by age, gender, income, and education levels—are the most likely to visit social gatherings and aggravate the spread of a disease. Analyzing the reported behavior of 87,169 individuals from 41 countries, we found that in the majority of the countries, the proportion of social gathering-goers was higher in male than female, younger than older, lower-educated than higher educated, and low-income than high-income subgroups of the populations. However, the data showed noteworthy heterogeneity between the countries warranting against generalizing from one country to another. The analysis also revealed that relative to other demographic factors, income was the strongest predictor of avoidance of social gatherings followed by age, education, and gender. Although the observed strength of these associations was relatively small, we argue that incorporating demographic-based segmentation into public health campaigns can increase the efficiency of campaigns with an important caveat: the exploration of these associations needs to be done on a country level before using the information to target populations in behavior change interventions.

Published
2022
Full Text
View/download PDF

9. Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project

Author

Zoltan Kekecs, Bence Palfi, Barnabas Szaszi, Peter Szecsi, Mark Zrubka, Marton Kovacs, Bence E. Bakos, Denis Cousineau, Patrizio Tressoldi, Kathleen Schmidt, Massimo Grassi, Thomas Rhys Evans, Yuki Yamada, Jeremy K. Miller, Huanxu Liu, Fumiya Yonemitsu, Dmitrii Dubrov, Jan Philipp Röer, Marvin Becker, Roxane Schnepper, Atsunori Ariga, Patrícia Arriaga, Raquel Oliveira, Nele Põldver, Kairi Kreegipuu, Braeden Hall, Sera Wiechert, Bruno Verschuere, Kyra Girán, and Balazs Aczel

Subjects
metascience, research methods, credibility, transparency, replication, real-time procedures, Science
Abstract

The low reproducibility rate in social sciences has produced hesitation among researchers in accepting published findings at their face value. Despite the advent of initiatives to increase transparency in research reporting, the field is still lacking tools to verify the credibility of research reports. In the present paper, we describe methodologies that let researchers craft highly credible research and allow their peers to verify this credibility. We demonstrate the application of these methods in a multi-laboratory replication of Bem's Experiment 1 (Bem 2011 J. Pers. Soc. Psychol. 100, 407–425. (doi:10.1037/a0021524)) on extrasensory perception (ESP), which was co-designed by a consensus panel including both proponents and opponents of Bem's original hypothesis. In the study we applied direct data deposition in combination with born-open data and real-time research reports to extend transparency to protocol delivery and data collection. We also used piloting, checklists, laboratory logs and video-documented trial sessions to ascertain as-intended protocol delivery, and external research auditors to monitor research integrity. We found 49.89% successful guesses, while Bem reported 53.07% success rate, with the chance level being 50%. Thus, Bem's findings were not replicated in our study. In the paper, we discuss the implementation, feasibility and perceived usefulness of the credibility-enhancing methodologies used throughout the project.

Published
2023
Full Text
View/download PDF

11. A billion-dollar donation: estimating the cost of researchers’ time spent on peer review

Author

Balazs Aczel, Barnabas Szaszi, and Alex O. Holcombe

Subjects
Peer-review, Academic publishers, Publication system, General Works
Abstract

Abstract Background The amount and value of researchers’ peer review work is critical for academia and journal publishing. However, this labor is under-recognized, its magnitude is unknown, and alternative ways of organizing peer review labor are rarely considered. Methods Using publicly available data, we provide an estimate of researchers’ time and the salary-based contribution to the journal peer review system. Results We found that the total time reviewers globally worked on peer reviews was over 100 million hours in 2020, equivalent to over 15 thousand years. The estimated monetary value of the time US-based reviewers spent on reviews was over 1.5 billion USD in 2020. For China-based reviewers, the estimate is over 600 million USD, and for UK-based, close to 400 million USD. Conclusions By design, our results are very likely to be under-estimates as they reflect only a portion of the total number of journals worldwide. The numbers highlight the enormous amount of work and time that researchers provide to the publication system, and the importance of considering alternative ways of structuring, and paying for, peer review. We foster this process by discussing some alternative models that aim to boost the benefits of peer review, thus improving its cost-benefit ratio.

Published
2021
Full Text
View/download PDF

12. A survey on how preregistration affects the research workflow: better science but more work

Author

Alexandra Sarafoglou, Marton Kovacs, Bence Bakos, Eric-Jan Wagenmakers, and Balazs Aczel

Subjects
open science, meta-science, replication crisis, Science
Abstract

The preregistration of research protocols and analysis plans is a main reform innovation to counteract confirmation bias in the social and behavioural sciences. While theoretical reasons to preregister are frequently discussed in the literature, the individually experienced advantages and disadvantages of this method remain largely unexplored. The goal of this exploratory study was to identify the perceived benefits and challenges of preregistration from the researcher’s perspective. To this end, we surveyed 355 researchers, 299 of whom had used preregistration in their own work. The researchers indicated the experienced or expected effects of preregistration on their workflow. The results show that experiences and expectations are mostly positive. Researchers in our sample believe that implementing preregistration improves or is likely to improve the quality of their projects. Criticism of preregistration is primarily related to the increase in work-related stress and the overall duration of the project. While the benefits outweighed the challenges for the majority of researchers with preregistration experience, this was not the case for the majority of researchers without preregistration experience. The experienced advantages and disadvantages identified in our survey could inform future efforts to improve preregistration and thus help the methodology gain greater acceptance in the scientific community.

Published
2022
Full Text
View/download PDF

13. Data from an International Multi-Centre Study of Statistics and Mathematics Anxieties and Related Variables in University Students (the SMARVUS Dataset)

Author

Jenny Terry, Robert M. Ross, Tamás Nagy, Mauricio Salgado, Patricia Garrido-Vásquez, Jacob O. Sarfo, Susan Cooper, Anke C. Buttner, Tiago J. S. Lima, İbrahim Öztürk, Nazlı Akay, Flavia H. Santos, Christina Artemenko, Lee T. Copping, Mahmoud M. Elsherif, Ilija Milovanović, Robert A. Cribbie, Marina G. Drushlyak, Katherine Swainston, Yiyun Shou, Juan David Leongómez, Nicola Palena, Fitri A. Abidin, Maria F. Reyes-Rodríguez, Yunfeng He, Juneman Abraham, Argiro Vatakis, Kristin Jankowsky, Stephanie N. L. Schmidt, Elise Grimm, Desirée González, Philipp Schmid, Roberto A. Ferreira, Dmitri Rozgonjuk, Neslihan Özhan, Patrick A. O’Connor, Andras N. Zsido, Gregor Stiglic, Darren Rhodes, Cristina Rodríguez, Ivan Ropovik, Violeta Enea, Ratri Nurwanti, Alejandro J. Estudillo, Nataly Beribisky, Karel K. Himawan, Linda M. Geven, Anne H. van Hoogmoed, Amélie Bret, Jodie E. Chapman, Udi Alter, Zoe M. Flack, Donncha Hanna, Mojtaba Soltanlou, Gabriel Banik, Matúš Adamkovič, Sanne H. G. van der Ven, Jochen A. Mosbacher, Hilal H. Şen, Joel R. Anderson, Michael Batashvili, Kristel de Groot, Matthew O. Parker, Mai Helmy, Mariia M. Ostroha, Katie A. Gilligan-Lee, Felix O. Egara, Martin J. Barwood, Karuna Thomas, Grace McMahon, Siobhán M. Griffin, Hans-Christoph Nuerk, Alyssa Counsell, Oliver Lindemann, Dirk Van Rooy, Theresa E. Wege, Joanna E. Lewis, Balazs Aczel, Conal Monaghan, Ali H. Al-Hoorie, Julia F. Huber, Saadet Yapan, Mauricio E. Garrido Vásquez, Antonino Callea, Tolga Ergiyen, James M. Clay, Gaetan Mertens, Feyza Topçu, Merve G. Tutlu, Karin Täht, Kristel Mikkor, Letizia Caso, Alexander Karner, Maxine M. C. Storm, Gabriella Daroczy, Rizqy A. Zein, Andrea Greco, Erin M. Buchanan, Katharina Schmid, Thomas E. Hunt, Jonas De keersmaecker, Peter E. Branney, Jordan Randell, Oliver J. Clark, Crystal N. Steltenpohl, Bhasker Malu, Burcu Tekeş, TamilSelvan Ramis, Stefan Agrigoroaei, Nicholas A. Badcock, Kareena McAloney-Kocaman, Olena V. Semenikhina, Erich W. Graf, Charlie Lea, Kalu T. U. Ogba, Fergus M. Guppy, Amy C. Warhurst, Shane Lindsay, Ahmed Al Khateeb, Frank Scharnowski, Leontien de Kwaadsteniet, Kathryn B. Francis, Mariah Lecompte, Lisa A. D. Webster, Kinga Morsanyi, Suzanna E. Forwood, Elizabeth R. Walters, Linda K. Tip, Jordan R. Wagge, Ho Yan Lai, Deborah S. Crossland, Kohinoor M. Darda, Tessa R. Flack, Zoe Leviston, Matthew Brolly, Samuel P. Hills, Elizabeth Collins, Andrew J. Roberts, Wing-Yee Cheung, Sophie Leonard, Bruno Verschuere, Samantha K. Stanley, Iro Xenidou-Dervou, Omid Ghasemi, Timothy Liew, Daniel Ansari, Johnrev Guilaran, Samuel G. Penny, Julia Bahnmueller, Christopher J. Hand, Unita W. Rahajeng, Dar Peterburg, Zsofia K. Takacs, Michael J. Platow, and Andy P. Field

Subjects
statistics, mathematics, anxiety, education, jangle fallacy, Psychology, BF1-990
Abstract

This large, international dataset contains survey responses from N = 12,570 students from 100 universities in 35 countries, collected in 21 languages. We measured anxieties (statistics, mathematics, test, trait, social interaction, performance, creativity, intolerance of uncertainty, and fear of negative evaluation), self-efficacy, persistence, and the cognitive reflection test, and collected demographics, previous mathematics grades, self-reported and official statistics grades, and statistics module details. Data reuse potential is broad, including testing links between anxieties and statistics/mathematics education factors, and examining instruments’ psychometric properties across different languages and contexts. Data and metadata are stored on the Open Science Framework website [https://osf.io/mhg94/].

Published
2023
Full Text
View/download PDF

14. Contextual factors predicting compliance behavior during the COVID-19 pandemic: A machine learning analysis on survey data from 16 countries.

Author

Nandor Hajdu, Kathleen Schmidt, Gergely Acs, Jan P Röer, Alberto Mirisola, Isabella Giammusso, Patrícia Arriaga, Rafael Ribeiro, Dmitrii Dubrov, Dmitry Grigoryev, Nwadiogo C Arinze, Martin Voracek, Stefan Stieger, Matus Adamkovic, Mahmoud Elsherif, Bettina M J Kern, Krystian Barzykowski, Ewa Ilczuk, Marcel Martončik, Ivan Ropovik, Susana Ruiz-Fernandez, Gabriel Baník, José Luis Ulloa, Balazs Aczel, and Barnabas Szaszi

Subjects
Medicine, Science
Abstract

Voluntary isolation is one of the most effective methods for individuals to help prevent the transmission of diseases such as COVID-19. Understanding why people leave their homes when advised not to do so and identifying what contextual factors predict this non-compliant behavior is essential for policymakers and public health officials. To provide insight on these factors, we collected data from 42,169 individuals across 16 countries. Participants responded to items inquiring about their socio-cultural environment, such as the adherence of fellow citizens, as well as their mental states, such as their level of loneliness and boredom. We trained random forest models to predict whether someone had left their home during a one week period during which they were asked to voluntarily isolate themselves. The analyses indicated that overall, an increase in the feeling of being caged leads to an increased probability of leaving home. In addition, an increased feeling of responsibility and an increased fear of getting infected decreased the probability of leaving home. The models predicted compliance behavior with between 54% and 91% accuracy within each country's sample. In addition, we modeled factors leading to risky behavior in the pandemic context. We observed an increased probability of visiting risky places as both the anticipated number of people and the importance of the activity increased. Conversely, the probability of visiting risky places increased as the perceived putative effectiveness of social distancing decreased. The variance explained in our models predicting risk ranged from < .01 to .54 by country. Together, our findings can inform behavioral interventions to increase adherence to lockdown recommendations in pandemic conditions.

Published
2022
Full Text
View/download PDF

15. Consensus-based guidance for conducting and reporting multi-analyst studies

Author

Balazs Aczel, Barnabas Szaszi, Gustav Nilsonne, Olmo R van den Akker, Casper J Albers, Marcel ALM van Assen, Jojanneke A Bastiaansen, Daniel Benjamin, Udo Boehm, Rotem Botvinik-Nezer, Laura F Bringmann, Niko A Busch, Emmanuel Caruyer, Andrea M Cataldo, Nelson Cowan, Andrew Delios, Noah NN van Dongen, Chris Donkin, Johnny B van Doorn, Anna Dreber, Gilles Dutilh, Gary F Egan, Morton Ann Gernsbacher, Rink Hoekstra, Sabine Hoffmann, Felix Holzmeister, Juergen Huber, Magnus Johannesson, Kai J Jonas, Alexander T Kindel, Michael Kirchler, Yoram K Kunkels, D Stephen Lindsay, Jean-Francois Mangin, Dora Matzke, Marcus R Munafò, Ben R Newell, Brian A Nosek, Russell A Poldrack, Don van Ravenzwaaij, Jörg Rieskamp, Matthew J Salganik, Alexandra Sarafoglou, Tom Schonberg, Martin Schweinsberg, David Shanks, Raphael Silberzahn, Daniel J Simons, Barbara A Spellman, Samuel St-Jean, Jeffrey J Starns, Eric Luis Uhlmann, Jelte Wicherts, and Eric-Jan Wagenmakers

Subjects
multi-analyst, metascience, statistical practice, science forum, expert consensus, analytical variability, Medicine, Science, Biology (General), QH301-705.5
Abstract

Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research.

Published
2021
Full Text
View/download PDF

16. Is there evidence for cross-domain congruency sequence effect? A replication of Kan et al. (2013)

Author

Balazs Aczel, Marton Kovacs, Miklos Bognar, Bence Palfi, Andree Hartanto, Sandersan Onie, Lucas E. Tiong, and Thomas Rhys Evans

Subjects
cognitive control, conflict adaptation, domain-generality, replication, Science
Abstract

Exploring the mechanisms of cognitive control is central to understanding how we control our behaviour. These mechanisms can be studied in conflict paradigms, which require the inhibition of irrelevant responses to perform the task. It has been suggested that in these tasks, the detection of conflict enhances cognitive control resulting in improved conflict resolution of subsequent trials. If this is the case, then this so-called congruency sequence effect can be expected to occur in cross-domain tasks. Previous research on the domain-generality of the effect presented inconsistent results. In this study, we provide a multi-site replication of three previous experiments of Kan et al. (Kan IP, Teubner-Rhodes S, Drummey AB, Nutile L, Krupa L, Novick JM 2013 Cognition 129, 637–651) which test congruency sequence effect between very different domains: from a syntactic to a non-syntactic domain (Experiment 1), and from a perceptual to a verbal domain (Experiments 2 and 3). Despite all our efforts, we found only partial support for the claims of the original study. With a single exception, we could not replicate the original findings; the data remained inconclusive or went against the theoretical hypothesis. We discuss the compatibility of the results with alternative theoretical frameworks.

Published
2021
Full Text
View/download PDF

17. Researchers working from home: Benefits and challenges.

Author

Balazs Aczel, Marton Kovacs, Tanja van der Lippe, and Barnabas Szaszi

Subjects
Medicine, Science
Abstract

The flexibility allowed by the mobilization of technology disintegrated the traditional work-life boundary for most professionals. Whether working from home is the key or impediment to academics' efficiency and work-life balance became a daunting question for both scientists and their employers. The recent pandemic brought into focus the merits and challenges of working from home on a level of personal experience. Using a convenient sampling, we surveyed 704 academics while working from home and found that the pandemic lockdown decreased the work efficiency for almost half of the researchers but around a quarter of them were more efficient during this time compared to the time before. Based on the gathered personal experience, 70% of the researchers think that in the future they would be similarly or more efficient than before if they could spend more of their work-time at home. They indicated that in the office they are better at sharing thoughts with colleagues, keeping in touch with their team, and collecting data, whereas at home they are better at working on their manuscript, reading the literature, and analyzing their data. Taking well-being also into account, 66% of them would find it ideal to work more from home in the future than they did before the lockdown. These results draw attention to how working from home is becoming a major element of researchers' life and that we have to learn more about its influencer factors and coping tactics in order to optimize its arrangements.

Published
2021
Full Text
View/download PDF

18. Documenting contributions to scholarly articles using CRediT and tenzing.

Author

Alex O Holcombe, Marton Kovacs, Frederik Aust, and Balazs Aczel

Subjects
Medicine, Science
Abstract

Scholars traditionally receive career credit for a paper based on where in the author list they appear, but position in an author list often carries little information about what the contribution of each researcher was. "Contributorship" refers to a movement to formally document the nature of each researcher's contribution to a project. We discuss the emerging CRediT standard for documenting contributions and describe a web-based app and R package called tenzing that is designed to facilitate its use. tenzing can make it easier for researchers on a project to plan and record their planned contributions and to document those contributions in a journal article.

Published
2020
Full Text
View/download PDF

19. Thinking dynamics and individual differences: Mouse-tracking analysis of the denominator neglect task

Author

Barnabas Szaszi, Bence Palfi, Aba Szollosi, Pascal J. Kieslich, and Balazs Aczel

Subjects
individual differences, process-tracing, reasoning, heuristics and biases, denominator neglect, mouse-trackingNAKeywords, Social Sciences, Psychology, BF1-990
Abstract

Most decision-making models describing individual differences in heuristics and biases tasks build on the assumption that reasoners produce a first incorrect answer in a quick, automatic way which they may or may not override later and that the advantage of high capacity reasoners arises from this late correction mechanism. To investigate this assumption, we developed a mouse-tracking analysis technique to capture individuals’ first answers and subsequent thinking dynamics. Across two denominator neglect task experiments, we observed that individuals initially move the mouse cursor towards the correct answer option in a substantial number of cases suggesting that reasoners may not always produce an incorrect answer first. Furthermore, we observed that, compared to low capacity reasoners, high capacity individuals revise their first answer more frequently if it is incorrect and make fewer changes if it is correct. However, we did not find evidence that high capacity individuals produce correct initial answers more frequently. Consistent with the predictions of previous decision-making models, these results suggest that in the denominator neglect task the capacity-normativity relationship arises after the initial response is formulated. The present work demonstrates how the analysis of mouse trajectories can be utilized to investigate individual differences in decision-making and help us better apprehend the dynamics of thinking behind decision biases.

Published
2018

20. Estimating the evidential value of significant results in psychological science.

Author

Balazs Aczel, Bence Palfi, and Barnabas Szaszi

Subjects
Medicine, Science
Abstract

Quantifying evidence is an inherent aim of empirical science, yet the customary statistical methods in psychology do not communicate the degree to which the collected data serve as evidence for the tested hypothesis. In order to estimate the distribution of the strength of evidence that individual significant results offer in psychology, we calculated Bayes factors (BF) for 287,424 findings of 35,515 articles published in 293 psychological journals between 1985 and 2016. Overall, 55% of all analyzed results were found to provide BF > 10 (often labeled as strong evidence) for the alternative hypothesis, while more than half of the remaining results do not pass the level of BF = 3 (labeled as anecdotal evidence). The results estimate that at least 82% of all published psychological articles contain one or more significant results that do not provide BF > 10 for the hypothesis. We conclude that due to the threshold of acceptance having been set too low for psychological findings, a substantial proportion of the published results have weak evidential support.

Published
2017
Full Text
View/download PDF

22. PSACR: The Psychological Science Accelerator's COVID-19 Rapid-response Dataset

Author

Erin Michelle Buchanan, Savannah C Lewis, Bastien Paris, Patrick S. Forscher, Jeffrey Michael Pavlacic, Julie Beshears, Amélie Gourdon-Kanhukamwe, Peter Robert Mallik, Miguel Alejandro A. Silan, Jeremy K. Miller, Hans IJzerman, Jennifer L Beaudry, Jordan W Suchow, Christopher R. Chartier, Anna Louise Todsen, Carmel Levitan, Flavio Azevedo, Nicole Legate, Ke Wang, Gwenael Kaminski, Claudia Christina von Bastian, Mariola Paruzel-Czachura, Farnaz Mosannenzadeh, Soufian Azouaghe, Alexandre Bran, Susana Ruiz-Fernandez, Anabela Caetano Santos, Niv Reggev, Janis Zickfeld, Handan Akkas, Myrto Pantazi, Ivan Ropovik, Max Korbmacher, Patricia Arriaga, Biljana Gjoneska, Lara Warmelink, Sara Gouveia Alves, Gabriel Lins Holanda Coelho, Stefan Stieger, Vidar Schei, Paul H. P. Hanel, Barnabas Szaszi, Maksim Fedotov, Jan Antfolk, Gabriela Mariana Marcu, Jana Schrötter, Jonas R. Kunst, Sandra Jeanette Geiger, Adeyemi Adetula, Halil Emre Kocalar, Julita Kielińska, Pavol Kačmár, Oscar J. Galindo-Caballero, Sara Johanna Pöntinen, Bamikole Bamikole Agesin, Teodor Jernsäther, Anum Urooj, Nikolay R. Rachev, Maria Koptjevskaja-Tamm, Murathan Kurfalı, Ilse L. Pit, Ranran Li, Sami Çoksan, Dmitrii Dubrov, Tamar Paltrow, Gabriel Baník, Tatiana Korobova, Anna Studzinska, Xiaoming Jiang, JOHN JAMIR BENZON R. ARUTA, Jáchym Vintr, Faith Chiu, Lada Kaliska, Jana Berkessel, Murat Tümer, Sara Morales-Izquierdo, Hu Chuan-Peng, Kevin Vezirian, Anna Dalla Rosa, Nicholas Alvaro Coles, Blake Heller, Alexander Rothman, Vaughan W. Rees, Nancy Gibbs, Amit Goldenberg, James Gross, Olga Bialobrzeska, Martin R. Vasilev, Julia Beitner, Ondřej Kácha, Barbara Zuro, Minja Westerlund, Mina Nedelcheva-Datsova, Andrej Findor, Dajana Krupić, Marta Kowal, Adrian Dahl Askelund, Razieh Pourafshari, Jasna Milošević Đorđević, Nadya-Daniela Schmidt, Ekaterina Baklanova, Anna Szala, Marek Albert Vranka, Keiko Ihaya, Caterina Grano, Nicola Cellini, Michal Bialek, Lisa Anton-Boicuk, Ilker Dalgar, Arca Adıgüzel, Jeroen P. H. Verharen, Princess Lovella Gonzales Maturan, Angelos Kassianos, Raquel Alves Oliveira, Martin Čadek, Vera Cubela Adoric, Asil Ali Özdoğru, Therese E Sverdrup, Balazs Aczel, Danilo Zambrano, Christian K. Tamnes, Yuki Yamada, Leonhard Volz, Naoyuki Sunami, Lilian Suter, Luc Vieira, Agata Groyecka-Bernard, Julia Kamburidis, Ulf-Dietrich Reips, Mikayel Harutyunyan, Gabriel Agboola Adetula, Tara Bulut Allred, Krystian Barzykowski, Benedict Guzman Antazo, Dušana Šakan, Wilson Cyrus-Lai, Lina Ahlgren, Matej Hruška, Efisio Manunta, Aviv Mokady, Mariagrazia Capizzi, Marcel Martončik, Nicolas Say, Roosevelt Vilar, Karolina Staniaszek, Milica Vdovic, Matus Adamkovic, Niklas Johannes, Nandor Hajdu, Noga Cohen, Clara S. R. Overkott, Dino Krupić, Barbora Hubená, Gustav Nilsonne, Giovanna Mioni, Claudio Singh Solorzano, Tatsunori Ishii, Zhang Chen, Elizaveta Kushnir, CEMRE KARAARSLAN, Rafael Ramos Ribeiro, Małgorzata Kossowska, Jozef Bavolar, Karlijn Hoyer, Marta Roczniewska, Alper KARABABA, Maja Becker, Renan P. Monteiro, Yoshihiko Kunisato, Irem Metin-Orta, Luca Kozma, Gabriela Czarnek, Artur Domurat, Eva Štrukelj, Daniela Serrato Alvarez, Sébastien Massoni, Johanna Czamanski-Cohen, Ekaterina Pronizius, Fany Muchembled, Asli Sacakli, Evgeniya Hristova, Anna O. Kuzminska, Abdelilah CHARYATE, Gijsbert Bijlstra, Reza Afhami, Nadyanna M. Majeed, Erica D. Musser, Miroslav Sirota, Robert M Ross, Siu Kit Yeung, Marietta Papadatou-Pastou, Francesco Foroni, Inês A. T. Almeida, Dmitry Grigoryev, David M. G. Lewis, Dawn Liu Holford, Steve M. J. Janssen, Srinivasan Tatachari, Carlota Batres, Jonas Olofsson, Shimrit Daches, Anabel Belaus, Gerit Pfuhl, Nadia Saraí Corral-Frías, Daniela Sousa, Jan Philipp Röer, Peder Mortvedt Isager, Hendrik Godbersen, Radoslaw B. Walczak, Natalia Van Doren, Dongning Ren, Martin Voracek, Lisa Marie DeBruine, Michele Anne, Sanja Batić Očovaj, Andrew G. Thomas, Alexios Arvanitis, Thomas Ostermann, Kelly Wolfe, Nwadiogo Chisom Arinze, Claus Lamm, Robert Calin-Jageman, William E. Davis, Maria Karekla, Saša Zorjan, Lisa M Jaremka, Jim Uttley, Monika Hricova, Monica A Koehn, Hui Bai, Anthony James Krafnick, Busra Bahar Balci, Tonia Ballantyne, Samuel Lins, Zahir Vally, Celia Esteban Serna, Kathleen Schmidt, Paulo Manuel Labalan Macapagal, Paulina Szwed, Przemysław Zdybek, David Moreau, W. Matthew Collins, Jennifer Alana Joy-Gaba, Iris Vilares, Ulrich S. Tran, Jordane Boudesseul, Nihan Albayrak-Aydemir, Barnaby Dixson, Jennifer Torkildson Perillo, Ana Ferreira, Erin Corwin Westgate, Chris Aberson, Azuka Ikechukwu ARINZE, Bastian Jaeger, Muhammad Mussaffa Butt, Jaime Silva Rojas, Daniel Storage, Allison Janak, Jose Angel Soto, Agnieszka Sorokowska, Randy J. McCarthy, Alexa Mary Tullett, Martha Frias-Armenta, Matheus Fernando Felix Ribeiro, Andree Hartanto, Paul Forbes, Megan Willis, Adriana Olaya Torres, ANABEL DE LA ROSA GOMEZ, Clare Sutherland, Mathi Manavalan, Jan Urban, Ernest Baskin, Joseph Patrick McFall, Chisom Ogbonnaya, Cynthia H.Y. Fu, Rima-Maria Rahal, Izuchukwu Lawrence Gabriel Ndukaihe, Tom Hostler, Heather Barry Kappes, Piotr Sorokowski, Meetu Khosla, Johannes K Vilsmeier, Elkin Oswaldo Luis Garcia, Rafał Muda, Elena Agadullina, Rodrigo Cárcamo, Crystal Reeck, Gulnaz Anjum, Mónica Toro, Michał Misiak, Richard M. Ryan, Nora L. Nock, Giovanni A. Travaglino, Michael Craig Mensink, Gilad Feldman, Aaron Lee Wichman, Ignazio Ziano, Martin Seehuus, William J. Chopik, Franki Y. H. Kung, Joelle Carpentier, Leigh Ann Vaughn, Hongfei Du, Qinyu Xiao, Tiago J. S. Lima, Chris Noone, Sandersan Onie, Frederick Verbruggen, Theda Radtke, Ljiljana B. Lazarevic, Ahmed Khaoudi, Ahmed Bokkour, Ikhlas Djamai, Ian David Stephen, Thuy-vy Thi Nguyen, Brian P. Gill, Hannah Moshontz, Charles Dorison, Karen Yu, Diego Vega, Natalya Kiselnikova, Michal Parzuchowski, Sylwia Adamus, Ilya Zakharov, Luis Eudave, Afroja Ahmed, Kevin van Schie, Wlliam Alexander Jimenez Leal, MohammadHasan Sharifian, David C. Vaidis, Katarzyna Filip, Carsten Bundt, Behzad Behzadnia, Tripat Gill, Weilun Chou, Maria del Carmen, and Maximilian Primbs

Abstract

In response to the COVID-19 pandemic, the Psychological Science Accelerator coordinated three large-scale psychological studies to examine the effects of loss-gain framing, cognitive reappraisals, and autonomy framing manipulations on behavioral intentions and affective measures. The data collected (April to October 2020) included specific measures for each experimental study, a general questionnaire examining health prevention behaviors and COVID-19 experience, geographical and cultural context characterization, and demographic information for each participant. Each participant started the study with the same general questions and then was randomized to complete either one longer experiment or two shorter experiments. Data were provided by 73,223 participants with varying completion rates. Participants completed the survey from 111 geopolitical regions in 44 unique languages/dialects. The anonymized dataset described here is provided in both raw and processed formats to facilitate re-use and further analyses. The dataset offers secondary analytic opportunities to explore coping, framing, and self-determination across a diverse, global sample obtained at the onset of the COVID-19 pandemic, which can be merged with other time-sampled or geographic data.

Published
2023

24. Transparency Guidance for ChatGPT Usage in Scientific Writing

Author

Balazs Aczel and Eric-Jan Wagenmakers

Abstract

The use of text-generating Large Language Models (LLM), such as ChatGPT, in scholarly writing presents challenges to transparency and credibility. Journals and institutes are in need to revise their policies on whether the usage of such tools is acceptable throughout the research workflow and to provide guidance on how to safeguard transparency and credibility when LLMs are allowed to assist researchers. The present practical guideline should help those scholars who use LLMs and journals and institutes that allow using them. We also provide an example text to show a transparent usage of ChatGPT.

Published
2023

25. Situational factors shape moral judgements in the trolley dilemma in Eastern, Southern and Western countries in a culturally diverse sample

Author

Bence Bago, Marton Kovacs, John Protzko, Tamas Nagy, Zoltan Kekecs, Bence Palfi, Matus Adamkovic, Sylwia Adamus, Sumaya Albalooshi, Nihan Albayrak-Aydemir, Ilham N. Alfian, Sinan Alper, Sara Alvarez-Solas, Sara G. Alves, Santiago Amaya, Pia K. Andresen, Gulnaz Anjum, Daniel Ansari, Patrícia Arriaga, John Jamir Benzon R. Aruta, Alexios Arvanitis, Peter Babincak, Krystian Barzykowski, Bana Bashour, Ernest Baskin, Luisa Batalha, Carlota Batres, Jozef Bavolar, Fatih Bayrak, Benjamin Becker, Maja Becker, Anabel Belaus, Michał Białek, Ennio Bilancini, Daniel Boller, Leonardo Boncinelli, Jordane Boudesseul, Benjamin T. Brown, Erin M. Buchanan, Muhammad M. Butt, Dustin P. Calvillo, Nate C. Carnes, Jared B. Celniker, Christopher R. Chartier, William J. Chopik, Poom Chotikavan, Hu Chuan-Peng, Rockwell F. Clancy, Ogeday Çoker, Rita C. Correia, Vera Cubela Adoric, Carmelo P. Cubillas, Stefan Czoschke, Yalda Daryani, Job A. M. de Grefte, Wieteke C. de Vries, Elif G. Demirag Burak, Carina Dias, Barnaby J. W. Dixson, Xinkai Du, Francesca Dumančić, Andrei Dumbravă, Natalia B. Dutra, Janina Enachescu, Celia Esteban-Serna, Luis Eudave, Thomas R. Evans, Gilad Feldman, Fatima M. Felisberti, Susann Fiedler, Andrej Findor, Alexandra Fleischmann, Francesco Foroni, Radka Francová, Darius-Aurel Frank, Cynthia H. Y. Fu, Shan Gao, Omid Ghasemi, Ali-Reza Ghazi-Noori, Maliki E. Ghossainy, Isabella Giammusso, Tripat Gill, Biljana Gjoneska, Mario Gollwitzer, Aurélien Graton, Maurice Grinberg, Agata Groyecka-Bernard, Elizabeth A. Harris, Andree Hartanto, Widad A. N. M. Hassan, Javad Hatami, Katrina R. Heimark, Jasper J. J. Hidding, Evgeniya Hristova, Matej Hruška, Charlotte A. Hudson, Richard Huskey, Ayumi Ikeda, Yoel Inbar, Gordon P. D. Ingram, Ozan Isler, Chris Isloi, Aishwarya Iyer, Bastian Jaeger, Steve M. J. Janssen, William Jiménez-Leal, Biljana Jokić, Pavol Kačmár, Veselina Kadreva, Gwenaël Kaminski, Farzan Karimi-Malekabadi, Arno T. A. Kasper, Keith M. Kendrick, Bradley J. Kennedy, Halil E. Kocalar, Rabia I. Kodapanakkal, Marta Kowal, Elliott Kruse, Lenka Kučerová, Anton Kühberger, Anna O. Kuzminska, Fanny Lalot, Claus Lamm, Joris Lammers, Elke B. Lange, Anthony Lantian, Ivy Y.-M. Lau, Ljiljana B. Lazarevic, Marijke C. Leliveld, Jennifer N. Lenz, Carmel A. Levitan, Savannah C. Lewis, Manyu Li, Yansong Li, Haozheng Li, Tiago J. S. Lima, Samuel Lins, Marco Tullio Liuzza, Paula Lopes, Jackson G. Lu, Trent Lynds, Martin Máčel, Sean P. Mackinnon, Madhavilatha Maganti, Zoe Magraw-Mickelson, Leon F. Magson, Harry Manley, Gabriela M. Marcu, Darja Masli Seršić, Celine-Justine Matibag, Alan D. A. Mattiassi, Mahdi Mazidi, Joseph P. McFall, Neil McLatchie, Michael C. Mensink, Lena Miketta, Taciano L. Milfont, Alberto Mirisola, Michal Misiak, Panagiotis Mitkidis, Mehrad Moeini-Jazani, Arash Monajem, David Moreau, Erica D. Musser, Erita Narhetali, Danielle P. Ochoa, Jerome Olsen, Nicholas C. Owsley, Asil A. Özdoğru, Miriam Panning, Marietta Papadatou-Pastou, Neha Parashar, Philip Pärnamets, Mariola Paruzel-Czachura, Michal Parzuchowski, Julia V. Paterlini, Jeffrey M. Pavlacic, Mehmet Peker, Kim Peters, Liudmila Piatnitckaia, Isabel Pinto, Monica Renee Policarpio, Nada Pop-Jordanova, Annas J. Pratama, Maximilian A. Primbs, Ekaterina Pronizius, Danka Purić, Elisa Puvia, Vahid Qamari, Kun Qian, Alain Quiamzade, Beáta Ráczová, Diego A. Reinero, Ulf-Dietrich Reips, Cecilia Reyna, Kimberly Reynolds, Matheus F. F. Ribeiro, Jan P. Röer, Robert M. Ross, Petros Roussos, Fernando Ruiz-Dodobara, Susana Ruiz-Fernandez, Bastiaan T. Rutjens, Katarzyna Rybus, Adil Samekin, Anabela C. Santos, Nicolas Say, Christoph Schild, Kathleen Schmidt, Karolina A. Ścigała, MohammadHasan Sharifian, Jiaxin Shi, Yaoxi Shi, Erin Sievers, Miroslav Sirota, Michael Slipenkyj, Çağlar Solak, Agnieszka Sorokowska, Piotr Sorokowski, Sinem Söylemez, Niklas K. Steffens, Ian D. Stephen, Anni Sternisko, Laura Stevens-Wilson, Suzanne L. K. Stewart, Stefan Stieger, Daniel Storage, Justine Strube, Kyle J. Susa, Raluca D. Szekely-Copîndean, Natalia M. Szostak, Bagus Takwin, Srinivasan Tatachari, Andrew G. Thomas, Kevin E. Tiede, Lucas E. Tiong, Mirjana Tonković, Bastien Trémolière, Lauren V. Tunstead, Belgüzar N. Türkan, Mathias Twardawski, Miguel A. Vadillo, Zahir Vally, Leigh Ann Vaughn, Bruno Verschuere, Denis Vlašiček, Martin Voracek, Marek A. Vranka, Shuzhen Wang, Skye-Loren West, Stephen Whyte, Leigh S. Wilton, Anna Wlodarczyk, Xue Wu, Fei Xin, Su Yadanar, Hiroshi Yama, Yuki Yamada, Onurcan Yilmaz, Sangsuk Yoon, Danielle M. Young, Ilya Zakharov, Rizqy A. Zein, Ingo Zettler, Iris L. Žeželj, Don C. Zhang, Jin Zhang, Xiaoxiao Zheng, Rink Hoekstra, Balazs Aczel, Department of Social Psychology, Burak, Elif Gizem Demirağ, Bago, Bence, Kovacs, Marton, Protzko, John, Nagy, Tamas, Kekecs, Zoltan, Palfi, Bence, Adamkovic, Matus, Adamus, Sylwia, Albalooshi, Sumaya, Albayrak-Aydemir, Nihan, Alfian, Ilham N., Alper, Sinan, Alvarez-Solas, Sara, Alves, Sara G., Amaya, Santiago, Andresen, Pia K., Anjum, Gulnaz, Ansari, Daniel, Arriaga, Patricia, Aruta, John Jamir Benzon R., Arvanitis, Alexios, Babincak, Peter, Barzykowski, Krystian, Bashour, Bana, Baskin, Ernest, Batalha, Luisa, Batres, Carlota, Bavolar, Jozef, Bayrak, Fatih, Becker, Benjamin, Becker, Maja, Belaus, Anabel, Bialek, Michal, Bilancini, Ennio, Boller, Daniel, Boncinelli, Leonardo, Boudesseul, Jordane, Brown, Benjamin T., Buchanan, Erin M., Butt, Muhammad M., Calvillo, Dustin P., Carnes, Nate C., Celniker, Jared B., Chartier, Christopher R., Chopik, William J., Chotikavan, Poom, Chuan-Peng, Hu, Clancy, Rockwell F., Coker, Ogeday, Correia, Rita C., Adoric, Vera Cubela, Cubillas, Carmelo P., Czoschke, Stefan, Daryani, Yalda, de Grefte, Job A. M., de Vries, Wieteke C., Dias, Carina, Dixson, Barnaby J. W., Du, Xinkai, Dumancic, Francesca, Dumbrava, Andrei, Dutra, Natalia B., Enachescu, Janina, Esteban-Serna, Celia, Eudave, Luis, Evans, Thomas R., Feldman, Gilad, Felisberti, Fatima M., Fiedler, Susann, Findor, Andrej, Fleischmann, Alexandra, Foroni, Francesco, Francova, Radka, Frank, Darius-Aurel, Fu, Cynthia H. Y., Gao, Shan, Ghasemi, Omid, Ghazi-Noori, Ali-Reza, Ghossainy, Maliki E., Giammusso, Isabella, Gill, Tripat, Gjoneska, Biljana, Gollwitzer, Mario, Graton, Aurelien, Grinberg, Maurice, Groyecka-Bernard, Agata, Harris, Elizabeth A., Hartanto, Andree, Hassan, Widad A. N. M., Hatami, Javad, Heimark, Katrina R., Hidding, Jasper J. J., Hristova, Evgeniya, Hruska, Matej, Hudson, Charlotte A., Huskey, Richard, Ikeda, Ayumi, Inbar, Yoel, Ingram, Gordon P. D., Isler, Ozan, Isloi, Chris, Iyer, Aishwarya, Jaeger, Bastian, Janssen, Steve M. J., Jimenez-Leal, William, Jokic, Biljana, Kacmar, Pavol, Kadreva, Veselina, Kaminski, Gwenael, Karimi-Malekabadi, Farzan, Kasper, Arno T. A., Kendrick, Keith M., Kennedy, Bradley J., Kocalar, Halil E., Kodapanakkal, Rabia I., Kowal, Marta, Kruse, Elliott, Kucerova, Lenka, Kuehberger, Anton, Kuzminska, Anna O., Lalot, Fanny, Lamm, Claus, Lammers, Joris, Lange, Elke B., Lantian, Anthony, Lau, Ivy Y. -M., Lazarevic, Ljiljana B., Leliveld, Marijke C., Lenz, Jennifer N., Levitan, Carmel A., Lewis, Savannah C., Li, Manyu, Li, Yansong, Li, Haozheng, Lima, Tiago J. S., Lins, Samuel, Liuzza, Marco Tullio, Lopes, Paula, Lu, Jackson G., Lynds, Trent, Macel, Martin, Mackinnon, Sean P., Maganti, Madhavilatha, Magraw-Mickelson, Zoe, Magson, Leon F., Manley, Harry, Marcu, Gabriela M., Sersic, Darja Masli, Matibag, Celine-Justine, Mattiassi, Alan D. A., Mazidi, Mahdi, McFall, Joseph P., McLatchie, Neil, Mensink, Michael C., Miketta, Lena, Milfont, Taciano L., Mirisola, Alberto, Misiak, Michal, Mitkidis, Panagiotis, Moeini-Jazani, Mehrad, Monajem, Arash, Moreau, David, Musser, Erica D., Narhetali, Erita, Ochoa, Danielle P., Olsen, Jerome, Owsley, Nicholas C., Ozdogru, Asil A., Panning, Miriam, Papadatou-Pastou, Marietta, Parashar, Neha, Parnamets, Philip, Paruzel-Czachura, Mariola, Parzuchowski, Michal, Paterlini, Julia V., Pavlacic, Jeffrey M., Peker, Mehmet, Peters, Kim, Piatnitckaia, Liudmila, Pinto, Isabel, Policarpio, Monica Renee, Pop-Jordanova, Nada, Pratama, Annas J., Primbs, Maximilian A., Pronizius, Ekaterina, Puric, Danka, Puvia, Elisa, Qamari, Vahid, Qian, Kun, Quiamzade, Alain, Raczova, Beata, Reinero, Diego A., Reips, Ulf-Dietrich, Reyna, Cecilia, Reynolds, Kimberly, Ribeiro, Matheus F. F., Roeer, Jan P., Ross, Robert M., Roussos, Petros, Ruiz-Dodobara, Fernando, Ruiz-Fernandez, Susana, Rutjens, Bastiaan T., Rybus, Katarzyna, Samekin, Adil, Santos, Anabela C., Say, Nicolas, Schild, Christoph, Schmidt, Kathleen, Scigala, Karolina A., Sharifian, MohammadHasan, Shi, Jiaxin, Shi, Yaoxi, Sievers, Erin, Sirota, Miroslav, Slipenkyj, Michael, Solak, Caglar, Sorokowska, Agnieszka, Sorokowski, Piotr, Soylemez, Sinem, Steffens, Niklas K., Stephen, Ian D., Sternisko, Anni, Stevens-Wilson, Laura, Stewart, Suzanne L. K., Stieger, Stefan, Storage, Daniel, Strube, Justine, Susa, Kyle J., Szekely-Copindean, Raluca D., Szostak, Natalia M., Takwin, Bagus, Tatachari, Srinivasan, Thomas, Andrew G., Tiede, Kevin E., Tiong, Lucas E., Tonkovic, Mirjana, Tremoliere, Bastien, Tunstead, Lauren V., Turkan, Belguzar N., Twardawski, Mathias, Vadillo, Miguel A., Vally, Zahir, Vaughn, Leigh Ann, Verschuere, Bruno, Vlasicek, Denis, Voracek, Martin, Vranka, Marek A., Wang, Shuzhen, West, Skye-Loren, Whyte, Stephen, Wilton, Leigh S., Wlodarczyk, Anna, Wu, Xue, Xin, Fei, Yadanar, Su, Yama, Hiroshi, Yamada, Yuki, Yilmaz, Onurcan, Yoon, Sangsuk, Young, Danielle M., Zakharov, Ilya, Zein, Rizqy A., Zettler, Ingo, Zezelj, Iris L., Zhang, Don C., Zhang, Jin, Zheng, Xiaoxiao, Hoekstra, Rink, Aczel, Balazs, College of Social Sciences and Humanities, Department of Psychology, Bence Bago, Marton Kovacs , John Protzko, Tamas Nagy , Zoltan Kekecs , Bence Palfi, Matus Adamkovic, Sylwia Adamus, Sumaya Albalooshi, Nihan Albayrak-Aydemir , Ilham N. Alfian, Sinan Alper , Sara Alvarez-Solas ,Sara G. Alves , Santiago Amaya , Pia K. Andresen , Gulnaz Anjum , Daniel Ansari, Patrícia Arriaga , John Jamir Benzon R. Aruta, Alexios Arvanitis, Peter Babincak, Krystian Barzykowski, Bana Bashour , Ernest Baskin , Luisa Batalha, Carlota Batres, Jozef Bavolar , Fatih Bayrak, Benjamin Becker, Maja Becker, Anabel Belaus, Michał Białek, Ennio Bilancini, Daniel Boller, Leonardo Boncinelli, Jordane Boudesseul, Benjamin T. Brown, Erin M. Buchanan, Muhammad M. Butt, Dustin P. Calvillo, Nate C. Carnes, Jared B. Celniker, Christopher R. Chartier, William J. Chopik, Poom Chotikavan, Hu Chuan-Peng, Rockwell F. Clancy, Ogeday Çoker, Rita C. Correia, Vera Cubela Adoric, Carmelo P. Cubillas, Stefan Czoschke, Yalda Daryani, Job A. M. de Grefte, Wieteke C. de Vries, Elif G. Demirag Burak, Carina Dias, Barnaby J. W. Dixson, Xinkai Du, Francesca Dumančić, Andrei Dumbravă, Natalia B. Dutra, Janina Enachescu, Celia Esteban-Serna, Luis Eudave, Thomas R. Evans, Gilad Feldman, Fatima M. Felisberti, Susann Fiedler, Andrej Findor, Alexandra Fleischmann, Francesco Foroni, Radka Francová, Darius-Aurel Frank, Cynthia H. Y. Fu, Shan Gao, Omid Ghasemi, Ali-Reza Ghazi-Noori, Maliki E. Ghossainy, Isabella Giammusso, Tripat Gill, Biljana Gjoneska, Mario Gollwitzer, Aurélien Graton, Maurice Grinberg, Agata Groyecka-Bernard, Elizabeth A. Harris, Andree Hartanto, Widad A. N. M. Hassan, Javad Hatami, Katrina R. Heimark, Jasper J. J. Hidding, Evgeniya Hristova, Matej Hruška, Charlotte A. Hudson, Richard Huskey, Ayumi Ikeda, Yoel Inbar, Gordon P. D. Ingram, Ozan Isler, Chris Isloi, Aishwarya Iyer, Bastian Jaeger, Steve M. J. Janssen, William Jiménez-Leal, Biljana Jokić, Pavol Kačmár, Veselina Kadreva, Gwenaël Kaminski, Farzan Karimi-Malekabadi, Arno T. A. Kasper, Keith M. Kendrick, Bradley J. Kennedy, Halil E. Kocalar, Rabia I. Kodapanakkal, Marta Kowal, Elliott Kruse, Lenka Kučerová, Anton Kühberger, Anna O. Kuzminska, Fanny Lalot, Claus Lamm, Joris Lammers, Elke B. Lange, Anthony Lantian, Ivy Y.-M. Lau, Ljiljana B. Lazarevic, Marijke C. Leliveld, Jennifer N. Lenz, Carmel A. Levitan, Savannah C. Lewis, Manyu Li, Yansong Li, Haozheng Li, Tiago J. S. Lima, Samuel Lins, Marco Tullio Liuzza, Paula Lopes, Jackson G. Lu, Trent Lynds, Martin Máčel, Sean P. Mackinnon, Madhavilatha Maganti, Zoe Magraw-Mickelson, Leon F. Magson, Harry Manley, Gabriela M. Marcu, Darja Masli Seršić, Celine-Justine Matibag, Alan D. A. Mattiassi, Mahdi Mazidi, Joseph P. McFall, Neil McLatchie, Michael C. Mensink, Lena Miketta, Taciano L. Milfont, Alberto Mirisola, Michal Misiak, Panagiotis Mitkidis, Mehrad Moeini-Jazani, Arash Monajem, David Moreau, Erica D. Musser, Erita Narhetali, Danielle P. Ochoa, Jerome Olsen, Nicholas C. Owsley, Asil A. Özdoğru, Miriam Panning, Marietta Papadatou-Pastou, Neha Parashar, Philip Pärnamets, Mariola Paruzel-Czachura, Michal Parzuchowski, Julia V. Paterlini, Jeffrey M. Pavlacic, Mehmet Peker, Kim Peters, Liudmila Piatnitckaia, Isabel Pinto, Monica Renee Policarpio, Nada Pop-Jordanova, Annas J. Pratama, Maximilian A. Primbs, Ekaterina Pronizius, Danka Purić, Elisa Puvia, Vahid Qamari, Kun Qian, Alain Quiamzade, Beáta Ráczová, Diego A. Reinero, Ulf-Dietrich Reips, Cecilia Reyna, Kimberly Reynolds, Matheus F. F. Ribeiro, Jan P. Röer, Robert M. Ross, Petros Roussos, Fernando Ruiz-Dodobara, Susana Ruiz-Fernandez, Bastiaan T. Rutjens, Katarzyna Rybus, Adil Samekin, Anabela C. Santos, Nicolas Say, Christoph Schild, Kathleen Schmidt, Karolina A. Ścigała, MohammadHasan Sharifian, Jiaxin Shi, Yaoxi Shi, Erin Sievers, Miroslav Sirota, Michael Slipenkyj, Çağlar Solak, Agnieszka Sorokowska, Piotr Sorokowski, Sinem Söylemez, Niklas K. Steffens, Ian D. Stephen, Anni Sternisko, Laura Stevens-Wilson, Suzanne L. K. Stewart, Stefan Stieger, Daniel Storage, Justine Strube, Kyle J. Susa, Raluca D. Szekely-Copîndean, Natalia M. Szostak, Bagus Takwin, Srinivasan Tatachari, Andrew G. Thomas, Kevin E. Tiede, Lucas E. Tiong, Mirjana Tonković, Bastien Trémolière, Lauren V. Tunstead, Belgüzar N. Türkan, Mathias Twardawski, Miguel A. Vadillo, Zahir Vally, Leigh Ann Vaughn, Bruno Verschuere, Denis Vlašiček, Martin Voracek, Marek A. Vranka, Shuzhen Wang, Skye-Loren West, Stephen Whyte, Leigh S. Wilton, Anna Wlodarczyk, Xue Wu, Fei Xin, Su Yadanar, Hiroshi Yama, Yuki Yamada, Onurcan Yilmaz, Sangsuk Yoon, Danielle M. Young, Ilya Zakharov, Rizqy A. Zein, Ingo Zettler, Iris L. Žeželj, Don C. Zhang, Jin Zhang, Xiaoxiao Zheng,194, Rink Hoekstra and Balazs Aczel, Research Programme Marketing, Research and Evaluation of Educational Effectiveness, Faculdade de Psicologia e de Ciências da Educação, Management and Organisation, Organizational Psychology, and Sociology [until 2010]

Subjects
trolley, Situational factors, SDG 16 - Peace, Social Psychology, Individuality, BF, Experimental and Cognitive Psychology, Intention, Eastern, HM, psychology, Morals, Social Development, trolley dilemma, Behavioral Neuroscience, Judgment, ddc:150, replicability, cultural universality, Humans, Psychology, Pendiente, SHAME, CONFLICT, Behaviour Change and Well-being, philosophy, SDG 16 - Peace, Justice and Strong Institutions, moral judgement, SDG 10 - Reduced Inequalities, Justice and Strong Institutions, MODEL, NORMS, Knowledge, PROCESS DISSOCIATION, moral judgements, UTILITARIAN JUDGMENTS, Settore M-PSI/05 - Psicologia Sociale, Moral judgments, Trolley dilemma, cultural universality and variations, replication study, RESPONSES
Abstract

The study of moral judgements often centres on moral dilemmas in which options consistent with deontological perspectives (that is, emphasizing rules, individual rights and duties) are in conflict with options consistent with utilitarian judgements (that is, following the greater good based on consequences). Greene et al. (2009) showed that psychological and situational factors (for example, the intent of the agent or the presence of physical contact between the agent and the victim) can play an important role in moral dilemma judgements (for example, the trolley problem). Our knowledge is limited concerning both the universality of these effects outside the United States and the impact of culture on the situational and psychological factors affecting moral judgements. Thus, we empirically tested the universality of the effects of intent and personal force on moral dilemma judgements by replicating the experiments of Greene et al. in 45 countries from all inhabited continents. We found that personal force and its interaction with intention exert influence on moral judgements in the US and Western cultural clusters, replicating and expanding the original findings. Moreover, the personal force effect was present in all cultural clusters, suggesting it is culturally universal. The evidence for the cultural universality of the interaction effect was inconclusive in the Eastern and Southern cultural clusters (depending on exclusion criteria). We found no strong association between collectivism/individualism and moral dilemma judgements. Including participants from 45 countries, Bago et al. find that the situational factors that affect moral reasoning are shared across countries, with diminished observed cultural variation., Comunidad de Madrid [2016-T1/SOC-1395, 2020-5A/SOC-19723]; AEI [PSI2017-85159-P]; UE/FEDER; National Science Centre, Poland [2017/01/X/HS6/01332, 2015/19/D/HS6/00641, 2019/35/B/HS6/00528]; Aarhus University Research Foundation (AUFF) [AUFF-E-2019-9-4]; ANR [ANR-17-EURE-0010]; ANR Labex IAST; Australian Research Council [DP180102384]; CAPES [88887.364180/2019-00]; Carlsberg Foundation [CF16-0444]; Independent Research Fund Denmark [7024-00057B]; Germany's Excellence Strategy [EXC 2126/1-390838866]; FONDECYT, CONICYT [11190980]; German Research Foundation [FOR-2150, LA 3566/1-2]; JSPS [18K03010]; JSPS KAKENHI [16H03079, 17H00875, 18K12015, 20H04581, 17H06342, 20K03479, 20KK0054, 20J21976]; Natural Science Foundation of China (NSFC) [31530032]; Key Technological Projects of Guangdong Province [2018B030335001]; National Science Foundation Graduate Research Fellowship [DGE-1839285]; Polish National Science Center; DFG Beethoven [2016/23/G/HS6/01775]; Portuguese National Foundation for Science and Technology [SFRH/BD/126304/2016, UID/PSI/03125/2019]; PRIN 2017 (Italian Ministry of Education and Research) [20178293XT]; PSA 006 BRA 008 Data Collection in Support of PSADM 001 Measurement Invariance Project; Foundation for Polish Science (START); National Science Centre [2020/36/T/HS6/00256, 2019/33/N/HS6/00054]; Slovak Research and Development Agency [APVV-18-0140, APVV-17-0418, PRIMUS/20/HUM/009, APVV-17-0596]; Social Sciences and Humanities Research Council of Canada [950-224884]; Swedish Research Council [2016-06793]; Project of Philosophy and Social Science Research in Colleges and Universities in Jiangsu Province [2020SJA0017], M.A. Vadillo was supported by 2016-T1/SOC-1395 and 2020-5A/SOC-19723 from Comunidad de Madrid, PSI2017-85159-P from AEI and UE/FEDER. M.P.-C. was supported by 2017/01/X/HS6/01332 from the National Science Centre, Poland. P.M. was supported by Aarhus University Research Foundation (AUFF), starting grant: AUFF-E-2019-9-4. B. Bago was supported by ANR grant ANR-17-EURE-0010 (Investissements d'Avenir programme) and ANR Labex IAST. R.M.R. was supported by the Australian Research Council (DP180102384). N.B.D. was supported by CAPES grant no. 88887.364180/2019-00. C.S., K.A.. and I. Zettler were supported by the Carlsberg Foundation (CF16-0444) and the Independent Research Fund Denmark (7024-00057B). J.L. was supported by EXC 2126/1-390838866 under Germany's Excellence Strategy. K.B. was supported by the following grants from the National Science Centre, Poland: (1) while working on the data collection, no. 2015/19/D/HS6/00641, (2) while working on the final version of the paper, no. 2019/35/B/HS6/00528. A.W. was supported by FONDECYT 11190980, CONICYT. A. Fleischmann was supported by the German Research Foundation (research unit grant FOR-2150, LA 3566/1-2). H.Y. was supported by JSPS grant 18K03010. Y.Y. was supported by JSPS KAKENHI (16H03079, 17H00875, 18K12015 and 20H04581). K.Q. was supported by JSPS KAKENHI (17H06342, 20K03479 and 20KK0054). A. Ikeda was supported by JSPS KAKENHI (20J21976). K.M.K. was supported by National Natural Science Foundation of China (NSFC) grant no. 31530032 and Key Technological Projects of Guangdong Province grant no. 2018B030335001. J.B.C. was supported by National Science Foundation Graduate Research Fellowship grant no. DGE-1839285. M. Parzuchowski, K. Rybus and N.M.S. were supported by Polish National Science Center and DFG Beethoven grant 2016/23/G/HS6/01775. A.C.S. was supported by Portuguese National Foundation for Science and Technology grant no. SFRH/BD/126304/2016. L. Boncinelli was supported by PRIN 2017 grant no. 20178293XT (Italian Ministry of Education and Research). M.F.F.R. was supported by PSA 006 BRA 008 Data Collection in Support of PSADM 001 Measurement Invariance Project. M. Misiak was supported by a scholarship from the Foundation for Polish Science (START) and by a scholarship from the National Science Centre (2020/36/T/HS6/00256). P.B. was supported by Slovak Research and Development Agency project no. APVV-18-0140. M.A. was supported by Slovak Research and Development Agency project no. APVV-17-0418 and project PRIMUS/20/HUM/009. A. Findor and M.H. were supported by the Slovak Research and Development Agency under contract no. APVV-17-0596. T.G. was supported by the Social Sciences and Humanities Research Council of Canada (no. 950-224884). P.P. was supported by the Swedish Research Council (2016-06793). Y.L. was supported by The Project of Philosophy and Social Science Research in Colleges and Universities in Jiangsu Province (grant no. 2020SJA0017). M. Kowal was supported by a scholarship from the National Science Centre (2019/33/N/HS6/00054). P.A. was supported by UID/PSI/03125/2019 from the Portuguese National Foundation for Science and Technology. The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript.

Published
2022

26. No reason to expect large and consistent effects of nudge interventions

Author

Barnabas Szaszi, anthony higney, Aaron Charlton, andrew gelman, Ignazio Ziano, Balazs Aczel, Daniel G Goldstein, David Scott Yeager, and Elizabeth Tipton

Subjects
nudge, meta-analysis, behavioral insights, behavior change, Multidisciplinary, choice architecture, Psychological and Cognitive Sciences, Humans, Social Sciences, Choice Behavior
Abstract

Significance Changing individuals’ behavior is key to tackling some of today’s most pressing societal challenges such as the COVID-19 pandemic or climate change. Choice architecture interventions aim to nudge people toward personally and socially desirable behavior through the design of choice environments. Although increasingly popular, little is known about the overall effectiveness of choice architecture interventions and the conditions under which they facilitate behavior change. Here we quantitatively review over a decade of research, showing that choice architecture interventions successfully promote behavior change across key behavioral domains, populations, and locations. Our findings offer insights into the effects of choice architecture and provide guidelines for behaviorally informed policy making., Over the past decade, choice architecture interventions or so-called nudges have received widespread attention from both researchers and policy makers. Built on insights from the behavioral sciences, this class of behavioral interventions focuses on the design of choice environments that facilitate personally and socially desirable decisions without restricting people in their freedom of choice. Drawing on more than 200 studies reporting over 450 effect sizes (n = 2,149,683), we present a comprehensive analysis of the effectiveness of choice architecture interventions across techniques, behavioral domains, and contextual study characteristics. Our results show that choice architecture interventions overall promote behavior change with a small to medium effect size of Cohen’s d = 0.45 (95% CI [0.39, 0.52]). In addition, we find that the effectiveness of choice architecture interventions varies significantly as a function of technique and domain. Across behavioral domains, interventions that target the organization and structure of choice alternatives (decision structure) consistently outperform interventions that focus on the description of alternatives (decision information) or the reinforcement of behavioral intentions (decision assistance). Food choices are particularly responsive to choice architecture interventions, with effect sizes up to 2.5 times larger than those in other behavioral domains. Overall, choice architecture interventions affect behavior relatively independently of contextual study characteristics such as the geographical location or the target population of the intervention. Our analysis further reveals a moderate publication bias toward positive results in the literature. We end with a discussion of the implications of our findings for theory and behaviorally informed policy making.

Published
2022

27. A many-analysts approach to the relation between religiosity and well-being

Author

Suzanne Hoogeveen, Alexandra Sarafoglou, Balazs Aczel, Yonathan Aditya, Alexandra J. Alayan, Peter J. Allen, Sacha Altay, Shilaan Alzahawi, Yulmaida Amir, Francis-Vincent Anthony, Obed Kwame Appiah, Quentin D. Atkinson, Adam Baimel, Merve Balkaya-Ince, Michela Balsamo, Sachin Banker, František Bartoš, Mario Becerra, Bertrand Beffara, Julia Beitner, Theiss Bendixen, Jana B. Berkessel, Renatas Berniūnas, Matthew I. Billet, Joseph Billingsley, Tiago Bortolini, Heiko Breitsohl, Amélie Bret, Faith L. Brown, Jennifer Brown, Claudia C. Brumbaugh, Jacek Buczny, Joseph Bulbulia, Saúl Caballero, Leonardo Carlucci, Cheryl L. Carmichael, Marco E. G. V. Cattaneo, Sarah J. Charles, Scott Claessens, Maxinne C. Panagopoulos, Angelo Brandelli Costa, Damien L. Crone, Stefan Czoschke, Christian Czymara, E. Damiano D'Urso, Örjan Dahlström, Anna Dalla Rosa, Henrik Danielsson, Jill De Ron, Ymkje Anna de Vries, Kristy K. Dean, Bryan J. Dik, David J. Disabato, Jaclyn K. Doherty, Tim Draws, Lucas Drouhot, Marin Dujmovic, Yarrow Dunham, Tobias Ebert, Peter A. Edelsbrunner, Anita Eerland, Christian T. Elbaek, Shole Farahmand, Hooman Farahmand, Miguel Farias, Abrey A. Feliccia, Kyle Fischer, Ronald Fischer, Donna Fisher-Thompson, Zoë Francis, Susanne Frick, Lisa K. Frisch, Diogo Geraldes, Emily Gerdin, Linda Geven, Omid Ghasemi, Erwin Gielens, Vukašin Gligorić, Kristin Hagel, Nandor Hajdu, Hannah R. Hamilton, Imaduddin Hamzah, Paul H. P. Hanel, Christopher E. Hawk, Karel K. Himawan, Benjamin C. Holding, Lina E. Homman, Moritz Ingendahl, Hilla Inkilä, Mary L. Inman, Chris-Gabriel Islam, Ozan Isler, David Izydorczyk, Bastian Jaeger, Kathryn A. Johnson, Jonathan Jong, Johannes A. Karl, Erikson Kaszubowski, Benjamin A. Katz, Lucas A. Keefer, Stijn Kelchtermans, John M. Kelly, Richard A. Klein, Bennett Kleinberg, Megan L. Knowles, Marta Kołczyńska, Dave Koller, Julia Krasko, Sarah Kritzler, Angelos-Miltiadis Krypotos, Thanos Kyritsis, Todd L. Landes, Ruben Laukenmann, Guy A. Lavender Forsyth, Aryeh Lazar, Barbara J. Lehman, Neil Levy, Ronda F. Lo, Paul Lodder, Jennifer Lorenz, Paweł Łowicki, Albert L. Ly, Esther Maassen, Gina M. Magyar-Russell, Maximilian Maier, Dylan R. Marsh, Nuria Martinez, Marcellin Martinie, Ihan Martoyo, Susan E. Mason, Anne Lundahl Mauritsen, Phil McAleer, Thomas McCauley, Michael McCullough, Ryan McKay, Camilla M. McMahon, Amelia A. McNamara, Kira K. Means, Brett Mercier, Panagiotis Mitkidis, Benoît Monin, Jordan W. Moon, David Moreau, Jonathan Morgan, James Murphy, George Muscatt, Christof Nägel, Tamás Nagy, Ladislas Nalborczyk, Gustav Nilsonne, Pamina Noack, Ara Norenzayan, Michèle B. Nuijten, Anton Olsson-Collentine, Lluis Oviedo, Yuri G. Pavlov, James O. Pawelski, Hannah I. Pearson, Hugo Pedder, Hannah K. Peetz, Michael Pinus, Steven Pirutinsky, Vince Polito, Michaela Porubanova, Michael J. Poulin, Jason M. Prenoveau, Mark A. Prince, John Protzko, Campbell Pryor, Benjamin G. Purzycki, Lin Qiu, Julian Quevedo Pütter, André Rabelo, Milen L. Radell, Jonathan E. Ramsay, Graham Reid, Andrew J. Roberts, Lindsey M. Root Luna, Robert M. Ross, Piotr Roszak, Nirmal Roy, Suvi-Maria K. Saarelainen, Joni Y. Sasaki, Catherine Schaumans, Bruno Schivinski, Marcel C. Schmitt, Sarah A. Schnitker, Martin Schnuerch, Marcel R. Schreiner, Victoria Schüttengruber, Simone Sebben, Suzanne C. Segerstrom, Berenika Seryczyńska, Uffe Shjoedt, Müge Simsek, Willem W. A. Sleegers, Eliot R. Smith, Walter J. Sowden, Marion Späth, Christoph Spörlein, William Stedden, Andrea H. Stoevenbelt, Simon Stuber, Justin Sulik, Christiany Suwartono, Stylianos Syropoulos, Barnabas Szaszi, Peter Szecsi, Ben M. Tappin, Louis Tay, Robert T. Thibault, Burt Thompson, Christian M. Thurn, Josefa Torralba, Shelby D. Tuthill, Ann-Marie Ullein, Robbie C. M. Van Aert, Marcel A. L. M. van Assen, Patty Van Cappellen, Olmo R. van den Akker, Ine Van der Cruyssen, Jolanda Van der Noll, Noah N. N. van Dongen, Caspar J. Van Lissa, Valerie van Mulukom, Don van Ravenzwaaij, Casper J. J. van Zyl, Leigh Ann Vaughn, Bojana Većkalov, Bruno Verschuere, Michelangelo Vianello, Felipe Vilanova, Allon Vishkin, Vera Vogel, Leonie V. D. E. Vogelsmeier, Shoko Watanabe, Cindel J. M. White, Kristina Wiebels, Sera Wiechert, Zachary Z. Willett, Maciej Witkowiak, Charlotte V. O. Witvliet, Dylan Wiwad, Robin Wuyts, Dimitris Xygalatas, Xin Yang, Darren J. Yeo, Onurcan Yilmaz, Natalia Zarzeczna, Yitong Zhao, Josjan Zijlmans, Michiel van Elk, Eric-Jan Wagenmakers, Pediatrics, APH - Mental Health, Sociology, Tilburg University, Department of Methodology and Statistics, Organizational Psychology, Social Psychology, Functional Genomics, and Faculty of Behavioural and Movement Sciences

Subjects
INVOLVEMENT, HAPPINESS, Health, many analysts, open science, religion, PEOPLE HAPPY, Religious studies, BF, HN, Religionsvetenskap, SPIRITUALITY, Social Development, Religious Studies, Communication and Media, LIFE, CULTURE, REPLICATION, BV, PERSPECTIVE, CONSENSUS, MENTAL-HEALTH
Abstract

The relation between religiosity and well-being is one of the most researched topics in the psychology of religion, yet the directionality and robustness of the effect remains debated. Here, we adopted a many-analysts approach to assess the robustness of this relation based on a new cross-cultural dataset (N = 10, 535 participants from 24 countries). We recruited 120 analysis teams to investigate (1) whether religious people self-report higher well-being, and (2) whether the relation between religiosity and self-reported well-being depends on perceived cultural norms of religion (i.e., whether it is considered normal and desirable to be religious in a given country). In a two-stage procedure, the teams first created an analysis plan and then executed their planned analysis on the data. For the first research question, all but 3 teams reported positive effect sizes with credible/confidence intervals excluding zero (median reported beta = 0.120). For the second research question, this was the case for 65% of the teams (median reported beta = 0.039). While most teams applied (multilevel) linear regression models, there was considerable variability in the choice of items used to construct the independent variables, the dependent variable, and the included covariates. Funding: Australian Research Council [DP180102384]; Cogito Foundation [R10917]; French Agence Nationale de la Recherche [17-EURE-0017, 10-IDEX-0001-02]; National Science Foundation Graduate Research Fellowship [GR100544, DGE-2139841]; Netherlands Organisation for Scientific Research [406-17-568, 016.Vici.170.083, 016.Vidi.188.001]; John Templeton Foundation [60663]; Templeton Religion Trust [TRT 0154]; German Research Foundation [GRK 2277]

Published
2022

28. Facing the Unknown Unknowns of Data Analysis

Author

Eric-Jan Wagenmakers, Alexandra Sarafoglou, and Balazs Aczel

Subjects
General Psychology
Abstract

Empirical claims are inevitably associated with uncertainty, and a major goal of data analysis is therefore to quantify that uncertainty. Recent work has revealed that most uncertainty may lie not in what is usually reported (e.g., p value, confidence interval, or Bayes factor) but in what is left unreported (e.g., how the experiment was designed, whether the conclusion is robust under plausible alternative analysis protocols, and how credible the authors believe their hypothesis to be). This suggests that the rigorous evaluation of an empirical claim involves an assessment of the entire empirical cycle and that scientific progress benefits from radical transparency in planning, data management, inference, and reporting. We summarize recent methodological developments in this area and conclude that the focus on a single statistical analysis is myopic. Sound statistical analysis is important, but social scientists may gain more insight by taking a broad view on uncertainty and by working to reduce the “unknown unknowns” that still plague reporting practice.

Published
2023

29. Seven Steps Toward More Transparency in Statistical Practice

Author

Casper J. Albers, Franziska A. Stanke, Štěpán Bahník, Jorge N. Tendeiro, Balazs Aczel, Alexandra Sarafoglou, David Moreau, Rink Hoekstra, Don van Ravenzwaaij, Noah van Dongen, Sil Aarts, Eric-Jan Wagenmakers, Aljaž Sluga, Johannes Algermissen, Psychometrics and Statistics, Research and Evaluation of Educational Effectiveness, RS: CAPHRI - R1 - Ageing and Long-Term Care, and Health Services Research

Subjects
MetaArXiv|Social and Behavioral Sciences|Political Science, Social Psychology, bepress|Social and Behavioral Sciences|Economics, Statistics as Topic, Acknowledgement, Behavioural sciences, Experimental and Cognitive Psychology, TABLES, GRAPHS, bepress|Social and Behavioral Sciences|Political Science, Ethos, Behavioral Neuroscience, MetaArXiv|Social and Behavioral Sciences|Other Social and Behavioral Sciences, bepress|Social and Behavioral Sciences|Social Statistics, Openness to experience, Statistical inference, Humans, Positive economics, Universalism, bepress|Social and Behavioral Sciences|Other Social and Behavioral Sciences, bepress|Social and Behavioral Sciences|Psychology, MetaArXiv|Social and Behavioral Sciences, Models, Statistical, Information Dissemination, Action, intention, and motor control, MetaArXiv|Social and Behavioral Sciences|Social Statistics, Uncertainty, Common ground, Transparency (behavior), TRIALS, Research Design, MetaArXiv|Social and Behavioral Sciences|Economics, MetaArXiv|Social and Behavioral Sciences|Psychology, Data Interpretation, Statistical, bepress|Social and Behavioral Sciences, VISUALIZATION, Psychology
Abstract

We argue that statistical practice in the social and behavioural sciences benefits from transparency, a fair acknowledgement of uncertainty and openness to alternative interpretations. Here, to promote such a practice, we recommend seven concrete statistical procedures: (1) visualizing data; (2) quantifying inferential uncertainty; (3) assessing data preprocessing choices; (4) reporting multiple models; (5) involving multiple analysts; (6) interpreting results modestly; and (7) sharing data and code. We discuss their benefits and limitations, and provide guidelines for adoption. Each of the seven procedures finds inspiration in Merton's ethos of science as reflected in the norms of communalism, universalism, disinterestedness and organized scepticism. We believe that these ethical considerations-as well as their statistical consequences-establish common ground among data analysts, despite continuing disagreements about the foundations of statistical inference.Wagenmakers and colleagues describe seven statistical procedures that increase transparency in data analysis. These procedures highlight common ground among data analysts from different schools and find inspiration in Merton's ethos of science.

Published
2021

30. Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability

Author

Lena F. Aeschbach, Balazs Aczel, Maria Vlachou, Blair Saunders, Jennifer A. Joy-Gaba, Ailsa E. Millen, Christopher R. Chartier, Danielle J. Kellier, Carlo Chiorri, Damian Pieńkosz, Tiago Jessé Souza de Lima, Sean Hughes, Carmel A. Levitan, Luca Andrighetto, Mallory C. Kidwell, Domenico Viganola, Sebastiaan Pessers, Sue Kraus, Claudia Chloe Brumbaugh, John E. Edlund, Ernest Baskin, Anna Fedor, Brett Mercier, Michał J. Białek, Sean Coary, Antonia M. Ciunci, Bence E. Bakos, Jon Grahe, Sabina Kołodziej, Radomir Belopavlović, Emilian Pękala, William J. Chopik, Rosanna E. Guadagno, Don A. Moore, Florian Brühlmann, Gideon Nave, Katarzyna Idzikowska, Rachel L. Shubella, Ryan J. Walker, Orsolya Szöke, Mathias Kauff, Ana Orlić, Sara Steegen, Hans IJzerman, Katarzyna Kuchno, Mitchell M. Metzger, Heather M. Claypool, Michael J. Wood, Samuel Lincoln Bezerra Lins, Michael C. Frank, Benjamin Dering, Iris Žeželj, Erica Baranski, Sophia C. Weissgerber, Timothy Razza, Leanne Boucher, Magnus Johannesson, R. Weylin Sternglanz, Yiling Chen, Maya B. Mathur, Christian Nunnally, Jonathan Ravid, Charles R. Ebersole, Lauren Skorb, Kurt Schuepfer, Łukasz Markiewicz, Thomas Schultze, Katherine S. Corker, Thomas Pfeiffer, Darko Stojilović, Oliver Christ, Kayla Ashbaugh, Alan Jern, Caio Ambrosio Lage, Filipe Falcão, Austin Lee Nichols, Peter Babincak, Mauro Giacomantonio, Sean C. Rife, Rafał Muda, Lacy E. Krueger, Jeremy K. Miller, Juliette Richetin, Martin Corley, Venus Meyet, W. Matthew Collins, Luana Elayne Cunha de Souza, Lynda A. R. Stein, Christopher Day, Erica Casini, Astrid Schütz, Ann-Kathrin Torka, Anna Dreber, Diane-Jo Bart-Plange, Steffen R. Giessner, Holly Arrow, Przemysław Sawicki, Joachim Hüffmeier, Ian R. Ferguson, Anna Dalla Rosa, Natasha Tidwell, Hause Lin, Matthew R. Penner, Boban Petrović, Bojana Bodroža, Janos Salamon, Josiah P. J. King, Mark Zrubka, Diane B. V. Bonfiglio, Stefan Schulz-Hardt, Emily Fryberger, Gabriel Baník, David Zealley, Amanda M. Kimbrough, Ewa Hałasa, William Jiménez-Leal, Angelo Panno, Karolina Krasuska, Michael Inzlicht, Jack Arnal, Madhavi Menon, Jia E. Loy, Vanessa S. Kolb, Nicholas G. Bloxsom, Michael H. Bernstein, Máire B. Ford, Grecia Kessinger, Marija V. Čolić, Wolf Vanpaemel, Barnabas Szaszi, Carly tocco, Nick Buttrick, Emanuele Preti, Andres Montealegre, Brian A. Nosek, Katarzyna Gawryluk, Kaylis Hase Rudy, Leigh Ann Vaughn, Anna Palinkas, Rúben Silva, Daniel Wolf, Sarah A. Novak, Aaron L. Wichman, Manuela Thomae, Adam Siegel, Ivana Pedović, Eleanor V. Langford, Kathleen Schmidt, Daniel Storage, Attila Szuts, Ljiljana B. Lazarević, Paul G. Curran, Rias A. Hilliard, Alexander Garinther, Joshua K. Hartshorne, Ani N. Shabazian, Tiago Ramos, Peter Szecsi, Hugh Rabagliati, Kimberly P. Parks, Lily Feinberg, Dylan Manfredi, Ivan Ropovik, Katrin Rentzsch, Michelangelo Vianello, Barbara Sioma, Marton Kovacs, Francis Tuerlinckx, Peter J. B. Hancock, Bradford J. Wiggins, Gavin Brent Sullivan, Danka Purić, Laboratoire Inter-universitaire de Psychologie : Personnalité, Cognition, Changement Social (LIP-PC2S), Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Savoie Mont Blanc (USMB [Université de Savoie] [Université de Chambéry]), Department of Organisation and Personnel Management, Human Resource Excellence, Ebersole, C, Mathur, M, Baranski, E, Bart-Plange, D, Buttrick, N, Chartier, C, Corker, K, Corley, M, Hartshorne, J, Ijzerman, H, Lazarević, L, Rabagliati, H, Ropovik, I, Aczel, B, Aeschbach, L, Andrighetto, L, Arnal, J, Arrow, H, Babincak, P, Bakos, B, Baník, G, Baskin, E, Belopavlović, R, Bernstein, M, Białek, M, Bloxsom, N, Bodroža, B, Bonfiglio, D, Boucher, L, Brühlmann, F, Brumbaugh, C, Casini, E, Chen, Y, Chiorri, C, Chopik, W, Christ, O, Ciunci, A, Claypool, H, Coary, S, Čolić, M, Collins, W, Curran, P, Day, C, Dering, B, Dreber, A, Edlund, J, Falcão, F, Fedor, A, Feinberg, L, Ferguson, I, Ford, M, Frank, M, Fryberger, E, Garinther, A, Gawryluk, K, Ashbaugh, K, Giacomantonio, M, Giessner, S, Grahe, J, Guadagno, R, Hałasa, E, Hancock, P, Hilliard, R, Hüffmeier, J, Hughes, S, Idzikowska, K, Inzlicht, M, Jern, A, Jiménez-Leal, W, Johannesson, M, Joy-Gaba, J, Kauff, M, Kellier, D, Kessinger, G, Kidwell, M, Kimbrough, A, King, J, Kolb, V, Kołodziej, S, Kovacs, M, Krasuska, K, Kraus, S, Krueger, L, Kuchno, K, Lage, C, Langford, E, Levitan, C, de Lima, T, Lin, H, Lins, S, Loy, J, Manfredi, D, Markiewicz, Ł, Menon, M, Mercier, B, Metzger, M, Meyet, V, Millen, A, Miller, J, Montealegre, A, Moore, D, Muda, R, Nave, G, Nichols, A, Novak, S, Nunnally, C, Orlić, A, Palinkas, A, Panno, A, Parks, K, Pedović, I, Pękala, E, Penner, M, Pessers, S, Petrović, B, Pfeiffer, T, Pieńkosz, D, Preti, E, Purić, D, Ramos, T, Ravid, J, Razza, T, Rentzsch, K, Richetin, J, Rife, S, Rosa, A, Rudy, K, Salamon, J, Saunders, B, Sawicki, P, Schmidt, K, Schuepfer, K, Schultze, T, Schulz-Hardt, S, Schütz, A, Shabazian, A, Shubella, R, Siegel, A, Silva, R, Sioma, B, Skorb, L, de Souza, L, Steegen, S, Stein, L, Sternglanz, R, Stojilović, D, Storage, D, Sullivan, G, Szaszi, B, Szecsi, P, Szöke, O, Szuts, A, Thomae, M, Tidwell, N, Tocco, C, Torka, A, Tuerlinckx, F, Vanpaemel, W, Vaughn, L, Vianello, M, Viganola, D, Vlachou, M, Walker, R, Weissgerber, S, Wichman, A, Wiggins, B, Wolf, D, Wood, M, Zealley, D, Žeželj, I, Zrubka, M, Nosek, B, and Faculdade de Psicologia e de Ciências da Educação

Subjects
replication, metascience, Registered Reports, biology, media_common.quotation_subject, Curran, 05 social sciences, [SHS.PSY]Humanities and Social Sciences/Psychology, open data, Art history, 050109 social psychology, Art, biology.organism_classification, preregistered, 050105 experimental psychology, Attila, [STAT.ML]Statistics [stat]/Machine Learning [stat.ML], 0501 psychology and cognitive sciences, reproducibility, [STAT.ME]Statistics [stat]/Methodology [stat.ME], General Psychology, media_common
Abstract

Additional co-authors: Ivan Ropovik, Balazs Aczel, Lena F. Aeschbach, Luca Andrighetto, Jack D. Arnal, Holly Arrow, Peter Babincak, Bence E. Bakos, Gabriel Banik, Ernest Baskin, Radomir Belopavlovic, Michael H. Bernstein, Michal Bialek, Nicholas G. Bloxsom, Bojana Bodroža, Diane B. V. Bonfiglio, Leanne Boucher, Florian Bruhlmann, Claudia C. Brumbaugh, Erica Casini, Yiling Chen, Carlo Chiorri, William J. Chopik, Oliver Christ, Antonia M. Ciunci, Heather M. Claypool, Sean Coary, Marija V. Cˇolic, W. Matthew Collins, Paul G. Curran, Chris R. Day, Anna Dreber, John E. Edlund, Filipe Falcao, Anna Fedor, Lily Feinberg, Ian R. Ferguson, Maire Ford, Michael C. Frank, Emily Fryberger, Alexander Garinther, Katarzyna Gawryluk, Kayla Ashbaugh, Mauro Giacomantonio, Steffen R. Giessner, Jon E. Grahe, Rosanna E. Guadagno, Ewa Halasa, Rias A. Hilliard, Joachim Huffmeier, Sean Hughes, Katarzyna Idzikowska, Michael Inzlicht, Alan Jern, William Jimenez-Leal, Magnus Johannesson, Jennifer A. Joy-Gaba, Mathias Kauff, Danielle J. Kellier, Grecia Kessinger, Mallory C. Kidwell, Amanda M. Kimbrough, Josiah P. J. King, Vanessa S. Kolb, Sabina Kolodziej, Marton Kovacs, Karolina Krasuska, Sue Kraus, Lacy E. Krueger, Katarzyna Kuchno, Caio Ambrosio Lage, Eleanor V. Langford, Carmel A. Levitan, Tiago Jesse Souza de Lima, Hause Lin, Samuel Lins, Jia E. Loy, Dylan Manfredi, Łukasz Markiewicz, Madhavi Menon, Brett Mercier, Mitchell Metzger, Venus Meyet, Jeremy K. Miller, Andres Montealegre, Don A. Moore, Rafal Muda, Gideon Nave, Austin Lee Nichols, Sarah A. Novak, Christian Nunnally, Ana Orlic, Anna Palinkas, Angelo Panno, Kimberly P. Parks, Ivana Pedovic, Emilian Pekala, Matthew R. Penner, Sebastiaan Pessers, Boban Petrovic, Thomas Pfeiffer, Damian Pienkosz, Emanuele Preti, Danka Puric, Tiago Ramos, Jonathan Ravid, Timothy S. Razza, Katrin Rentzsch, Juliette Richetin, Sean C. Rife, Anna Dalla Rosa, Kaylis Hase Rudy, Janos Salamon, Blair Saunders, Przemyslaw Sawicki, Kathleen Schmidt, Kurt Schuepfer, Thomas Schultze, Stefan Schulz-Hardt, Astrid Schutz, Ani N. Shabazian, Rachel L. Shubella, Adam Siegel, Ruben Silva, Barbara Sioma, Lauren Skorb, Luana Elayne Cunha de Souza, Sara Steegen, L. A. R. Stein, R. Weylin Sternglanz, Darko Stojilovic, Daniel Storage, Gavin Brent Sullivan, Barnabas Szaszi, Peter Szecsi, Orsolya Szoke, Attila Szuts, Manuela Thomae, Natasha D. Tidwell, Carly Tocco, Ann-Kathrin Torka, Francis Tuerlinckx, Wolf Vanpaemel, Leigh Ann Vaughn, Michelangelo Vianello, Domenico Viganola, Maria Vlachou, Ryan J. Walker, Sophia C. Weissgerber, Aaron L. Wichman, Bradford J. Wiggins, Daniel Wolf, Michael J. Wood, David Zealley, Iris Žeželj, Mark Zrubka, and Brian A. Nosek

Published
2020

31. Many Labs 5: Replication of van Dijk, van Kleef, Steinel, and van Beest (2008)

Author

Gideon Nave, Katrin Rentzsch, Rafał Muda, Barbara Sioma, Emilian Pękala, Anna Fedor, Janos Salamon, Attila Szuts, Balazs Aczel, Karolina Krasuska, Jonathan Ravid, Oliver Christ, Barnabas Szaszi, Orsolya Szöke, Joshua K. Hartshorne, Mathias Kauff, Marton Kovacs, Peter Szecsi, Lily Feinberg, Bence E. Bakos, Lauren Skorb, Dylan Manfredi, Katarzyna Kuchno, Thomas Schultze, Ewa Hałasa, William Jiménez-Leal, Andres Montealegre, Damian Pieńkosz, and Stefan Schulz-Hardt

Subjects
010104 statistics & probability, 05 social sciences, Replication (statistics), 050109 social psychology, 0501 psychology and cognitive sciences, Sociology, 0101 mathematics, 01 natural sciences, Humanities, General Psychology
Abstract

As part of the Many Labs 5 project, we ran a replication of van Dijk, van Kleef, Steinel, and van Beest’s (2008) study examining the effect of emotions in negotiations. They reported that when the consequences of rejection were low, subjects offered fewer chips to angry bargaining partners than to happy partners. We ran this replication under three protocols: the protocol used in the Reproducibility Project: Psychology, a revised protocol, and an online protocol. The effect averaged one ninth the size of the originally reported effect and was significant only for the revised protocol. However, the difference between the original and revised protocols was not significant.

Published
2020

32. Many Labs 5: Registered Replication of Vohs and Schooler (2008), Experiment 1

Author

Kurt Schuepfer, Lena F. Aeschbach, Ann-Kathrin Torka, Ryan J. Walker, Heather M. Claypool, Nick Buttrick, Michael J. Wood, Peter Szecsi, Manuela Thomae, Orsolya Szöke, Joachim Hüffmeier, Marton Kovacs, Florian Brühlmann, Balazs Aczel, Bence E. Bakos, and Attila Szuts

Subjects
media_common.quotation_subject, 05 social sciences, Illusion, Morality, 01 natural sciences, 050105 experimental psychology, Replication (computing), 010104 statistics & probability, Open data, Reading (process), Free will, 0501 psychology and cognitive sciences, Moral responsibility, 0101 mathematics, Psychology, Social psychology, General Psychology, media_common
Abstract

Does convincing people that free will is an illusion reduce their sense of personal responsibility? Vohs and Schooler (2008) found that participants reading from a passage “debunking” free will cheated more on experimental tasks than did those reading from a control passage, an effect mediated by decreased belief in free will. However, this finding was not replicated by Embley, Johnson, and Giner-Sorolla (2015), who found that reading arguments against free will had no effect on cheating in their sample. The present study investigated whether hard-to-understand arguments against free will and a low-reliability measure of free-will beliefs account for Embley et al.’s failure to replicate Vohs and Schooler’s results. Participants ( N = 621) were randomly assigned to participate in either a close replication of Vohs and Schooler’s Experiment 1 based on the materials of Embley et al. or a revised protocol, which used an easier-to-understand free-will-belief manipulation and an improved instrument to measure free will. We found that the revisions did not matter. Although the revised measure of belief in free will had better reliability than the original measure, an analysis of the data from the two protocols combined indicated that free-will beliefs were unchanged by the manipulations, d = 0.064, 95% confidence interval = [−0.087, 0.22], and in the focal test, there were no differences in cheating behavior between conditions, d = 0.076, 95% CI = [−0.082, 0.22]. We found that expressed free-will beliefs did not mediate the link between the free-will-belief manipulation and cheating, and in exploratory follow-up analyses, we found that participants expressing lower beliefs in free will were not more likely to cheat in our task.

Published
2020

33. Uncanny but not confusing

Author

Gideon Nave, David B. Reichling, Carmel A. Levitan, Attila Szuts, Dylan Manfredi, Francesca Lunardini, Brandy Bessette-Symons, Alice Geminiani, Balazs Aczel, Maya B. Mathur, Peter A. M. Ruijten, Alberto Antonietti, Human Technology Interaction, EAISI Foundational, and EAISI Mobility

Subjects
media_common.quotation_subject, 050801 communication & media studies, Social interaction, Human–robot interaction, Categorical perception, 0508 media and communications, Arts and Humanities (miscellaneous), Perception, Psychology, Uncanny, General Psychology, media_common, 05 social sciences, 050301 education, Uncanny valley, Human-robot interaction, Human-Computer Interaction, Feeling, Categorization, Robot, 0503 education, Cognitive psychology
Abstract

Android robots that resemble humans closely, but not perfectly, can provoke negative feelings of dislike and eeriness in humans (the “Uncanny Valley” effect). We investigated whether category confusion between the perceptual categories of “robot” and “human” contributes to Uncanny Valley aversion. Using a novel, validated corpus of 182 images of real robot and human faces, we precisely estimated the shape of the Uncanny Valley and the location of the perceived robot/human boundary. To implicitly measure confusion, we tracked 358 participants’ mouse trajectories as they categorized the faces. We observed a clear Uncanny Valley, though with some interesting differences from standard theoretical predictions; the initial apex of likability for highly mechanical robots indicated that these robots were still moderately dislikable, and the Uncanny Valley itself was positioned closer to the mechanical than to the human-like end of the spectrum. We also observed a pattern of categorization suggesting that humans do perceive a categorical robot/human boundary. Yet in contrast to predictions of the category confusion mechanism hypothesis, the locations of the Uncanny Valley and of the category boundary did not coincide, and mediation analyses further failed to support a mechanistic role of category confusion. These results suggest category confusion does not explain the Uncanny Valley effect.

Published
2020

34. A Community-Sourced Glossary of Open Scholarship Terms

Author

Suzanne Stewart, Flavio Azevedo, Sam Parsons, Balazs Aczel, Mahmoud Elsherif, and Nihan Albayrak-Aydemir

Subjects
MetaArXiv|Social and Behavioral Sciences, bepress|Social and Behavioral Sciences, ComputingMilieux_COMPUTERSANDEDUCATION, ComputingMilieux_COMPUTERSANDSOCIETY, GeneralLiterature_MISCELLANEOUS
Abstract

Open scholarship has transformed research, introducing a host of new terms in the lexicon of researchers. The Framework of Open and Reproducible Research Teaching (FORRT) community presents a crowd-sourced glossary of open scholarship terms to facilitate education and effective communication between experts and newcomers.

Published
2022

35. SampleSizePlanner: A Tool to Estimate and Justify Sample Size for Two-Group Studies

Author

Marton Kovacs, Don van Ravenzwaaij, Rink Hoekstra, Balazs Aczel, Psychometrics and Statistics, and Research and Evaluation of Educational Effectiveness

Subjects
MetaArXiv|Social and Behavioral Sciences, bepress|Social and Behavioral Sciences, General Psychology
Abstract

Planning sample size often requires researchers to identify a statistical technique and to make several choices during their calculations. Currently, there is a lack of clear guidelines for researchers to find and use the applicable procedure. In the present tutorial, we introduce a web app and R package that offer nine different procedures to determine and justify the sample size for independent two-group study designs. The application highlights the most important decision points for each procedure and suggests example justifications for them. The resulting sample-size report can serve as a template for preregistrations and manuscripts.

Published
2022

36. A multi-lab test of the facial feedback hypothesis by the Many Smiles Collaboration

Author

Nicholas A. Coles, David S. March, Fernando Marmolejo-Ramos, Jeff T. Larsen, Nwadiogo C. Arinze, Izuchukwu L. G. Ndukaihe, Megan L. Willis, Francesco Foroni, Niv Reggev, Aviv Mokady, Patrick S. Forscher, John F. Hunter, Gwenaël Kaminski, Elif Yüvrük, Aycan Kapucu, Tamás Nagy, Nandor Hajdu, Julian Tejada, Raquel M. K. Freitag, Danilo Zambrano, Bidisha Som, Balazs Aczel, Krystian Barzykowski, Sylwia Adamus, Katarzyna Filip, Yuki Yamada, Ayumi Ikeda, Daniel L. Eaves, Carmel A. Levitan, Sydney Leiweke, Michal Parzuchowski, Natalie Butcher, Gerit Pfuhl, Dana M. Basnight-Brown, José A. Hinojosa, Pedro R. Montoro, Lady G. Javela D, Kevin Vezirian, Hans IJzerman, Natalia Trujillo, Sarah D. Pressman, Pascal M. Gygax, Asil A. Özdoğru, Susana Ruiz-Fernandez, Phoebe C. Ellsworth, Lowell Gaertner, Fritz Strack, Marco Marozzi, Marco Tullio Liuzza, Coles, Nicholas A, March, David S, Marmolejo-Ramos, Fernando, Larsen, Jeff T, and Liuzza, Marco Tullio

Subjects
Settore M-PSI/01 - Psicologia Generale, Double-Blind, replication, botulinum-toxin-a, Social Psychology, Computer science, emotion, Replication, Emotional embodiment, emotion, facial expressions, multicentre study, pen-in-mouth task, Expression, Experimental and Cognitive Psychology, facial expressions, onabotulinumtoxina, Behavioral Neuroscience, experience, Human–computer interaction, expression, Settore SECS-S/05 - Statistica Sociale, Facial feedback hypothesis, methodological problems, Placebo, Emotion, Experience, Depression, Methodological Problems, Settore M-PSI/03 - Psicometria, Botulinum-Toxin-A, multicentre study, Emotional embodiment, Test (assessment), stomatognathic diseases, Onabotulinumtoxina, depression, placebo, double-blind, Settore SECS-S/01 - Statistica, pen-in-mouth task
Abstract

Following theories of emotional embodiment, the facial feedback hypothesis suggests that individuals' subjective experiences of emotion are influenced by their facial expressions. However, evidence for this hypothesis has been mixed. We thus formed a global adversarial collaboration and carried out a preregistered, multicentre study designed to specify and test the conditions that should most reliably produce facial feedback effects. Data from n = 3,878 participants spanning 19 countries indicated that a facial mimicry and voluntary facial action task could both amplify and initiate feelings of happiness. However, evidence of facial feedback effects was less conclusive when facial feedback was manipulated unobtrusively via a pen-in-mouth task., National Science Centre, Poland [2019/35/B/HS6/00528]; JSPS KAKENHI [16H03079, 17H00875, 18K12015, 20H04581, 21H03784]; National Council for Scientific and Technological Development (CNPq); Polish National Science Center; DFG Beethoven grant [2016/23/G/HS6/01775]; National Science Foundation Graduate Research Fellowship [R010138018]; Ministerio de Ciencia, Innovacion y Universidades [PGC2018-098558-B-I00]; Comunidad de Madrid [H2019/HUM-5705]; Teesside University; Occidental College Academic Student Project Award, This work was financially supported by B. Stastny, who generously donated funds for this research in memory of his father, Bill Stastny (J.T.L.). The work was also supported by the National Science Centre, Poland (grant no. 2019/35/B/HS6/00528; K.B.), JSPS KAKENHI (grant nos 16H03079, 17H00875, 18K12015, 20H04581 and 21H03784; Y.Y.), the National Council for Scientific and Technological Development (CNPq; R.M.K.F.), the Polish National Science Center (M.P.), the DFG Beethoven grant no. 2016/23/G/HS6/01775 (M.P.), the National Science Foundation Graduate Research Fellowship (grant no. R010138018; N.A.C.), the Ministerio de Ciencia, Innovacion y Universidades (grant no. PGC2018-098558-B-I00; J.A.H.), the Comunidad de Madrid (grant no. H2019/HUM-5705; J.A.H.), Teesside University (N.B.) and the Occidental College Academic Student Project Award (S.L.). The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript. We also thank C. Scavo and A. Bidani for help with translating the study materials, L. Pullano and R. Giorgini for help with coding, and E. Tolomeo and L. Pane for help with data collection.

Published
2022

37. A survey on how preregistration affects the research workflow: Better science but more work

Author

Alexandra Sarafoglou, Marton Kovacs, Bence Bakos, Eric-Jan Wagenmakers, Balazs Aczel, and Psychologische Methodenleer (Psychologie, FMG)

Subjects
Multidisciplinary
Abstract

The preregistration of research protocols and analysis plans is a main reform innovation to counteract confirmation bias in the social and behavioural sciences. While theoretical reasons to preregister are frequently discussed in the literature, the individually experienced advantages and disadvantages of this method remain largely unexplored. The goal of this exploratory study was to identify the perceived benefits and challenges of preregistration from the researcher’s perspective. To this end, we surveyed 355 researchers, 299 of whom had used preregistration in their own work. The researchers indicated the experienced or expected effects of preregistration on their workflow. The results show that experiences and expectations are mostly positive. Researchers in our sample believe that implementing preregistration improves or is likely to improve the quality of their projects. Criticism of preregistration is primarily related to the increase in work-related stress and the overall duration of the project. While the benefits outweighed the challenges for the majority of researchers with preregistration experience, this was not the case for the majority of researchers without preregistration experience. The experienced advantages and disadvantages identified in our survey could inform future efforts to improve preregistration and thus help the methodology gain greater acceptance in the scientific community.

Published
2021

38. Author Correction: A multi-country test of brief reappraisal interventions on emotions during the COVID-19 pandemic

Author

Ke Wang, Amit Goldenberg, Charles A. Dorison, Jeremy K. Miller, Andero Uusberg, Jennifer S. Lerner, James J. Gross, Bamikole Bamikole Agesin, Márcia Bernardo, Olatz Campos, Luis Eudave, Karolina Grzech, Daphna Hausman Ozery, Emily A. Jackson, Elkin Oswaldo Luis Garcia, Shira Meir Drexler, Anita Penić Jurković, Kafeel Rana, John Paul Wilson, Maria Antoniadi, Kermeka Desai, Zoi Gialitaki, Elizaveta Kushnir, Khaoula Nadif, Olalla Niño Bravo, Rafia Nauman, Marlies Oosterlinck, Myrto Pantazi, Natalia Pilecka, Anna Szabelska, I. M. M. van Steenkiste, Katarzyna Filip, Andreea Ioana Bozdoc, Gabriela Mariana Marcu, Elena Agadullina, Matúš Adamkovič, Marta Roczniewska, Cecilia Reyna, Angelos P. Kassianos, Minja Westerlund, Lina Ahlgren, Sara Pöntinen, Gabriel Agboola Adetula, Pinar Dursun, Azuka Ikechukwu Arinze, Nwadiogo Chisom Arinze, Chisom Esther Ogbonnaya, Izuchukwu L. G. Ndukaihe, Ilker Dalgar, Handan Akkas, Paulo Manuel Macapagal, Savannah Lewis, Irem Metin-Orta, Francesco Foroni, Megan Willis, Anabela Caetano Santos, Aviv Mokady, Niv Reggev, Merve A. Kurfali, Martin R. Vasilev, Nora L. Nock, Michal Parzuchowski, Mauricio F. Espinoza Barría, Marek Vranka, Markéta Braun Kohlová, Ivan Ropovik, Mikayel Harutyunyan, Chunhui Wang, Elvin Yao, Maja Becker, Efisio Manunta, Gwenael Kaminski, Jordane Boudesseul, Dafne Marko, Kortnee Evans, David M. G. Lewis, Andrej Findor, Anais Thibault Landry, John Jamir Benzon Aruta, Manuel S. Ortiz, Zahir Vally, Ekaterina Pronizius, Martin Voracek, Claus Lamm, Maurice Grinberg, Ranran Li, Jaroslava Varella Valentova, Giovanna Mioni, Nicola Cellini, Sau-Chin Chen, Janis Zickfeld, Karis Moon, Habiba Azab, Neil Levy, Alper Karababa, Jennifer L. Beaudry, Leanne Boucher, W. Matthew Collins, Anna Louise Todsen, Kevin van Schie, Jáchym Vintr, Jozef Bavolar, Lada Kaliska, Valerija Križanić, Lara Samojlenko, Razieh Pourafshari, Sandra J. Geiger, Julia Beitner, Lara Warmelink, Robert M. Ross, Ian D. Stephen, Thomas J. Hostler, Soufian Azouaghe, Randy McCarthy, Anna Szala, Caterina Grano, Claudio Singh Solorzano, Gulnaz Anjum, William Jimenez-Leal, Maria Bradford, Laura Calderón Pérez, Julio E. Cruz Vásquez, Oscar J. Galindo-Caballero, Juan Camilo Vargas-Nieto, Ondřej Kácha, Alexios Arvanitis, Qinyu Xiao, Rodrigo Cárcamo, Saša Zorjan, Zuzanna Tajchman, Iris Vilares, Jeffrey M. Pavlacic, Jonas R. Kunst, Christian K. Tamnes, Claudia C. von Bastian, Mohammad Atari, MohammadHasan Sharifian, Monika Hricova, Pavol Kačmár, Jana Schrötter, Rima-Maria Rahal, Noga Cohen, Saeideh FatahModares, Miha Zrimsek, Ilya Zakharov, Monica A. Koehn, Celia Esteban-Serna, Robert J. Calin-Jageman, Anthony J. Krafnick, Eva Štrukelj, Peder Mortvedt Isager, Jan Urban, Jaime R. Silva, Marcel Martončik, Sanja Batić Očovaj, Dušana Šakan, Anna O. Kuzminska, Jasna Milosevic Djordjevic, Inês A. T. Almeida, Ana Ferreira, Ljiljana B. Lazarevic, Harry Manley, Danilo Zambrano Ricaurte, Renan P. Monteiro, Zahra Etabari, Erica Musser, Daniel Dunleavy, Weilun Chou, Hendrik Godbersen, Susana Ruiz-Fernández, Crystal Reeck, Carlota Batres, Komila Kirgizova, Abdumalik Muminov, Flavio Azevedo, Daniela Serrato Alvarez, Muhammad Mussaffa Butt, Jeong Min Lee, Zhang Chen, Frederick Verbruggen, Ignazio Ziano, Murat Tümer, Abdelilah C. A. Charyate, Dmitrii Dubrov, María del Carmen M. C. Tejada Rivera, Christopher Aberson, Bence Pálfi, Mónica Alarcón Maldonado, Barbora Hubena, Asli Sacakli, Chris D. Ceary, Karley L. Richard, Gage Singer, Jennifer T. Perillo, Tonia Ballantyne, Wilson Cyrus-Lai, Maksim Fedotov, Hongfei Du, Magdalena Wielgus, Ilse L. Pit, Matej Hruška, Daniela Sousa, Balazs Aczel, Nandor Hajdu, Barnabas Szaszi, Sylwia Adamus, Krystian Barzykowski, Leticia Micheli, Nadya-Daniela Schmidt, Andras N. Zsido, Mariola Paruzel-Czachura, Rafał Muda, Michal Bialek, Marta Kowal, Agnieszka Sorokowska, Michal Misiak, Débora Mola, María Victoria Ortiz, Pablo Sebastián Correa, Anabel Belaus, Fany Muchembled, Rafael R. Ribeiro, Patricia Arriaga, Raquel Oliveira, Leigh Ann Vaughn, Paulina Szwed, Małgorzata Kossowska, Gabriela Czarnek, Julita Kielińska, Benedict Antazo, Ruben Betlehem, Stefan Stieger, Gustav Nilsonne, Nicolle Simonovic, Jennifer Taber, Amélie Gourdon-Kanhukamwe, Artur Domurat, Keiko Ihaya, Yuki Yamada, Anum Urooj, Tripat Gill, Martin Čadek, Lisa Bylinina, Johanna Messerschmidt, Murathan Kurfalı, Adeyemi Adetula, Ekaterina Baklanova, Nihan Albayrak-Aydemir, Heather B. Kappes, Biljana Gjoneska, Thea House, Marc V. Jones, Jana B. Berkessel, William J. Chopik, Sami Çoksan, Martin Seehuus, Ahmed Khaoudi, Ahmed Bokkour, Kanza Ait El Arabi, Ikhlas Djamai, Aishwarya Iyer, Neha Parashar, Arca Adiguzel, Halil Emre Kocalar, Carsten Bundt, James O. Norton, Marietta Papadatou-Pastou, Anabel De la Rosa-Gomez, Vladislav Ankushev, Natalia Bogatyreva, Dmitry Grigoryev, Aleksandr Ivanov, Irina Prusova, Marina Romanova, Irena Sarieva, Maria Terskova, Evgeniya Hristova, Veselina Hristova Kadreva, Allison Janak, Vidar Schei, Therese E. Sverdrup, Adrian Dahl Askelund, Lina Maria Sanabria Pineda, Dajana Krupić, Carmel A. Levitan, Niklas Johannes, Nihal Ouherrou, Nicolas Say, Sladjana Sinkolova, Kristina Janjić, Marija Stojanovska, Dragana Stojanovska, Meetu Khosla, Andrew G. Thomas, Franki Y. H. Kung, Gijsbert Bijlstra, Farnaz Mosannenzadeh, Busra Bahar Balci, Ulf-Dietrich Reips, Ernest Baskin, Byurakn Ishkhanyan, Johanna Czamanski-Cohen, Barnaby James Wyld Dixson, David Moreau, Clare A. M. Sutherland, Hu Chuan-Peng, Chris Noone, Heather Flowe, Michele Anne, Steve M. J. Janssen, Marta Topor, Nadyanna M. Majeed, Yoshihiko Kunisato, Karen Yu, Shimrit Daches, Andree Hartanto, Milica Vdovic, Lisa Anton-Boicuk, Paul A. G. Forbes, Julia Kamburidis, Evelina Marinova, Mina Nedelcheva-Datsova, Nikolay R. Rachev, Alina Stoyanova, Kathleen Schmidt, Jordan W. Suchow, Maria Koptjevskaja-Tamm, Teodor Jernsäther, Jonas K. Olofsson, Olga Bialobrzeska, Magdalena Marszalek, Srinivasan Tatachari, Reza Afhami, Wilbert Law, Jan Antfolk, Barbara Žuro, Natalia Van Doren, Jose A. Soto, Rachel Searston, Jacob Miranda, Kaja Damnjanović, Siu Kit Yeung, Dino Krupić, Karlijn Hoyer, Bastian Jaeger, Dongning Ren, Gerit Pfuhl, Kristoffer Klevjer, Nadia S. Corral-Frías, Martha Frias-Armenta, Marc Y. Lucas, Adriana Olaya Torres, Mónica Toro, Lady Grey Javela Delgado, Diego Vega, Sara Álvarez Solas, Roosevelt Vilar, Sébastien Massoni, Thomas Frizzo, Alexandre Bran, David C. Vaidis, Luc Vieira, Bastien Paris, Mariagrazia Capizzi, Gabriel Lins de Holanda Coelho, Anna Greenburgh, Cassie M. Whitt, Alexa M. Tullett, Xinkai Du, Leonhard Volz, Minke Jasmijn Bosma, Cemre Karaarslan, Eylül Sarıoğuz, Tara Bulut Allred, Max Korbmacher, Melissa F. Colloff, Tiago J. S. Lima, Matheus Fernando Felix Ribeiro, Jeroen P. H. Verharen, Maria Karekla, Christiana Karashiali, Naoyuki Sunami, Lisa M. Jaremka, Daniel Storage, Sumaiya Habib, Anna Studzinska, Paul H. P. Hanel, Dawn Liu Holford, Miroslav Sirota, Kelly Wolfe, Faith Chiu, Andriana Theodoropoulou, El Rim Ahn, Yijun Lin, Erin C. Westgate, Hilmar Brohmer, Gabriela Hofer, Olivier Dujols, Kevin Vezirian, Gilad Feldman, Giovanni A. Travaglino, Afroja Ahmed, Manyu Li, Jasmijn Bosch, Nathan Torunsky, Hui Bai, Mathi Manavalan, Xin Song, Radoslaw B. Walczak, Przemysław Zdybek, Maja Friedemann, Anna Dalla Rosa, Luca Kozma, Sara G. Alves, Samuel Lins, Isabel R. Pinto, Rita C. Correia, Peter Babinčák, Gabriel Banik, Luis Miguel Rojas-Berscia, Marco A. C. Varella, Jim Uttley, Julie E. Beshears, Katrine Krabbe Thommesen, Behzad Behzadnia, Shawn N. Geniole, Miguel A. Silan, Princess Lovella G. Maturan, Johannes K. Vilsmeier, Ulrich S. Tran, Sara Morales Izquierdo, Michael C. Mensink, Piotr Sorokowski, Agata Groyecka-Bernard, Theda Radtke, Vera Cubela Adoric, Joelle Carpentier, Asil Ali Özdoğru, Jennifer A. Joy-Gaba, Mattie V. Hedgebeth, Tatsunori Ishii, Aaron L. Wichman, Jan Philipp Röer, Thomas Ostermann, William E. Davis, Lilian Suter, Konstantinos Papachristopoulos, Chelsea Zabel, Sandersan Onie, Charles R. Ebersole, Christopher R. Chartier, Peter R. Mallik, Heather L. Urry, Erin M. Buchanan, Nicholas A. Coles, Maximilian A. Primbs, Dana M. Basnight-Brown, Hans IJzerman, Patrick S. Forscher, and Hannah Moshontz

Subjects
Behavioral Neuroscience, Behaviour Change and Well-being, SDG 3 - Good Health and Well-being, Social Psychology, Experimental and Cognitive Psychology
Abstract

Correction to: Nature Human Behaviour https://doi.org/10.1038/s41562-021-01173-x, published online 2 August 2021.In the version of this article initially published, the following authors were omitted from the author list and the Author contributionssection for “investigation” and “writing and editing”: Nandor Hajdu (Institute of Psychology, ELTE Eötvös Loránd University, Budapest,Hungary), Jordane Boudesseul (Facultad de Psicología, Instituto de Investigación Científica, Universidad de Lima, Lima, Perú), RafałMuda (Faculty of Economics, Maria Curie-Sklodowska University, Lublin, Poland) and Sandersan Onie (Black Dog Institute, UNSWSydney, Sydney, Australia & Emotional Health for All Foundation, Jakarta, Indonesia). In addition, Saeideh FatahModares’ name wasoriginally misspelled as Saiedeh FatahModarres in the author list. Further, affiliations have been corrected for Maria Terskova (NationalResearch University Higher School of Economics, Moscow, Russia), Susana Ruiz Fernandez (FOM University of Applied Sciences,Essen; Leibniz-Institut fur Wissensmedien, Tubingen, and LEAD Research Network, Eberhard Karls University, Tubingen, Germany),Hendrik Godbersen (FOM University of Applied Sciences, Essen, Germany), Gulnaz Anjum (Department of Psychology, Simon FraserUniversity, Burnaby, Canada, and Department of Economics & Social Sciences, Institute of Business Administration, Karachi, Pakistan).

Published
2022

39. Author response: Consensus-based guidance for conducting and reporting multi-analyst studies

Author

Jeffrey J. Starns, Yoram K. Kunkels, Gustav Nilsonne, Balazs Aczel, Felix Holzmeister, Jörg Rieskamp, Andrea M Cataldo, Casper J. Albers, Ben R. Newell, Brian A Nosek, Raphael Silberzahn, Jean-François Mangin, Morton Ann Gernsbacher, Gary F. Egan, Alexandra Sarafoglou, Barnabas Szaszi, Matthew J. Salganik, Martin Schweinsberg, Alexander T. Kindel, Niko A. Busch, Daniel J. Simons, Emmanuel Caruyer, Eric-Jan Wagenmakers, Russell A. Poldrack, Dora Matzke, Noah van Dongen, Anna Dreber, Nelson Cowan, Barbara A. Spellman, Chris Donkin, Gilles Dutilh, Johnny van Doorn, Don van Ravenzwaaij, Marcus R. Munafò, Marcel A.L.M. van Assen, Rink Hoekstra, Juergen Huber, Samuel St-Jean, Laura F. Bringmann, Udo Boehm, Daniel J. Benjamin, Tom Schonberg, Eric Luis Uhlmann, D. Stephen Lindsay, Michael Kirchler, David R. Shanks, Jojanneke A. Bastiaansen, Kai J. Jonas, Andrew Delios, Olmo van den Akker, Jelte M. Wicherts, Sabine Hoffmann, Rotem Botvinik-Nezer, and Magnus Johannesson

Published
2021

40. Contextual factors predicting compliance behavior during the COVID-19 pandemic: A machine learning analysis on survey data from 16 countries

Author

Nandor Hajdu, Kathleen Schmidt, Gergely Acs, Jan P. Röer, Alberto Mirisola, Isabella Giammusso, Patrícia Arriaga, Rafael Ribeiro, Dmitrii Dubrov, Dmitry Grigoryev, Nwadiogo C. Arinze, Martin Voracek, Stefan Stieger, Matus Adamkovic, Mahmoud Elsherif, Bettina M. J. Kern, Krystian Barzykowski, Ewa Ilczuk, Marcel Martončik, Ivan Ropovik, Susana Ruiz-Fernandez, Gabriel Baník, José Luis Ulloa, Balazs Aczel, Barnabas Szaszi, N. Hajdu, K. Schmidt, G. Ac, J.P. Röer, Alberto Mirisola, Isabella Giammusso, P. Arriaga, R. Ribeiro, D. Dubrov, D. Grigoryev, N. C. Arinze, M. Voracek, S. Stieger, M. Adamkovic, M. Elsherif, B. M. J. Kern, K. Barzykowski, E. Ilczuk, M. Martončik, I. Ropovik, S. Ruiz-Fernandez, G. Baník, J. L. Ulloa, B. Aczel, and B. Szaszi

Subjects
Multidisciplinary, Physical Distancing, social distancing, COVID-19, Ciências Sociais::Psicologia [Domínio/Área Científica], lockdown, Machine Learning, voluntary isolation, Communicable Disease Control, Humans, multi-national study, Settore M-PSI/05 - Psicologia Sociale, Pandemics, random forest
Abstract

Voluntary isolation is one of the most effective methods for individuals to help prevent the transmission of diseases such as COVID-19. Understanding why people leave their homes when advised not to do so and identifying what contextual factors predict this non-compliant behavior is essential for policymakers and public health officials. To provide insight on these factors, we collected data from 42,169 individuals across 16 countries. Participants responded to items inquiring about their socio-cultural environment, such as the adherence of fellow citizens, as well as their mental states, such as their level of loneliness and boredom. We trained random forest models to predict whether someone had left their home during a one week period during which they were asked to voluntarily isolate themselves. The analyses indicated that overall, an increase in the feeling of being caged leads to an increased probability of leaving home. In addition, an increased feeling of responsibility and an increased fear of getting infected decreased the probability of leaving home. The models predicted compliance behavior with between 54% and 91% accuracy within each country’s sample. In addition, we modeled factors leading to risky behavior in the pandemic context. We observed an increased probability of visiting risky places as both the anticipated number of people and the importance of the activity increased. Conversely, the probability of visiting risky places increased as the perceived putative effectiveness of social distancing decreased. The variance explained in our models predicting risk ranged from < .01 to .54 by country. Together, our findings can inform behavioral interventions to increase adherence to lockdown recommendations in pandemic conditions.

Published
2021

41. Tenzing and the importance of tool development for research efficiency

Author

Alex O. Holcombe, Frederik Aust, Balazs Aczel, Marton Kovacs, Brein en Cognitie (Psychologie, FMG), and Psychologische Methodenleer (Psychologie, FMG)

Subjects
Engineering management, MetaArXiv|Social and Behavioral Sciences, Research efficiency, bepress|Social and Behavioral Sciences, Business, Library and Information Sciences, Computer Science Applications, Information Systems
Abstract

The way science is done is changing. While some tools are facilitating this change, others lag behind. The resulting mismatch between tools and researchers' workflows can be inefficient and delay the progress of research. As an example, information about the people associated with a published journal article was traditionally handled manually and unsystematically. However, as large-scale collaboration, sometimes referred to as “team science,” is now common, a more structured and easy-to-automate approach to managing meta-data is required. In this paper we describe how the latest version of tenzing (A.O. Holcombe et al., Documenting contributions to scholarly articles using CRediT and tenzing, PLOS One 15(12) (2020)) helps researchers collect and structure contributor information efficiently and without frustration. Using tenzing as an example, we discuss the importance of efficient tools in reforming science and our experience with tool development as researchers.

Published
2021

42. Demographic patterns of lockdown breakers: a worldwide study

Author

Barnabas Szaszi, Balazs Aczel, Nandor Hajdu, Peter Szecsi, and Elizabeth Tipton

Subjects
Geography, Data science
Abstract

Knowing who to target with certain messages is the prerequisite of efficient public health campaigns during pandemics. Using the COVID-19 pandemic situation, we explored which facets of the society - defined by age, gender, income, and education levels - are the most likely to visit social gatherings and aggravate the spread of a disease. Analyzing the reported behavior of 87,169 individuals from and 41 countries, we found that in the majority of the countries, the proportion of social gathering-goers was higher in male than female, younger than older, lower-educated than higher educated, and low-income than high-income subgroups of the populations. However, the data showed noteworthy heterogeneity between the countries warranting against generalizing from one country to another. The analysis also revealed that relative to other demographic factors, income was the strongest predictor of avoidance of social gatherings followed by age, education and gender. Although the observed strength of these associations were relatively small, we argue that incorporating demographic-based segmentation into public health campaigns can increase the efficiency of campaigns with an important caveat: the exploration of these associations need to be done on a country level before using the information to target populations in behavior change interventions.

Published
2021
Full Text
View/download PDF

43. Publisher correction: Situational factors shape moral judgements in the trolley dilemma in Eastern, Southern and Western countries in a culturally diverse sample

Author

Bence Bago, Marton Kovacs, John Protzko, Tamas Nagy, Zoltan Kekecs, Bence Palfi, Matus Adamkovic, Sylwia Adamus, Sumaya Albalooshi, Nihan Albayrak-Aydemir, Ilham N. Alfian, Sinan Alper, Sara Alvarez-Solas, Sara G. Alves, Santiago Amaya, Pia K. Andresen, Gulnaz Anjum, Daniel Ansari, Patrícia Arriaga, John Jamir Benzon R. Aruta, Alexios Arvanitis, Peter Babincak, Krystian Barzykowski, Bana Bashour, Ernest Baskin, Luisa Batalha, Carlota Batres, Jozef Bavolar, Fatih Bayrak, Benjamin Becker, Maja Becker, Anabel Belaus, Michał Białek, Ennio Bilancini, Daniel Boller, Leonardo Boncinelli, Jordane Boudesseul, Benjamin T. Brown, Erin M. Buchanan, Muhammad M. Butt, Dustin P. Calvillo, Nate C. Carnes, Jared B. Celniker, Christopher R. Chartier, William J. Chopik, Poom Chotikavan, Hu Chuan-Peng, Rockwell F. Clancy, Ogeday Çoker, Rita C. Correia, Vera Cubela Adoric, Carmelo P. Cubillas, Stefan Czoschke, Yalda Daryani, Job A. M. de Grefte, Wieteke C. de Vries, Elif G. Demirag Burak, Carina Dias, Barnaby J. W. Dixson, Xinkai Du, Francesca Dumančić, Andrei Dumbravă, Natalia B. Dutra, Janina Enachescu, Celia Esteban-Serna, Luis Eudave, Thomas R. Evans, Gilad Feldman, Fatima M. Felisberti, Susann Fiedler, Andrej Findor, Alexandra Fleischmann, Francesco Foroni, Radka Francová, Darius-Aurel Frank, Cynthia H. Y. Fu, Shan Gao, Omid Ghasemi, Ali-Reza Ghazi-Noori, Maliki E. Ghossainy, Isabella Giammusso, Tripat Gill, Biljana Gjoneska, Mario Gollwitzer, Aurélien Graton, Maurice Grinberg, Agata Groyecka-Bernard, Elizabeth A. Harris, Andree Hartanto, Widad A. N. M. Hassan, Javad Hatami, Katrina R. Heimark, Jasper J. J. Hidding, Evgeniya Hristova, Matej Hruška, Charlotte A. Hudson, Richard Huskey, Ayumi Ikeda, Yoel Inbar, Gordon P. D. Ingram, Ozan Isler, Chris Isloi, Aishwarya Iyer, Bastian Jaeger, Steve M. J. Janssen, William Jiménez-Leal, Biljana Jokić, Pavol Kačmár, Veselina Kadreva, Gwenaël Kaminski, Farzan Karimi-Malekabadi, Arno T. A. Kasper, Keith M. Kendrick, Bradley J. Kennedy, Halil E. Kocalar, Rabia I. Kodapanakkal, Marta Kowal, Elliott Kruse, Lenka Kučerová, Anton Kühberger, Anna O. Kuzminska, Fanny Lalot, Claus Lamm, Joris Lammers, Elke B. Lange, Anthony Lantian, Ivy Y.-M. Lau, Ljiljana B. Lazarevic, Marijke C. Leliveld, Jennifer N. Lenz, Carmel A. Levitan, Savannah C. Lewis, Manyu Li, Yansong Li, Haozheng Li, Tiago J. S. Lima, Samuel Lins, Marco Tullio Liuzza, Paula Lopes, Jackson G. Lu, Trent Lynds, Martin Máčel, Sean P. Mackinnon, Madhavilatha Maganti, Zoe Magraw-Mickelson, Leon F. Magson, Harry Manley, Gabriela M. Marcu, Darja Masli Seršić, Celine-Justine Matibag, Alan D. A. Mattiassi, Mahdi Mazidi, Joseph P. McFall, Neil McLatchie, Michael C. Mensink, Lena Miketta, Taciano L. Milfont, Alberto Mirisola, Michal Misiak, Panagiotis Mitkidis, Mehrad Moeini-Jazani, Arash Monajem, David Moreau, Erica D. Musser, Erita Narhetali, Danielle P. Ochoa, Jerome Olsen, Nicholas C. Owsley, Asil A. Özdoğru, Miriam Panning, Marietta Papadatou-Pastou, Neha Parashar, Philip Pärnamets, Mariola Paruzel-Czachura, Michal Parzuchowski, Julia V. Paterlini, Jeffrey M. Pavlacic, Mehmet Peker, Kim Peters, Liudmila Piatnitckaia, Isabel Pinto, Monica Renee Policarpio, Nada Pop-Jordanova, Annas J. Pratama, Maximilian A. Primbs, Ekaterina Pronizius, Danka Purić, Elisa Puvia, Vahid Qamari, Kun Qian, Alain Quiamzade, Beáta Ráczová, Diego A. Reinero, Ulf-Dietrich Reips, Cecilia Reyna, Kimberly Reynolds, Matheus F. F. Ribeiro, Jan P. Röer, Robert M. Ross, Petros Roussos, Fernando Ruiz-Dodobara, Susana Ruiz-Fernandez, Bastiaan T. Rutjens, Katarzyna Rybus, Adil Samekin, Anabela C. Santos, Nicolas Say, Christoph Schild, Kathleen Schmidt, Karolina A. Ścigała, MohammadHasan Sharifian, Jiaxin Shi, Yaoxi Shi, Erin Sievers, Miroslav Sirota, Michael Slipenkyj, Çağlar Solak, Agnieszka Sorokowska, Piotr Sorokowski, Sinem Söylemez, Niklas K. Steffens, Ian D. Stephen, Anni Sternisko, Laura Stevens-Wilson, Suzanne L. K. Stewart, Stefan Stieger, Daniel Storage, Justine Strube, Kyle J. Susa, Raluca D. Szekely-Copîndean, Natalia M. Szostak, Bagus Takwin, Srinivasan Tatachari, Andrew G. Thomas, Kevin E. Tiede, Lucas E. Tiong, Mirjana Tonković, Bastien Trémolière, Lauren V. Tunstead, Belgüzar N. Türkan, Mathias Twardawski, Miguel A. Vadillo, Zahir Vally, Leigh Ann Vaughn, Bruno Verschuere, Denis Vlašiček, Martin Voracek, Marek A. Vranka, Shuzhen Wang, Skye-Loren West, Stephen Whyte, Leigh S. Wilton, Anna Wlodarczyk, Xue Wu, Fei Xin, Su Yadanar, Hiroshi Yama, Yuki Yamada, Onurcan Yilmaz, Sangsuk Yoon, Danielle M. Young, Ilya Zakharov, Rizqy A. Zein, Ingo Zettler, Iris L. Žeželj, Don C. Zhang, Jin Zhang, Xiaoxiao Zheng, Rink Hoekstra, and Balazs Aczel

Subjects
Behavioral Neuroscience, Behaviour Change and Well-being, Social Psychology, Experimental and Cognitive Psychology, Social Development
Abstract

Correction to: Nature Human Behaviour https://doi.org/10.1038/s41562-022-01319-5, published online 14 April 2022.

Published
2022

44. Is there evidence for cross-domain congruency sequence effect? A replication of Kan et al. (2013)

Author

Miklos Bognar, Lucas E Tiong, Thomas Rhys Evans, Balazs Aczel, Bence Palfi, Marton Kovacs, Sandersan Onie, and Andree Hartanto

Subjects
replication, media_common.quotation_subject, BF, 050105 experimental psychology, Task (project management), 03 medical and health sciences, 0302 clinical medicine, Perception, Replication (statistics), Conflict resolution, 0501 psychology and cognitive sciences, cognitive control, Control (linguistics), lcsh:Science, media_common, Sequence, Multidisciplinary, 05 social sciences, Cognition, Replicate, lcsh:Q, Psychology, conflict adaptation, domain-generality, 030217 neurology & neurosurgery, Cognitive psychology
Abstract

Exploring the mechanisms of cognitive control is central to understanding how we control our behaviour. These mechanisms can be studied in conflict paradigms, which require the inhibition of irrelevant responses to perform the task. It has been suggested that in these tasks, the detection of conflict enhances cognitive control resulting in improved conflict resolution of subsequent trials. If this is the case, then this so-called congruency sequence effect can be expected to occur in cross-domain tasks. Previous research on the domain-generality of the effect presented inconsistent results. In this study, we provide a multi-site replication of three previous experiments of Kan et al . (Kan IP, Teubner-Rhodes S, Drummey AB, Nutile L, Krupa L, Novick JM 2013 Cognition 129 , 637–651) which test congruency sequence effect between very different domains: from a syntactic to a non-syntactic domain (Experiment 1), and from a perceptual to a verbal domain (Experiments 2 and 3). Despite all our efforts, we found only partial support for the claims of the original study. With a single exception, we could not replicate the original findings; the data remained inconclusive or went against the theoretical hypothesis. We discuss the compatibility of the results with alternative theoretical frameworks.

Published
2021

45. A multi-site collaborative study of the hostile priming effect

Author

Jasmine B. Norman, Peggy Chekroun, Hugo Bouxom, Gianni Ribeiro, Muriel Kosaka, Bryon Hines, Curtis E. Phills, Martin Müller, Ann Bettencourt, John E. Edlund, Anthony D. Hermann, Marton Kovacs, Randy J. McCarthy, Paul T. Fuglestad, Jason Young, Keith D. Markman, Alia Rohain, Catherine Haley, Mark Aveyard, Pavol Kačmár, Ashley Buck, Cristina Zogmaister, Ángel del Fresno-Díaz, Silvia Marcella Baraldo, Anna Maria C. Behler, Alec Ducham, Robert Körner, Amanda ElBassiouny, Lauren Hauck, Jo-Ann Tsang, John Kitchener Sakaluk, Michela Vezzoli, Balazs Aczel, Patrick J. Ewell, Murat Kezer, Jacqueline M. Chen, Dana C. Leighton, Zeynep Cemalcilar, Christopher E. Hawk, Lauren N. Jordan, Daniel Toribio-Flórez, Lemi Baruh, Adam Bitar, Astrid Schütz, Rosemary L. Al-Kire, Thomas Rhys Evans, Anna Baumert, Jennifer A. Joy-Gaba, Patrick S. Forscher, Charlotte Basch, Mukunzi Irumva, Elicia C. Lair, Michael W. Magee, Marcel Martončik, Will M. Gervais, Danielle L. Oyler, Caitlin Williams, Guillermo B. Willis, Jerome Olsen, Baruh, Lemi (ORCID 0000-0002-2797-242X & YÖK ID 36113), Cemalcılar, Zeynep (ORCID 0000-0002-0886-7982 & YÖK ID 40374), Kezer, Murat, McCarthy, Randy, Gervais, Will, Aczel, Balazs, Al-Kire, Rosemary L., Aveyard, Mark, Baraldo, Silvia Marcella, Basch, Charlotte, Baumert, Anna, Bettencourt, Ann, Bitar, Adam, Bouxom, Hugo, Buck, Ashley, Chekroun, Peggy, Chen, Jacqueline M., del Fresno-Diaz, Angel, Ducham, Alec, Edlund, John E., ElBassiouny, Amanda, Evans, Thomas Rhys, Ewell, Patrick J., Forscher, Patrick S., Fuglestad, Paul T., Hauck, Lauren, Hawk, Christopher E., Hermann, Anthony D., Hines, Bryon, Irumva, Mukunzi, Jordan, Lauren N., Joy-Gaba, Jennifer A., Haley, Catherine, Kacmar, Pavol, Koerner, Robert, Kosaka, Muriel, Kovacs, Marton, Lair, Elicia C., Legal, Jean-Baptiste, Leighton, Dana C., Magee, Michael W., Markman, Keith, Martoncik, Marcel Mueller, Martin, Norman, Jasmine B., Olsen, Jerome, Oyler, Danielle, Phills, Curtis E., Ribeiro, Gianni, Rohain, Alia, Sakaluk, John, Schuetz, Astrid, Toribio-Florez, Daniel, Tsang, Jo-Ann, Vezzoli, Michela, Williams, Caitlin, Willis, Guillermo B., Young, Jason, Zogmaister, Cristina, College of Social Sciences and Humanities, Graduate School of Social Sciences and Humanities, Department of Psychology, Mccarthy, R, Gervais, W, Aczel, B, Al-Kire, R, Aveyard, M, Baraldo, S, Baruh, L, Basch, C, Baumert, A, Behler, A, Bettencourt, A, Bitar, A, Bouxom, H, Buck, A, Cemalcilar, Z, Chekroun, P, Chen, J, del Fresno-Diaz, A, Ducham, A, Edlund, J, Elbassiouny, A, Evans, T, Ewell, P, Forscher, P, Fuglestad, P, Hauck, L, Hawk, C, Hermann, A, Hines, B, Irumva, M, Jordan, L, Joy-Gaba, J, Haley, C, Kacmar, P, Kezer, M, Korner, R, Kosaka, M, Kovacs, M, Lair, E, Legal, J, Leighton, D, Magee, M, Markman, K, Martoncik, M, Muller, M, Norman, J, Olsen, J, Oyler, D, Phills, C, Ribeiro, G, Rohain, A, Sakaluk, J, Schutz, A, Toribio-Florez, D, Tsang, J, Vezzoli, M, Williams, C, Willis, G, Young, J, Zogmaister, C, and Toribio-Flórez, Daniel

Subjects
Hostile attribution, Hostile perception, Social judgment, 05 social sciences, Multi site, Replication, 050109 social psychology, 050105 experimental psychology, Crowdsourcing, Hostile attributions, Hostile perceptions, Priming, Social judgments, Social priming, M-PSI/03 - PSICOMETRIA, Social cognition, Psychology, 0501 psychology and cognitive sciences, M-PSI/01 - PSICOLOGIA GENERALE, Priming (psychology), Social psychology, General Psychology, M-PSI/05 - PSICOLOGIA SOCIALE
Abstract

In a now-classic study by Srull and Wyer (1979), people who were exposed to phrases with hostile content subsequently judged a man as being more hostile. And this “hostile priming effect” has had a significant influence on the field of social cognition over the subsequent decades. However, a recent multi-lab collaborative study (McCarthy et al., 2018) that closely followed the methods described by Srull and Wyer (1979) found a hostile priming effect that was nearly zero, which casts doubt on whether these methods reliably produce an effect. To address some limitations with McCarthy et al. (2018), the current multi-site collaborative study included data collected from 29 labs. Each lab conducted a close replication (total N = 2,123) and a conceptual replication (total N = 2,579) of Srull and Wyer's methods. The hostile priming effect for both the close replication (d = 0.09, 95% CI [-0.04, 0.22], z = 1.34, p =.16) and the conceptual replication (d = 0.05, 95% CI [-0.04, 0.15], z = 1.15, p =.58) were not significantly different from zero and, if the true effects are non-zero, were smaller than what most labs could feasibly and routinely detect. Despite our best efforts to produce favorable conditions for the effect to emerge, we did not detect a hostile priming effect. We suggest that researchers should not invest more resources into trying to detect a hostile priming effect using methods like those described in Srull and Wyer (1979)., NA

Published
2021

46. A multi-country test of brief reappraisal interventions on emotions during the COVID-19 pandemic

Author

Ke Wang, Amit Goldenberg, Charles A. Dorison, Jeremy K. Miller, Andero Uusberg, Jennifer S. Lerner, James J. Gross, Bamikole Bamikole Agesin, Márcia Bernardo, Olatz Campos, Luis Eudave, Karolina Grzech, Daphna Hausman Ozery, Emily A. Jackson, Elkin Oswaldo Luis Garcia, Shira Meir Drexler, Anita Penić Jurković, Kafeel Rana, John Paul Wilson, Maria Antoniadi, Kermeka Desai, Zoi Gialitaki, Elizaveta Kushnir, Khaoula Nadif, Olalla Niño Bravo, Rafia Nauman, Marlies Oosterlinck, Myrto Pantazi, Natalia Pilecka, Anna Szabelska, I. M.M. van Steenkiste, Katarzyna Filip, Andreea Ioana Bozdoc, Gabriela Mariana Marcu, Elena Agadullina, Matúš Adamkovič, MA (Marta) Roczniewska, Cecilia Reyna, Angelos P. Kassianos, Minja Westerlund, Lina Ahlgren, Sara Pöntinen, Gabriel Agboola Adetula, Pinar Dursun, Azuka Ikechukwu Arinze, Nwadiogo Chisom Arinze, Chisom Esther Ogbonnaya, Izuchukwu L.G. Ndukaihe, Ilker Dalgar, Handan Akkas, Paulo Manuel Macapagal, Savannah Lewis, Irem Metin-Orta, Francesco Foroni, Megan Willis, Anabela Caetano Santos, Aviv Mokady, Niv Reggev, Merve A. Kurfali, Martin R. Vasilev, Nora L. Nock, Michal Parzuchowski, Mauricio F. Espinoza Barría, Marek Vranka, Markéta Braun Kohlová, Ivan Ropovik, Mikayel Harutyunyan, Chunhui Wang, Elvin Yao, Maja Becker, Efisio Manunta, Gwenael Kaminski, Dafne Marko, Kortnee Evans, David M.G. Lewis, Andrej Findor, Anais Thibault Landry, John Jamir Benzon Aruta, Manuel S. Ortiz, Zahir Vally, Ekaterina Pronizius, Martin Voracek, Claus Lamm, Maurice Grinberg, Ranran Li, Jaroslava Varella Valentova, Giovanna Mioni, Nicola Cellini, Sau Chin Chen, Janis Zickfeld, Karis Moon, Habiba Azab, Neil Levy, Alper Karababa, Jennifer L. Beaudry, Leanne Boucher, W. Matthew Collins, Anna Louise Todsen, K (Kevin) van Schie, Jáchym Vintr, Jozef Bavolar, Lada Kaliska, Valerija Križanić, Lara Samojlenko, Razieh Pourafshari, Sandra J. Geiger, Julia Beitner, Lara Warmelink, Robert M. Ross, Ian D. Stephen, Thomas J. Hostler, Soufian Azouaghe, Randy McCarthy, Anna Szala, Caterina Grano, Claudio Singh Solorzano, Gulnaz Anjum, William Jimenez-Leal, Maria Bradford, Laura Calderón Pérez, Julio E. Cruz Vásquez, Oscar J. Galindo-Caballero, Juan Camilo Vargas-Nieto, Ondřej Kácha, Alexios Arvanitis, Qinyu Xiao, Rodrigo Cárcamo, Saša Zorjan, Zuzanna Tajchman, Iris Vilares, Jeffrey M. Pavlacic, Jonas R. Kunst, Christian K. Tamnes, Claudia C. von Bastian, Mohammad Atari, Mohammad Hasan Sharifian, Monika Hricova, Pavol Kačmár, Jana Schrötter, Rima Maria Rahal, Noga Cohen, Saiedeh FatahModarres, Miha Zrimsek, Ilya Zakharov, Monica A. Koehn, Celia Esteban-Serna, Robert J. Calin-Jageman, Anthony J. Krafnick, Eva Štrukelj, Peder Mortvedt Isager, Jan Urban, Jaime R. Silva, Marcel Martončik, Sanja Batić Očovaj, Dušana Šakan, Anna O. Kuzminska, Jasna Milosevic Djordjevic, Inês A.T. Almeida, A.S. (Ana) Ferreira, Ljiljana B. Lazarevic, Harry Manley, Danilo Zambrano Ricaurte, Renan P. Monteiro, Zahra Etabari, Erica Musser, Daniel Dunleavy, Weilun Chou, Hendrik Godbersen, Susana Ruiz-Fernández, Crystal Reeck, Carlota Batres, Komila Kirgizova, Abdumalik Muminov, Flavio Azevedo, Daniela Serrato Alvarez, Muhammad Mussaffa Butt, Jeong Min Lee, Zhang Chen, Frederick Verbruggen, Ignazio Ziano, Murat Tümer, Abdelilah C.A. Charyate, Dmitrii Dubrov, María del Carmen M.C. Tejada Rivera, Christopher Aberson, Bence Pálfi, Mónica Alarcón Maldonado, Barbora Hubena, Asli Sacakli, Chris D. Ceary, Karley L. Richard, Gage Singer, Jennifer T. Perillo, Tonia Ballantyne, Wilson Cyrus-Lai, Maksim Fedotov, Hongfei Du, Magdalena Wielgus, Ilse L. Pit, Matej Hruška, Daniela Sousa, Balazs Aczel, Barnabas Szaszi, Sylwia Adamus, Krystian Barzykowski, Leticia Micheli, Nadya Daniela Schmidt, Andras N. Zsido, Mariola Paruzel-Czachura, Michal Bialek, Marta Kowal, Agnieszka Sorokowska, Michal Misiak, Débora Mola, María Victoria Ortiz, Pablo Sebastián Correa, Anabel Belaus, Fany Muchembled, Rafael R. Ribeiro, Patricia Arriaga, Raquel Oliveira, Leigh Ann Vaughn, Paulina Szwed, Małgorzata Kossowska, Gabriela Czarnek, Julita Kielińska, Benedict Antazo, Ruben Betlehem, Stefan Stieger, Gustav Nilsonne, Nicolle Simonovic, Jennifer Taber, Amélie Gourdon-Kanhukamwe, Artur Domurat, Keiko Ihaya, Yuki Yamada, Anum Urooj, Tripat Gill, Martin Čadek, Lisa Bylinina, Johanna Messerschmidt, Murathan Kurfalı, Adeyemi Adetula, Ekaterina Baklanova, Nihan Albayrak-Aydemir, Heather B. Kappes, Biljana Gjoneska, Thea House, Marc V. Jones, Jana B. Berkessel, William J. Chopik, Sami Çoksan, Martin Seehuus, Ahmed Khaoudi, Ahmed Bokkour, Kanza Ait El Arabi, Ikhlas Djamai, Aishwarya Iyer, Neha Parashar, Arca Adiguzel, Halil Emre Kocalar, Carsten Bundt, James O. Norton, Marietta Papadatou-Pastou, Anabel De la Rosa-Gomez, Vladislav Ankushev, Natalia Bogatyreva, Dmitry Grigoryev, Aleksandr Ivanov, Irina Prusova, Marina Romanova, Irena Sarieva, Maria Terskova, Evgeniya Hristova, Veselina Hristova Kadreva, Allison Janak, Vidar Schei, Therese E. Sverdrup, Adrian Dahl Askelund, Lina Maria Sanabria Pineda, Dajana Krupić, Carmel A. Levitan, Niklas Johannes, Nihal Ouherrou, Nicolas Say, Sladjana Sinkolova, Kristina Janjić, Marija Stojanovska, Dragana Stojanovska, Meetu Khosla, Andrew G. Thomas, Franki Y.H. Kung, Gijsbert Bijlstra, Farnaz Mosannenzadeh, Busra Bahar Balci, Ulf Dietrich Reips, Ernest Baskin, Byurakn Ishkhanyan, Johanna Czamanski-Cohen, Barnaby James Wyld Dixson, David Moreau, Clare A.M. Sutherland, Hu Chuan-Peng, Chris Noone, Heather Flowe, Michele Anne, Steve M.J. Janssen, Marta Topor, Nadyanna M. Majeed, Yoshihiko Kunisato, Karen Yu, Shimrit Daches, Andree Hartanto, Milica Vdovic, Lisa Anton-Boicuk, Paul A.G. Forbes, Julia Kamburidis, Evelina Marinova, Mina Nedelcheva-Datsova, Nikolay R. Rachev, Alina Stoyanova, Kathleen Schmidt, Jordan W. Suchow, Maria Koptjevskaja-Tamm, Teodor Jernsäther, Jonas K. Olofsson, Olga Bialobrzeska, Magdalena Marszalek, Srinivasan Tatachari, Reza Afhami, Wilbert Law, Jan Antfolk, Barbara Žuro, Natalia Van Doren, Jose A. Soto, Rachel Searston, Jacob Miranda, Kaja Damnjanović, Siu Kit Yeung, Dino Krupić, Karlijn Hoyer, Bastian Jaeger, Dongning Ren, Gerit Pfuhl, Kristoffer Klevjer, Nadia S. Corral-Frías, Martha Frias-Armenta, Marc Y. Lucas, Adriana Olaya Torres, Mónica Toro, Lady Grey Javela Delgado, Diego Vega, Sara Álvarez Solas, Roosevelt Vilar, Sébastien Massoni, Thomas Frizzo, Alexandre Bran, David C. Vaidis, Luc Vieira, Bastien Paris, Mariagrazia Capizzi, Gabriel Lins de Holanda Coelho, Anna Greenburgh, Cassie M. Whitt, Alexa M. Tullett, Xinkai Du, Leonhard Volz, Minke Jasmijn Bosma, Cemre Karaarslan, Eylül Sarıoğuz, Tara Bulut Allred, Max Korbmacher, Melissa F. Colloff, Tiago J.S. Lima, Matheus Fernando Felix Ribeiro, Jeroen P.H. Verharen, Maria Karekla, Christiana Karashiali, Naoyuki Sunami, Lisa M. Jaremka, Daniel Storage, Sumaiya Habib, Anna Studzinska, Paul H.P. Hanel, Dawn Liu Holford, Miroslav Sirota, Kelly Wolfe, Faith Chiu, Andriana Theodoropoulou, El Rim Ahn, Yijun Lin, Erin C. Westgate, Hilmar Brohmer, Gabriela Hofer, Olivier Dujols, Kevin Vezirian, Gilad Feldman, Giovanni A. Travaglino, Afroja Ahmed, Manyu Li, Jasmijn Bosch, Nathan Torunsky, Hui Bai, Mathi Manavalan, Xin Song, Radoslaw B. Walczak, Przemysław Zdybek, Maja Friedemann, Anna Dalla Rosa, Luca Kozma, Sara G. Alves, Samuel Lins, Isabel R. Pinto, Rita C. Correia, Peter Babinčák, Gabriel Banik, Luis Miguel Rojas-Berscia, Marco A.C. Varella, Jim Uttley, Julie E. Beshears, Katrine Krabbe Thommesen, Behzad Behzadnia, Shawn N. Geniole, Miguel A. Silan, Princess Lovella G. Maturan, Johannes K. Vilsmeier, Ulrich S. Tran, Sara Morales Izquierdo, Michael C. Mensink, Piotr Sorokowski, Agata Groyecka-Bernard, Theda Radtke, Vera Cubela Adoric, Joelle Carpentier, Asil Ali Özdoğru, Jennifer A. Joy-Gaba, Mattie V. Hedgebeth, Tatsunori Ishii, Aaron L. Wichman, Jan Philipp Röer, Thomas Ostermann, William E. Davis, Lilian Suter, Konstantinos Papachristopoulos, Chelsea Zabel, Charles R. Ebersole, Christopher R. Chartier, Peter R. Mallik, Heather L. Urry, Erin M. Buchanan, Nicholas A. Coles, Maximilian A. Primbs, Dana M. Basnight-Brown, Hans IJzerman, Patrick S. Forscher, Hannah Moshontz, Ke Wang, Amit Goldenberg, Charles A. Dorison, Jeremy K. Miller, Andero Uusberg, Jennifer S. Lerner, James J. Gross, Bamikole Bamikole Agesin, Márcia Bernardo, Olatz Campos, Luis Eudave, Karolina Grzech, Daphna Hausman Ozery, Emily A. Jackson, Elkin Oswaldo Luis Garcia, Shira Meir Drexler, Anita Penić Jurković, Kafeel Rana, John Paul Wilson, Maria Antoniadi, Kermeka Desai, Zoi Gialitaki, Elizaveta Kushnir, Khaoula Nadif, Olalla Niño Bravo, Rafia Nauman, Marlies Oosterlinck, Myrto Pantazi, Natalia Pilecka, Anna Szabelska, I. M.M. van Steenkiste, Katarzyna Filip, Andreea Ioana Bozdoc, Gabriela Mariana Marcu, Elena Agadullina, Matúš Adamkovič, MA (Marta) Roczniewska, Cecilia Reyna, Angelos P. Kassianos, Minja Westerlund, Lina Ahlgren, Sara Pöntinen, Gabriel Agboola Adetula, Pinar Dursun, Azuka Ikechukwu Arinze, Nwadiogo Chisom Arinze, Chisom Esther Ogbonnaya, Izuchukwu L.G. Ndukaihe, Ilker Dalgar, Handan Akkas, Paulo Manuel Macapagal, Savannah Lewis, Irem Metin-Orta, Francesco Foroni, Megan Willis, Anabela Caetano Santos, Aviv Mokady, Niv Reggev, Merve A. Kurfali, Martin R. Vasilev, Nora L. Nock, Michal Parzuchowski, Mauricio F. Espinoza Barría, Marek Vranka, Markéta Braun Kohlová, Ivan Ropovik, Mikayel Harutyunyan, Chunhui Wang, Elvin Yao, Maja Becker, Efisio Manunta, Gwenael Kaminski, Dafne Marko, Kortnee Evans, David M.G. Lewis, Andrej Findor, Anais Thibault Landry, John Jamir Benzon Aruta, Manuel S. Ortiz, Zahir Vally, Ekaterina Pronizius, Martin Voracek, Claus Lamm, Maurice Grinberg, Ranran Li, Jaroslava Varella Valentova, Giovanna Mioni, Nicola Cellini, Sau Chin Chen, Janis Zickfeld, Karis Moon, Habiba Azab, Neil Levy, Alper Karababa, Jennifer L. Beaudry, Leanne Boucher, W. Matthew Collins, Anna Louise Todsen, K (Kevin) van Schie, Jáchym Vintr, Jozef Bavolar, Lada Kaliska, Valerija Križanić, Lara Samojlenko, Razieh Pourafshari, Sandra J. Geiger, Julia Beitner, Lara Warmelink, Robert M. Ross, Ian D. Stephen, Thomas J. Hostler, Soufian Azouaghe, Randy McCarthy, Anna Szala, Caterina Grano, Claudio Singh Solorzano, Gulnaz Anjum, William Jimenez-Leal, Maria Bradford, Laura Calderón Pérez, Julio E. Cruz Vásquez, Oscar J. Galindo-Caballero, Juan Camilo Vargas-Nieto, Ondřej Kácha, Alexios Arvanitis, Qinyu Xiao, Rodrigo Cárcamo, Saša Zorjan, Zuzanna Tajchman, Iris Vilares, Jeffrey M. Pavlacic, Jonas R. Kunst, Christian K. Tamnes, Claudia C. von Bastian, Mohammad Atari, Mohammad Hasan Sharifian, Monika Hricova, Pavol Kačmár, Jana Schrötter, Rima Maria Rahal, Noga Cohen, Saiedeh FatahModarres, Miha Zrimsek, Ilya Zakharov, Monica A. Koehn, Celia Esteban-Serna, Robert J. Calin-Jageman, Anthony J. Krafnick, Eva Štrukelj, Peder Mortvedt Isager, Jan Urban, Jaime R. Silva, Marcel Martončik, Sanja Batić Očovaj, Dušana Šakan, Anna O. Kuzminska, Jasna Milosevic Djordjevic, Inês A.T. Almeida, A.S. (Ana) Ferreira, Ljiljana B. Lazarevic, Harry Manley, Danilo Zambrano Ricaurte, Renan P. Monteiro, Zahra Etabari, Erica Musser, Daniel Dunleavy, Weilun Chou, Hendrik Godbersen, Susana Ruiz-Fernández, Crystal Reeck, Carlota Batres, Komila Kirgizova, Abdumalik Muminov, Flavio Azevedo, Daniela Serrato Alvarez, Muhammad Mussaffa Butt, Jeong Min Lee, Zhang Chen, Frederick Verbruggen, Ignazio Ziano, Murat Tümer, Abdelilah C.A. Charyate, Dmitrii Dubrov, María del Carmen M.C. Tejada Rivera, Christopher Aberson, Bence Pálfi, Mónica Alarcón Maldonado, Barbora Hubena, Asli Sacakli, Chris D. Ceary, Karley L. Richard, Gage Singer, Jennifer T. Perillo, Tonia Ballantyne, Wilson Cyrus-Lai, Maksim Fedotov, Hongfei Du, Magdalena Wielgus, Ilse L. Pit, Matej Hruška, Daniela Sousa, Balazs Aczel, Barnabas Szaszi, Sylwia Adamus, Krystian Barzykowski, Leticia Micheli, Nadya Daniela Schmidt, Andras N. Zsido, Mariola Paruzel-Czachura, Michal Bialek, Marta Kowal, Agnieszka Sorokowska, Michal Misiak, Débora Mola, María Victoria Ortiz, Pablo Sebastián Correa, Anabel Belaus, Fany Muchembled, Rafael R. Ribeiro, Patricia Arriaga, Raquel Oliveira, Leigh Ann Vaughn, Paulina Szwed, Małgorzata Kossowska, Gabriela Czarnek, Julita Kielińska, Benedict Antazo, Ruben Betlehem, Stefan Stieger, Gustav Nilsonne, Nicolle Simonovic, Jennifer Taber, Amélie Gourdon-Kanhukamwe, Artur Domurat, Keiko Ihaya, Yuki Yamada, Anum Urooj, Tripat Gill, Martin Čadek, Lisa Bylinina, Johanna Messerschmidt, Murathan Kurfalı, Adeyemi Adetula, Ekaterina Baklanova, Nihan Albayrak-Aydemir, Heather B. Kappes, Biljana Gjoneska, Thea House, Marc V. Jones, Jana B. Berkessel, William J. Chopik, Sami Çoksan, Martin Seehuus, Ahmed Khaoudi, Ahmed Bokkour, Kanza Ait El Arabi, Ikhlas Djamai, Aishwarya Iyer, Neha Parashar, Arca Adiguzel, Halil Emre Kocalar, Carsten Bundt, James O. Norton, Marietta Papadatou-Pastou, Anabel De la Rosa-Gomez, Vladislav Ankushev, Natalia Bogatyreva, Dmitry Grigoryev, Aleksandr Ivanov, Irina Prusova, Marina Romanova, Irena Sarieva, Maria Terskova, Evgeniya Hristova, Veselina Hristova Kadreva, Allison Janak, Vidar Schei, Therese E. Sverdrup, Adrian Dahl Askelund, Lina Maria Sanabria Pineda, Dajana Krupić, Carmel A. Levitan, Niklas Johannes, Nihal Ouherrou, Nicolas Say, Sladjana Sinkolova, Kristina Janjić, Marija Stojanovska, Dragana Stojanovska, Meetu Khosla, Andrew G. Thomas, Franki Y.H. Kung, Gijsbert Bijlstra, Farnaz Mosannenzadeh, Busra Bahar Balci, Ulf Dietrich Reips, Ernest Baskin, Byurakn Ishkhanyan, Johanna Czamanski-Cohen, Barnaby James Wyld Dixson, David Moreau, Clare A.M. Sutherland, Hu Chuan-Peng, Chris Noone, Heather Flowe, Michele Anne, Steve M.J. Janssen, Marta Topor, Nadyanna M. Majeed, Yoshihiko Kunisato, Karen Yu, Shimrit Daches, Andree Hartanto, Milica Vdovic, Lisa Anton-Boicuk, Paul A.G. Forbes, Julia Kamburidis, Evelina Marinova, Mina Nedelcheva-Datsova, Nikolay R. Rachev, Alina Stoyanova, Kathleen Schmidt, Jordan W. Suchow, Maria Koptjevskaja-Tamm, Teodor Jernsäther, Jonas K. Olofsson, Olga Bialobrzeska, Magdalena Marszalek, Srinivasan Tatachari, Reza Afhami, Wilbert Law, Jan Antfolk, Barbara Žuro, Natalia Van Doren, Jose A. Soto, Rachel Searston, Jacob Miranda, Kaja Damnjanović, Siu Kit Yeung, Dino Krupić, Karlijn Hoyer, Bastian Jaeger, Dongning Ren, Gerit Pfuhl, Kristoffer Klevjer, Nadia S. Corral-Frías, Martha Frias-Armenta, Marc Y. Lucas, Adriana Olaya Torres, Mónica Toro, Lady Grey Javela Delgado, Diego Vega, Sara Álvarez Solas, Roosevelt Vilar, Sébastien Massoni, Thomas Frizzo, Alexandre Bran, David C. Vaidis, Luc Vieira, Bastien Paris, Mariagrazia Capizzi, Gabriel Lins de Holanda Coelho, Anna Greenburgh, Cassie M. Whitt, Alexa M. Tullett, Xinkai Du, Leonhard Volz, Minke Jasmijn Bosma, Cemre Karaarslan, Eylül Sarıoğuz, Tara Bulut Allred, Max Korbmacher, Melissa F. Colloff, Tiago J.S. Lima, Matheus Fernando Felix Ribeiro, Jeroen P.H. Verharen, Maria Karekla, Christiana Karashiali, Naoyuki Sunami, Lisa M. Jaremka, Daniel Storage, Sumaiya Habib, Anna Studzinska, Paul H.P. Hanel, Dawn Liu Holford, Miroslav Sirota, Kelly Wolfe, Faith Chiu, Andriana Theodoropoulou, El Rim Ahn, Yijun Lin, Erin C. Westgate, Hilmar Brohmer, Gabriela Hofer, Olivier Dujols, Kevin Vezirian, Gilad Feldman, Giovanni A. Travaglino, Afroja Ahmed, Manyu Li, Jasmijn Bosch, Nathan Torunsky, Hui Bai, Mathi Manavalan, Xin Song, Radoslaw B. Walczak, Przemysław Zdybek, Maja Friedemann, Anna Dalla Rosa, Luca Kozma, Sara G. Alves, Samuel Lins, Isabel R. Pinto, Rita C. Correia, Peter Babinčák, Gabriel Banik, Luis Miguel Rojas-Berscia, Marco A.C. Varella, Jim Uttley, Julie E. Beshears, Katrine Krabbe Thommesen, Behzad Behzadnia, Shawn N. Geniole, Miguel A. Silan, Princess Lovella G. Maturan, Johannes K. Vilsmeier, Ulrich S. Tran, Sara Morales Izquierdo, Michael C. Mensink, Piotr Sorokowski, Agata Groyecka-Bernard, Theda Radtke, Vera Cubela Adoric, Joelle Carpentier, Asil Ali Özdoğru, Jennifer A. Joy-Gaba, Mattie V. Hedgebeth, Tatsunori Ishii, Aaron L. Wichman, Jan Philipp Röer, Thomas Ostermann, William E. Davis, Lilian Suter, Konstantinos Papachristopoulos, Chelsea Zabel, Charles R. Ebersole, Christopher R. Chartier, Peter R. Mallik, Heather L. Urry, Erin M. Buchanan, Nicholas A. Coles, Maximilian A. Primbs, Dana M. Basnight-Brown, Hans IJzerman, Patrick S. Forscher, and Hannah Moshontz

Abstract

Abstract: The COVID-19 pandemic has increased negative emotions and decreased positive emotions globally. Left unchecked, these emotional changes might have a wide array of adverse impacts. To reduce negative emotions and increase positive emotions, we tested the effectiveness of reappraisal, an emotion-regulation strategy that modifies how one thinks about a situation. Participants from 87 countries and regions (n = 21,644) were randomly assigned to one of two brief reappraisal interventions (reconstrual or repurposing) or one of two control conditions (active or passive). Results revealed that both reappraisal interventions (vesus both control conditions) consistently reduced negative emotions and increased positive emotions across different measures. Reconstrual and repurposing interventions h

Published
2021
Full Text
View/download PDF

47. The role of human fallibility in psychological research: A survey of mistakes in data management

Author

Marton Kovacs, Balazs Aczel, Rink Hoekstra, and Research and Evaluation of Educational Effectiveness

Subjects
Time delays, Recall, business.industry, Psychological research, Data management, Human error, Applied psychology, data-management mistakes, open data, open materials, preregistered, Open data, research workflow, life cycle of the data, business, Psychology, General Psychology, human error
Abstract

Errors are an inevitable consequence of human fallibility, and researchers are no exception. Most researchers can recall major frustrations or serious time delays due to human errors while collecting, analyzing, or reporting data. The present study is an exploration of mistakes made during the data-management process in psychological research. We surveyed 488 researchers regarding the type, frequency, seriousness, and outcome of mistakes that have occurred in their research team during the last 5 years. The majority of respondents suggested that mistakes occurred with very low or low frequency. Most respondents reported that the most frequent mistakes led to insignificant or minor consequences, such as time loss or frustration. The most serious mistakes caused insignificant or minor consequences for about a third of respondents, moderate consequences for almost half of respondents, and major or extreme consequences for about one fifth of respondents. The most frequently reported types of mistakes were ambiguous naming/defining of data, version control error, and wrong data processing/analysis. Most mistakes were reportedly due to poor project preparation or management and/or personal difficulties (physical or cognitive constraints). With these initial exploratory findings, we do not aim to provide a description representative for psychological scientists but, rather, to lay the groundwork for a systematic investigation of human fallibility in research data management and the development of solutions to reduce errors and mitigate their impact.

Published
2020

48. Expert Consensus Procedure (ECO): Facilitating Robust Scientific Outputs

Author

Zoltan Kekecs, Barnabas Szaszi, and Balazs Aczel

Subjects
Computer science, Expert consensus, Data science
Abstract

This tutorial provides a step-by-step guide for the implementation of the Expert Consensus procedure (ECO) for scientific projects. The ECO aims to facilitate consensus among a panel of experts about a target scientific output. Consensus is achieved through an iterative process including surveys and feedback to the panel members. Following the procedure can achieve two main aims: (1) to decrease the chance that the target output will be subject to conceptual or methodological mistakes, and (2) to increase the chance that the target output would be acceptable by the stakeholders on the field.

Published
2020

49. Extending the Choice Architecture Toolbox: The Choice Context Mapping

Author

Barnabas Szaszi, Hajdu N, and Balazs Aczel

Subjects
Computer science, Context (language use), Data science, Toolbox, Choice architecture
Abstract

The role of context in behavioral interventions is indisputable, yet few intervention studies start with a systematic mapping of the influencing contextual factors. This is mostly due to the lack of a methodology that researchers can employ for this aim. Recognizing this current limitation of the field, we developed a procedure, the Choice Context Mapping, to provide researchers a tool to examine the contextual factors of a targeted behavior. We demonstrate the steps of Choice Context Mapping on the behavioural choice situation of stairs vs. elevator use. Potential contextual factors were collected from laypeople as well as experts, and two surveys were created to measure both the behavior and choice, as well as the beliefs of participants. We estimated the effect of contextual factors on the participants’ behavior and managed to identify the most influential ones regarding their contribution to the studied choice. Using Choice Context Mapping, we obtained an accurate prediction of whether one chooses the stairs or elevator based on contextual information in 93.26% of the cases, on previously unseen data. We also ascertained that participants differed in their beliefs about what influences them in this particular choice, and that they can be divided into different groups based on their beliefs. Our results indicate that Choice Context Mapping is a useful procedure for the collection and assessment of contextual factors in a given choice setting which can help the planning of behavioral interventions by considerably lowering the number of possible interventions that are plausibly effective.

Published
2020

50. Documenting contributions to scholarly articles using CRediT and tenzing

Author

Balazs Aczel, Alex O. Holcombe, Marton Kovacs, Frederik Aust, and Psychologische Methodenleer (Psychologie, FMG)

Subjects
Computer and Information Sciences, Science and Technology Workforce, Medical Journals, Science Policy, Science, Data management, Information Storage and Retrieval, Plan (drawing), Research and Analysis Methods, Careers in Research, Computer Software, Database and Informatics Methods, Taxonomy (general), Medicine and Health Sciences, Humans, Sociology, Database Searching, Data Management, Scientific Publishing, Metadata, Multidisciplinary, business.industry, Software Engineering, Paper based, Public relations, Authorship, Controlled Vocabularies, R package, Professions, Bibliometrics, People and Places, Medicine, Position (finance), Engineering and Technology, Scientists, Population Groupings, User interface, business, Medical Humanities, Software, Research Article
Abstract

Scholars traditionally receive career credit for a paper based on where in the author list they appear, but position in an author list often carries little information about what the contribution of each researcher was. “Contributorship” refers to a movement to formally document the nature of each researcher’s contribution to a project. We discuss the emerging CRediT standard for documenting contributions and describe a web-based app and R package called tenzing that is designed to facilitate its use. tenzing can make it easier for researchers on a project to plan and record their planned contributions and to document those contributions in a journal article.

Published
2020

Catalog

Books, media, physical & digital resources
See catalog results