Search

Your search keyword '"D'Urso, E. Damiano"' showing total 29 results
Start Over Author "D'Urso, E. Damiano" Search Limiters Academic (Peer-Reviewed) Journals
29 results on '"D'Urso, E. Damiano"'

1. Awareness Is Bliss: How Acquiescence Affects Exploratory Factor Analysis

Author

D'Urso, E. Damiano, Tijmstra, Jesper, Vermunt, Jeroen K., and De Roover, Kim

Abstract

Assessing the measurement model (MM) of self-report scales is crucial to obtain valid measurements of individuals' latent psychological constructs. This entails evaluating the number of measured constructs and determining which construct is measured by which item. Exploratory factor analysis (EFA) is the most-used method to evaluate these psychometric properties, where the number of measured constructs (i.e., factors) is assessed, and, afterward, rotational freedom is resolved to interpret these factors. This study assessed the effects of an acquiescence response style (ARS) on EFA for unidimensional and multidimensional (un)balanced scales. Specifically, we evaluated (a) whether ARS is captured as an additional factor, (b) the effect of different rotation approaches on the content and ARS factors recovery, and (c) the effect of extracting the additional ARS factor on the recovery of factor loadings. ARS was often captured as an additional factor in balanced scales when it was strong. For these scales, ignoring extracting this additional ARS factor, or rotating to simple structure when extracting it, harmed the recovery of the original MM by introducing bias in loadings and cross-loadings. These issues were avoided by using informed rotation approaches (i.e., target rotation), where (part of) the rotation target is specified according to a priori expectations on the MM. Not extracting the additional ARS factor did not affect the loading recovery in unbalanced scales. Researchers should consider the potential presence of ARS when assessing the psychometric properties of balanced scales and use informed rotation approaches when suspecting that an additional factor is an ARS factor.

Published
2023
Full Text
View/download PDF

5. Does Acquiescence Disagree with Measurement Invariance Testing?

Author

D'Urso, E. Damiano, Tijmstra, Jesper, Vermunt, Jeroen K., and De Roover, Kim

Subjects
*CONFIRMATORY factor analysis
Abstract

Measurement invariance (MI) is required for validly comparing latent constructs measured by multiple ordinal self-report items. Non-invariances may occur when disregarding (group differences in) an acquiescence response style (ARS; an agreeing tendency regardless of item content). If non-invariance results solely from neglecting ARS, one should not worry about scale inequivalences but model the ARS instead. In a simulation study, we investigated the effect of ARS on MI testing, both when including ARS as a factor in the measurement model or not. For (semi-) balanced scales, disregarding a large ARS resulted in non-invariance already at the configural level. This was resolved by including an ARS factor for all groups. For unbalanced scales, disregarding ARS did not affect MI testing, and including an ARS factor often resulted in non-convergence. Implications and recommendations for applied research are discussed. [ABSTRACT FROM AUTHOR]

Published
2024
Full Text
View/download PDF

6. A many-analysts approach to the relation between religiosity and well-being

Author

Hoogeveen, Suzanne, Sarafoglou, Alexandra, Aczel, Balazs, Aditya, Yonathan, Alayan, Alexandra J., Allen, Peter J., Altay, Sacha, Alzahawi, Shilaan, Amir, Yulmaida, Anthony, Francis-Vincent, Appiah, Obed Kwame, Atkinson, Quentin D., Baimel, Adam, Balkaya-Ince, Merve, Balsamo, Michela, Banker, Sachin, Bartos, Frantisek, Becerra, Mario, Beffara, Bertrand, Beitner, Julia, Bendixen, Theiss, Berkessel, Jana B., Berniunas, Renatas, Billet, Matthew, Billingsley, Joseph, Bortolini, Tiago, Breitsohl, Heiko, Bret, Amelie, Brown, Faith L., Brown, Jennifer, Brumbaugh, Claudia C., Buczny, Jacek, Bulbulia, Joseph, Caballero, Saul, Carlucci, Leonardo, Carmichael, Cheryl L., Cattaneo, Marco E. G., Charles, Sarah J., Claessens, Scott, Panagopoulos, Maxinne C., Costa, Angelo Brandelli, Crone, Damien L., Czoschke, Stefan, Czymara, Christian, D'Urso, E. Damiano, Dahlstrom, Orjan, Dalla Rosa, Anna, Danielsson, Henrik, De Ron, Jill, de Vries, Ymkje Anna, Dean, Kristy K., Dik, Bryan J., Disabato, David J., Doherty, Jaclyn K., Draws, Tim, Drouhot, Lucas, Dujmovic, Marin, Dunham, Yarrow, Ebert, Tobias, Edelsbrunner, Peter A., Eerland, Anita, Elbaek, Christian T., Farahmand, Shole, Farahmand, Hooman, Farias, Miguel, Feliccia, Abrey A., Fischer, Kyle, Fischer, Ronald, Fisher-Thompson, Donna, Francis, Zoe, Frick, Susanne, Frisch, Lisa K., Geraldes, Diogo, Gerdin, Emily, Geven, Linda, Ghasemi, Omid, Gielens, Erwin, Gligoric, Vukasin, Hagel, Kristin, Hajdu, Nandor, Hamilton, Hannah R., Hamzah, Imaduddin, Hanel, Paul H. P., Hawk, Christopher E., Himawan, Karel K., Holding, Benjamin C., Homman, Lina E., Ingendahl, Moritz, Inkila, Hilla, Inman, Mary L., Islam, Chris-Gabriel, Isler, Ozan, Izydorczyk, David, Jaeger, Bastian, Johnson, Kathryn A., Jong, Jonathan, Karl, Johannes A., Kaszubowski, Erikson, Katz, Benjamin A., Keefer, Lucas A., Kelchtermans, Stijn, Kelly, John M., Klein, Richard A., Kleinberg, Bennett, Knowles, Megan L., Kolczynska, Marta, Koller, Dave, Krasko, Julia, Kritzler, Sarah, Krypotos, Angelos-Miltiadis, Kyritsis, Thanos, Landes, Todd L., Laukenmann, Ruben, Forsyth, Guy A. Lavender, Lazar, Aryeh, Lehman, Barbara J., Levy, Neil, Lo, Ronda F., Lodder, Paul, Lorenz, Jennifer, Lowicki, Pawel, Ly, Albert L., Maassen, Esther, Magyar-Russell, Gina M., Maier, Maximilian, Marsh, Dylan R., Martinez, Nuria, Martinie, Marcellin, Martoyo, Ihan, Mason, Susan E., Mauritsen, Anne Lundahl, McAleer, Phil, McCauley, Thomas, McCullough, Michael, McKay, Ryan, McMahon, Camilla M., McNamara, Amelia A., Means, Kira K., Mercier, Brett, Mitkidis, Panagiotis, Monin, Benoit, Moon, Jordan W., Moreau, David, Morgan, Jonathan, Murphy, James, Muscatt, George, Nagel, Christof, Nagy, Tamas, Nalborczyk, Ladislas, Nilsonne, Gustav, Noack, Pamina, Norenzayan, Ara, Nuijten, Michele B., Olsson-Collentine, Anton, Oviedo, Lluis, Pavlov, Yuri G., Pawelski, James O., Pearson, Hannah, Pedder, Hugo, Peetz, Hannah K., Pinus, Michael, Pirutinsky, Steven, Polito, Vince, Porubanova, Michaela, Poulin, Michael J., Prenoveau, Jason M., Prince, Mark A., Protzko, John, Pryor, Campbell, Purzycki, Benjamin G., Qiu, Lin, Putter, Julian Quevedo, Rabelo, Andre, Radell, Milen L., Ramsay, Jonathan E., Reid, Graham, Roberts, Andrew J., Luna, Lindsey M. Root, Ross, Robert M., Roszak, Piotr, Roy, Nirmal, Saarelainen, Suvi-Maria K., Sasaki, Joni Y., Schaumans, Catherine, Schivinski, Bruno, Schmitt, Marcel C., Schnitker, Sarah A., Schnuerch, Martin, Schreiner, Marcel R., Schuttengruber, Victoria, Sebben, Simone, Segerstrom, Suzanne C., Seryczynska, Berenika, Shjoedt, Uffe, Simsek, Muge, Sleegers, Willem W. A., Smith, Eliot R., Sowden, Walter J., Spath, Marion, Sporlein, Christoph, Stedden, William, Stoevenbelt, Andrea H., Stuber, Simon, Sulik, Justin, Suwartono, Christiany, Syropoulos, Stylianos, Szaszi, Barnabas, Szecsi, Peter, Tappin, Ben M., Tay, Louis, Thibault, Robert T., Thompson, Burt, Thurn, Christian M., Torralba, Josefa, Tuthill, Shelby D., Ullein, Ann-Marie, Van Aert, Robbie C. M., van Assen, Marcel A. L. M., Van Cappellen, Patty, van den Akker, Olmo R., Van der Cruyssen, Ine, Van der Noll, Jolanda, van Dongen, Noah N. N., Van Lissa, Caspar J., van Mulukom, Valerie, van Ravenzwaaij, Don, van Zyl, Casper J. J., Vaughn, Leigh Ann, Verschuere, Bruno, Vianello, Michelangelo, Vilanova, Felipe, Vishkin, Allon, Vogel, Vera, Vogelsmeier, Leonie V. D. E., Watanabe, Shoko, White, Cindel J. M., Wiebels, Kristina, Wiechert, Sera, Willett, Zachary Z., Witkowiak, Maciej, Witvliet, Charlotte V. O., Wiwad, Dylan, Wuyts, Robin, Xygalatas, Dimitris, Yang, Xin, Yeo, Darren J., Yilmaz, Onurcan, Zarzeczna, Natalia, Zhao, Yitong, Zijlmans, Josjan, van Elk, Michiel, Wagenmakers, Eric-Jan, Hoogeveen, Suzanne, Sarafoglou, Alexandra, Aczel, Balazs, Aditya, Yonathan, Alayan, Alexandra J., Allen, Peter J., Altay, Sacha, Alzahawi, Shilaan, Amir, Yulmaida, Anthony, Francis-Vincent, Appiah, Obed Kwame, Atkinson, Quentin D., Baimel, Adam, Balkaya-Ince, Merve, Balsamo, Michela, Banker, Sachin, Bartos, Frantisek, Becerra, Mario, Beffara, Bertrand, Beitner, Julia, Bendixen, Theiss, Berkessel, Jana B., Berniunas, Renatas, Billet, Matthew, Billingsley, Joseph, Bortolini, Tiago, Breitsohl, Heiko, Bret, Amelie, Brown, Faith L., Brown, Jennifer, Brumbaugh, Claudia C., Buczny, Jacek, Bulbulia, Joseph, Caballero, Saul, Carlucci, Leonardo, Carmichael, Cheryl L., Cattaneo, Marco E. G., Charles, Sarah J., Claessens, Scott, Panagopoulos, Maxinne C., Costa, Angelo Brandelli, Crone, Damien L., Czoschke, Stefan, Czymara, Christian, D'Urso, E. Damiano, Dahlstrom, Orjan, Dalla Rosa, Anna, Danielsson, Henrik, De Ron, Jill, de Vries, Ymkje Anna, Dean, Kristy K., Dik, Bryan J., Disabato, David J., Doherty, Jaclyn K., Draws, Tim, Drouhot, Lucas, Dujmovic, Marin, Dunham, Yarrow, Ebert, Tobias, Edelsbrunner, Peter A., Eerland, Anita, Elbaek, Christian T., Farahmand, Shole, Farahmand, Hooman, Farias, Miguel, Feliccia, Abrey A., Fischer, Kyle, Fischer, Ronald, Fisher-Thompson, Donna, Francis, Zoe, Frick, Susanne, Frisch, Lisa K., Geraldes, Diogo, Gerdin, Emily, Geven, Linda, Ghasemi, Omid, Gielens, Erwin, Gligoric, Vukasin, Hagel, Kristin, Hajdu, Nandor, Hamilton, Hannah R., Hamzah, Imaduddin, Hanel, Paul H. P., Hawk, Christopher E., Himawan, Karel K., Holding, Benjamin C., Homman, Lina E., Ingendahl, Moritz, Inkila, Hilla, Inman, Mary L., Islam, Chris-Gabriel, Isler, Ozan, Izydorczyk, David, Jaeger, Bastian, Johnson, Kathryn A., Jong, Jonathan, Karl, Johannes A., Kaszubowski, Erikson, Katz, Benjamin A., Keefer, Lucas A., Kelchtermans, Stijn, Kelly, John M., Klein, Richard A., Kleinberg, Bennett, Knowles, Megan L., Kolczynska, Marta, Koller, Dave, Krasko, Julia, Kritzler, Sarah, Krypotos, Angelos-Miltiadis, Kyritsis, Thanos, Landes, Todd L., Laukenmann, Ruben, Forsyth, Guy A. Lavender, Lazar, Aryeh, Lehman, Barbara J., Levy, Neil, Lo, Ronda F., Lodder, Paul, Lorenz, Jennifer, Lowicki, Pawel, Ly, Albert L., Maassen, Esther, Magyar-Russell, Gina M., Maier, Maximilian, Marsh, Dylan R., Martinez, Nuria, Martinie, Marcellin, Martoyo, Ihan, Mason, Susan E., Mauritsen, Anne Lundahl, McAleer, Phil, McCauley, Thomas, McCullough, Michael, McKay, Ryan, McMahon, Camilla M., McNamara, Amelia A., Means, Kira K., Mercier, Brett, Mitkidis, Panagiotis, Monin, Benoit, Moon, Jordan W., Moreau, David, Morgan, Jonathan, Murphy, James, Muscatt, George, Nagel, Christof, Nagy, Tamas, Nalborczyk, Ladislas, Nilsonne, Gustav, Noack, Pamina, Norenzayan, Ara, Nuijten, Michele B., Olsson-Collentine, Anton, Oviedo, Lluis, Pavlov, Yuri G., Pawelski, James O., Pearson, Hannah, Pedder, Hugo, Peetz, Hannah K., Pinus, Michael, Pirutinsky, Steven, Polito, Vince, Porubanova, Michaela, Poulin, Michael J., Prenoveau, Jason M., Prince, Mark A., Protzko, John, Pryor, Campbell, Purzycki, Benjamin G., Qiu, Lin, Putter, Julian Quevedo, Rabelo, Andre, Radell, Milen L., Ramsay, Jonathan E., Reid, Graham, Roberts, Andrew J., Luna, Lindsey M. Root, Ross, Robert M., Roszak, Piotr, Roy, Nirmal, Saarelainen, Suvi-Maria K., Sasaki, Joni Y., Schaumans, Catherine, Schivinski, Bruno, Schmitt, Marcel C., Schnitker, Sarah A., Schnuerch, Martin, Schreiner, Marcel R., Schuttengruber, Victoria, Sebben, Simone, Segerstrom, Suzanne C., Seryczynska, Berenika, Shjoedt, Uffe, Simsek, Muge, Sleegers, Willem W. A., Smith, Eliot R., Sowden, Walter J., Spath, Marion, Sporlein, Christoph, Stedden, William, Stoevenbelt, Andrea H., Stuber, Simon, Sulik, Justin, Suwartono, Christiany, Syropoulos, Stylianos, Szaszi, Barnabas, Szecsi, Peter, Tappin, Ben M., Tay, Louis, Thibault, Robert T., Thompson, Burt, Thurn, Christian M., Torralba, Josefa, Tuthill, Shelby D., Ullein, Ann-Marie, Van Aert, Robbie C. M., van Assen, Marcel A. L. M., Van Cappellen, Patty, van den Akker, Olmo R., Van der Cruyssen, Ine, Van der Noll, Jolanda, van Dongen, Noah N. N., Van Lissa, Caspar J., van Mulukom, Valerie, van Ravenzwaaij, Don, van Zyl, Casper J. J., Vaughn, Leigh Ann, Verschuere, Bruno, Vianello, Michelangelo, Vilanova, Felipe, Vishkin, Allon, Vogel, Vera, Vogelsmeier, Leonie V. D. E., Watanabe, Shoko, White, Cindel J. M., Wiebels, Kristina, Wiechert, Sera, Willett, Zachary Z., Witkowiak, Maciej, Witvliet, Charlotte V. O., Wiwad, Dylan, Wuyts, Robin, Xygalatas, Dimitris, Yang, Xin, Yeo, Darren J., Yilmaz, Onurcan, Zarzeczna, Natalia, Zhao, Yitong, Zijlmans, Josjan, van Elk, Michiel, and Wagenmakers, Eric-Jan

Abstract

The relation between religiosity and well-being is one of the most researched topics in the psychology of religion, yet the directionality and robustness of the effect remains debated. Here, we adopted a many-analysts approach to assess the robustness of this relation based on a new cross-cultural dataset (N = 10, 535 participants from 24 countries). We recruited 120 analysis teams to investigate (1) whether religious people self-report higher well-being, and (2) whether the relation between religiosity and self-reported well-being depends on perceived cultural norms of religion (i.e., whether it is considered normal and desirable to be religious in a given country). In a two-stage procedure, the teams first created an analysis plan and then executed their planned analysis on the data. For the first research question, all but 3 teams reported positive effect sizes with credible/confidence intervals excluding zero (median reported beta = 0.120). For the second research question, this was the case for 65% of the teams (median reported beta = 0.039). While most teams applied (multilevel) linear regression models, there was considerable variability in the choice of items used to construct the independent variables, the dependent variable, and the included covariates.

Published
2023

7. The dire disregard of measurement invariance testing in psychological science

Author

Maassen, E., D'Urso, E. Damiano, van Assen, M.A.L.M., Nuijten, M.B., de Roover, K., Wicherts, J.M., Maassen, E., D'Urso, E. Damiano, van Assen, M.A.L.M., Nuijten, M.B., de Roover, K., and Wicherts, J.M.

Abstract

Self-report scales are widely used in psychology to compare means in latent constructs across groups, experimental conditions, or time points. However, for these comparisons to be meaningful and unbiased, the scales must demonstrate measurement invariance (MI) across compared time points or (experimental) groups. MI testing determines whether the latent constructs are measured equivalently across groups or time, which is essential for meaningful comparisons. We conducted a systematic review of 426 psychology articles with openly available data, to (a) examine common practices in conducting and reporting of MI testing, (b) assess whether we could reproduce the reported MI results, and (c) conduct MI tests for the comparisons that enabled sufficiently powerful MI testing. We identified 96 articles that contained a total of 929 comparisons. Results showed that only 4% of the 929 comparisons underwent MI testing, and the tests were generally poorly reported. None of the reported MI tests were reproducible, and only 26% of the 174 newly performed MI tests reached sufficient (scalar) invariance, with MI failing completely in 58% of tests. Exploratory analyses suggested that in nearly half of the comparisons where configural invariance was rejected, the number of factors differed between groups. These results indicate that MI tests are rarely conducted and poorly reported in psychological studies. We observed frequent violations of MI, suggesting that reported differences between (experimental) groups may not be solely attributed to group differences in the latent constructs. We offer recommendations aimed at improving reporting and computational reproducibility practices in psychology.

Published
2023

8. Awareness Is bliss: How acquiescence affects exploratory factor analysis

Author

D’Urso, E. Damiano, Tijmstra, Jesper, Vermunt, Jeroen K., Roover, Kim De, D’Urso, E. Damiano, Tijmstra, Jesper, Vermunt, Jeroen K., and Roover, Kim De

Abstract

Assessing the measurement model (MM) of self-report scales is crucial to obtain valid measurements of individuals’ latent psychological constructs. This entails evaluating the number of measured constructs and determining which construct is measured by which item. Exploratory factor analysis (EFA) is the most-used method to evaluate these psychometric properties, where the number of measured constructs (i.e., factors) is assessed, and, afterward, rotational freedom is resolved to interpret these factors. This study assessed the effects of an acquiescence response style (ARS) on EFA for unidimensional and multidimensional (un)balanced scales. Specifically, we evaluated (a) whether ARS is captured as an additional factor, (b) the effect of different rotation approaches on the content and ARS factors recovery, and (c) the effect of extracting the additional ARS factor on the recovery of factor loadings. ARS was often captured as an additional factor in balanced scales when it was strong. For these scales, ignoring extracting this additional ARS factor, or rotating to simple structure when extracting it, harmed the recovery of the original MM by introducing bias in loadings and cross-loadings. These issues were avoided by using informed rotation approaches (i.e., target rotation), where (part of) the rotation target is specified according to a priori expectations on the MM. Not extracting the additional ARS factor did not affect the loading recovery in unbalanced scales. Researchers should consider the potential presence of ARS when assessing the psychometric properties of balanced scales and use informed rotation approaches when suspecting that an additional factor is an ARS factor.

Published
2023

10. The Amsterdam Sexual Pleasure Index (ASPI Vol. 1.0) – A Psychometric Study of a Trait and State Assessment of Sexual Pleasure

Author

Werner, Marlene, Borgmann, Michèle, D'Urso, E. Damiano, and Azevedo, Flavio

Subjects
FOS: Psychology, Health Psychology, Sociology, Psychometrics, Questionnaire Development, Psychology, Quantitative Psychology, Social and Behavioral Sciences, Sexual Pleasure, FOS: Sociology
Abstract

This project includes information related to the development of the Amsterdam Sexual Pleasure Index (Vol. 1.0), a questionnaire which aims to assess the tendency to experience sexual pleasure and the level of recently experienced sexual pleasure.

Published
2023
Full Text
View/download PDF

11. The Amsterdam Sexual Pleasure Inventory (ASPI Vol. 1.0) – A Multi-Method Psychometric Study of a Trait and State Assessment of Sexual Pleasure

Author

Borgmann, Michèle, Brandner, Lucca, D'Urso, E. Damiano, Gonin-Spahni, Stefanie, Znoj, Hansjörg, and Werner, Marlene

Subjects
Psychometrics, Questionnaire Development, Sexual Pleasure
Abstract

This project includes information related to the validation study of the (German version of the) Amsterdam Sexual Pleasure Inventory (Vol. 1.0), a questionnaire which aims to assess the tendency to experience sexual pleasure and the level of recently experienced sexual pleasure.

Published
2023
Full Text
View/download PDF

14. Measurement Invariance Testing in Psychology: a Systematic Review [main study]

Author

Maassen, Esther, D'Urso, E. Damiano, Wicherts, Jelte, and Nuijten, Michele

Subjects
FOS: Psychology, Psychology, Social and Behavioral Sciences
Abstract

This is the preregistration for the main study of the "Measurement Invariance Testing in Psychology" project. The preregistration for the pilot study can be found here: https://osf.io/6rfy5.

Published
2022
Full Text
View/download PDF

15. Data and Scripts

Author

Buchanan, Erin, Coles, Nicholas, Ebersole, Charles, Forscher, Patrick, Moshontz, Hannah, Miller, Jeremy, Szabelska, Anna, Wang, Ke, Vasilev, Martin, Ropovik, Ivan, Kaminski, Gwenaël, Isager, Peder, Holcombe, Alex, Stefan, Angelika, D'Urso, E. Damiano, Nilsonne, Gustav, Pit, Ilse, Beitner, Julia, DeBruine, Lisa, Searston, Rachel, Dorison, Charles, Legate, Nicole, Nguyen, Thuy-vy, Goldenberg, Amit, Lewis, Savannah, Paris, Bastien, and Pavlacic, Jeffrey

Published
2022
Full Text
View/download PDF

16. The dire disregard of measurement invariance testing in psychological science

Author

D'Urso, E. Damiano, Maassen, Esther, Assen, Marcel A. L. M. van, Nuijten, Michele B., Roover, Kim De, Wicherts, Jelte M., and Department of Methodology and Statistics

Abstract

In psychological science, self-report scales are widely used to compare means in targeted latent constructs across time points, groups, or experimental conditions. For these scale mean comparisons (SMC) to be meaningful and unbiased, the scales should be measurement invariant across the compared time points or (experimental) groups. Measurement invariance (MI) testing checks whether the latent constructs are measured equivalently across groups or time points. Since MI is essential for meaningful comparisons, we conducted a systematic review to check whether MI is taken seriously in psychological research. Specifically, we sampled 426 psychology articles with openly available data that involved a total of 918 SMCs to (1) investigate common practices in conducting and reporting of MI testing, (2) check whether reported MI test results can be reproduced, and (3) conduct MI tests for the SMCs that enabled sufficiently powerful MI testing with the shared data. Our results indicate that (1) 4% of the 918 scales underwent MI testing across groups or time and that these tests were generally poorly reported, (2) none of the reported MI tests could be successfully reproduced, and (3) of 161 newly performed MI tests, a mere 46 (29%) reached sufficient MI (scalar invariance), and MI often failed completely (89; 55%). Thus, MI tests were rarely done and poorly reported in psychological studies, and the frequent violations of MI indicate that reported group differences cannot be solely attributed to group differences in the latent constructs. We offer recommendations on reporting MI tests and improving computational reproducibility practices.

Published
2022

18. A many-analysts approach to the relation between religiosity and well-being

Author

Hoogeveen, Suzanne, primary, Sarafoglou, Alexandra, additional, Aczel, Balazs, additional, Aditya, Yonathan, additional, Alayan, Alexandra J., additional, Allen, Peter J., additional, Altay, Sacha, additional, Alzahawi, Shilaan, additional, Amir, Yulmaida, additional, Anthony, Francis-Vincent, additional, Kwame Appiah, Obed, additional, Atkinson, Quentin D., additional, Baimel, Adam, additional, Balkaya-Ince, Merve, additional, Balsamo, Michela, additional, Banker, Sachin, additional, Bartoš, František, additional, Becerra, Mario, additional, Beffara, Bertrand, additional, Beitner, Julia, additional, Bendixen, Theiss, additional, Berkessel, Jana B., additional, Berniūnas, Renatas, additional, Billet, Matthew I., additional, Billingsley, Joseph, additional, Bortolini, Tiago, additional, Breitsohl, Heiko, additional, Bret, Amélie, additional, Brown, Faith L., additional, Brown, Jennifer, additional, Brumbaugh, Claudia C., additional, Buczny, Jacek, additional, Bulbulia, Joseph, additional, Caballero, Saúl, additional, Carlucci, Leonardo, additional, Carmichael, Cheryl L., additional, Cattaneo, Marco E. G. V., additional, Charles, Sarah J., additional, Claessens, Scott, additional, Panagopoulos, Maxinne C., additional, Costa, Angelo Brandelli, additional, Crone, Damien L., additional, Czoschke, Stefan, additional, Czymara, Christian, additional, D'Urso, E. Damiano, additional, Dahlström, Örjan, additional, Rosa, Anna Dalla, additional, Danielsson, Henrik, additional, De Ron, Jill, additional, de Vries, Ymkje Anna, additional, Dean, Kristy K., additional, Dik, Bryan J., additional, Disabato, David J., additional, Doherty, Jaclyn K., additional, Draws, Tim, additional, Drouhot, Lucas, additional, Dujmovic, Marin, additional, Dunham, Yarrow, additional, Ebert, Tobias, additional, Edelsbrunner, Peter A., additional, Eerland, Anita, additional, Elbaek, Christian T., additional, Farahmand, Shole, additional, Farahmand, Hooman, additional, Farias, Miguel, additional, Feliccia, Abrey A., additional, Fischer, Kyle, additional, Fischer, Ronald, additional, Fisher-Thompson, Donna, additional, Francis, Zoë, additional, Frick, Susanne, additional, Frisch, Lisa K., additional, Geraldes, Diogo, additional, Gerdin, Emily, additional, Geven, Linda, additional, Ghasemi, Omid, additional, Gielens, Erwin, additional, Gligorić, Vukašin, additional, Hagel, Kristin, additional, Hajdu, Nandor, additional, Hamilton, Hannah R., additional, Hamzah, Imaduddin, additional, Hanel, Paul H. P., additional, Hawk, Christopher E., additional, K. Himawan, Karel, additional, Holding, Benjamin C., additional, Homman, Lina E., additional, Ingendahl, Moritz, additional, Inkilä, Hilla, additional, Inman, Mary L., additional, Islam, Chris-Gabriel, additional, Isler, Ozan, additional, Izydorczyk, David, additional, Jaeger, Bastian, additional, Johnson, Kathryn A., additional, Jong, Jonathan, additional, Karl, Johannes A., additional, Kaszubowski, Erikson, additional, Katz, Benjamin A., additional, Keefer, Lucas A., additional, Kelchtermans, Stijn, additional, Kelly, John M., additional, Klein, Richard A., additional, Kleinberg, Bennett, additional, Knowles, Megan L., additional, Kołczyńska, Marta, additional, Koller, Dave, additional, Krasko, Julia, additional, Kritzler, Sarah, additional, Krypotos, Angelos-Miltiadis, additional, Kyritsis, Thanos, additional, L. Landes, Todd, additional, Laukenmann, Ruben, additional, Forsyth, Guy A. Lavender, additional, Lazar, Aryeh, additional, Lehman, Barbara J., additional, Levy, Neil, additional, Lo, Ronda F., additional, Lodder, Paul, additional, Lorenz, Jennifer, additional, Łowicki, Paweł, additional, Ly, Albert L., additional, Maassen, Esther, additional, Magyar-Russell, Gina M., additional, Maier, Maximilian, additional, Marsh, Dylan R., additional, Martinez, Nuria, additional, Martinie, Marcellin, additional, Martoyo, Ihan, additional, Mason, Susan E., additional, Mauritsen, Anne Lundahl, additional, McAleer, Phil, additional, McCauley, Thomas, additional, McCullough, Michael, additional, McKay, Ryan, additional, McMahon, Camilla M., additional, McNamara, Amelia A., additional, Means, Kira K., additional, Mercier, Brett, additional, Mitkidis, Panagiotis, additional, Monin, Benoît, additional, Moon, Jordan W., additional, Moreau, David, additional, Morgan, Jonathan, additional, Murphy, James, additional, Muscatt, George, additional, Nägel, Christof, additional, Nagy, Tamás, additional, Nalborczyk, Ladislas, additional, Nilsonne, Gustav, additional, Noack, Pamina, additional, Norenzayan, Ara, additional, Nuijten, Michèle B., additional, Olsson-Collentine, Anton, additional, Oviedo, Lluis, additional, Pavlov, Yuri G., additional, Pawelski, James O., additional, Pearson, Hannah I., additional, Pedder, Hugo, additional, Peetz, Hannah K., additional, Pinus, Michael, additional, Pirutinsky, Steven, additional, Polito, Vince, additional, Porubanova, Michaela, additional, Poulin, Michael J., additional, Prenoveau, Jason M., additional, Prince, Mark A., additional, Protzko, John, additional, Pryor, Campbell, additional, Purzycki, Benjamin G., additional, Qiu, Lin, additional, Pütter, Julian Quevedo, additional, Rabelo, André, additional, Radell, Milen L., additional, Ramsay, Jonathan E., additional, Reid, Graham, additional, J. Roberts, Andrew, additional, Luna, Lindsey M. Root, additional, Ross, Robert M., additional, Roszak, Piotr, additional, Roy, Nirmal, additional, Saarelainen, Suvi-Maria K., additional, Sasaki, Joni Y., additional, Schaumans, Catherine, additional, Schivinski, Bruno, additional, Schmitt, Marcel C., additional, Schnitker, Sarah A., additional, Schnuerch, Martin, additional, Schreiner, Marcel R., additional, Schüttengruber, Victoria, additional, Sebben, Simone, additional, Segerstrom, Suzanne C., additional, Seryczyńska, Berenika, additional, Shjoedt, Uffe, additional, Simsek, Müge, additional, Sleegers, Willem W. A., additional, Smith, Eliot R., additional, Sowden, Walter J., additional, Späth, Marion, additional, Spörlein, Christoph, additional, Stedden, William, additional, Stoevenbelt, Andrea H., additional, Stuber, Simon, additional, Sulik, Justin, additional, Suwartono, Christiany, additional, Syropoulos, Stylianos, additional, Szaszi, Barnabas, additional, Szecsi, Peter, additional, Tappin, Ben M., additional, Tay, Louis, additional, Thibault, Robert T., additional, Thompson, Burt, additional, Thurn, Christian M., additional, Torralba, Josefa, additional, Tuthill, Shelby D., additional, Ullein, Ann-Marie, additional, Van Aert, Robbie C. M., additional, van Assen, Marcel A. L. M., additional, Van Cappellen, Patty, additional, van den Akker, Olmo R., additional, Van der Cruyssen, Ine, additional, Van der Noll, Jolanda, additional, van Dongen, Noah N. N., additional, Van Lissa, Caspar J., additional, van Mulukom, Valerie, additional, van Ravenzwaaij, Don, additional, van Zyl, Casper J. J., additional, Ann Vaughn, Leigh, additional, Većkalov, Bojana, additional, Verschuere, Bruno, additional, Vianello, Michelangelo, additional, Vilanova, Felipe, additional, Vishkin, Allon, additional, Vogel, Vera, additional, Vogelsmeier, Leonie V. D. E., additional, Watanabe, Shoko, additional, White, Cindel J. M., additional, Wiebels, Kristina, additional, Wiechert, Sera, additional, Willett, Zachary Z., additional, Witkowiak, Maciej, additional, Witvliet, Charlotte V. O., additional, Wiwad, Dylan, additional, Wuyts, Robin, additional, Xygalatas, Dimitris, additional, Yang, Xin, additional, Yeo, Darren J., additional, Yilmaz, Onurcan, additional, Zarzeczna, Natalia, additional, Zhao, Yitong, additional, Zijlmans, Josjan, additional, van Elk, Michiel, additional, and Wagenmakers, Eric-Jan, additional

Published
2022
Full Text
View/download PDF

19. A many-analysts approach to the relation between religiosity and well-being

Author

Hoogeveen, Suzanne, Sarafoglou, Alexandra, Aczel, Balazs, Aditya, Yonathan, Alayan, Alexandra J., Allen, Peter J., Altay, Sacha, Alzahawi, Shilaan, Amir, Yulmaida, Anthony, Francis-Vincent, Appiah, Obed Kwame, Atkinson, Quentin D., Baimel, Adam, Balkaya-Ince, Merve, Balsamo, Michela, Banker, Sachin, Bartos, Frantisek, Becerra, Mario, Beffara, Bertrand, Beitner, Julia, Bendixen, Theiss, Berkessel, Jana B., Berniunas, Renatas, Billet, Matthew, Billingsley, Joseph, Bortolini, Tiago, Breitsohl, Heiko, Bret, Amelie, Brown, Faith L., Brown, Jennifer, Brumbaugh, Claudia C., Buczny, Jacek, Bulbulia, Joseph, Caballero, Saul, Carlucci, Leonardo, Carmichael, Cheryl L., Cattaneo, Marco E. G., Charles, Sarah J., Claessens, Scott, Panagopoulos, Maxinne C., Costa, Angelo Brandelli, Crone, Damien L., Czoschke, Stefan, Czymara, Christian, D'Urso, E. Damiano, Dahlstrom, Orjan, Dalla Rosa, Anna, Danielsson, Henrik, De Ron, Jill, de Vries, Ymkje Anna, Dean, Kristy K., Dik, Bryan J., Disabato, David J., Doherty, Jaclyn K., Draws, Tim, Drouhot, Lucas, Dujmovic, Marin, Dunham, Yarrow, Ebert, Tobias, Edelsbrunner, Peter A., Eerland, Anita, Elbaek, Christian T., Farahmand, Shole, Farahmand, Hooman, Farias, Miguel, Feliccia, Abrey A., Fischer, Kyle, Fischer, Ronald, Fisher-Thompson, Donna, Francis, Zoe, Frick, Susanne, Frisch, Lisa K., Geraldes, Diogo, Gerdin, Emily, Geven, Linda, Ghasemi, Omid, Gielens, Erwin, Gligoric, Vukasin, Hagel, Kristin, Hajdu, Nandor, Hamilton, Hannah R., Hamzah, Imaduddin, Hanel, Paul H. P., Hawk, Christopher E., Himawan, Karel K., Holding, Benjamin C., Homman, Lina E., Ingendahl, Moritz, Inkila, Hilla, Inman, Mary L., Islam, Chris-Gabriel, Isler, Ozan, Izydorczyk, David, Jaeger, Bastian, Johnson, Kathryn A., Jong, Jonathan, Karl, Johannes A., Kaszubowski, Erikson, Katz, Benjamin A., Keefer, Lucas A., Kelchtermans, Stijn, Kelly, John M., Klein, Richard A., Kleinberg, Bennett, Knowles, Megan L., Kolczynska, Marta, Koller, Dave, Krasko, Julia, Kritzler, Sarah, Krypotos, Angelos-Miltiadis, Kyritsis, Thanos, Landes, Todd L., Laukenmann, Ruben, Forsyth, Guy A. Lavender, Lazar, Aryeh, Lehman, Barbara J., Levy, Neil, Lo, Ronda F., Lodder, Paul, Lorenz, Jennifer, Lowicki, Pawel, Ly, Albert L., Maassen, Esther, Magyar-Russell, Gina M., Maier, Maximilian, Marsh, Dylan R., Martinez, Nuria, Martinie, Marcellin, Martoyo, Ihan, Mason, Susan E., Mauritsen, Anne Lundahl, McAleer, Phil, McCauley, Thomas, McCullough, Michael, McKay, Ryan, McMahon, Camilla M., McNamara, Amelia A., Means, Kira K., Mercier, Brett, Mitkidis, Panagiotis, Monin, Benoit, Moon, Jordan W., Moreau, David, Morgan, Jonathan, Murphy, James, Muscatt, George, Nagel, Christof, Nagy, Tamas, Nalborczyk, Ladislas, Nilsonne, Gustav, Noack, Pamina, Norenzayan, Ara, Nuijten, Michele B., Olsson-Collentine, Anton, Oviedo, Lluis, Pavlov, Yuri G., Pawelski, James O., Pearson, Hannah, Pedder, Hugo, Peetz, Hannah K., Pinus, Michael, Pirutinsky, Steven, Polito, Vince, Porubanova, Michaela, Poulin, Michael J., Prenoveau, Jason M., Prince, Mark A., Protzko, John, Pryor, Campbell, Purzycki, Benjamin G., Qiu, Lin, Putter, Julian Quevedo, Rabelo, Andre, Radell, Milen L., Ramsay, Jonathan E., Reid, Graham, Roberts, Andrew J., Luna, Lindsey M. Root, Ross, Robert M., Roszak, Piotr, Roy, Nirmal, Saarelainen, Suvi-Maria K., Sasaki, Joni Y., Schaumans, Catherine, Schivinski, Bruno, Schmitt, Marcel C., Schnitker, Sarah A., Schnuerch, Martin, Schreiner, Marcel R., Schuttengruber, Victoria, Sebben, Simone, Segerstrom, Suzanne C., Seryczynska, Berenika, Shjoedt, Uffe, Simsek, Muge, Sleegers, Willem W. A., Smith, Eliot R., Sowden, Walter J., Spath, Marion, Sporlein, Christoph, Stedden, William, Stoevenbelt, Andrea H., Stuber, Simon, Sulik, Justin, Suwartono, Christiany, Syropoulos, Stylianos, Szaszi, Barnabas, Szecsi, Peter, Tappin, Ben M., Tay, Louis, Thibault, Robert T., Thompson, Burt, Thurn, Christian M., Torralba, Josefa, Tuthill, Shelby D., Ullein, Ann-Marie, Van Aert, Robbie C. M., van Assen, Marcel A. L. M., Van Cappellen, Patty, van den Akker, Olmo R., Van der Cruyssen, Ine, Van der Noll, Jolanda, van Dongen, Noah N. N., Van Lissa, Caspar J., van Mulukom, Valerie, van Ravenzwaaij, Don, van Zyl, Casper J. J., Vaughn, Leigh Ann, Verschuere, Bruno, Vianello, Michelangelo, Vilanova, Felipe, Vishkin, Allon, Vogel, Vera, Vogelsmeier, Leonie V. D. E., Watanabe, Shoko, White, Cindel J. M., Wiebels, Kristina, Wiechert, Sera, Willett, Zachary Z., Witkowiak, Maciej, Witvliet, Charlotte V. O., Wiwad, Dylan, Wuyts, Robin, Xygalatas, Dimitris, Yang, Xin, Yeo, Darren J., Yilmaz, Onurcan, Zarzeczna, Natalia, Zhao, Yitong, Zijlmans, Josjan, van Elk, Michiel, Wagenmakers, Eric-Jan, Hoogeveen, Suzanne, Sarafoglou, Alexandra, Aczel, Balazs, Aditya, Yonathan, Alayan, Alexandra J., Allen, Peter J., Altay, Sacha, Alzahawi, Shilaan, Amir, Yulmaida, Anthony, Francis-Vincent, Appiah, Obed Kwame, Atkinson, Quentin D., Baimel, Adam, Balkaya-Ince, Merve, Balsamo, Michela, Banker, Sachin, Bartos, Frantisek, Becerra, Mario, Beffara, Bertrand, Beitner, Julia, Bendixen, Theiss, Berkessel, Jana B., Berniunas, Renatas, Billet, Matthew, Billingsley, Joseph, Bortolini, Tiago, Breitsohl, Heiko, Bret, Amelie, Brown, Faith L., Brown, Jennifer, Brumbaugh, Claudia C., Buczny, Jacek, Bulbulia, Joseph, Caballero, Saul, Carlucci, Leonardo, Carmichael, Cheryl L., Cattaneo, Marco E. G., Charles, Sarah J., Claessens, Scott, Panagopoulos, Maxinne C., Costa, Angelo Brandelli, Crone, Damien L., Czoschke, Stefan, Czymara, Christian, D'Urso, E. Damiano, Dahlstrom, Orjan, Dalla Rosa, Anna, Danielsson, Henrik, De Ron, Jill, de Vries, Ymkje Anna, Dean, Kristy K., Dik, Bryan J., Disabato, David J., Doherty, Jaclyn K., Draws, Tim, Drouhot, Lucas, Dujmovic, Marin, Dunham, Yarrow, Ebert, Tobias, Edelsbrunner, Peter A., Eerland, Anita, Elbaek, Christian T., Farahmand, Shole, Farahmand, Hooman, Farias, Miguel, Feliccia, Abrey A., Fischer, Kyle, Fischer, Ronald, Fisher-Thompson, Donna, Francis, Zoe, Frick, Susanne, Frisch, Lisa K., Geraldes, Diogo, Gerdin, Emily, Geven, Linda, Ghasemi, Omid, Gielens, Erwin, Gligoric, Vukasin, Hagel, Kristin, Hajdu, Nandor, Hamilton, Hannah R., Hamzah, Imaduddin, Hanel, Paul H. P., Hawk, Christopher E., Himawan, Karel K., Holding, Benjamin C., Homman, Lina E., Ingendahl, Moritz, Inkila, Hilla, Inman, Mary L., Islam, Chris-Gabriel, Isler, Ozan, Izydorczyk, David, Jaeger, Bastian, Johnson, Kathryn A., Jong, Jonathan, Karl, Johannes A., Kaszubowski, Erikson, Katz, Benjamin A., Keefer, Lucas A., Kelchtermans, Stijn, Kelly, John M., Klein, Richard A., Kleinberg, Bennett, Knowles, Megan L., Kolczynska, Marta, Koller, Dave, Krasko, Julia, Kritzler, Sarah, Krypotos, Angelos-Miltiadis, Kyritsis, Thanos, Landes, Todd L., Laukenmann, Ruben, Forsyth, Guy A. Lavender, Lazar, Aryeh, Lehman, Barbara J., Levy, Neil, Lo, Ronda F., Lodder, Paul, Lorenz, Jennifer, Lowicki, Pawel, Ly, Albert L., Maassen, Esther, Magyar-Russell, Gina M., Maier, Maximilian, Marsh, Dylan R., Martinez, Nuria, Martinie, Marcellin, Martoyo, Ihan, Mason, Susan E., Mauritsen, Anne Lundahl, McAleer, Phil, McCauley, Thomas, McCullough, Michael, McKay, Ryan, McMahon, Camilla M., McNamara, Amelia A., Means, Kira K., Mercier, Brett, Mitkidis, Panagiotis, Monin, Benoit, Moon, Jordan W., Moreau, David, Morgan, Jonathan, Murphy, James, Muscatt, George, Nagel, Christof, Nagy, Tamas, Nalborczyk, Ladislas, Nilsonne, Gustav, Noack, Pamina, Norenzayan, Ara, Nuijten, Michele B., Olsson-Collentine, Anton, Oviedo, Lluis, Pavlov, Yuri G., Pawelski, James O., Pearson, Hannah, Pedder, Hugo, Peetz, Hannah K., Pinus, Michael, Pirutinsky, Steven, Polito, Vince, Porubanova, Michaela, Poulin, Michael J., Prenoveau, Jason M., Prince, Mark A., Protzko, John, Pryor, Campbell, Purzycki, Benjamin G., Qiu, Lin, Putter, Julian Quevedo, Rabelo, Andre, Radell, Milen L., Ramsay, Jonathan E., Reid, Graham, Roberts, Andrew J., Luna, Lindsey M. Root, Ross, Robert M., Roszak, Piotr, Roy, Nirmal, Saarelainen, Suvi-Maria K., Sasaki, Joni Y., Schaumans, Catherine, Schivinski, Bruno, Schmitt, Marcel C., Schnitker, Sarah A., Schnuerch, Martin, Schreiner, Marcel R., Schuttengruber, Victoria, Sebben, Simone, Segerstrom, Suzanne C., Seryczynska, Berenika, Shjoedt, Uffe, Simsek, Muge, Sleegers, Willem W. A., Smith, Eliot R., Sowden, Walter J., Spath, Marion, Sporlein, Christoph, Stedden, William, Stoevenbelt, Andrea H., Stuber, Simon, Sulik, Justin, Suwartono, Christiany, Syropoulos, Stylianos, Szaszi, Barnabas, Szecsi, Peter, Tappin, Ben M., Tay, Louis, Thibault, Robert T., Thompson, Burt, Thurn, Christian M., Torralba, Josefa, Tuthill, Shelby D., Ullein, Ann-Marie, Van Aert, Robbie C. M., van Assen, Marcel A. L. M., Van Cappellen, Patty, van den Akker, Olmo R., Van der Cruyssen, Ine, Van der Noll, Jolanda, van Dongen, Noah N. N., Van Lissa, Caspar J., van Mulukom, Valerie, van Ravenzwaaij, Don, van Zyl, Casper J. J., Vaughn, Leigh Ann, Verschuere, Bruno, Vianello, Michelangelo, Vilanova, Felipe, Vishkin, Allon, Vogel, Vera, Vogelsmeier, Leonie V. D. E., Watanabe, Shoko, White, Cindel J. M., Wiebels, Kristina, Wiechert, Sera, Willett, Zachary Z., Witkowiak, Maciej, Witvliet, Charlotte V. O., Wiwad, Dylan, Wuyts, Robin, Xygalatas, Dimitris, Yang, Xin, Yeo, Darren J., Yilmaz, Onurcan, Zarzeczna, Natalia, Zhao, Yitong, Zijlmans, Josjan, van Elk, Michiel, and Wagenmakers, Eric-Jan

Abstract

The relation between religiosity and well-being is one of the most researched topics in the psychology of religion, yet the directionality and robustness of the effect remains debated. Here, we adopted a many-analysts approach to assess the robustness of this relation based on a new cross-cultural dataset (N = 10, 535 participants from 24 countries). We recruited 120 analysis teams to investigate (1) whether religious people self-report higher well-being, and (2) whether the relation between religiosity and self-reported well-being depends on perceived cultural norms of religion (i.e., whether it is considered normal and desirable to be religious in a given country). In a two-stage procedure, the teams first created an analysis plan and then executed their planned analysis on the data. For the first research question, all but 3 teams reported positive effect sizes with credible/confidence intervals excluding zero (median reported beta = 0.120). For the second research question, this was the case for 65% of the teams (median reported beta = 0.039). While most teams applied (multilevel) linear regression models, there was considerable variability in the choice of items used to construct the independent variables, the dependent variable, and the included covariates.

Published
2022

20. Scale length does matter: Recommendations for measurement invariance testing with categorical factor analysis and item response theory approaches

Author

D'Urso, E. Damiano, Roover, Kim De, Vermunt, Jeroen K., Tijmstra, Jesper, D'Urso, E. Damiano, Roover, Kim De, Vermunt, Jeroen K., and Tijmstra, Jesper

Abstract

In social sciences, the study of group differences concerning latent constructs is ubiquitous. These constructs are generally measured by means of scales composed of ordinal items. In order to compare these constructs across groups, one crucial requirement is that they are measured equivalently or, in technical jargon, that measurement invariance (MI) holds across the groups. This study compared the performance of scale- and item-level approaches based on multiple group categorical confirmatory factor analysis (MG-CCFA) and multiple group item response theory (MG-IRT) in testing MI with ordinal data. In general, the results of the simulation studies showed that, MG-CCFA-based approaches outperformed MG-IRT-based approaches when testing MI at the scale level, whereas, at the item level, the best performing approach depends on the tested parameter (i.e., loadings or thresholds). That is, when testing loadings equivalence, the likelihood ratio test provided the best trade-off between true positive rate and false positve rate, whereas, when testing thresholds equivalence, the chi-square test outperformed the other testing strategies. In addition, the performance of MG-CCFA's fit measures, such as RMSEA and CFI, seemed to depend largely on the length of the scale, especially when MI was tested at the item level. General caution is recommended when using these measures, especially when MI is tested for each item individually.

Published
2022

21. Does acquiescence disagree with Measurement Invariance testing?

Author

D'Urso, E. Damiano, Tijmstra, Jesper, Vermunt, Jeroen, Roover, Kim De, D'Urso, E. Damiano, Tijmstra, Jesper, Vermunt, Jeroen, and Roover, Kim De

Abstract

Measurement invariance (MI) is required for validly comparing latent constructs measured by multiple ordinal self-report items. Non-invariances may occur when disregarding(group differences in) an acquiescence response style (ARS; an agreeing tendency regardless of item content). If non-invariance results solely from neglecting ARS, one should not worry about scale inequivalences but model the ARS instead. In a simulation study, we investigated the effect of ARS on MI testing, both when including ARS as a factor in the measurement model or not. For (semi-) balanced scales, disregarding a large ARS resulted in non-invariance already at the configural level. This was resolved by including an ARS factor for all groups. For unbalanced scales, disregarding ARS did not affect testing, and including an ARS factor often resulted in non-convergence. Implications and recommendations for applied research are discussed.

Published
2022

23. sj-docx-1-ebm-10.1177_00131644221089857 – Supplemental material for Awareness Is Bliss: How Acquiescence Affects Exploratory Factor Analysis

Author

D’Urso, E. Damiano, Tijmstra, Jesper, Vermunt, Jeroen K., and De Roover, Kim

Subjects
FOS: Psychology, 160807 Sociological Methodology and Research Methods, 170199 Psychology not elsewhere classified, FOS: Sociology, Education
Abstract

Supplemental material, sj-docx-1-ebm-10.1177_00131644221089857 for Awareness Is Bliss: How Acquiescence Affects Exploratory Factor Analysis by E. Damiano D’Urso, Jesper Tijmstra, Jeroen K. Vermunt and Kim De Roover in Educational and Psychological Measurement

Published
2022
Full Text
View/download PDF

26. Awareness is bliss: How acquiescence affects exploratory factor analysis

Author

D'Urso, E. Damiano, Tijmstra, Jesper, Vermunt, Jeroen K., Roover, Kim De, and Department of Methodology and Statistics

Subjects
Response styles, Psychometrics, Exploratory factor analysis (EFA), categorical data, response bias
Abstract

Assessing the measurement model (MM) of self-report scales is crucial to obtain valid measurement of individuals' latent psychological constructs. This entails evaluating the number of measured constructs and determining which construct is measured by which item. Exploratory factor analysis (EFA) is the most-used method to evaluate these psychometric properties, where the number of measured constructs (i.e., factors) is assessed, and, afterwards, rotational freedom is resolved to interpret these factors. This study assessed the effects of an acquiescence response style (ARS) on EFA for unidimensional and multidimensional (un)balanced scales. Specifically, we evaluated (i) whether ARS is captured as an additional factor, (ii) the effect of different rotation approaches on the recovery of the content and ARS factors, and (iii) the effect of extracting the additional ARS factor on the recovery of factor loadings. ARS was often captured as an additional factor in balanced scales when it was strong. For these scales, ignoring (i.e., not extracting) this additional ARS factor, or rotating to simple structure when extracting it, harmed the recovery of the original MM by introducing bias in loadings and cross-loadings. These issues were avoided by using informed rotation approaches (i.e., target rotation), where (part of) the MM is specified a priori. Not extracting the additional ARS factor did not affect the loading recovery in unbalanced scales. Researchers should consider the potential presence of an additional ARS factor when assessing the psychometric properties of balanced scales, and use informed rotation approaches when suspecting that an additional factor is an ARS factor.

Published
2021

27. Scale length does matter: Recommendations for measurement invariance testing with categorical factor analysis and item response theory approaches

Author

D'Urso, E. Damiano, Roover, Kim De, Vermunt, Jeroen K., Tijmstra, Jesper, and Department of Methodology and Statistics

Subjects
CONFIRMATORY FACTOR-ANALYSIS, MODEL, DIF (differential item functioning), OF-FIT INDEXES, IRT (item response theory), IDENTIFICATION, MANTEL-HAENSZEL, R PACKAGE, CFA (confirmatory factor analysis), Categorical data, LOGISTIC-REGRESSION, Measurement invariance
Abstract

In social sciences, the study of group differences concerning latent constructs is ubiquitous. These constructs are generally measured by means of scales composed of ordinal items. In order to compare these constructs across groups, one crucial requirement is that they are measured equivalently or, in technical jargon, that measurement invariance (MI) holds across the groups. This study compared the performance of scale- and item-level approaches based on multiple group categorical confirmatory factor analysis (MG-CCFA) and multiple group item response theory (MG-IRT) in testing MI with ordinal data. In general, the results of the simulation studies showed that, MG-CCFA-based approaches outperformed MG-IRT-based approaches when testing MI at the scale level, whereas, at the item level, the best performing approach depends on the tested parameter (i.e., loadings or thresholds). That is, when testing loadings equivalence, the likelihood ratio test provided the best trade-off between true positive rate and false positve rate, whereas, when testing thresholds equivalence, the chi-square test outperformed the other testing strategies. In addition, the performance of MG-CCFA's fit measures, such as RMSEA and CFI, seemed to depend largely on the length of the scale, especially when MI was tested at the item level. General caution is recommended when using these measures, especially when MI is tested for each item individually.

Published
2020

29. Scale length does matter: Recommendations for measurement invariance testing with categorical factor analysis and item response theory approaches.

Author

D'Urso ED, De Roover K, Vermunt JK, and Tijmstra J

Subjects
Humans, Psychometrics methods, Factor Analysis, Statistical
Abstract

In social sciences, the study of group differences concerning latent constructs is ubiquitous. These constructs are generally measured by means of scales composed of ordinal items. In order to compare these constructs across groups, one crucial requirement is that they are measured equivalently or, in technical jargon, that measurement invariance (MI) holds across the groups. This study compared the performance of scale- and item-level approaches based on multiple group categorical confirmatory factor analysis (MG-CCFA) and multiple group item response theory (MG-IRT) in testing MI with ordinal data. In general, the results of the simulation studies showed that MG-CCFA-based approaches outperformed MG-IRT-based approaches when testing MI at the scale level, whereas, at the item level, the best performing approach depends on the tested parameter (i.e., loadings or thresholds). That is, when testing loadings equivalence, the likelihood ratio test provided the best trade-off between true-positive rate and false-positive rate, whereas, when testing thresholds equivalence, the χ 2 test outperformed the other testing strategies. In addition, the performance of MG-CCFA's fit measures, such as RMSEA and CFI, seemed to depend largely on the length of the scale, especially when MI was tested at the item level. General caution is recommended when using these measures, especially when MI is tested for each item individually., (© 2021. The Author(s).)

Published
2022
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results