1. Correcting the bias of the Root Mean Squared Error of Approximation under missing data
- Author
-
Von Oertzen, Timo, Brandmaier , Andreas, Martin, Daniel, Estabrook , Ryne, and Fitzgerald, Cailey
- Subjects
PsyArXiv|Social and Behavioral Sciences|School Psychology ,PsyArXiv|Social and Behavioral Sciences|School Psychology|Testing ,Kullback–Leibler divergence ,Mean squared error ,Computation ,PsyArXiv|Social and Behavioral Sciences|Quantitative Methods|Mathematical Psychology ,bepress|Social and Behavioral Sciences|Psychology|Quantitative Psychology ,Social and Behavioral Sciences ,Structural equation modeling ,PsyArXiv|Social and Behavioral Sciences|Quantitative Methods|Experimental Design and Sample Surveys ,Software ,PsyArXiv|Social and Behavioral Sciences|Quantitative Methods|Quantitative Psychology ,Statistics ,Psychology ,PsyArXiv|Social and Behavioral Sciences|Quantitative Methods|Statistical Methods ,PsyArXiv|Social and Behavioral Sciences|School Psychology|Consultation ,Fraction (mathematics) ,PsyArXiv|Social and Behavioral Sciences|School Psychology|Intervention ,General Psychology ,Mathematics ,bepress|Social and Behavioral Sciences|Psychology|School Psychology ,business.industry ,PsyArXiv|Social and Behavioral Sciences|Quantitative Methods|Computational Modeling ,General Social Sciences ,Quantitative Psychology ,Missing data ,PsyArXiv|Social and Behavioral Sciences|Quantitative Methods|Psychometrics ,FOS: Psychology ,PsyArXiv|Social and Behavioral Sciences ,School Psychology ,bepress|Social and Behavioral Sciences ,PsyArXiv|Social and Behavioral Sciences|Quantitative Methods ,business ,Coding (social sciences) - Abstract
Missing data are ubiquitous in psychological research. They may come about as an unwanted result of coding or computer error, participants' non-response or absence, or missing values may be intentional, as in planned missing designs. We discuss the effects of missing data on χ²-based goodness-of-fit indices in Structural Equation Modeling (SEM), specifically on the Root Mean Squared Error of Approximation (RMSEA). We use simulations to show that naive implementations of the RMSEA have a downward bias in the presence of missing data and, thus, overestimate model goodness-of-fit. Unfortunately, many state-of-the-art software packages report the biased form of RMSEA. As a consequence, the scientific community may have been accepting a much larger fraction of models with non-acceptable model fit. We propose a bias-correction for the RMSEA based on information-theoretic considerations that take into account the expected misfit of a person with fully observed data. The corrected RMSEA is asymptotically independent of the proportion of missing data for misspecified models. Importantly, results of the corrected RMSEA computation are identical to naive RMSEA if there are no missing data.
- Published
- 2021