Search

We present an IRT goodness-of-fit framework based on approaches from logistic regression. We briefly elaborate the formal relation of IRT models and logistic regression modeling. Subsequently, we examine which model tests and goodness-of-fit indices from logistic regression can be meaningfully used for IRT. The performance of the casewise deviance, a collapsed deviance, and the Hosmer- Lemeshow test is studied by means of a simulation that compares their power to well known IRT model tests. Next, various R2 measures are discussed in terms of interpretability and appropriateness within an IRT context. By treating IRT models as classifiers, several additional indices such as hit rate, sensitivity, specificity, and area under the ROC curve are defined. Data stemming from a social discomfort scale are used to demonstrate the application of these statistics.

We present an IRT goodness-of-fit framework based on approaches from logistic regression. We briefly elaborate the formal relation of IRT models and logistic regression modeling. Subsequently, we examine which model tests and goodness-of-fit indices from logistic regression can be meaningfully used for IRT. The performance of the casewise deviance, a collapsed deviance, and the Hosmer- Lemeshow test is studied by means of a simulation that compares their power to well known IRT model tests. Next, various R2 measures are discussed in terms of interpretability and appropriateness within an IRT context. By treating IRT models as classifiers, several additional indices such as hit rate, sensitivity, specificity, and area under the ROC curve are defined. Data stemming from a social discomfort scale are used to demonstrate the application of these statistics.