Back to Search
Start Over
Large-scale model selection in misspecified generalized linear models
- Source :
- Biometrika. 109:123-136
- Publication Year :
- 2021
- Publisher :
- Oxford University Press (OUP), 2021.
-
Abstract
- Summary Model selection is crucial both to high-dimensional learning and to inference for contemporary big data applications in pinpointing the best set of covariates among a sequence of candidate interpretable models. Most existing work implicitly assumes that the models are correctly specified or have fixed dimensionality, yet both model misspecification and high dimensionality are prevalent in practice. In this paper, we exploit the framework of model selection principles under the misspecified generalized linear models presented in Lv & Liu (2014), and investigate the asymptotic expansion of the posterior model probability in the setting of high-dimensional misspecified models. With a natural choice of prior probabilities that encourages interpretability and incorporates the Kullback–Leibler divergence, we suggest using the high-dimensional generalized Bayesian information criterion with prior probability for large-scale model selection with misspecification. Our new information criterion characterizes the impacts of both model misspecification and high dimensionality on model selection. We further establish the consistency of covariance contrast matrix estimation and the model selection consistency of the new information criterion in ultrahigh dimensions under some mild regularity conditions. Our numerical studies demonstrate that the proposed method enjoys improved model selection consistency over its main competitors.
- Subjects :
- Statistics and Probability
Generalized linear model
Applied Mathematics
General Mathematics
Statistics::Methodology
Applied mathematics
Statistics, Probability and Uncertainty
General Agricultural and Biological Sciences
Agricultural and Biological Sciences (miscellaneous)
Scale model
Selection (genetic algorithm)
Mathematics
Subjects
Details
- ISSN :
- 14643510 and 00063444
- Volume :
- 109
- Database :
- OpenAIRE
- Journal :
- Biometrika
- Accession number :
- edsair.doi...........513661a304e47ec2bb03e902d07c19c9