1. Extended differential geometric LARS for high-dimensional GLMs with general dispersion parameter
- Author
-
Ernst Wit, Hassan Pazira, Luigi Augugliaro, Stochastic Studies and Statistics, Pazira, H., Augugliaro, L., and Wit, E.
- Subjects
Statistics and Probability ,Generalized linear model ,Mathematical optimization ,Generalized linear models ,Predictor-corrector algorithm ,02 engineering and technology ,Poisson distribution ,DANTZIG SELECTOR ,01 natural sciences ,Cross-validation ,High-dimensional inference ,Theoretical Computer Science ,010104 statistics & probability ,symbols.namesake ,Exponential family ,LEAST ANGLE REGRESSION ,0202 electrical engineering, electronic engineering, information engineering ,Applied mathematics ,Statistics::Methodology ,0101 mathematics ,CROSS-VALIDATION ,Mathematics ,Least-angle regression ,Linear model ,020206 networking & telecommunications ,Probability and statistics ,VARIABLE SELECTION ,Efficient estimator ,Predictor-corrector algorithm ,Computational Theory and Mathematics ,Dispersion paremeter ,LINEAR-MODELS ,symbols ,SHRINKAGE ,Statistics, Probability and Uncertainty ,Settore SECS-S/01 - Statistica - Abstract
A large class of modeling and prediction problems involves outcomes that belong to an exponential family distribution. Generalized linear models (GLMs) are a standard way of dealing with such situations. Even in high-dimensional feature spaces GLMs can be extended to deal with such situations. Penalized inference approaches, such as the $$\ell _1$$ or SCAD, or extensions of least angle regression, such as dgLARS, have been proposed to deal with GLMs with high-dimensional feature spaces. Although the theory underlying these methods is in principle generic, the implementation has remained restricted to dispersion-free models, such as the Poisson and logistic regression models. The aim of this manuscript is to extend the differential geometric least angle regression method for high-dimensional GLMs to arbitrary exponential dispersion family distributions with arbitrary link functions. This entails, first, extending the predictor–corrector (PC) algorithm to arbitrary distributions and link functions, and second, proposing an efficient estimator of the dispersion parameter. Furthermore, improvements to the computational algorithm lead to an important speed-up of the PC algorithm. Simulations provide supportive evidence concerning the proposed efficient algorithms for estimating coefficients and dispersion parameter. The resulting method has been implemented in our R package (which will be merged with the original dglars package) and is shown to be an effective method for inference for arbitrary classes of GLMs.
- Published
- 2018