Search

High-dimensional data often display heteroscedasticity. If the heteroscedasticity is neglected in the regression model, it will produce inefficient inference for the regression coefficients. Quantile regression is not only robust to outliers, but also accommodates heteroscedasticity. This paper aims to simultaneously carry out variable selection and heteroscedasticity identification for the linear location-scale model under a unified framework. We develop a regularized multiple quantile regression approach simultaneously identifying the heteroscedasticity, seeking common features of quantile coefficients and eliminating irrelevant variables. We also establish the theoretical properties of the proposed method under some regularity conditions. Simulation studies are conducted to evaluate the finite sample performance of the proposed method, showing that it is able to identify the covariates that affect the variability of the response. We further apply the proposed method to analyse the Wage data. [ABSTRACT FROM AUTHOR]

This article focuses on variable selection for varying coefficient models in the case of the number of covariates being larger than the sample size. Combining B-spline basis function approximations with the modified adaptive group lasso, we establish selection consistency, convergence rate and asymptotic normality. Our contribution is that the marginal nonparametric estimates are used as weights of the adaptive group lasso. Simulation studies and two real data applications show that our method performs better than the method of Wei, Huang, and Li (2011). [ABSTRACT FROM AUTHOR]

The modified Cholesky decomposition (MCD) is a powerful tool for estimating a covariance matrix. The regularization can be conveniently imposed on the linear regressions to encourage the sparsity in the estimated covariance matrix to accommodate the high-dimensional data. In this paper, we propose a Cholesky-based sparse ensemble estimate for covariance matrix by averaging a set of Cholesky factor estimates obtained from multiple variable orderings used in the MCD. The sparse estimation is enabled by encouraging the sparsity in the Cholesky factor. The theoretical consistent property is established under some regular conditions. The merits of the proposed method are illustrated through simulation and a maize genes data set. [ABSTRACT FROM AUTHOR]

This paper develops a new method to estimate a large-dimensional covariance matrix when the variables have no natural ordering among themselves. The modified Cholesky decomposition technique is used to provide a set of estimates of the covariance matrix under multiple orderings of variables. The proposed estimator is in the form of a linear combination of these available estimates and the identity matrix. It is positive definite and applicable in large dimensions. The merits of the proposed estimator are demonstrated through the numerical study and a real data example by comparison with several existing methods. [ABSTRACT FROM AUTHOR]

High-dimensional data arise frequently in modern applications such as biology, chemometrics, economics, neuroscience and other scientific fields. The common features of high-dimensional data are that many of predictors may not be significant, and there exists high correlation among predictors. Generalized linear models, as the generalization of linear models, also suffer from the collinearity problem. In this paper, combining the nonconvex penalty and ridge regression, we propose the weighted elastic-net to deal with the variable selection of generalized linear models on high dimension and give the theoretical properties of the proposed method with a diverging number of parameters. The finite sample behavior of the proposed method is illustrated with simulation studies and a real data example. [ABSTRACT FROM AUTHOR]

High-dimensional data with a group structure of variables arise always in many contemporary statistical modelling problems. Heavy-tailed errors or outliers in the response often exist in these data. We consider robust group selection for partially linear models when the number of covariates can be larger than the sample size. The non-convex penalty function is applied to achieve both goals of variable selection and estimation in the linear part simultaneously, and we use polynomial splines to estimate the nonparametric component. Under regular conditions, we show that the robust estimator enjoys the oracle property. Simulation studies demonstrate the performance of the proposed method with samples of moderate size. The analysis of a real example illustrates that our method works well. [ABSTRACT FROM AUTHOR]

The high-dimensional data arises in diverse fields of sciences, engineering and humanities. Variable selection plays an important role in dealing with high dimensional statistical modelling. In this article, we study the variable selection of quadratic approximation via thesmoothly clipped absolute deviation(SCAD) penalty with a diverging number of parameters. We provide a unified method to select variables and estimate parameters for various of high dimensional models. Under appropriate conditions and with a proper regularization parameter, we show that the estimator has consistency and sparsity, and the estimators of nonzero coefficients enjoy the asymptotic normality as they would have if the zero coefficients were known in advance. In addition, under some mild conditions, we can obtain the global solution of the penalized objective function with the SCAD penalty. Numerical studies and a real data analysis are carried out to confirm the performance of the proposed method. [ABSTRACT FROM PUBLISHER]

When outliers and/or heavy-tailed errors exist in linear models, theleast absolute deviation(LAD) regression is a robust alternative to the ordinary least squares regression. Existing variable-selection methods in linear models based on LAD regression either only consider the finite number of predictors or lack the oracle property associated with the estimator. In this article, we focus on the variable selection via LAD regression with a diverging number of parameters. The rate of convergence of the LAD estimator with thesmoothly clipped absolute deviation(SCAD) penalty function is established. Furthermore, we demonstrate that, under certain regularity conditions, the penalized estimator with a properly selected tuning parameter enjoys the oracle property. In addition, the rank correlation screening method originally proposed by Liet al.(2011) is applied to deal with ultrahigh dimensional data. Simulation studies are conducted for revealing the finite sample performance of the estimator. We further illustrate the proposed methodology by a real example. [ABSTRACT FROM PUBLISHER]

In the economics and biological gene expression study area where a large number of variables will be involved, even when the predictors are independent, as long as the dimension is high, the maximum sample correlation can be large. Variable selection is a fundamental method to deal with such models. The ridge regression performs well when the predictors are highly correlated and some nonconcave penalized thresholding estimators enjoy the nice oracle property. In order to provide a satisfactory solution to the collinearity problem, in this paper we report the combined-penalization (CP) mixed by the nonconcave penalty and ridge, with a diverging number of parameters. It is observed that the CP estimator with a diverging number of parameters can correctly select covariates with nonzero coefficients and can estimate parameters simultaneously in the presence of multicollinearity. Simulation studies and a real data example demonstrate the well performance of the proposed method. [ABSTRACT FROM AUTHOR]

In survival studies, current status data are frequently encountered when some individuals in a study are not successively observed. This paper considers the problem of simultaneous variable selection and parameter estimation in the high-dimensional continuous generalized linear model with current status data. We apply the penalized likelihood procedure with the smoothly clipped absolute deviation penalty to select significant variables and estimate the corresponding regression coefficients. With a proper choice of tuning parameters, the resulting estimator is shown to be a rootn/pn-consistent estimator under some mild conditions. In addition, we show that the resulting estimator has the same asymptotic distribution as the estimator obtained when the true model is known. The finite sample behavior of the proposed estimator is evaluated through simulation studies and a real example. [ABSTRACT FROM PUBLISHER]

This article studies variable selection and parameter estimation in the partially linear model when the number of covariates in the linear part increases to infinity. Using the bridge penalty method, we succeed in selecting the important covariates of the linear part. Under regularity conditions, we have shown that the bridge penalized estimator of the parametric part enjoys the oracle property. We also obtain the convergence rate of the estimator of the nonparametric part. Simulation studies show that the bridge estimator performs as well as the oracle estimator for the partially linear model. An application is analyzed to illustrate the bridge procedure. [ABSTRACT FROM AUTHOR]