Search

Imbalanced domain prediction analysis is currently one of the hot research topics. Many real‐world data mining analyses involve using imbalanced data to obtain predictive models. In the context of imbalance, research on classification problems has been extensive, but research on regression problems is negligible. Rare values rarely occur in imbalanced regression problems, but the focus is on accurately predicting the continuous target variables of rare instances. One of the challenges in imbalanced regression is finding a suitable strategy to rebalance the original dataset in order to improve the predictive performance of the model in rare instances. In this study, two algorithms are proposed: sigma nearest over‐sampling based on convex combination for regression (SNOCCR) and affine combination‐based over‐sampling (ACOS). ACOS rebalances the original dataset by generating new instances through the affine combinations of the original examples. The region where the new instances are generated can be adjusted based on the distribution of the data, ensuring that the generated cases better mimic the distribution of the original examples. The comparison among ACOS, SNOCCR, and other preprocessing methods was conducted on 15 datasets to validate the predictive performance of models trained on rebalanced datasets for rare instances. The experimental results indicate that ACOS outperforms other existing methods. In this study, two over‐sampling algorithms are proposed: sigma nearest over‐sampling based on convex combination for regression (SNOCCR) and affine combination‐based over‐sampling (ACOS) in order to improve the predictive performance of the model in imbalanced regression. The experimental results indicate that ACOS outperforms other existing methods. [ABSTRACT FROM AUTHOR]

Feature selection and rebalancing can be seen as two preprocessing ways in class‐imbalanced learning. Recently, there have been many research achievements and applications on LASSO‐type feature selection, whereas most of them are not directly designed for addressing class‐imbalanced data. In this study, we proposed a LASSO‐based stable feature selection algorithm for class‐imbalanced data analysis, and false‐positive selection (FPS) under balanced and imbalanced situations was calculated via selection frequency of each predictor in doing stable selection. The results on simulation studies and real data examples show that class imbalance contributes to avoid overselection caused by LASSO when the data are highly correlated and a lower FPS can be obtained with class‐imbalanced data than balanced one in most of cases in the same settings. A statistical explanation was given for this phenomenon. In addition, it does not need to rebalance the class‐imbalanced data for performing such LASSO‐based feature selection with a stable strategy, and to some degree, intentionally disequilibrating the balanced data could be an alternative strategy to weaken overselection and to perform biomarker identification for finding a few of most important biomarkers. A LASSO‐based stable feature selection algorithm was proposed for imbalanced data. It is not necessary to rebalance the imbalanced data with such stable feature selection strategy. Class imbalance even contributes to avoid overselection caused by LASSO when data are strongly correlated. [ABSTRACT FROM AUTHOR]