Search

This paper presents a multi-algorithm fusion model (StackingGroup) based on the Stacking ensemble learning framework to address the variable selection problem in high-dimensional group structure data. The proposed algorithm takes into account the differences in data observation and training principles of different algorithms. It leverages the strengths of each model and incorporates Stacking ensemble learning with multiple group structure regularization methods. The main approach involves dividing the data set into K parts on average, using more than 10 algorithms as basic learning models, and selecting the base learner based on low correlation, strong prediction ability, and small model error. Finally, we selected the grSubset + grLasso, grLasso, and grSCAD algorithms as the base learners for the Stacking algorithm. The Lasso algorithm was used as the meta-learner to create a comprehensive algorithm called StackingGroup. This algorithm is designed to handle high-dimensional group structure data. Simulation experiments showed that the proposed method outperformed other R2, RMSE, and MAE prediction methods. Lastly, we applied the proposed algorithm to investigate the risk factors of low birth weight in infants and young children. The final results demonstrate that the proposed method achieves a mean absolute error (MAE) of 0.508 and a root mean square error (RMSE) of 0.668. The obtained values are smaller compared to those obtained from a single model, indicating that the proposed method surpasses other algorithms in terms of prediction accuracy. [ABSTRACT FROM AUTHOR]

The ever-increasing demand for electricity has presented a grave threat to traditional energy sources, which are finite, rapidly depleting, and have a detrimental environmental impact. These shortcomings of conventional energy resources have caused the globe to switch from traditional to renewable energy sources. Wind power significantly contributes to carbon-free energy because it is widely accessible, inexpensive, and produces no harmful emissions. Better and more efficient renewable wind power production relies on accurate wind speed predictions. Accurate short-term wind speed forecasting is essential for effectively handling unsteady wind power generation and ensuring that wind turbines operate safely. The significant stochastic nature of the wind speed and its dynamic unpredictability makes it difficult to forecast. This paper develops a hybrid model, L-LG-S, for precise short-term wind speed forecasting to address problems in wind speed forecasting. In this research, state-of-the-art machine learning and deep learning algorithms employed in wind speed forecasting are compared with the proposed approach. The effectiveness of the proposed hybrid model is tested using real-world wind speed data from a wind turbine located in the city of Karachi, Pakistan. Moreover, the mean square error (MSE), root mean square error (RMSE), and mean absolute error (MAE) are used as accuracy evaluation indices. Experimental results show that the proposed model outperforms the state-of-the-art legacy models in terms of accuracy for short-term wind speed in training, validation and test predictions by 98% respectively. [ABSTRACT FROM AUTHOR]

Accurate, non-destructive and cost-effective estimation of crop canopy Soil Plant Analysis De-velopment(SPAD) is crucial for precision agriculture and cultivation management. Unmanned aerial vehicle (UAV) platforms have shown tremendous potential in predicting crop canopy SPAD. This was because they can rapidly and accurately acquire remote sensing spectral data of the crop canopy in real-time. In this study, a UAV equipped with a five-channel multispectral camera (Blue, Green, Red, Red_edge, Nir) was used to acquire multispectral images of sugar beets. These images were then combined with five machine learning models, namely K-Nearest Neighbor, Lasso, Random Forest, RidgeCV and Support Vector Machine (SVM), as well as ground measurement data to predict the canopy SPAD of sugar beets. The results showed that under both normal irrigation and drought stress conditions, the SPAD values in the normal ir-rigation treatment were higher than those in the water-limited treatment. Multiple vegetation indices showed a significant correlation with SPAD, with the highest correlation coefficient reaching 0.60. Among the SPAD prediction models, different models showed high estimation accuracy under both normal irrigation and water-limited conditions. The SVM model demon-strated a good performance with a correlation coefficient (R2) of 0.635, root mean square error (Rmse) of 2.13, and relative error (Re) of 0.80% for the prediction and testing values under normal irrigation. Similarly, for the prediction and testing values under drought stress, the SVM model exhibited a correlation coefficient (R2) of 0.609, root mean square error (Rmse) of 2.71, and rela-tive error (Re) of 0.10%. Overall, the SVM model showed good accuracy and stability in the pre-diction model, greatly facilitating high-throughput phenotyping research of sugar beet canopy SPAD. [ABSTRACT FROM AUTHOR]

Accurate inflow forecasting is an essential non-engineering strategy to guarantee flood management and boost the effectiveness of the water supply. As inflow is the primary reservoir input, precise inflow forecasting may also offer appropriate reservoir design and management assistance. This study aims to generalize the machine learning model using the support vector machine (SVM), which is support vector regression (SVR), to predict the discharges of the Euphrates River upstream of the Haditha Dam reservoir in Anbar province West of Iraq. Time series data were collected for the period (1986-2024) for the river's daily, monthly, and seasonal flow. Different kernel functions of SVR were applied in this study. The kernels are linear, Quadratic, and Gaussian (RBF). The results showed that the daily time scale is better than the monthly and seasonal performance. In contrast, the linear kernel outperformed the other SVR kernel with a time delay of one day based on the value of the coefficient of determination (R2 = 0.95) and the root mean square error (RMSE = 53.29) m3/sec for predicting daily river flow. The results showed that the proposed machine learning model performed well in predicting the daily flow of the Euphrates River upstream of the Haditha Dam reservoir; this indicates that the model might effectively forecast flows, which helps improve water resource management and dam operations. [ABSTRACT FROM AUTHOR]

Existing missing value imputation methods focused on imputing the data regarding actual values towards a completion of datasets as an input for machine learning tasks. This work proposes an imputation of missing values towards improvement of accuracy performance for classification. The proposed method was based on bee algorithm and the use of k-nearest neighborhood with linear regression to guide on finding the appropriate solution in prevention of randomness. Among the processes, GINI importance score was utilized in selecting values for imputation. The imputed values thus reflected on improving a discriminative power in classification tasks instead of replicating the actual values from the original dataset. In this study, we evaluated the proposed method against frequently used imputation methods such as k-nearest neighborhood, principal components analysis, nonlinear principal, and component analysis to compare root mean square error results and accuracy of using imputed datasets in a classification task. The experimental results indicated that our proposed method obtained the best accuracy results from all datasets comparing to other methods. In comparison to original dataset, the classification model from imputed datasets yielded 15-25% higher accuracy in class prediction. From analysis, the results showed that feature ranking used in a classification process was affected and lead to noticeably change in informativeness as the imputed data from the proposed method played the role to boost a discriminating power. [ABSTRACT FROM AUTHOR]

Urbanization and industrialization have led to a significant increase in air pollution, posing a severe environmental and public health threat. Accurate forecasting of air quality is crucial for policymakers to implement effective interventions. This study presents a novel AIoT platform specifically designed for PM2.5 monitoring in Southwestern Morocco. The platform utilizes low-cost sensors to collect air quality data, transmitted via WiFi/3G for analysis and prediction on a central server. We focused on identifying optimal features for PM2.5 prediction using Minimum Redundancy Maximum Relevance (mRMR) and LightGBM Recursive Feature Elimination (LightGBM-RFE) techniques. Furthermore, Bayesian optimization was employed to fine-tune hyperparameters of popular machine learning models for the most accurate PM2.5 concentration forecasts. Model performance was evaluated using Root Mean Square Error (RMSE), Mean Absolute Error (MAE), and the coefficient of determination (R2). Our results demonstrate that the LightGBM model achieved superior performance in PM2.5 prediction, with a significant reduction in RMSE compared to other evaluated models. This study highlights the potential of AIoT platforms coupled with advanced feature selection and hyperparameter optimization for effective air quality monitoring and forecasting. [ABSTRACT FROM AUTHOR]

Background: The purpose of this study was to develop a model that can predict the postoperative visual acuity in eyes that had undergone vitrectomy for an epiretinal membrane (ERM). The Light Gradient Boosting Machine (LightGBM) was used to evaluate the accuracy of the prediction and the contribution of the explanatory variables. Two models were designed to predict the postoperative visual acuity in 67 ERM patients. Model 1 used the age, sex, affected eye, axial length, preoperative visual acuity, Govetto's classification stage, and OCT-derived vector information as features to predict the visual acuity at 1, 3, and 6 months postoperatively. Model 2 incorporated the early postoperative visual acuity as an additional variable to predict the visual acuity at 3, and 6 months postoperatively. LightGBM with 100 iterations of 5-fold cross-validation was used to tune the hyperparameters and train the model. This involved addressing multicollinearity and selecting the explanatory variables. The generalized performance of these models was evaluated using the root mean squared error (RMSE) in a 5-fold cross-validation, and the contributions of the explanatory variables were visualized using the average Shapley Additive exPlanations (SHAP) values. Results: The RMSEs for the predicted visual acuity of Model 1 were 0.14 ± 0.02 logMAR units at 1 month, 0.12 ± 0.03 logMAR units at 3 months, and 0.13 ± 0.04 logMAR units at 6 months. High SHAP values were observed for the preoperative visual acuity and the ectopic inner foveal layer (EIFL) area with significant and positive correlations across all models. Model 2 that incorporated the postoperative visual acuity was used to predict the visual acuity at 3 and 6 months, and it had superior accuracy with RMSEs of 0.10 ± 0.02 logMAR units at 3 months and 0.10 ± 0.04 logMAR units at 6 months. High SHAP values were observed for the postoperative visual acuity in Model 2. Conclusion: Predicting the postoperative visual acuity in ERM patients is possible using the preoperative clinical data and OCT images with LightGBM. The contribution of the explanatory variables can be visualized using the SHAP values, and the accuracy of the prediction models improved when the postoperative visual acuity is included as an explanatory variable. Our data-driven machine learning models reveal that preoperative visual acuity and the size of the EIFL significantly influence postoperative visual acuity. Early intervention may be crucial for achieving favorable visual outcomes in eyes with an ERM. [ABSTRACT FROM AUTHOR]

Objective: To assess the effectiveness of different machine learning models in estimating the pharmaceutical and non-pharmaceutical expenditures associated with Diabetes Mellitus type II diagnosis, based on the clinical risk index determined by the analysis of comorbidities. Materials and methods: In this cross-sectional study, we have used data from 11,028 anonymized records of patients admitted to a high-complexity hospital in Bogota, Colombia between 2017–2019 with a primary diagnosis of Diabetes. These cases were classified according to Charlson's comorbidity index in several risk categories. The main variables analyzed in this study are hospitalization costs (which include pharmaceutical and non-pharmaceutical expenditures), age, gender, length of stay, medicines and services consumed, and comorbidities assessed by the Charlson's index. The model's dependent variable is expenditure (composed of pharmaceutical and non-pharmaceutical expenditures). Based on these variables, different machine learning models (Multivariate linear regression, Lasso model, and Neural Networks) were used to estimate the pharmaceutical and non-pharmaceutical expenditures associated with the clinical risk classification. To evaluate the performance of these models, different metrics were used: Mean Absolute Percentage Error (MAPE), Mean Squared Error (MSE), Root Mean Squared Error (RMSE), Mean Absolute Error (MAE), and Coefficient of Determination (R2). Results: The results indicate that the Neural Networks model performed better in terms of accuracy in predicting pharmaceutical and non-pharmaceutical expenditures considering the clinical risk based on Charlson's comorbidity index. A deeper understanding and experimentation with Neural Networks can improve these preliminary results, therefore we can also conclude that the main variables used and those that were proposed can be used as predictors for the medical expenditures of patients with diabetes type-II. Conclusions: With the increase of technology elements and tools, it is possible to build models that allow decision-makers in hospitals to improve the resource planning process given the accuracy obtained with the different models tested. [ABSTRACT FROM AUTHOR]

This study integrates advanced machine learning techniques, namely Artificial Neural Networks, Long Short-Term Memory, and Gated Recurrent Unit models, to forecast monkeypox outbreaks in Canada, Spain, the USA, and Portugal. The research focuses on the effectiveness of these models in predicting the spread and severity of cases using data from June 3 to December 31, 2022, and evaluates them against test data from January 1 to February 7, 2023. The study highlights the potential of neural networks in epidemiology, especially concerning recent monkeypox outbreaks. It provides a comparative analysis of the models, emphasizing their capabilities in public health strategies. The research identifies optimal model configurations and underscores the efficiency of the Levenberg-Marquardt algorithm in training. The findings suggest that ANN models, particularly those with optimized Root Mean Squared Error, Mean Absolute Percentage Error, and the Coefficient of Determination values, are effective in infectious disease forecasting and can significantly enhance public health responses. [ABSTRACT FROM AUTHOR]

There are global efforts to deploy Electric Vehicles (EVs) because of the role they promise to play in energy transition. These efforts underscore the e-mobility paradigm, representing an interplay between renewable energy resources, smart technologies, and networked transportation. However, there are concerns that these initiatives could burden the electricity grid due to increased demand. Hence, the need for accurate short-term load forecasting is pivotal for the efficient planning, operation, and control of the grid and associated power systems. This study presents robust models for forecasting half-hourly and hourly loads in the UK's power system. The work leverages machine learning techniques such as Support Vector Regression (SVR), Artificial Neural Networks (ANN), and Gaussian Process Regression (GPR) to develop robust prediction models using the net imports dataset from 2010 to 2020. The models were evaluated based on metrics like Root Mean Square Error (RMSE), Mean Absolute Prediction Error (MAPE), Mean Absolute Deviation (MAD), and the Correlation of Determination (R2). For half-hourly forecasts, SVR performed best with an R-value of 99.85%, followed closely by GPR and ANN. But, for hourly forecasts, ANN led with an R-value of 99.71%. The findings affirm the reliability and precision of machine learning methods in short-term load forecasting, particularly highlighting the superior accuracy of the SVR model for half-hourly forecasts and the ANN model for hourly forecasts. [ABSTRACT FROM AUTHOR]

Accurate prediction of blood glucose levels is essential for type 1 diabetes optimizing insulin therapy and minimizing complications in patients with type 1 diabetes. Using ensemble learning algorithms is a promising approach. In this regard, this study proposes an improved stacking ensemble learning algorithm for predicting blood glucose level, in which three improved long short-term memory network models are used as the base model, and an improved nearest neighbor propagation clustering algorithm is adaptively weighted to this ensemble model. The OhioT1DM dataset is used to train and evaluate the performance of the proposed model. This study evaluated the performance of the proposed model using the Root Mean Square Error (RMSE), Mean Absolute Error (MAE), and Matthews Correlation Coefficient (MCC) as the evaluation metrics. The experimental results demonstrate that the proposed model achieves an RMSE of 1.425 mg/dL, MAE of 0.721 mg/dL, and MCC of 0.982 mg/dL for a 30-minute prediction horizon(PH), RMSE of 3.212 mg/dL, MAE of 1.605 mg/dL, and MCC of 0.950 mg/dL for a 45-minute PH; and RMSE of 6.346 mg/dL, MAE of 3.232 mg/dL, and MCC of 0.930 mg/dL for a 60-minute PH. Compared with the best non-ensemble model StackLSTM, the RMSE and MAE were improved by up to 27.92% and 65.32%, respectively. Clarke Error Grid Analysis and critical difference diagram revealed that the model errors were within 10%. The model proposed in this study exhibits state-of-the-art predictive performance, making it suitable for clinical decision-making and of significant importance for the effective treatment of diabetes in patients. [ABSTRACT FROM AUTHOR]

This study investigates the quality of peak oxygen consumption (VO2peak) prediction based on cardiac and respiratory parameters calculated from warmup and submaximal stages of treadmill cardiopulmonary exercise test (CPET) using machine learning (ML) techniques and assesses the importance of respiratory parameters for the prediction outcome. The database consists of the following parameters: heart rate (HR), respiratory rate (RespRate), pulmonary ventilation (VE), oxygen consumption (VO2) and carbon dioxide production (VCO2) obtained from 369 treadmill CPETs. Combinations of features calculated based on the HR, VE and RespRate time-series from different stages of CPET were used to create 11 datasets for VO2peak prediction. Thirteen ML algorithms were employed, and model performances were evaluated using cross-validation with mean absolute percentage error (MAPE), R2 score, mean absolute error (MAE), and root mean squared error (RMSE) calculated after each iteration of the validation. The results demonstrated that incorporating respiratory-based features improves the prediction of VO2peak. The best results in terms of R2 score (0.47) and RMSE (5.78) were obtained for the dataset which included both cardiac- and respiratory-based features from CPET up to 85% of age-predicted HRmax, while the best results in terms of MAPE (10.5%) and MAE (4.63) were obtained for the dataset containing cardiorespiratory features from the last 30 seconds of warmup. The study showed the potential of using ML models based on cardiorespiratory features from submaximal tests for prediction of VO2peak and highlights the importance of the monitoring of respiratory signals, enabling to include respiratory parameters into the analysis. Presented approach offers a feasible alternative to direct VO2peak measurement, especially when specialized equipment is limited or unavailable. [ABSTRACT FROM AUTHOR]