Search

Air Traffic Flow Management (ATFM) delay can quantitatively reflect the congestion caused by the imbalance between capacity and demand in an airspace network. Furthermore, it is an important parameter for the ex-post analysis of airspace congestion and the effectiveness of ATFM strategy implementation. If ATFM delays can be predicted in advance, the predictability and effectiveness of ATFM strategies can be improved. In this paper, a short-term ATFM delay regression prediction method is proposed for the characteristics of the multiple sources, high dimension, and complexity of ATFM delay prediction data. The method firstly constructs an ATFM delay prediction network model, specifies the prediction object, and proposes an ATFM delay prediction index system by integrating common flow control information. Secondly, an ATFM delay prediction method based on feature extraction modules (including CNN, TCN, and attention modules), a heuristic optimization algorithm (sparrow search algorithm (SSA)), and a prediction model (LSTM) are proposed. The method constructs a CNN-LSTM-ATT model based on SSA optimization and a TCN-LSTM-ATT model based on SSA optimization. Finally, four busy airports and their major waypoints in East China are selected as the ATFM delay prediction network nodes for example validation. The experimental results show that the MAEs of the two models proposed in this paper for ATFM delay regression prediction are 4.25 min and 4.38 min, respectively. Compared with the CNN-LSTM model, the errors are reduced by 2.71 min and 2.59 min, respectively. Compared with the TCN-LSTM model, the times are 3.68 min and 3.55 min, respectively. In this paper, two improved LSTM models are constructed to improve the prediction accuracy of ATFM delay duration so as to provide support for the establishment of an ATFM delay early warning mechanism, further improve ATFM delay management, and enhance resource allocation efficiency. [ABSTRACT FROM AUTHOR]

Estimation of vivo muscle forces during human motion is important for understanding human motion control mechanisms and joint mechanics. This paper combined the advantages of the convolutional neural network (CNN) and long-short-term memory (LSTM) and proposed a novel muscle force estimation method based on CNN–LSTM. A wearable sensor system was also developed to collect the angles and angular velocities of the hip, knee, and ankle joints in the sagittal plane during walking, and the collected kinematic data were used as the input for the neural network model. In this paper, the muscle forces calculated using OpenSim based on the Static Optimization (SO) method were used as the standard value to train the neural network model. Four lower limb muscles of the left leg, including gluteus maximus (GM), rectus femoris (RF), gastrocnemius (GAST), and soleus (SOL), were selected as the studying objects in this paper. The experiment results showed that compared to the standard CNN and the standard LSTM, the CNN–LSTM performed better in muscle forces estimation under slow (1.2 m/s), medium (1.5 m/s), and fast walking speeds (1.8 m/s). The average correlation coefficients between true and estimated values of four muscle forces under slow, medium, and fast walking speeds were 0.9801, 0.9829, and 0.9809, respectively. The average correlation coefficients had smaller fluctuations under different walking speeds, which indicated that the model had good robustness. The external testing experiment showed that the CNN–LSTM also had good generalization. The model performed well when the estimated object was not included in the training sample. This article proposed a convenient method for estimating muscle forces, which could provide theoretical assistance for the quantitative analysis of human motion and muscle injury. The method has established the relationship between joint kinematic signals and muscle forces during walking based on a neural network model; compared to the SO method to calculate muscle forces in OpenSim, it is more convenient and efficient in clinical analysis or engineering applications. [ABSTRACT FROM AUTHOR]

The bowhead whale is a vital component of the maritime environment. Using deep learning techniques to recognize bowhead whales accurately and efficiently is crucial for their protection. Marine acoustic remote sensing technology is currently an important method to recognize bowhead whales. Adaptive SWT is used to extract the acoustic features of bowhead whales. The CNN-LSTM deep learning model was constructed to recognize bowhead whale voices. Compared to STFT, the adaptive SWT used in this study raises the SCR for the stationary and nonstationary bowhead whale whistles by 88.20% and 92.05%, respectively. Ten-fold cross-validation yields an average recognition accuracy of 92.85%. The method efficiency of this work was further confirmed by the consistency found in the Beaufort Sea recognition results and the fisheries ecological study. The research results in this paper help promote the application of marine acoustic remote sensing technology and the conservation of bowhead whales. [ABSTRACT FROM AUTHOR]

Financial time series data are characterized by non-linearity, non-stationarity, and stochastic complexity, so predicting such data presents a significant challenge. This paper proposes a novel hybrid model for financial forecasting based on CEEMDAN-SE and ARIMA- CNN-LSTM. With the help of the CEEMDAN-SE method, the original data are decomposed into several IMFs and reconstructed via sample entropy into a lower-complexity stationary high-frequency component and a low-frequency component. The high-frequency component is predicted by the ARIMA statistical forecasting model, while the low-frequency component is predicted by a neural network model combining CNN and LSTM. Compared to some classical prediction models, our algorithm exhibits superior performance in terms of three evaluation indexes, namely, RMSE, MAE, and MAPE, effectively enhancing model accuracy while reducing computational overhead. [ABSTRACT FROM AUTHOR]

In order to solve the problem of the slow transmission rate of high-frequency information in smart grid and improve the efficiency of information transmission, a research method of high-frequency information transmission in smart grids based on the CNN-LSTM model is proposed. It effectively combines the superiority of the CNN algorithm for high-frequency information feature extraction and the learning ability of the LSTM algorithm for global features of high-frequency information. Meanwhile, the client buffer is divided by the VLAN area division method, which avoids the buffer being too large due to line congestion. The intelligent control module is adopted to change the traditional control concept. In addition, the neural network optimization control module is used for intelligent control, which ensures the feedback speed of the control terminal and avoids the problem of increasing the buffer area caused by the feedback time difference. The experimental results show that via the method in this paper, the total efficiency of single-channel transmission reaches 96% and the transmission rate reaches 46 bit/s; the total efficiency of multiplex transmission is 89% and the transmission rate reaches 75 bit/s. It is verified that the method proposed in this paper has a fast transmission rate and high efficiency. [ABSTRACT FROM AUTHOR]

Irrigation is crucial for crop cultivation and productivity. However, traditional methods often waste water and energy due to neglecting soil and crop variations, leading to inefficient water distribution and potential crop water stress. The crop water stress index (CWSI) has become a widely accepted index for assessing plant water status. However, it is necessary to forecast the plant water stress to estimate the quantity of water to irrigate. Deep learning (DL) models for water stress forecasting have gained prominence in irrigation management to address these needs. In this paper, we present a comparative study between two deep learning models, ConvLSTM and CNN-LSTM, for water stress forecasting using remote sensing data. While these DL architectures have been previously proposed and studied in various applications, our novelty lies in studying their effectiveness in the field of water stress forecasting using time series of remote sensing images. The proposed methodology involves meticulous preparation of time series data, where we calculate the crop water stress index (CWSI) using Landsat 8 satellite imagery through Google Earth Engine. Subsequently, we implemented and fine-tuned the hyperparameters of the ConvLSTM and CNN-LSTM models. The same processes of model compilation, optimization of hyperparameters, and model training were applied for the two architectures. A citrus farm in Morocco was chosen as a case study. The analysis of the results reveals that the CNN-LSTM model excels over the ConvLSTM model for long sequences (nine images) with an RMSE of 0.119 and 0.123, respectively, while ConvLSTM provides better results for short sequences (three images) than CNN-LSTM with an RMSE of 0.153 and 0.187, respectively. [ABSTRACT FROM AUTHOR]

Day-ahead electricity price forecasting (DAEPF) holds critical significance for stakeholders in energy markets, particularly in areas with large amounts of renewable energy sources (RES) integration. In Japan, the proliferation of RES has led to instances wherein day-ahead electricity prices drop to nearly zero JPY/kWh during peak RES production periods, substantially affecting transactions between electricity retailers and consumers. This paper introduces an innovative DAEPF framework employing a Convolutional Neural Network–Long Short-Term Memory (CNN–LSTM) model designed to predict day-ahead electricity prices in the Kyushu area of Japan. To mitigate the inherent uncertainties associated with neural networks, a novel ensemble learning approach is implemented to bolster the DAEPF model's robustness and prediction accuracy. The CNN–LSTM model is verified to outperform a standalone LSTM model in both prediction accuracy and computation time. Additionally, applying a natural logarithm transformation to the target day-ahead electricity price as a pre-processing technique has proven necessary for higher prediction accuracy. A novel "policy-versus-policy" strategy is proposed to address the prediction problem of the zero prices, halving the computation time of the traditional two-stage method. The efficacy of incorporating a suite of multimodal features: areal day-ahead electricity price, day-ahead system electricity price, areal actual power generation, areal meteorological forecasts, calendar forecasts, alongside the rolling features of areal day-ahead electricity price, as explanatory variables to significantly enhance DAEPF accuracy has been validated. With the full integration of the proposed features, the CNN–LSTM ensemble model achieves its highest accuracy, reaching performance metrics of R 2 , MAE, and RMSE of 0.787, 1.936 JPY/kWh, and 2.630 JPY/kWh, respectively, during the test range from 1 March 2023 to 31 March 2023, underscoring the advantages of a comprehensive, multi-dimensional approach to DAEPF. [ABSTRACT FROM AUTHOR]

As the core component of the automobile braking system, brake pads have a complex structure and high failure rate. Their accurate and effective state monitoring can help to evaluate the safety performance of brake pads and avoid accidents caused by brake failure. The wear process of automobile brake pads is a gradual, nonlinear, and non-stationary time-varying system, and it is difficult to extract its features. Therefore, this paper proposes a CNN-LSTM brake pad wear state monitoring method. This method uses a Convolutional Neural Network (CNN) to complete the deep mining of brake pad wear characteristics and realize data dimensionality reduction, and a Long Short-Term Memory (LSTM) network to capture the time dependence of the brake pad wear sequence, so as to construct the nonlinear mapping relationship between brake pad wear characteristics and brake pad wear values. At the same time, the artificial Gorilla Troops Optimization (GTO) algorithm is used to perform multi-objective optimization of the network structure parameters in the CNN-LSTM model, and its powerful global search ability improves the monitoring effect of the brake pad wear status. The results show that the CNN-LSTM model based on GTO multi-objective optimization can effectively monitor the wear state of brake pads, and its coefficient of determination R2 value is 0.9944, the root mean square error RMSE value is 0.0023, and the mean absolute error MAE value is 0.0017. Compared with the BP model, CNN model, LSTM model, and CNN-LSTM model, the value of the coefficient of determination R2 is the closest to 1, which is increased by 8.29%, 5.52%, 4.47%, 3.30%, respectively, which can more effectively realize the monitoring and intelligent early warning of the brake pad wear state. [ABSTRACT FROM AUTHOR]

River water-level prediction is crucial for mitigating flood damage caused by torrential rainfall. In this paper, we attempt to predict river water levels using a deep learning model based on radar rainfall data instead of data from upstream hydrological stations. A prediction model incorporating a two-dimensional convolutional neural network (2D-CNN) and long short-term memory (LSTM) is constructed to exploit geographical and temporal features of radar rainfall data, and a transfer learning method using a newly defined flow–distance matrix is presented. The results of our evaluation of the Oyodo River basin in Japan show that the presented transfer learning model using radar rainfall instead of upstream measurements has a good prediction accuracy in the case of torrential rain, with a Nash–Sutcliffe efficiency (NSE) value of 0.86 and a Kling–Gupta efficiency (KGE) of 0.83 for 6-h-ahead forecast for the top-four peak water-level height cases, which is comparable to the conventional model using upstream measurements (NSE = 0.84 and KGE = 0.83). It is also confirmed that the transfer learning model maintains its performance even when the amount of training data for the prediction site is reduced; values of NSE = 0.82 and KGE = 0.82 were achieved when reducing the training torrential-rain-period data from 12 to 3 periods (with 105 periods of data from other rivers for transfer learning). The results demonstrate that radar rainfall data and a few torrential rain measurements at the prediction location potentially enable us to predict river water levels even if hydrological stations have not been installed at the prediction location. [ABSTRACT FROM AUTHOR]

For a lithium-ion (Li-ion) battery to operate safely and reliably, an accurate state of health (SOH) estimation is crucial. Data-driven models with manual feature extraction are commonly used for battery SOH estimation, requiring extensive expert knowledge to extract features. In this regard, a novel data pre-processing model is proposed in this paper to extract health-related features automatically from battery-discharging data for SOH estimation. In the proposed method, one-dimensional (1D) voltage data are converted to two-dimensional (2D) data, and a new data set is created using a 2D sliding window. Then, features are automatically extracted in the machine learning (ML) training process. Finally, the estimation of the SOH is achieved by forecasting the battery voltage in the subsequent cycle. The performance of the proposed technique is evaluated on the NASA public data set for a Li-ion battery degradation analysis in four different scenarios. The simulation results show a considerable reduction in the RMSE of battery SOH estimation. The proposed method eliminates the need for the manual extraction and evaluation of features, which is an important step toward automating the SOH estimation process and developing battery digital twins. [ABSTRACT FROM AUTHOR]

Sea surface temperature (SST) is crucial in ocean research and marine activities. It makes predicting SST of paramount importance. While SST is highly affected by different oceanic, atmospheric, and climatic parameters, few papers have investigated time-series SST prediction based on multiple features. This paper utilized multi features of air pressure, water temperature, wind direction, and wind speed for time-series hourly SST prediction using deep neural networks of convolutional neural network (CNN), long short-term memory (LSTM), and CNN–LSTM. Models were trained and validated by different epochs, and feature importance was evaluated by the leave-one-feature-out method. Air pressure and water temperature were significantly more important than wind direction and wind speed. Accordingly, feature selection is an essential step for time-series SST prediction. Findings also revealed that all models performed well with low prediction errors, and increasing the epochs did not necessarily improve the modeling. While all models were similarly practical, CNN was considered the most suitable as its training speed was several times faster than the other two models. With all this, the low variance of time-series data helped models make accurate predictions, and the proposed method may have higher errors while working with more variant features. [ABSTRACT FROM AUTHOR]

With an increase in the use of software, the incidence of bugs and resulting maintenance costs also increase. In open source projects, developer reassignment accounts for approximately 50%. Software maintenance costs can be reduced if appropriate developers are recommended to resolve bugs. In this study, features are extracted by applying feature selection for each developer. These features are entered into CNN-LSTM algorithm to learn the model and recommend appropriate developers. To compare the performance of the proposed model, open source projects (Google Chrome, Mozilla Core, and Mozilla Firefox) were used to compare the performance of the proposed method with a baseline for developer recommendation. In this paper, the performance showed 54% for F-measure and 52% for accuracy in open source projects. The proposed model has improved and showed about a 13% more effective performance improvement than with DeepTriage. It was discovered that the performance of the proposed model was better. [ABSTRACT FROM AUTHOR]

The proposed study aims to estimate and conduct an investigation of the performance of a hybrid thermal/photovoltaic system cooled by nanofluid (Al2O3) utilizing time-series deep learning networks. The use of nanofluids greatly improves the proposed system's performance deficiencies due to the rise in cell temperature, and time-series algorithms assist in investigating its potential in various regions more accurately. In this paper, energy balance methods were used to generate the hybrid thermal/photovoltaic system's performance located in Tabuk, Saudi Arabia. Moreover, the generated dataset for the hybrid thermal/photovoltaic system was utilized to develop deep learning algorithms, such as the hybrid convolutional neural network (CNN) and long short-term memory (LSTM), in order to estimate and investigate the thermal/photovoltaic performance. The models were evaluated based on several performance metrics such as mean absolute percentage error (MAPE), root mean square error (RMSE), mean absolute error (MAE), and the coefficient of determination (R2). The results of the evaluated algorithms were compared and provided high accuracy ranges of 98.3–99.3%. It was observed that the best model among the others was CNN-LSTM, with an MAE of 0.375. The model was utilized to investigate the electrical and thermal performance of the hybrid thermal/photovoltaic application cooled by Al2O3 in addition to the hybrid thermal/photovoltaic cell temperature. The results show hybrid thermal/photovoltaic cell temperatures could be decreased to 43 °C, while the average daily thermal and electrical efficiencies were raised by 15% and 9%, respectively. [ABSTRACT FROM AUTHOR]

In recent years, the number of people with disabilities has increased hugely, especially in low- and middle-income countries. At the same time, robotics has made significant advances in the medical field, and many research groups have begun to develop low-cost wearable solutions. The Mechatronics and Dynamic Modelling Lab of the Department of Industrial Engineering at the University of Florence has recently developed a new version of a wearable hand exoskeleton for assistive purposes. In this paper, we will present a new regression method to predict the finger angle position of the first joint from the value of the sEMG of the forearm and the previous position of the finger itself. To acquire the dataset necessary to train the regressor a specific graphical user interface was developed which was able to acquire sEMG data from a Myo armband and the finger position from a Leap Motion Controller. Two long short-term memory (LSTM) models were compared, one in its standard configuration and the other with a convolutional layer, yielding significantly better performance for the second one, with an increase in R 2 coefficient from an average value of 0.746 to 0.825 , leading to the conclusion that a convolutional layer could increase performance when few sensors are available. [ABSTRACT FROM AUTHOR]

In recent times, the power sector has become a focal point of extensive scientific interest, driven by a convergence of factors, such as mounting global concerns surrounding climate change, the persistent increase in electricity prices within the wholesale energy market, and the surge in investments catalyzed by technological advancements across diverse sectors. These evolving challenges have necessitated the emergence of new imperatives aimed at effectively managing energy resources, ensuring grid stability, bolstering reliability, and making informed decisions. One area that has garnered particular attention is the accurate prediction of end-user electricity load, which has emerged as a critical facet in the pursuit of efficient energy management. To tackle this challenge, machine and deep learning models have emerged as popular and promising approaches, owing to their having remarkable effectiveness in handling complex time series data. In this paper, the development of an algorithmic model that leverages an automated process to provide highly accurate predictions of electricity load, specifically tailored for the island of Thira in Greece, is introduced. Through the implementation of an automated application, an array of deep learning forecasting models were meticulously crafted, encompassing the Multilayer Perceptron, Long Short-Term Memory (LSTM), One Dimensional Convolutional Neural Network (CNN-1D), hybrid CNN–LSTM, Temporal Convolutional Network (TCN), and an innovative hybrid model called the Convolutional LSTM Encoder–Decoder. Through evaluation of prediction accuracy, satisfactory performance across all the models considered was observed, with the proposed hybrid model showcasing the highest level of accuracy. These findings underscore the profound significance of employing deep learning techniques for precise forecasting of electricity demand, thereby offering valuable insights with which to tackle the multifaceted challenges encountered within the power sector. By adopting advanced forecasting methodologies, the electricity sector moves towards greater efficiency, resilience and sustainability. [ABSTRACT FROM AUTHOR]

The occurrence of catastrophic floods will increase the uncertainty of hydrological forecasting at downstream hydrological stations. In order to solve the problems of the unclear propagation law of catastrophic floods in the middle and lower reaches of the Yangtze River and the inadaptability of traditional forecasting methods, this paper uses the M-K trend test method to analyze the annual average flow and annual average water level of the Yichang and Hankou stations. For conventional floods and catastrophic floods, Random Forest (RF), Convolutional Neural Network (CNN), Long Short-Term Memory Network (LSTM), and CNN-LSTM neural networks are used to simulate the water level/flow of Hankou station. The simulation results are analyzed by Nash–Sutcliffe Efficiency Coefficient (NSE), Kling–Gupta efficiency coefficient (KGE), Root Mean Square Error (RMSE), and Symmetric Mean Absolute Percentage Error (SMAPE). The results show that the annual average flow and annual average water level of Yichang station show a downward trend and the annual average water level of Hankou station shows an upward trend. By comparing the four indicators of NSE, KGE, RMSE, and SMAPE, the CNN-LSTM coupling model was determined to be the best fitting model, with NSE and KGE greater than 0.995 and RMSE and SMAPE less than 0.200. The proposed coupling model can provide technical support for flood control optimization, scheduling, emergency rescue, and scheduling impact analysis of the Three Gorges Power Station. [ABSTRACT FROM AUTHOR]

Gas is the transaction-fee metering system of the Ethereum network. Users of the network are required to select a gas price for submission with their transaction, creating a risk of overpaying or delayed/unprocessed transactions involved in this selection. In this work, we investigate data in the aftermath of the London Hard Fork and shed insight into the transaction dynamics of the network after this major fork. As such, this paper provides an update on work previous to 2019 on the link between EthUSD/BitUSD and gas price. For forecasting, we compare a novel combination of machine learning methods such as Direct-Recursive Hybrid LSTM, CNN-LSTM, and Attention-LSTM. These are combined with wavelet threshold denoising and matrix profile data processing toward the forecasting of block minimum gas price, on a 5-min timescale, over multiple lookaheads. As the first application of the matrix profile being applied to gas price data and forecasting that we are aware of, this study demonstrates that matrix profile data can enhance attention-based models; however, given the hardware constraints, hybrid models outperformed attention and CNN-LSTM models. The wavelet coherence of inputs demonstrates correlation in multiple variables on a 1-day timescale, which is a deviation of base free from gas price. A Direct-Recursive Hybrid LSTM strategy is found to outperform other models, with an average RMSE of 26.08 and R2 of 0.54 over a 50-min lookahead window compared to an RMSE of 26.78 and R2 of 0.452 in the best-performing attention model. Hybrid models are shown to have favorable performance up to a 20-min lookahead with performance being comparable to attention models when forecasting 25–50-min ahead. Forecasts over a range of lookaheads allow users to make an informed decision on gas price selection and the optimal window to submit their transaction in without fear of their transaction being rejected. This, in turn, gives more detailed insight into gas price dynamics than existing recommenders, oracles and forecasting approaches, which provide simple heuristics or limited lookahead horizons. [ABSTRACT FROM AUTHOR]

Timely and accurate crop yield information can ensure regional food security. In the field of predicting crop yields, deep learning techniques such as long short-term memory (LSTM) and convolutional neural networks (CNN) are frequently employed. Many studies have shown that the predictions of models combining the two are better than those of single models. Crop growth can be reflected by the vegetation index calculated using data from remote sensing. However, the use of pure remote sensing data alone ignores the spatial heterogeneity of different regions. In this paper, we tested a total of three models, CNN-LSTM, CNN and convolutional LSTM (ConvLSTM), for predicting the annual rice yield at the county level in Hubei Province, China. The model was trained by ERA5 temperature (AT) data, MODIS remote sensing data including the Enhanced Vegetation Index (EVI), Gross Primary Productivity (GPP) and Soil-Adapted Vegetation Index (SAVI), and a dummy variable representing spatial heterogeneity; rice yield data from 2000–2019 were employed as labels. Data download and processing were based on Google Earth Engine (GEE). The downloaded remote sensing images were processed into normalized histograms for the training and prediction of deep learning models. According to the experimental findings, the model that included a dummy variable to represent spatial heterogeneity had a stronger predictive ability than the model trained using just remote sensing data. The prediction performance of the CNN-LSTM model outperformed the CNN or ConvLSTM model. [ABSTRACT FROM AUTHOR]

The field of signal processing using machine and deep learning algorithms has undergone significant growth in the last few years, with a wide scope of practical applications for electroencephalography (EEG). Transcutaneous electroacupuncture stimulation (TEAS) is a well-established variant of the traditional method of acupuncture that is also receiving increasing research attention. This paper presents the results of using deep learning algorithms on EEG data to investigate the effects on the brain of different frequencies of TEAS when applied to the hands in 66 participants, before, during and immediately after 20 min of stimulation. Wavelet packet decomposition (WPD) and a hybrid Convolutional Neural Network Long Short-Term Memory (CNN-LSTM) model were used to examine the central effects of this peripheral stimulation. The classification results were analysed using confusion matrices, with kappa as a metric. Contrary to expectation, the greatest differences in EEG from baseline occurred during TEAS at 80 pulses per second (pps) or in the 'sham' (160 pps, zero amplitude), while the smallest differences occurred during 2.5 or 10 pps stimulation (mean kappa 0.414). The mean and CV for kappa were considerably higher for the CNN-LSTM than for the Multilayer Perceptron Neural Network (MLP-NN) model. As far as we are aware, from the published literature, no prior artificial intelligence (AI) research appears to have been conducted into the effects on EEG of different frequencies of electroacupuncture-type stimulation (whether EA or TEAS). This ground-breaking study thus offers a significant contribution to the literature. However, as with all (unsupervised) DL methods, a particular challenge is that the results are not easy to interpret, due to the complexity of the algorithms and the lack of a clear understanding of the underlying mechanisms. There is therefore scope for further research that explores the effects of the frequency of TEAS on EEG using AI methods, with the most obvious place to start being a hybrid CNN-LSTM model. This would allow for better extraction of information to understand the central effects of peripheral stimulation. [ABSTRACT FROM AUTHOR]

Dissolved oxygen (DO) concentration is a pivotal determinant of water quality in freshwater lake ecosystems. However, rapid population growth and discharge of polluted wastewater, urban stormwater runoff, and agricultural non-point source pollution runoff have triggered a significant decline in DO levels in Lake Erie and other freshwater lakes located in populated temperate regions of the globe. Over eleven million people rely on Lake Erie, which has been adversely impacted by anthropogenic stressors resulting in deficient DO concentrations near the bottom of Lake Erie's Central Basin for extended periods. In the past, hybrid long short-term memory (LSTM) models have been successfully used for the time-series forecasting of water quality in rivers and ponds. However, the prediction errors tend to grow significantly with the forecasting period. Therefore, this research aimed to improve the accuracy of DO forecasting models by taking advantage of Lake Erie's real-time water quality (water temperature and DO concentration) monitoring network to establish temporal and spatial links between adjacent monitoring stations. We developed hybrid LSTM models that combine LSTM, convolutional neuron network LSTM (CNN-LSTM), hybrid CNN with gated recurrent unit (CNN-GRU) models, and convolutional LSTM (ConvLSTM) to forecast near-bottom DO concentrations in Lake Erie's Central Basin. These hybrid LSTM models improve their capacity to handle complicated datasets with spatial and temporal variability. These models can serve as accurate and reliable tools for forecasting DO concentrations in freshwater lakes to help environmental protection agencies better access and manage the health of these vital ecosystems. Following analysis of a 21-site Lake Erie dataset for 2020 and 2021, the ConvLSTM model emerged as the most accurate and reliable, boasting an MSE of 0.51 mg/L, MAE of 0.42 mg/L, and an R-squared of 0.95 over the 12 h prediction range. The model foresees future hypoxia in Lake Erie. Notably, the temperature near site 713 holds significance for Central Basin DO forecasting in Lake Erie, as indicated by outcomes derived from the Shapley additive explanations (SHAP). [ABSTRACT FROM AUTHOR]

With the increase in the penetration rate of renewable energy sources, a machine-learning-based forecasting system has been introduced to the grid sector to improve the participation rate in the electricity market and reduce energy losses. In these studies, correlation analysis of mechanical and environmental variables, including geographical figures, is considered a crucial point to increase the prediction's accuracy. Various models have been applied in terms of accuracy, speed calculation, and amount of data based on a mathematical model that can calculate the wake; however, it can be difficult to derive variables such as air density, roughness length, and the effect of turbulence on the structural characteristics of wind turbines. Furthermore, wake accuracy could decrease due to the excessive variables that come from the wake effect parameters. In this paper, we intend to conduct research to improve prediction accuracy by considering the wake effect of wind turbines using supervisory control and data acquisition (SCADA) data from the Dongbok wind farm. The wake divides the wind direction into four parts and then recognizes and predicts the affected wind turbine. The predicted result is the wake wind speed and its conversion to power generation by applying a power curve. We try to show the efficiency of machine learning by comparing the wake wind speed and the power generation in the wake model. This result shows the error rate using evaluation metrics of regression, such as mean squared error (MSE), root mean squared error (RMSE), and weighted absolute percentage error (WAPE), and attempts to verify power system impact and efficiency through a real-time digital simulator (RTDS). [ABSTRACT FROM AUTHOR]

In the Forex market, trend trading, where trend traders identify trends and attempt to capture gains through the analysis of an asset's momentum in a particular direction, is a great way to profit from market movement. When the price of currency is moving in one either of the direction such as; up or down, it is known as trends. This trend analysis helps traders and investors find low risk entry points or exit points until the trend reverses. In this paper, empirical trade and trend analysis results are suggested by two-phase experimentations. First, considering the blended learning paradigm and wide use of deep-learning methodologies, the variants of long-short-term-memory (LSTM) networks such as Vanilla-LSTM, Stacked-LSTM, Bidirectional-LSTM, CNN-LSTM, and Conv-LSTM are used to build effective investing trading systems for both short-term and long-term timeframes. Then, a deep network-based system used to obtain the trends (up trends and down trends) of the predicted closing price of the currency pairs is proposed based on the best fit predictive networks measured using a few performance measures and Friedman's non-parametric tests. The observed trends are compared and validated with a few readily available technical indicators such as average directional index (ADX), rate of change (ROC), momentum, commodity channel index (CCI), and moving average convergence divergence (MACD). The predictive ability of the proposed strategy for trend analysis can be summarized as follows: (a) with respect to the previous day for short-term predictions, AUD:INR achieves 99.7265% and GBP:INR achieves 99.6582% for long-term predictions; (b) considering the trend analysis strategy with respect to the determinant day, AUD:INR achieves 98.2906% for short-term predictive days and USD:INR achieves an accuracy of trend forecasting with 96.0342%. The significant outcome of this article is the proposed trend forecasting methodology. An attempt has been made to provide an environment to understand the average, maximum, and minimum unit up and/or downs observed during trend forecasting. In turn, this deep learning-based strategy will help investors and traders to comprehend the entry and exit points of this financial market. [ABSTRACT FROM AUTHOR]

In the process of violence recognition, accuracy is reduced due to problems related to time axis misalignment and the semantic deviation of multimedia visual auditory information. Therefore, this paper proposes a method for auditory-visual information fusion based on autoencoder mapping. First, a feature extraction model based on the CNN-LSTM framework is established, and multimedia segments are used as whole input to solve the problem of time axis misalignment of visual and auditory information. Then, a shared semantic subspace is constructed based on an autoencoder mapping model and is optimized by semantic correspondence, which solves the problem of audiovisual semantic deviation and realizes the fusion of visual and auditory information on segment level features. Finally, the whole network is used to identify violence. The experimental results show that the method can make good use of the complementarity between modes. Compared with single-mode information, the multimodal method can achieve better results. [ABSTRACT FROM AUTHOR]

With the wide application of wind energy as a clean energy source, to cope with the challenge of increasing maintenance difficulty brought about by the development of large-scale wind power equipment, it is crucial to monitor the operating status of wind turbines in real time and accurately identify the specific location of faults. In this study, a CNN-LSTM-based wind motor fault detection model is constructed for four types of typical faults, namely gearbox faults, electrical faults, yaw faults, and pitch faults of wind motors, combining CNN's advantages of excelling in feature extraction and LSTM's advantages of dealing with long-time sequence data, to achieve the simultaneous detection of multiple fault types. The accuracy of the CNN-LSTM-based wind turbine fault detection model reaches 90.06%, and optimal results are achieved for the effective discovery of yaw system faults, pitch system faults, and gearbox faults, obtaining 94.09%, 96.46%, and 97.39%, respectively. The CNN-LSTM wind turbine fault detection model proposed in this study improves the fault detection effect, avoids the further deterioration of faults, provides direction for preventive maintenance, reduces downtime loss due to restorative maintenance, and is essential for the sustainable use of wind turbines and maintenance of wind turbine service life, which helps to improve the operation and maintenance level of wind farms. [ABSTRACT FROM AUTHOR]

Groundwater is crucial in mediating the interactions between the carbon and water cycles. Recently, groundwater storage depletion has been identified as a significant source of carbon dioxide (CO2) emissions. Here, we developed two data-driven models—XGBoost and convolutional neural network–long short-term memory (CNN-LSTM)—based on multi-satellite and reanalysis data to monitor CO2 emissions resulting from groundwater storage depletion in South Korea. The data-driven models developed in this study provided reasonably accurate predictions compared with in situ groundwater storage anomaly (GWSA) observations, identifying relatively high groundwater storage depletion levels in several regions over the past decade. For each administrative region exhibiting a decreasing groundwater storage trend, the corresponding CO2 emissions were quantified based on the predicted GWSA and respective bicarbonate concentrations. For 2008–2019, XGBoost and CNN-LSTM estimated CO2 emissions to be 0.216 and 0.202 MMTCO2/year, respectively. Furthermore, groundwater storage depletion vulnerability was assessed using the entropy weight method and technique for order of preference by similarity to ideal solution (TOPSIS) to identify hotspots with a heightened potential risk of CO2 emissions. Western South Korean regions were particularly classified as high or very high regions and susceptible to groundwater storage depletion-associated CO2 emissions. This study provides a foundation for developing countermeasures to mitigate accelerating groundwater storage depletion and the consequent rise in CO2 emissions. [ABSTRACT FROM AUTHOR]

It is of great significance to develop early prediction technology for controlling downy mildew and promoting cucumber production. In this study, a cucumber downy mildew prediction method was proposed by fusing quantitative disease information and environmental data. Firstly, the number of cucumber downy mildew spores during the experiment was collected by a portable spore catcher, and the proportion of cucumber downy mildew leaf area to all cucumber leaf area was recorded, which was used as the incidence degree of cucumber plants. The environmental data in the greenhouse were monitored and recorded by the weather station in the greenhouse. Environmental data outside the greenhouse were monitored and recorded by a weather station in front of the greenhouse. Then, the influencing factors of cucumber downy mildew were analyzed based on the Pearson correlation coefficient method. The influencing factors of the cucumber downy mildew early warning model in greenhouse were identified. Finally, the CNN-LSTM (Convolutional Neural Network-Long Short-Term Memory) algorithm was used to establish the cucumber downy mildew incidence prediction model. The results showed that the Mean Absolute Error (MAE), Mean Square Error (MSE), Root Mean Square Error (RMSE), and determination coefficient (R2) of the CNN-LSTM network model were 0.069, 0.0098, 0.0991, and 0.9127, respectively. The maximum error between the predicted value and the true value for all test sets was 16.9398%. The minimum error between the predicted value and the true value for all test sets was 0.3413%. The average error between the predicted and true values for all test sets was 6.6478%. The Bland–Altman method was used to analyze the predicted and true values of the test set, and 95.65% of the test set data numbers were within the 95% consistency interval. This work can serve as a foundation for the creation of early prediction models of greenhouse crop airborne diseases. [ABSTRACT FROM AUTHOR]

The reasonable pricing of options can effectively help investors avoid risks and obtain benefits, which plays a very important role in the stability of the financial market. The traditional single option pricing model often fails to meet the ideal expectations due to its limited conditions. Combining an economic model with a deep learning model to establish a hybrid model provides a new method to improve the prediction accuracy of the pricing model. This includes the usage of real historical data of about 10,000 sets of CSI 300 ETF options from January to December 2020 for experimental analysis. Aiming at the prediction problem of CSI 300ETF option pricing, based on the importance of random forest features, the Convolutional Neural Network and Long Short-Term Memory model (CNN-LSTM) in deep learning is combined with a typical stochastic volatility Heston model and stochastic interests CIR model in parameter models. The dual hybrid pricing model of the call option and the put option of CSI 300ETF is established. The dual-hybrid model and the reference model are integrated with ridge regression to further improve the forecasting effect. The results show that the dual-hybrid pricing model proposed in this paper has high accuracy, and the prediction accuracy is tens to hundreds of times higher than the reference model; moreover, MSE can be as low as 0.0003. The article provides an alternative method for the pricing of financial derivatives. [ABSTRACT FROM AUTHOR]

To effectively detect motion sickness induced by virtual reality environments, we developed a classification model specifically designed for visually induced motion sickness, employing a phase-locked value (PLV) functional connectivity matrix and a CNN-LSTM architecture. This model addresses the shortcomings of traditional machine learning algorithms, particularly their limited capability in handling nonlinear data. We constructed PLV-based functional connectivity matrices and network topology maps across six different frequency bands using EEG data from 25 participants. Our analysis indicated that visually induced motion sickness significantly alters the synchronization patterns in the EEG, especially affecting the frontal and temporal lobes. The functional connectivity matrix served as the input for our CNN-LSTM model, which was used to classify states of visually induced motion sickness. The model demonstrated superior performance over other methods, achieving the highest classification accuracy in the gamma frequency band. Specifically, it reached a maximum average accuracy of 99.56% in binary classification and 86.94% in ternary classification. These results underscore the model's enhanced classification effectiveness and stability, making it a valuable tool for aiding in the diagnosis of motion sickness. [ABSTRACT FROM AUTHOR]

Personal identification is an important aspect of managing electronic health records (EHRs), ensuring secure access to patient information, and maintaining patient privacy. Traditionally, biometric, signature, username/password, photo identity, etc., are employed for user authentication. However, these methods can be prone to security breaches, identity theft, and user inconvenience. The security of personal information is of paramount importance, particularly in the context of EHR. To address this, our study leverages ResNet1D, a deep learning architecture, to analyze surface electromyography (sEMG) signals for robust identification purposes. The proposed ResNet1D-based personal identification approach using the sEMG signal can offer an alternative and potentially more secure method for personal identification in EHR systems. We collected a multi-session sEMG signal database from individuals, focusing on hand gestures. The ResNet1D model was trained using this database to learn discriminative features for both gesture and personal identification tasks. For personal identification, the model validated an individual's identity by comparing captured features with their own stored templates in the healthcare EHR system, allowing secure access to sensitive medical information. Data were obtained in two channels when each of the 200 subjects performed 12 motions. There were three sessions, and each motion was repeated 10 times with time intervals of a day or longer between each session. Experiments were conducted on a dataset of 20 randomly sampled subjects out of 200 subjects in the database, achieving exceptional identification accuracy. The experiment was conducted separately for 5, 10, 15, and 20 subjects using the ResNet1D model of a deep neural network, achieving accuracy rates of 97%, 96%, 87%, and 82%, respectively. The proposed model can be integrated with healthcare EHR systems to enable secure and reliable personal identification and the safeguarding of patient information. [ABSTRACT FROM AUTHOR]

Alzheimer's disease is a common type of neurodegenerative condition characterized by progressive neural deterioration. The anatomical changes associated with individuals affected by Alzheimer's disease include the loss of tissue in various areas of the brain. Magnetic Resonance Imaging (MRI) is commonly used as a noninvasive tool to assess the neural structure of the brain for diagnosing Alzheimer's disease. In this study, an integrated Improved Fuzzy C-means method with improved watershed segmentation was employed to segment the brain tissue components affected by this disease. These segmented features were fed into a hybrid technique for classification. Specifically, a hybrid Convolutional Neural Network–Long Short-Term Memory classifier with 14 layers was developed in this study. The evaluation results revealed that the proposed method achieved an accuracy of 98.13% in classifying segmented brain images according to different disease severities. [ABSTRACT FROM AUTHOR]

The primary function of a mine hoist is the transportation of personnel and equipment, serving as a crucial link between underground and surface systems. The proper functioning of key components such as work braking and safety braking is essential for ensuring the safety of both personnel and equipment, thereby playing a critical role in the safe operation of coal mines. As coal mining operations extend to greater depths, they introduce heightened challenges for safe transportation, compounded by increased equipment loss. Consequently, there is a pressing need to enhance safety protocols to safeguard personnel and materials. Traditional maintenance and repair methods, characterized by routine equipment inspections and scheduled downtime, often fall short in addressing emerging issues promptly, leading to production delays and heightened risks for maintenance personnel. This underscores the necessity of adopting predictive maintenance strategies, leveraging digital twin models to anticipate and prevent potential faults in mine hoists. In summary, the implementation of predictive maintenance techniques grounded in digital twin technology represents a proactive and scientifically rigorous approach to ensuring the continued safe operation of mine hoists amidst the evolving challenges of deepening coal mining operations. In this study, we propose the integration of a CNN-LSTM algorithm within a digital twin framework for predicting faults in mine hoist braking systems. Utilizing software such as AMESim 2019 and MATLAB 2016b, we conduct joint simulations of the hoist braking digital twin system. Subsequently, leveraging the simulation model, we establish a fault diagnosis platform for the hoist braking system. Finally, employing the CNN-LSTM network model, we forecast failures in the mine hoist braking system. Experimental findings demonstrate the effectiveness of our proposed algorithm, achieving a prediction accuracy of 95.35%. Comparative analysis against alternative algorithms confirms the superior performance of our approach. [ABSTRACT FROM AUTHOR]

Modeling and forecasting the river flow is essential for the management of water resources. In this study, we conduct a comprehensive comparative analysis of different models built for the monthly water discharge of the Buzău River (Romania), measured in the upper part of the river's basin from January 1955 to December 2010. They employ convolutional neural networks (CNNs) coupled with long short-term memory (LSTM) networks, named CNN-LSTM, sparrow search algorithm with backpropagation neural networks (SSA-BP), and particle swarm optimization with extreme learning machines (PSO-ELM). These models are evaluated based on various criteria, including computational efficiency, predictive accuracy, and adaptability to different training sets. The models obtained applying CNN-LSTM stand out as top performers, demonstrating a superior computational efficiency and a high predictive accuracy, especially when built with the training set containing the data series from January 1984 (putting the Siriu Dam in operation) to September 2006 (Model type S2). This research provides valuable guidance for selecting and assessing river flow prediction models, offering practical insights for the scientific community and real-world applications. The findings suggest that Model type S2 is the preferred choice for the discharge forecast predictions due to its high computational speed and accuracy. Model type S (considering the training set recorded from January 1955 to September 2006) is recommended as a secondary option. Model type S1 (with the training period January 1955–December 1983) is suitable when the other models are unavailable. This study advances the field of water discharge prediction by presenting a precise comparative analysis of these models and their respective strengths [ABSTRACT FROM AUTHOR]

Background: Over the past decade, the potential advantages of employing deep learning models and leveraging auxiliary data in data-driven end-to-end (E2E) frameworks to enhance inventory decision-making have gained recognition. However, current approaches predominantly rely on feed-forward networks, which may have difficulty capturing temporal correlations in time series data and identifying relevant features, resulting in less accurate predictions. Methods: Addressing this gap, we introduce novel E2E deep learning frameworks that combine Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) for resolving single-period inventory ordering decisions, also termed the Newsvendor Problem (NVP). This study investigates the performance drivers of hybrid CNN-LSTM architectures, coupled with an evolving algorithm for optimizing network configuration. Results: Empirical evaluation of real-world retail data demonstrates that our proposed models proficiently extract pertinent features and interpret sequential data characteristics, leading to more accurate and informed ordering decisions. Notably, results showcase substantial benefits, yielding up to an 85% reduction in costs compared to a univariate benchmark and up to 40% savings compared to a feed-forward E2E deep learning architecture. Conclusions: This confirms that, in practical scenarios, understanding the impact of features on demand empowers decision-makers to derive tailored, cost-effective ordering decisions for each store or product category. [ABSTRACT FROM AUTHOR]

The growing concerns over road safety and the increasing popularity of two-wheeled vehicles highlight the need to address aggressive driving behaviors in this context. Understanding and detecting such behaviors can significantly contribute to rider safety and accident prevention. The primary aim of this research is to develop an effective method for detecting aggressive driving patterns, specifically focusing on rapid turns and lane-change maneuvers using two-wheeled vehicles. To achieve this objective, we conducted a survey to establish criteria for aggressive driving. Subsequently, we collected data through a virtual simulator, implementing staged aggressive driving scenarios. The data underwent preprocessing, feature engineering, and deep learning model training for detection. The results of this study demonstrate the successful detection of aggressive driving patterns, including rapid turns and lane changes, using sensor data. The criterion for rapid turns is specified as a significant change in sensor values within 1 s. In the CNN-LSTM model for aggressive lane changes, the precision for normal driving is 0.97, and the overall accuracy for aggressive driving is 95%. Our approach, which relies on sensor technology rather than impractical camera systems, showcases the potential for enhancing rider safety in two-wheeled vehicles. In conclusion, this research provides valuable insights into the detection of aggressive driving patterns in two-wheeled vehicles. By leveraging sensor data and innovative methods, it offers promising implications for improving rider safety and accident prevention in the future. [ABSTRACT FROM AUTHOR]

In response to the problem of low forecasting accuracy in wind and solar power outputs, this study proposes a joint forecasting method for wind and solar power outputs by using their spatiotemporal correlation. First, autocorrelation analysis and causal testing are used to screen the forecasting factors. Then, a convolutional neural network–long short-term memory (CNN-LSTM) is constructed and trained to extract features effectively. Finally, the independent, ensemble, and joint forecasting effects are compared, using a certain clean energy base as the research object. Results show that the forecasting accuracy of the ensemble wind and solar power outputs is better than that of independent forecasting. The joint forecasting method can improve the forecasting accuracy of wind power by 20% but slightly affects the forecasting accuracy of solar power. [ABSTRACT FROM AUTHOR]

Unmanned aerial vehicles (UAVs), known as drones, have played a significant role in recent years in creating resilient smart cities. UAVs can be used for a wide range of applications, including emergency response, civil protection, search and rescue, and surveillance, thanks to their high mobility and reasonable price. Automatic recognition of human activity in aerial videos captured by drones is critical for various tasks for these applications. However, this is difficult due to many factors specific to aerial views, including camera motion, vibration, low resolution, background clutter, lighting conditions, and variations in view. Although deep learning approaches have demonstrated their effectiveness in a variety of challenging vision tasks, they require either a large number of labelled aerial videos for training or a dataset with balanced classes, both of which can be difficult to obtain. To address these challenges, a hybrid data augmentation method is proposed which combines data transformation with the Wasserstein Generative Adversarial Network (GAN)-based feature augmentation method. In particular, we apply the basic transformation methods to increase the amount of video in the database. A Convolutional Neural Network–Long Short-Term Memory (CNN-LSTM) model is used to learn the spatio-temporal dynamics of actions, then a GAN-based technique is applied to generate synthetic CNN-LSTM features conditioned on action classes which provide a high discriminative spatio-temporal features. We tested our model on the YouTube aerial database, demonstrating encouraging results that surpass those of previous state-of-the-art works, including an accuracy rate of 97.83%. [ABSTRACT FROM AUTHOR]

Human activity recognition (HAR) is becoming increasingly important, especially with the growing number of elderly people living at home. However, most sensors, such as cameras, do not perform well in low-light environments. To address this issue, we designed a HAR system that combines a camera and a millimeter wave radar, taking advantage of each sensor and a fusion algorithm to distinguish between confusing human activities and to improve accuracy in low-light settings. To extract the spatial and temporal features contained in the multisensor fusion data, we designed an improved CNN-LSTM model. In addition, three data fusion algorithms were studied and investigated. Compared to camera data in low-light environments, the fusion data significantly improved the HAR accuracy by at least 26.68%, 19.87%, and 21.92% under the data level fusion algorithm, feature level fusion algorithm, and decision level fusion algorithm, respectively. Moreover, the data level fusion algorithm also resulted in a reduction of the best misclassification rate to 2%~6%. These findings suggest that the proposed system has the potential to enhance the accuracy of HAR in low-light environments and to decrease human activity misclassification rates. [ABSTRACT FROM AUTHOR]

The massive installation of renewable energy sources together with energy storage in the power grid can lead to fluctuating energy consumption when there is a bi-directional power flow due to the surplus of electricity generation. To ensure the security and reliability of the power grid, high-quality bi-directional power flow prediction is required. However, predicting bi-directional power flow remains a challenge due to the ever-changing characteristics of power flow and the influence of weather on renewable power generation. To overcome these challenges, we present two of the most popular hybrid deep learning (HDL) models based on a combination of a convolutional neural network (CNN) and long-term memory (LSTM) to predict the power flow in the investigated network cluster. In our approach, the models CNN-LSTM and LSTM-CNN were trained with two different datasets in terms of size and included parameters. The aim was to see whether the size of the dataset and the additional weather data can affect the performance of the proposed model to predict power flow. The result shows that both proposed models can achieve a small error under certain conditions. While the size and parameters of the dataset can affect the training time and accuracy of the HDL model. [ABSTRACT FROM AUTHOR]

The stress behavior of key parts of concrete dams is related to the safe operation of the dam. However, the stress sensors in concrete are susceptible to aging and failure with increasing service life. Estimating the structural stress under sensor failure or data loss scenarios for concrete dams in service is essential and complex. This study presents a stress estimation method driven by the observation data. Firstly, a one-to-one correspondence exists between dam deformation reflecting the load effect and structural stress. Estimating the structural stress by simulating load effects with dam deformation is more convenient when it is hard to simulate complex load effects directly. Therefore, based on the observed data before stress sensor failure, the spatial–temporal relationship between structure stress and multi-point deformations of a concrete dam is developed using convolutional neural networks (CNN) and long short-term memory (LSTM). An improved particle swarm optimization algorithm combined with swarm information entropy (SIE–APSO) is proposed simultaneously for tuning the network's hyperparameter and accelerating the convergence. Finally, the stress estimation of the target part of the concrete dam in service is obtained. The case shows that it is valid and feasible. The RMSE decreased by approximately 21–58%, MAPE decreased by 19–58%, and ARV decreased by 22–94% compared with the load-stress relationship model. [ABSTRACT FROM AUTHOR]

Building a pattern detection model using a deep learning algorithm for data collected from manufacturing sites is an effective way for to perform decision-making and assess business feasibility for enterprises, by providing the results and implications of the patterns analysis of big data occurring at manufacturing sites. To identify the threshold of the abnormal pattern requires collaboration between data analysts and manufacturing process experts, but it is practically difficult and time-consuming. This paper suggests how to derive the threshold setting of the abnormal pattern without manual labelling by process experts, and offers a prediction algorithm to predict the potentials of future failures in advance by using the hybrid Convolutional Neural Networks (CNN)–Long Short-Term Memory (LSTM) algorithm, and the Fast Fourier Transform (FFT) technique. We found that it is easier to detect abnormal patterns that cannot be found in the existing time domain after preprocessing the data set through FFT. Our study shows that both train loss and test loss were well developed, with near zero convergence with the lowest loss rate compared to existing models such as LSTM. Our proposition for the model and our method of preprocessing the data greatly helps in understanding the abnormal pattern of unlabeled big data produced at the manufacturing site, and can be a strong foundation for detecting the threshold of the abnormal pattern of big data occurring at manufacturing sites. [ABSTRACT FROM AUTHOR]

Electricity consumption forecasting is a vital task for smart grid building regarding the supply and demand of electric power. Many pieces of research focused on the factors of weather, holidays, and temperatures for electricity forecasting that requires to collect those data by using kinds of sensors, which raises the cost of time and resources. Besides, most of the existing methods only focused on one or two types of forecasts, which cannot satisfy the actual needs of decision-making. This paper proposes a novel hybrid deep model for multiple forecasts by combining Convolutional Neural Networks (CNN) and Long-Short Term Memory (LSTM) algorithm without additional sensor data, and also considers the corresponding statistics. Different from the conventional stacked CNN–LSTM, in the proposed hybrid model, CNN and LSTM extracted features in parallel, which can obtain more robust features with less loss of original information. Chiefly, CNN extracts multi-scale robust features by various filters at three levels and wide convolution technology. LSTM extracts the features which think about the impact of different time-steps. The features extracted by CNN and LSTM are combined with six statistical components as comprehensive features. Therefore, comprehensive features are the fusion of multi-scale, multi-domain (time and statistic domain) and robust due to the utilization of wide convolution technology. We validate the effectiveness of the proposed method on three natural subsets associated with electricity consumption. The comparative study shows the state-of-the-art performance of the proposed hybrid deep model with good robustness for very short-term, short-term, medium-term, and long-term electricity consumption forecasting. [ABSTRACT FROM AUTHOR]

The stochastic nature of renewable energy sources, especially solar PV output, has created uncertainties for the power sector. It threatens the stability of the power system and results in an inability to match power consumption and production. This paper presents a Convolutional Neural Network (CNN) approach consisting of different architectures, such as the regular CNN, multi-headed CNN, and CNN-LSTM (CNN-Long Short-Term Memory), which utilizes a sliding window data-level approach and other data pre-processing techniques to make accurate forecasts. The output of the solar panels is linked to input parameters such as irradiation, module temperature, ambient temperature, and windspeed. The benchmarking and accuracy metrics are calculated for 1 h, 1 day, and 1 week for the CNN based methods which are then compared with the results from the autoregressive moving average and multiple linear regression models in order to demonstrate its efficacy in making short-term and medium-term forecasts. [ABSTRACT FROM AUTHOR]

Yield prediction is of great significance for yield mapping, crop market planning, crop insurance, and harvest management. Remote sensing is becoming increasingly important in crop yield prediction. Based on remote sensing data, great progress has been made in this field by using machine learning, especially the Deep Learning (DL) method, including Convolutional Neural Network (CNN) or Long Short-Term Memory (LSTM). Recent experiments in this area suggested that CNN can explore more spatial features and LSTM has the ability to reveal phenological characteristics, which both play an important role in crop yield prediction. However, very few experiments combining these two models for crop yield prediction have been reported. In this paper, we propose a deep CNN-LSTM model for both end-of-season and in-season soybean yield prediction in CONUS at the county-level. The model was trained by crop growth variables and environment variables, which include weather data, MODIS Land Surface Temperature (LST) data, and MODIS Surface Reflectance (SR) data; historical soybean yield data were employed as labels. Based on the Google Earth Engine (GEE), all these training data were combined and transformed into histogram-based tensors for deep learning. The results of the experiment indicate that the prediction performance of the proposed CNN-LSTM model can outperform the pure CNN or LSTM model in both end-of-season and in-season. The proposed method shows great potential in improving the accuracy of yield prediction for other crops like corn, wheat, and potatoes at fine scales in the future. [ABSTRACT FROM AUTHOR]

Cyber-attacks on the numerous parts of today's fast developing IoT are only going to increase in frequency and severity. A reliable method for detecting malicious attacks such as botnet in the IoT environment is critical for reducing security risks on IoT devices. Numerous existing methods exist for mining IoT networks for previously discovered patterns that may be exploited to improve security. This study used a hybrid deep learning approach, namely the CNN-LSTM technique, to detect botnet attacks. Any software that infiltrates a computer system or is installed there without the administrators' knowledge or permission is malicious. There is a wide range of viruses that cyber-criminals use to further their nefarious ends. A revolutionary deep learning system has been developed to counteract the increasing quantity of harmful programs. The system takes advantage of NLP methods as a baseline, mixes CNNs and LSTM neurons to capture local spatial correlations, and learns from successive long-term dependencies. Spatial invariance, often known as symmetry, is the property wherein the dataset size remains constant throughout iterations of an algorithm while undergoing various transformations. Therefore, automated extraction of high-level abstractions and representations aids in the malware categorization process. When compared to its predecessor research study, the current level of categorization accuracy is significantly greater than 0.81. The proposed CNN-LSTM method obtained an R2 = 99.19% in the dataset, with a correlation coefficient for the CNN-LSTM technique of R2 = 100% utilizing the provided dataset. The symmetry correlation of the CNN-LSTM, which illustrates that the CNN-LSTM method has the highest detection accuracy, at 99%, among the other malware detection methods such as the SVM and DT. The rest of classifiers had an accuracy of 98% for DT, and 95% for SVM. The accuracy of the LSTM model is 99%, the precision of the CNN-LSTM is 99%, recall is 99% and F1 score is 1. [ABSTRACT FROM AUTHOR]

Land cover change (LCC) studies are increasingly using deep learning (DL) modeling techniques. Past studies have leveraged temporal or spatiotemporal sequences of historical LC data to forecast changes with DL models. However, these studies do not adequately assess the association between neighborhood size and DL model capability to forecast LCCs, where neighborhood size refers to the spatial extent captured by each data sample. The objectives of this research study were to: (1) evaluate the effect of neighborhood size on the capacity of DL models to forecast LCCs, specifically Temporal Convolutional Networks (TCN) and Convolutional Neural Networks (CNN-TCN), and (2) assess the effect of auxiliary spatial variables on model capacity to forecast LCCs. First, each model type and neighborhood setting configuration was assessed using data derived from multitemporal MODIS LC for the Regional District of Bulkley-Nechako, Canada, comparing subareas exhibiting different amounts of LCCs with trends obtained for the full region. Next, outcomes were compared with three other study regions. The modeling results were evaluated with three-map comparison measures, where the real-world LC for the next timestep, the real-world LC for the previous timestep, and the forecasted LC for the next year were used to calculate correctly transitioned areas. Across all regions explored, it was observed that increasing neighborhood sizes improved the DL model's capabilities to forecast short-term LCCs. CNN–TCN models forecasted the most correct LCCs for several regions while reducing error due to quantity when provided additional spatial variables. This study contributes to the systematic exploration of neighborhood sizes on selected spatiotemporal DL techniques for geographic applications. [ABSTRACT FROM AUTHOR]

Convolutional Long Short-Term Memory Neural Networks (CNN-LSTM) are a variant of recurrent neural networks (RNN) that can extract spatial features in addition to classifying or making predictions from sequential data. In this paper, we analyzed the use of CNN-LSTM for gas source localization (GSL) in outdoor environments using time series data from a gas sensor network and anemometer. CNN-LSTM is used to estimate the location of a gas source despite the challenges created from inconsistent airflow and gas distribution in outdoor environments. To train CNN-LSTM for GSL, we used temporal data taken from a 5 × 6 metal oxide semiconductor (MOX) gas sensor array, spaced 1.5 m apart, and an anemometer placed in the center of the sensor array in an open area outdoors. The output of the CNN-LSTM is one of thirty cells approximating the location of a gas source. We show that by using CNN-LSTM, we were able to determine the location of a gas source from sequential data. In addition, we compared several artificial neural network (ANN) architectures as well as trained them without wind vector data to estimate the complexity of the task. We found that ANN is a promising prospect for GSL tasks. [ABSTRACT FROM AUTHOR]

Background: The modern era of human society has seen the rise of a different variety of diseases. The mortality rate, therefore, increases without adequate care which consequently causes wealth loss. It has become a priority of humans to take care of health and wealth in a genuine way. Methods: In this article, the authors endeavored to design a hospital management system with secured data processing. The proposed approach consists of three different phases. In the first phase, a smart healthcare system is proposed for providing an effective health service, especially to patients with a brain tumor. An application is developed that is compatible with Android and Microsoft-based operating systems. Through this application, a patient can enter the system either in person or from a remote place. As a result, the patient data are secured with the hospital and the patient only. It consists of patient registration, diagnosis, pathology, admission, and an insurance service module. Secondly, deep-learning-based tumor detection from brain MRI and EEG signals is proposed. Lastly, a modified SHA-256 encryption algorithm is proposed for secured medical insurance data processing which will help detect the fraud happening in healthcare insurance services. Standard SHA-256 is an algorithm which is secured for short data. In this case, the security issue is enhanced with a long data encryption scheme. The algorithm is modified for the generation of a long key and its combination. This can be applicable for insurance data, and medical data for secured financial and disease-related data. Results: The deep-learning models provide highly accurate results that help in deciding whether the patient will be admitted or not. The details of the patient entered at the designed portal are encrypted in the form of a 256-bit hash value for secured data management. [ABSTRACT FROM AUTHOR]

In a world where humanity's interests come first, the environment is flooded with pollutants produced by humans' urgent need for expansion. Air pollution and climate change are side effects of humans' inconsiderate intervention. Particulate matter of 2.5 µm diameter (PM2.5) infiltrates lungs and hearts, causing many respiratory system diseases. Innovation in air pollution prediction is a must to protect the environment and its habitants, including those of humans. For that purpose, an enhanced method for PM2.5 prediction within the next hour is introduced in this research work using nonlinear autoregression with exogenous input (NARX) model hosting a convolutional neural network (CNN) followed by long short-term memory (LSTM) neural networks. The proposed enhancement was evaluated by several metrics such as index of agreement (IA) and normalized root mean square error (NRMSE). The results indicated that the CNN–LSTM/NARX hybrid model has the lowest NRMSE and the best IA, surpassing the state-of-the-art proposed hybrid deep-learning algorithms. [ABSTRACT FROM AUTHOR]

An early warning flood forecasting system that uses machine-learning models can be utilized for saving lives from floods, which are now exacerbated due to climate change. Flood forecasting is carried out by determining the river discharge and water level using hydrologic models at the target sites. If the water level and discharge are forecasted to reach dangerous levels, the flood forecasting system sends warning messages to residents in flood-prone areas. In the past, hybrid Long Short-Term Memory (LSTM) models have been successfully used for the time series forecasting. However, the prediction errors grow exponentially with the forecasting period, making the forecast unreliable as an early warning tool with enough lead time. Therefore, this research aimed to improve the accuracy of flood forecasting models by employing real-time monitoring network datasets and establishing temporal and spatial links between adjacent monitoring stations. We evaluated the performance of the LSTM, the Convolutional Neural Networks LSTM (CNN-LSTM), the Convolutional LSTM (ConvLSTM), and the Spatio-Temporal Attention LSTM (STA-LSTM) models for flood forecasting. The dataset, employed for validation, includes hourly discharge records, from 2012 to 2017, on six stations of the Humber River in the City of Toronto, Canada. Experiments included forecasting for both 6 and 12 h ahead, using discharge data as input for the past 24 h. The STA-LSTM model's performance was superior to the CNN-LSTM, the ConvLSTM, and the basic LSTM models when the forecast time was longer than 6 h. [ABSTRACT FROM AUTHOR]