Search

The traditional method for retrieving cloud optical thickness (COT) is carried out through a Look-Up Table (LUT). Researchers must make a series of idealized assumptions and conduct extensive observations and record features in this scenario, consuming considerable resources. The emergence of deep learning effectively addresses the shortcomings of the traditional approach. In this paper, we first propose a daytime (SOZA < 70°) COT retrieval algorithm based on FY-4A AGRI. We establish and train a Convolutional Neural Network (CNN) model for COT retrieval, CM4CR, with the CALIPSO's COT product spatially and temporally synchronized as the ground truth. Then, a deep learning method extended from video prediction models is adopted to predict COT values based on the retrieval results obtained from CM4CR. The COT prediction model (CPM) consists of an encoder, a predictor, and a decoder. On this basis, we further incorporated a time embedding module to enhance the model's ability to learn from irregular time intervals in the input COT sequence. During the training phase, we employed Charbonnier Loss and Edge Loss to enhance the model's capability to represent COT details. Experiments indicate that our CM4CR outperforms existing COT retrieval methods, with predictions showing better performance across several metrics than other benchmark prediction models. Additionally, this paper also investigates the impact of different lengths of COT input sequences and the time intervals between adjacent frames of COT on prediction performance. [ABSTRACT FROM AUTHOR]

Photovoltaic (PV) microgrids comprise a multitude of small PV power stations distributed across a specific geographical area in a decentralized manner. Computational services for forecasting the output power of power stations are crucial for optimizing resource deployment. This paper proposes a deep-learning-based architecture for short-term prediction of PV power. Firstly, in order to make full use of the spatial information between different power stations, a spatio–temporal feature fusion method is proposed. This method is capable of exploiting both the power information of neighboring power stations with strong correlations and meteorological information with the PV feature data of the target power station. By using a multiscale convolutional neural network–long short-term memory (CNN-LSTM) network model, it is capable of generating a PV feature dataset containing spatio–temporal attributes that expand the data source and enhance the feature constraints. It is capable of predicting the output power sequences of power stations in PV microgrids with high model generalization and responsiveness. To validate the effectiveness of the proposed framework, an extensive numerical analysis is also conducted based on a real-world PV dataset. [ABSTRACT FROM AUTHOR]

The applications of deep learning and artificial intelligence have permeated daily life, with time series prediction emerging as a focal area of research due to its significance in data analysis. The evolution of deep learning methods for time series prediction has progressed from the Convolutional Neural Network (CNN) and the Recurrent Neural Network (RNN) to the recently popularized Transformer network. However, each of these methods has encountered specific issues. Recent studies have questioned the effectiveness of the self-attention mechanism in Transformers for time series prediction, prompting a reevaluation of approaches to LTSF (Long Time Series Forecasting) problems. To circumvent the limitations present in current models, this paper introduces a novel hybrid network, Temporal Convolutional Network-Linear (TCN-Linear), which leverages the temporal prediction capabilities of the Temporal Convolutional Network (TCN) to enhance the capacity of LSTF-Linear. Time series from three classical chaotic systems (Lorenz, Mackey–Glass, and Rossler) and real-world stock data serve as experimental datasets. Numerical simulation results indicate that, compared to classical networks and novel hybrid models, our model achieves the lowest RMSE, MAE, and MSE with the fewest training parameters, and its R2 value is the closest to 1. [ABSTRACT FROM AUTHOR]

The load forecasting research for an NPS faces challenges including a high model accuracy, non-sharing of data, and a high communication cost. This paper proposes a load forecasting method for an NPS, based on efficient federated transfer learning (FTL). The adversarial feature extractor is added on the basis that FTL can effectively transfer the parameter features of the non-mask load to the local load data, and make up for the loss of mask load prediction accuracy. In order to improve the efficiency of the gradient compression of federated learning (FL), a depth dynamic threshold compression sensing method is proposed, which replaces the sparse signal in compressed sensing via the U-Net model and achieves an observation dimension reduction through a convolutional neural network (CNN). The experimental results show that the mean absolute percentage error (MAPE) and the root-mean-square error (RMSE) of the load forecasting method proposed in this paper are reduced by 9.6% and 2.31 kW, on average, when the load data are covered up to different degrees. Compared with the traditional FL model, the proposed compression algorithm saves 23.5% of the communication cost, without changing the accuracy of the model. The proposed prediction framework is easily interpretable, and robust under different validation metrics. [ABSTRACT FROM AUTHOR]

A large proportion of photovoltaic (PV) power generation is connected to the power grid, and its volatility and stochasticity have significant impacts on the power system. Accurate PV power forecasting is of great significance in optimizing the safe operation of the power grid and power market transactions. In this paper, a novel dual-channel PV power forecasting method based on a temporal convolutional network (TCN) is proposed. The method deeply integrates the PV station feature data with the model computing mechanism through the dual-channel model architecture; utilizes the combination of multihead attention (MHA) and TCN to extract the multidimensional spatio-temporal features between other meteorological variables and the PV power; and utilizes a single TCN to fully extract the temporal constraints of the power sequence elements. The weighted fusion of the dual-channel feature data ultimately yields the ideal forecasting results. The experimental data in this study are from a 26.52 kW PV power plant in central Australia. The experiments were carried out over seven different input window widths, and the two models that currently show superior performance within the field of PV power forecasting: the convolutional neural network (CNN), and the convolutional neural network combined with a long and short-term memory network (CNN_LSTM), are used as the baseline models. The experimental results show that the proposed model and the baseline models both obtained the best forecasting performance over a 1-day input window width, while the proposed model exhibited superior forecasting performance compared to the baseline model. It also shows that designing model architectures that deeply integrate the data input method with the model mechanism has research potential in the field of PV power forecasting. [ABSTRACT FROM AUTHOR]

For grid stability, operation, and planning, solar irradiance forecasting is crucial. In this paper, we provide a method for predicting the Global Horizontal Irradiance (GHI) mean values one hour in advance. Sky images are utilized for training the various forecasting models along with measured meteorological data in order to account for the short-term variability of solar irradiance, which is mostly caused by the presence of clouds in the sky. Additionally, deep learning models like the multilayer perceptron (MLP), convolutional neural networks (CNN), long short-term memory (LSTM), or their hybridized forms are widely used for deterministic solar irradiance forecasting. The implementation of probabilistic solar irradiance forecasting, which is gaining prominence in grid management since it offers information on the likelihood of different outcomes, is another task we carry out using quantile regression. The novelty of this paper lies in the combination of a hybrid deep learning model (CNN-LSTM) with quantile regression for the computation of prediction intervals at different confidence levels. The training of the different machine learning algorithms is performed over a year's worth of sky images and meteorological data from the years 2019 to 2020. The data were measured at the University of French Polynesia (17.5770° S, 149.6092° W), on the island of Tahiti, which has a tropical climate. Overall, the hybrid model (CNN-LSTM) is the best performing and most accurate in terms of deterministic and probabilistic metrics. In addition, it was found that the CNN, LSTM, and ANN show good results against persistence. [ABSTRACT FROM AUTHOR]

To solve the problem of feature selection and error correction after mode decomposition and improve the ability of power load forecasting models to capture complex time series information, a two-stage short-term power load forecasting method based on recursive feature elimination with a cross validation (RFECV) algorithm and time convolution network–efficient channel attention mechanism–long short-term memory network (TCN–ECA–LSTM) is presented. First, the load sequence is decomposed into a relatively stable set of modal components using variational mode decomposition. Then, the RFECV-based method filters the feature set of each modal component to construct the best feature set. Finally, a two-stage prediction model based on TCN–ECA–LSTM is established. The first stage predicts each modal component and the second stage reconstructs the load forecast based on the predicted value of the previous stage. This paper takes actual data from New South Wales, Australia, as an example, and the results show that the method proposed in this paper can build the feature set reliably and efficiently and has a higher accuracy than the conventional prediction model. [ABSTRACT FROM AUTHOR]

Existing data-driven technology for prediction of state of health (SOH) has insufficient feature extraction capability and limited application scope. To deal with this challenge, this paper proposes a battery SOH prediction model based on multi-feature fusion. The model is based on a convolutional neural network (CNN) and a long short-term memory network (LSTM). The CNN can learn the cycle features in the battery data, the LSTM can learn the aging features of the battery over time, and regression prediction can be made through the full-connection layer (FC). In addition, for the aging differences caused by different battery operating conditions, this paper introduces transfer learning (TL) to improve the prediction effect. Across cycle data of the same battery under 12 different charging conditions, the fusion model in this paper shows higher prediction accuracy than with either LSTM and CNN in isolation, reducing RMSPE by 0.21% and 0.19%, respectively. [ABSTRACT FROM AUTHOR]

Contact fatigue is one of the most common failure forms of typical basic components such as bearings and gears. Accurate prediction of contact fatigue performance degradation trends in components is conducive to the scientific formulation of maintenance strategies and health management of equipment, which is of great significance for industrial production. In this paper, to realize the performance degradation trend prediction accurately, a prediction method based on multi-domain features and temporal convolutional networks (TCNs) was proposed. Firstly, a multi-domain and high-dimensional feature set of vibration signals was constructed, and performance degradation indexes with good sensitivity and strong trends were initially screened using comprehensive evaluation indexes. Secondly, the kernel principal component analysis (KPCA) method was used to eliminate redundant information among multi-domain features and construct health indexes (HIs) based on a convolutional autoencoder (CAE) network. Then, the performance degradation trend prediction model based on TCN was constructed, and the degradation trend prediction for the monitored object was realized using direct multi-step prediction. On this basis, the effectiveness of the proposed method was verified using a bearing common-use data set, and it was successfully applied to performance degradation trend prediction for rolling contact fatigue specimens. The results show that using KPCA can reduce the feature set from 14 dimensions to 4 dimensions and retain 98.33% of the information in the original preferred feature set. The method of constructing the HI based on CAE is effective, and change processes versus time of the constructed HI can truly reflect the degradation process of rolling contact fatigue specimen performance; this method has obvious advantages over the two commonly used methods for constructing HIs including auto-encoding (AE) networks and gaussian mixture models (GMMs). The model based on TCN can accurately predict the performance degradation of rolling contact fatigue specimens. Compared with prediction models based on long short-term memory (LSTM) networks and gating recurrent units (GRUs), the model based on TCN has better performance and higher prediction accuracy. The RMS error and average absolute error for a prediction step of 3 are 0.0146 and 0.0105, respectively. Overall, the proposed method has universal significance and can be applied to predict the performance degradation trend of other mechanical equipment/parts. [ABSTRACT FROM AUTHOR]

This paper proposes a new linear combination model to predict the closing prices on multivariate financial data sets. The new approach integrates two delays of deep learning methods called the two-delay combination model. The forecasts are derived from three different deep learning models: the multilayer perceptron (MLP), the convolutional neural network (CNN) and the long short-term memory (LSTM) network. Moreover, the weight combination of our proposed model is estimated using the differential evolution (DE) algorithm. The proposed model is built and tested for three high-frequency stock data in financial markets—Microsoft Corporation (MSFT), Johnson & Johnson (JNJ) and Pfizer Inc. (PFE). The individual and combination forecast methods are compared using the root mean square error (RMSE) and the mean absolute percentage error (MAPE). The state-of-the-art combination models used in this paper are the equal weight (EW), the inverse of RMSE (INV-RMSE) and the variance-no-covariance (VAR-NO-CORR) methods. These comparisons demonstrate that our proposed approach using DE weight's optimization has significantly lower forecast errors than the individual model and the state-of-the-art weight combination procedures for all experiments. Consequently, combining two delay deep learning models using differential evolution weights can effectively improve the stock price prediction. [ABSTRACT FROM AUTHOR]

Traditional statistical, physical, and correlation models for chaotic time series prediction have problems, such as low forecasting accuracy, computational time, and difficulty determining the neural network's topologies. Over a decade, various researchers have been working with these issues; however, it remains a challenge. Therefore, this review paper presents a comprehensive review of significant research conducted on various approaches for chaotic time series forecasting, using machine learning techniques such as convolutional neural network (CNN), wavelet neural network (WNN), fuzzy neural network (FNN), and long short-term memory (LSTM) in the nonlinear systems aforementioned above. The paper also aims to provide issues of individual forecasting approaches for better understanding and up-to-date knowledge for chaotic time series forecasting. The comprehensive review table summarizes the works closely associated with the mentioned issues. It includes published year, research country, forecasting approach, application, forecasting parameters, performance measures, and collected data area in this sector. Future improvements and current studies in this field are broadly examined. In addition, possible future scopes and limitations are closely discussed. [ABSTRACT FROM AUTHOR]

In recent times, the power sector has become a focal point of extensive scientific interest, driven by a convergence of factors, such as mounting global concerns surrounding climate change, the persistent increase in electricity prices within the wholesale energy market, and the surge in investments catalyzed by technological advancements across diverse sectors. These evolving challenges have necessitated the emergence of new imperatives aimed at effectively managing energy resources, ensuring grid stability, bolstering reliability, and making informed decisions. One area that has garnered particular attention is the accurate prediction of end-user electricity load, which has emerged as a critical facet in the pursuit of efficient energy management. To tackle this challenge, machine and deep learning models have emerged as popular and promising approaches, owing to their having remarkable effectiveness in handling complex time series data. In this paper, the development of an algorithmic model that leverages an automated process to provide highly accurate predictions of electricity load, specifically tailored for the island of Thira in Greece, is introduced. Through the implementation of an automated application, an array of deep learning forecasting models were meticulously crafted, encompassing the Multilayer Perceptron, Long Short-Term Memory (LSTM), One Dimensional Convolutional Neural Network (CNN-1D), hybrid CNN–LSTM, Temporal Convolutional Network (TCN), and an innovative hybrid model called the Convolutional LSTM Encoder–Decoder. Through evaluation of prediction accuracy, satisfactory performance across all the models considered was observed, with the proposed hybrid model showcasing the highest level of accuracy. These findings underscore the profound significance of employing deep learning techniques for precise forecasting of electricity demand, thereby offering valuable insights with which to tackle the multifaceted challenges encountered within the power sector. By adopting advanced forecasting methodologies, the electricity sector moves towards greater efficiency, resilience and sustainability. [ABSTRACT FROM AUTHOR]

Machine learning can play a significant role in bringing new insights in GNSS remote sensing for ionosphere monitoring and modeling to service. In this paper, a set of multilayer architectures of neural networks is proposed and considered, including both neural networks based on LSTM and GRU, and temporal convolutional networks. The set of methods included 10 architectures: TCN, modified LSTM-/GRU-based deep networks, including bidirectional ones, and BiTCN. The comparison of TEC forecasting accuracy is performed between individual architectures, as well as their bidirectional modifications, by means of MAE, MAPE, and RMSE estimates. The F10.7, 10 Kp, Np, Vsw, and Dst indices are used as predictors. The results are presented for the reference station Juliusruh, three stations along the meridian 30°E (Murmansk, Moscow, and Nicosia), and three years of different levels of solar activity (2015, 2020, and 2022). The MAE and RMSE values depend on the station latitude, following the solar activity. The conventional LSTM and GRU networks with the proposed modifications and the TCN provide results at the same level of accuracy. The use of bidirectional neural networks significantly improves forecast accuracy for all the architectures and all stations. The best results are provided by the BiTCN architecture, with MAE values less than 0.3 TECU, RMSE less than 0.6 TECU, and MAPE less than 5%. [ABSTRACT FROM AUTHOR]

Residential and industrial buildings are significant consumers of energy, which can be reduced by controlling their respective Heating, Ventilation, and Air Conditioning (HVAC) systems. Demand-based Ventilation (DCV) determines the operational times of ventilation systems that depend on indoor air quality (IAQ) conditions, including CO2 concentration changes, and the occupants' comfort requirements. The prediction of CO2 concentration changes can act as a proxy estimator of occupancy changes and provide feedback about the utility of current ventilation controls. This paper proposes a Hierarchical Model for CO2 Variation Predictions (HMCOVP) to accurately predict these variations. The proposed framework addresses two concerns in state-of-the-art implementations. First, the hierarchical structure enables fine-tuning of the produced models, facilitating their transferability to different spatial settings. Second, the formulation incorporates time dependencies, defining the relationship between different IAQ factors. Toward that goal, the HMCOVP decouples the variation prediction into two complementary steps. The first step transforms lagged versions of environmental features into image representations to predict the variations' direction. The second step combines the first step's result with environment-specific historical data to predict CO2 variations. Through the HMCOVP, these predictions, which outperformed state-of-the-art approaches, help the ventilation systems in their decision-making processes, reducing energy consumption and carbon-based emissions. [ABSTRACT FROM AUTHOR]

Workload prediction is essential in cloud data centers (CDCs) for establishing scalability and resource elasticity. However, the workload prediction accuracy in the cloud data center could be better due to noise, redundancy, and low performance for workload prediction. This paper designs a hierarchical tree-based deep convolutional neural network (T-CNN) model with sheep flock optimization (SFO) to enhance CDCs' power efficiency and workload prediction. The kernel method is used to preprocess historical information from the CDCs. Additionally, T-CNN model weight parameters are optimized using SFO. The suggested TCNN-SFO technology has successfully reduced excessive power consumption while correctly forecasting the incoming demand. Further, the proposed model is assessed using two benchmark datasets: Saskatchewan HTTP traces and NASA. The developed model is executed in a Java tool. Therefore, associated with existing methods, the developed technique has achieved higher accuracy of 20.75%, 19.06%, 29.09%, 23.8%, and 20.5%, as well as lower energy consumption of 20.84%, 18.03%, 28.64%, 30.72%, and 33.74% when validating the Saskatchewan HTTP traces dataset. It has also achieved higher accuracy of 32.95%, 12.05%, 32.65%, and 26.54%. [ABSTRACT FROM AUTHOR]

With the continuous development of financial markets worldwide to tackle rapid changes such as climate change and global warming, there has been increasing recognition of the importance of financial time series forecasting in financial market operation and management. In this paper, we propose a new financial time series forecasting model based on the deep learning ensemble model. The model is constructed by taking advantage of a convolutional neural network (CNN), long short-term memory (LSTM) network, and the autoregressive moving average (ARMA) model. The CNN-LSTM model is introduced to model the spatiotemporal data feature, while the ARMA model is used to model the autocorrelation data feature. These models are combined in the ensemble framework to model the mixture of linear and nonlinear data features in the financial time series. The empirical results using financial time series data show that the proposed deep learning ensemble-based financial time series forecasting model achieved superior performance in terms of forecasting accuracy and robustness compared with the benchmark individual models. [ABSTRACT FROM AUTHOR]

Artificial intelligence models have been widely applied for natural gas consumption forecasting over the past decades, especially for short-term consumption forecasting. This paper proposes a three-layer neural network forecasting model that can extract key information from input factors and improve the weight optimization mechanism of long short-term memory (LSTM) neural network to effectively forecast short-term consumption. In the proposed model, a convolutional neural network (CNN) layer is adopted to extract the features among various factors affecting natural gas consumption and improve computing efficiency. The LSTM layer is able to learn and save the long-distance state through the gating mechanism and overcomes the defects of gradient disappearance and explosion in the recurrent neural network. To solve the problem of encoding input sequences as fixed-length vectors, the layer of attention (ATT) is used to optimize the assignment of weights and highlight the key sequences. Apart from the comparisons with other popular forecasting models, the performance and robustness of the proposed model are validated on datasets with different fluctuations and complexities. Compared with traditional two-layer models (CNN-LSTM and LSTM-ATT), the mean absolute range normalized errors (MARNE) of the proposed model in Athens and Spata are improved by more than 16% and 11%, respectively. In comparison with single LSTM, back propagation neural network, support vector regression, and multiple linear regression methods, the improvement in MARNE exceeds 42% in Athens. The coefficient of determination is improved by more than 25%, even in the high-complexity dataset, Spata. [ABSTRACT FROM AUTHOR]

Convolution-based recurrent neural networks and convolutional neural networks have been used extensively in spatiotemporal prediction. However, these methods tend to concentrate on fixed-scale spatiotemporal state transitions and disregard the complexity of spatiotemporal motion. Through statistical analysis, we found that the distribution of the spatiotemporal sequence and the variety of spatiotemporal motion state transitions exhibit some regularity. In light of these statistics and observations, we propose the Multi-scale Spatiotemporal Neural Network (MSSTNet), an end-to-end neural network based on 3D convolution. It can be separated into three major child modules: a distribution feature extraction module, a multi-scale motion state capture module, and a feature decoding module. Furthermore, the MSST unit is designed to model multi-scale spatial and temporal information in the multi-scale motion state capture module. We first conduct the experiments on the MovingMNIST dataset, which is the most commonly used dataset in the field of spatiotemporal prediction, MSSTNet can achieve state-of-the-art results for this dataset, and ablation experiments demonstrate that the MSST unit has positive significance for spatiotemporal prediction. In addition, this paper applies the model to valuable precipitation nowcasting, due to efficiently capturing the multi-scale information of distribution and motion, the new MSSTNet model can predict the real-world radar echo more accurately. [ABSTRACT FROM AUTHOR]

Photovoltaic (PV) technology converts solar energy into electrical energy, and the PV industry is an essential renewable energy industry. However, the amount of power generated through PV systems is closely related to unpredictable and uncontrollable environmental factors such as solar radiation, temperature, humidity, cloud cover, and wind speed. Particularly, changes in temperature and solar radiation can substantially affect power generation, causing a sudden surplus or reduction in the power output. Nevertheless, accurately predicting the energy produced by PV power generation systems is crucial. This paper proposes a hybrid model comprising a convolutional neural network (CNN) and long short-term memory (LSTM) for stable power generation forecasting. The CNN classifies weather conditions, while the LSTM learns power generation patterns based on the weather conditions. The proposed model was trained and tested using the PV power output data from a power plant in Busan, Korea. Quantitative and qualitative evaluations were performed to verify the performance of the model. The proposed model achieved a mean absolute percentage error of 4.58 on a sunny day and 7.06 on a cloudy day in the quantitative evaluation. The experimental results suggest that precise power generation forecasting is possible using the proposed model according to instantaneous changes in power generation patterns. Moreover, the proposed model can help optimize PV power plant operations. [ABSTRACT FROM AUTHOR]

Forecasting return and profit is a primary challenge for financial practitioners and an even more critical issue when it comes to forecasting energy market returns. This research attempts to propose an effective method to predict the Brent Crude Oil return, which results in remarkable performance compared with the well-known models in the return prediction. The proposed hybrid model is based on long short-term memory (LSTM) and convolutional neural network (CNN) networks where the autoregressive integrated moving average (ARIMA) and generalized autoregressive conditional heteroscedasticity (GARCH) outputs are used as features, along with return lags, price, and macroeconomic variables to train the models, resulting in significant improvement in the model's performance. According to the obtained results, our proposed model performs better than other models, including artificial neural network (ANN), principal component analysis (PCA)-ANN, LSTM, and CNN. We show the efficiency of our proposed model by testing it with a simple trading strategy, indicating that the cumulative profit obtained from trading with the prediction results of the proposed 2D CNN-LSTM model is higher than those of the other models presented in this research. In the second part of this study, we consider the spread of COVID-19 and its impact on the financial markets to present a precise LSTM model that can reflect the impact of this disease on the Brent Crude Oil return. This paper uses the significance test and correlation measures to show the similarity between the series of Brent Crude Oil during the SARS and the COVID-19 pandemics, after which the data during the SARS period are used along with the data during COVID-19 to train the LSTM. The results demonstrate that the proposed LSTM model, tuned by the SARS data, can better predict the Brent Crude Oil return during the COVID-19 pandemic. [ABSTRACT FROM AUTHOR]

Determining and modeling the possible behaviour and actions of molecules requires investigating the basic structural features and physicochemical properties that determine their behaviour during chemical, physical, biological, and environmental processes. Computational approaches such as machine learning methods are alternatives to predicting the physiochemical properties of molecules based on their structures. However, the limited accuracy and high error rates of such predictions restrict their use. In this paper, a novel technique based on a deep learning convolutional neural network (CNN) for the prediction of chemical compounds' bioactivity is proposed and developed. The molecules are represented in the new matrix format Mol2mat, a molecular matrix representation adapted from the well-known 2D-fingerprint descriptors. To evaluate the performance of the proposed methods, a series of experiments were conducted using two standard datasets, namely the MDL Drug Data Report (MDDR) and Sutherland, datasets comprising 10 homogeneous and 14 heterogeneous activity classes. After analysing the eight fingerprints, all the probable combinations were investigated using the five best descriptors. The results showed that a combination of three fingerprints, ECFP4, EPFP4, and ECFC4, along with a CNN activity prediction process, achieved the highest performance of 98% AUC when compared to the state-of-the-art ML algorithms NaiveB, LSVM, and RBFN. [ABSTRACT FROM AUTHOR]

Electricity price forecasts have become a fundamental factor affecting the decision-making of all market participants. Extreme price volatility has forced market participants to hedge against volume risks and price movements. Hence, getting an accurate price forecast from a few hours to a few days ahead is very important and very challenging due to various factors. This paper proposes an integrated long-term recurrent convolutional network (ILRCN) model to predict electricity prices considering the majority of contributing attributes to the market price as input. The proposed ILRCN model combines the functionalities of a convolutional neural network and long short-term memory (LSTM) algorithm along with the proposed novel conditional error correction term. The combined ILRCN model can identify the linear and nonlinear behavior within the input data. ERCOT wholesale market price data along with load profile, temperature, and other factors for the Houston region have been used to illustrate the proposed model. The performance of the proposed ILRCN electricity price forecasting model is verified using performance/evaluation metrics like mean absolute error and accuracy. Case studies reveal that the proposed ILRCN model shows the highest accuracy and efficiency in electricity price forecasting as compared to the support vector machine (SVM) model, fully connected neural network model, LSTM model, and the traditional LRCN model without the conditional error correction stage. [ABSTRACT FROM AUTHOR]

Short-term load forecasting (STLF) has a significant role in reliable operation and efficient scheduling of power systems. However, it is still a major challenge to accurately predict power load due to social and natural factors, such as temperature, humidity, holidays and weekends, etc. Therefore, it is very important for the efficient feature selection and extraction of input data to improve the accuracy of STLF. In this paper, a novel hybrid model based on empirical mode decomposition (EMD), a one-dimensional convolutional neural network (1D-CNN), a temporal convolutional network (TCN), a self-attention mechanism (SAM), and a long short-term memory network (LSTM) is proposed to fully decompose the input data and mine the in-depth features to improve the accuracy of load forecasting. Firstly, the original load sequence was decomposed into a number of sub-series by the EMD, and the Pearson correlation coefficient method (PCC) was applied for analyzing the correlation between the sub-series with the original load data. Secondly, to achieve the relationships between load series and external factors during an hour scale and the correlations among these data points, a strategy based on the 1D-CNN and TCN is proposed to comprehensively refine the feature extraction. The SAM was introduced to further enhance the key feature information. Finally, the feature matrix was fed into the long short-term memory (LSTM) for STLF. According to experimental results employing the North American New England Control Area (ISO-NE-CA) dataset, the proposed model is more accurate than 1D-CNN, LSTM, TCN, 1D-CNN–LSTM, and TCN–LSTM models. The proposed model outperforms the 1D-CNN, LSTM, TCN, 1D-CNN–LSTM, and TCN–LSTM by 21.88%, 51.62%, 36.44%, 42.75%, 16.67% and 40.48%, respectively, in terms of the mean absolute percentage error. [ABSTRACT FROM AUTHOR]

Passenger flow is an important benchmark for measuring tourism benefits, and accurate tourism passenger flow prediction is of great significance to the government and related tourism enterprises and can promote the sustainable development of China's tourism industry. For daily passenger flow time series data, a passenger flow forecasting method based on convolutional neural network (CNN) and improved quantile regression long short-term memory network (QRLSTM), denoted as CNN-IQRLSTM, is proposed with reconstructed correlation features and in the form of sliding windows as inputs. First, four discrete variables such as whether the day is a weekend and holiday are created by time; then, a sliding window of width 42 is used to pass the passenger flow data into the network sequentially; finally, the loss function of the sparse Laplacian improved QRLSTM is introduced for passenger flow prediction, and the point prediction and interval prediction results under different quartiles are obtained. The application of quantile regression captures the overall picture of the data, enhances the robustness, fit, predictive power and nonlinear processing capability of neural networks, and fills the gap between quantile regression and neural network methods in the field of passenger flow prediction. CNN can effectively handle complex input data, and the improved nonlinear QR model can provide passenger flow quantile prediction information. The method is applied to the tourism traffic prediction of four 5A scenic spots in Jilin Province, and the effectiveness of the method is verified. The results show that the method proposed in this paper fits best in point prediction and has higher prediction accuracy. The MAPE of the Changbai Mountain dataset was 0.07, the MAPE of the puppet palace museum dataset was 0.05, the fit of the Sculpture Park dataset reached 93%, and the fit of the net moon lake dataset was as high as 99%. Meanwhile, the interval prediction results show that the method has a larger interval coverage as well as a smaller interval average width, which improves the prediction efficiency. In 95% of the interval predictions, the interval coverage of Changbai Mountain data is 99% and the interval average width is 0.49. It is a good reference value for the management of different scenic spots. [ABSTRACT FROM AUTHOR]

The forecasting of tourist arrival depends on the accurate modeling of prevalent data patterns found in tourist arrival, especially for daily tourist arrival, where tourist arrival changes are more complex and highly nonlinear. In this paper, a new multiscale mode learning-based tourist arrival forecasting model is proposed to exploit different multiscale data features in tourist arrival movement. Two popular Mode Decomposition models (MD) and the Convolutional Neural Network (CNN) model are introduced to model the multiscale data features in the tourist arrival data The data patterns at different scales are extracted using these two different MD models which dynamically decompose tourist arrival into the distinctive intrinsic mode function (IMF) data components. The convolutional neural network uses the deep network to further model the multiscale data structure of tourist arrivals, with the reduced dimensionality of key multiscale data features and finer modeling of nonlinearity in tourist arrival. Our empirical results using daily tourist arrival data show that the MD-CNN tourist arrival forecasting model significantly improves the forecasting reliability and accuracy. [ABSTRACT FROM AUTHOR]

In light of the increasing level of correlation and dependence between the crude oil markets and the external influencing factors in the related financial markets, we propose a new multivariate empirical decomposition convolutional neural network model to incorporate the external influence of financial markets such as stock market and exchange market in a multiscale setting into the modeling of crude oil market risk movement. We propose a multivariate empirical model decomposition to analyze the finer details of interdependence among risk movement of different markets across different time horizons or scales. We also introduce the convolutional neural network to construct a new nonlinear ensemble algorithm to reduce the estimation bias and improve the forecasting accuracy. We used the major crude oil price data, stock market index, and the euro/United States dollar exchange rate data to evaluate the performance of the multivariate empirical model decomposition convolutional neural network model. The combination of both the multivariate empirical model decomposition and the convolutional neural network model in this paper has produced the risk forecasts with significantly improved risk forecasting accuracy. [ABSTRACT FROM AUTHOR]

Traditional electricity price forecasting tends to adopt time-domain forecasting methods based on time series, which fail to make full use of the regional information of the electricity market, and ignore the extra-territorial factors affecting electricity price within the region under cross-regional transmission conditions. In order to improve the accuracy of electricity price forecasting, this paper proposes a novel spatio-temporal prediction model, which is combined with the graph convolutional network (GCN) and the temporal convolutional network (TCN). First, the model automatically extracts the relationships between price areas through the graph construction module. Then, the mix-jump GCN is used to capture the spatial dependence, and the dilated splicing TCN is used to capture the temporal dependence and forecast electricity price for all price areas. The results show that the model outperforms other models in both one-step forecasting and multi-step forecasting, indicating that the model has superior performance in electricity price forecasting. [ABSTRACT FROM AUTHOR]

Accurate and fine-grained individual air quality index (IAQI) prediction is the basis of air quality index (AQI), which is of great significance for air quality control and human health. Traditional approaches, such as time series, recurrent neural network or graph convolutional network, cannot effectively integrate spatial-temporal and meteorological factors and manage the dynamic edge relationship among scattered monitoring stations. In this paper, a ST-CCN-IAQI model is proposed based on spatial-temporal causal convolution networks. Both the spatial effects of multi-source air pollutants and meteorological factors were considered via spatial attention mechanism. Time-dependent features in the causal convolution network were extracted by stacked dilated convolution and time attention. All the hyper-parameters in ST-CCN-IAQI were tuned by Bayesian optimization. Shanghai air monitoring station data were employed with a series of baselines (AR, MA, ARMA, ANN, SVR, GRU, LSTM and ST-GCN). Final results showed that: (1) For a single station, the RMSE and MAE values of ST-CCN-IAQI were 9.873 and 7.469, decreasing by 24.95% and 16.87% on average, respectively. R2 was 0.917, with an average 5.69% improvement; (2) For all nine stations, the mean RMSE and MAE of ST-CCN-IAQI were 9.849 and 7.527, respectively, and the R2 value was 0.906. (3) Shapley analysis showed PM10, humidity and NO2 were the most influencing factors in ST-CCN-IAQI. The Friedman test, under different resampling, further confirmed the advantage of ST-CCN-IAQI. The ST-CCN-IAQI provides a promising direction for fine-grained IAQI prediction. [ABSTRACT FROM AUTHOR]

Short-term load forecasting plays a significant role in the operation of power systems. Recently, deep learning has been generally employed in short-term load forecasting, primarily in the extraction of the characteristics of digital information in a single dimension without taking into account of the impact of external variables, particularly non-digital elements on load characteristics. In this paper, we propose a joint MFF-SAM-GCN to realize short-term load forecasting. First, we utilize a Bi-directional Long Short-Term Memory (Bi-LSTM) network and One-Dimensional Convolutional Neural Network (1D-CNN) in parallel connection to form a multi-feature fusion (MFF) framework, which can extract spatiotemporal correlation features of the load data. In addition, we introduce a Self-Attention Mechanism (SAM) to further enhance the feature extraction capability of the 1D-CNN network. Then with the deployment of a Graph Convolutional Network (GCN), the external non-digital features such as weather, strength, and direction of wind, etc., are extracted. Moreover, the generated weight matrices are incorporated into the load features to enhance feature recognition ability. Finally, we exploit Bayesian Optimization (BO) to find the optimal hyperparameters of the model to further improve the prediction accuracy. The simulation is taken from our proposed model and six benchmark schemes by using the bus load dataset of the Shandong Open Data Network, China. The results show that the RMSE of our proposed MFF-SAM-GCN model is 0.0284, while the SMAPE is 9.453%,the MBE is 0.025, and R-squared is 0.989, which is better than the selected three traditional machine learning methods and the three deep learning models. [ABSTRACT FROM AUTHOR]

Load forecasting is an essential task in the operation management of a power system. Electric power companies utilize short-term load forecasting (STLF) technology to make reasonable power generation plans. A forecasting model with low prediction errors helps reduce operating costs and risks for the operators. In recent years, machine learning has become one of the most popular technologies for load forecasting. In this paper, a two-stage STLF model based on long short-term memory (LSTM) and multilayer perceptron (MLP), which improves the forecasting accuracy over the entire time horizon, is proposed. In the first stage, a sequence-to-sequence (seq2seq) architecture, which can handle a multi-sequence of input to extract more features of historical data than that of single sequence, is used to make multistep predictions. In the second stage, the MLP is used for residual modification by perceiving other information that the LSTM cannot. To construct the model, we collected the electrical load, calendar, and meteorological records of Kanto region in Japan for four years. Unlike other LSTM-based hybrid architectures, the proposed model uses two independent neural networks instead of making the neural network deeper by concatenating a series of LSTM cells and convolutional neural networks (CNNs). Therefore, the proposed model is easy to be trained and more interpretable. The seq2seq module performs well in the first few hours of the predictions. The MLP inherits the advantage of the seq2seq module and improves the results by feeding artificially selected features both from historical data and information of the target day. Compared to the LSTM-AM model and single MLP model, the mean absolute percentage error (MAPE) of the proposed model decreases from 2.82% and 2.65% to 2%, respectively. The results demonstrate that the MLP helps improve the prediction accuracy of seq2seq module and the proposed model achieves better performance than other popular models. In addition, this paper also reveals the reason why the MLP achieves the improvement. [ABSTRACT FROM AUTHOR]

In this paper, Computer Vision (CV) sensing technology based on Convolutional Neural Network (CNN) is introduced to process topographic maps for predicting wireless signal propagation models, which are applied in the field of forestry security monitoring. In this way, the terrain-related radio propagation characteristic including diffraction loss and shadow fading correlation distance can be predicted or extracted accurately and efficiently. Two data sets are generated for the two prediction tasks, respectively, and are used to train the CNN. To enhance the efficiency for the CNN to predict diffraction losses, multiple output values for different locations on the map are obtained in parallel by the CNN to greatly boost the calculation speed. The proposed scheme achieved a good performance in terms of prediction accuracy and efficiency. For the diffraction loss prediction task, 50% of the normalized prediction error was less than 0.518%, and 95% of the normalized prediction error was less than 8.238%. For the correlation distance extraction task, 50% of the normalized prediction error was less than 1.747%, and 95% of the normalized prediction error was less than 6.423%. Moreover, diffraction losses at 100 positions were predicted simultaneously in one run of CNN under the settings in this paper, for which the processing time of one map is about 6.28 ms, and the average processing time of one location point can be as low as 62.8 us. This paper shows that our proposed CV sensing technology is more efficient in processing geographic information in the target area. Combining a convolutional neural network to realize the close coupling of a prediction model and geographic information, it improves the efficiency and accuracy of prediction. [ABSTRACT FROM AUTHOR]

Soil nutrient prediction based on near-infrared spectroscopy has become the main research direction for rapid acquisition of soil information. The development of deep learning has greatly improved the prediction accuracy of traditional modeling methods. In view of the low efficiency and low accuracy of current soil prediction models, this paper proposes a soil multi-attribute intelligent prediction method based on convolutional neural networks, by constructing a dual-stream convolutional neural network model Multi_CNN that combines one-dimensional convolution and two-dimensional convolution, the intelligent prediction of soil multi-attribute is realized. The model extracts the characteristics of soil attributes from spectral sequences and spectrograms respectively, and multiple attributes can be predicted simultaneously by feature fusion. The model is based on two different-scale soil near-infrared spectroscopy data sets for multi-attribute prediction. The experimental results show that the R P 2 of the three attributes of Total Carbon, Total Nitrogen, and Alkaline Nitrogen on the small dataset are 0.94, 0.95, 0.87, respectively, and the R P 2 of the attributes of Organic Carbon, Nitrogen, and Clay on the LUCAS dataset are, respectively, 0.95, 0.91, 0.83, And compared with traditional regression models and new prediction methods commonly used in soil nutrient prediction, the multi-task model proposed in this paper is more accurate. [ABSTRACT FROM AUTHOR]

As artificial neural network architectures grow increasingly more efficient in time-series prediction tasks, their use for day-ahead electricity price and demand prediction, a task with very specific rules and highly volatile dataset values, grows more attractive. Without a standardized way to compare the efficiency of algorithms and methods for forecasting electricity metrics, it is hard to have a good sense of the strengths and weaknesses of each approach. In this paper, we create models in several neural network architectures for predicting the electricity price on the HUPX market and electricity load in Montenegro and compare them to multiple neural network models on the same basis (using the same dataset and metrics). The results show the promising efficiency of neural networks in general for the task of short-term prediction in the field, with methods combining fully connected layers and recurrent neural or temporal convolutional layers performing the best. The feature extraction power of convolutional layers shows very promising results and recommends the further exploration of temporal convolutional networks in the field. [ABSTRACT FROM AUTHOR]

In order to reduce maintenance costs and avoid safety accidents, it is of great significance to carry out fault prediction to reasonably arrange maintenance plans for rotating mechanical equipment. At present, the relevant research mainly focuses on fault diagnosis and remaining useful life (RUL) predictions, which cannot provide information on the specific health condition and fault types of rotating mechanical equipment in advance. In this paper, a novel three-stage fault prediction method is presented to realize the identification of the degradation period and the type of failure simultaneously. Firstly, based on the vibration signals from multiple sensors, a convolutional neural network (CNN) and long short-term memory (LSTM) network are combined to extract the spatiotemporal features of the degradation period and fault type by means of the cross-entropy loss function. Then, to predict the degradation trend and the type of failure, the attention-bidirectional (Bi)-LSTM network is used as the regression model to predict the future trend of features. Furthermore, the predicted features are given to the support vector classification (SVC) model to identify the specific degradation period and fault type, which can eventually realize a comprehensive fault prediction. Finally, the NSF I/UCR Center for Intelligent Maintenance Systems (IMS) dataset is used to verify the feasibility and efficiency of the proposed fault prediction method. [ABSTRACT FROM AUTHOR]

Satellite image time series (SITS) is a sequence of satellite images that record a given area at several consecutive times. The aim of such sequences is to use not only spatial information but also the temporal dimension of the data, which is used for multiple real-world applications, such as classification, segmentation, anomaly detection, and prediction. Several traditional machine learning algorithms have been developed and successfully applied to time series for predictions. However, these methods have limitations in some situations, thus deep learning (DL) techniques have been introduced to achieve the best performance. Reviews of machine learning and DL methods for time series prediction problems have been conducted in previous studies. However, to the best of our knowledge, none of these surveys have addressed the specific case of works using DL techniques and satellite images as datasets for predictions. Therefore, this paper concentrates on the DL applications for SITS prediction, giving an overview of the main elements used to design and evaluate the predictive models, namely the architectures, data, optimization functions, and evaluation metrics. The reviewed DL-based models are divided into three categories, namely recurrent neural network-based models, hybrid models, and feed-forward-based models (convolutional neural networks and multi-layer perceptron). The main characteristics of satellite images and the major existing applications in the field of SITS prediction are also presented in this article. These applications include weather forecasting, precipitation nowcasting, spatio-temporal analysis, and missing data reconstruction. Finally, current limitations and proposed workable solutions related to the use of DL for SITS prediction are also highlighted. [ABSTRACT FROM AUTHOR]

The accurate cycle time (CT) prediction of the wafer fabrication remains a tough task, as the system level of work in process (WIP) is fluctuant. Aiming to construct one unified CT forecasting model under dynamic WIP levels, this paper proposes a transfer learning method for finetuning the predicted neural network hierarchically. First, a two-dimensional (2D) convolutional neural network was constructed to predict the CT under a primary WIP level with the input of spatial-temporal characteristics by reorganizing the input parameters. Then, to predict the CT under another WIP level, a hierarchical optimization transfer learning strategy was designed to finetune the prediction model so as to improve the accuracy of the CT forecasting. The experimental results demonstrated that the hierarchically transfer learning approach outperforms the compared methods in the CT forecasting with the fluctuation of WIP levels. [ABSTRACT FROM AUTHOR]

Photovoltaic (PV) power forecasting urges in economic and secure operations of power systems. To avoid an inaccurate individual forecasting model, we propose an approach for a one-day to three-day ahead PV power hourly forecasting based on the stacking ensemble model with a recurrent neural network (RNN) as a meta-learner. The proposed approach is built by using real weather data and forecasted weather data in the training and testing stages, respectively. To accommodate uncertain weather, a daily clustering method based on statistical features, e.g., daily average, maximum, and standard deviation of PV power is applied in the data sets. Historical PV power output and weather data are used to train and test the model. The single learner considered in this research are artificial neural network, deep neural network, support vector regressions, long short-term memory, and convolutional neural network. Then, RNN is used to combine the forecasting results of each single learner. It is also important to observe the best combination of the single learners in this paper. Furthermore, to compare the performance of the proposed method, a random forest ensemble instead of RNN is used as a benchmark for comparison. Mean relative error (MRE) and mean absolute error (MAE) are used as criteria to validate the accuracy of different forecasting models. The MRE of the proposed RNN ensemble learner model is 4.29%, which has significant improvements by about 7–40%, 7–30%, and 8% compared to the single models, the combinations of fewer single learners, and the benchmark method, respectively. The results show that the proposed method is promising for use in real PV power forecasting systems. [ABSTRACT FROM AUTHOR]

This paper proposes a multimodal deep learning method for forecasting the daily power generation of small hydropower stations that considers the temporal and spatial distribution of precipitation, which compensates for the shortcomings of traditional forecasting methods that do not consider differences in the spatial distribution of precipitation. First, the actual precipitation values measured by ground weather stations and the spatial distribution of precipitation observed by meteorological satellite remote sensing are used to complete the missing precipitation data through linear interpolation, and the gridded precipitation data covering a group of small hydropower stations are constructed. Then, considering the time lag between changes in the daily power generation of the group of small hydropower stations and precipitation, the partial mutual information method is used to estimate the "time difference" between the two, and combined with the precipitation grid data, a data set of the temporal and spatial distribution of precipitation is generated. Finally, using only the temporal and spatial distribution of precipitation and historical power generation data, a multimodal deep learning network based on a convolutional neural network (CNN) and multilayer perceptron (MLP) is constructed, and a highly accurate prediction model for the daily power generation of small hydropower stations is obtained. Taking the real power generation data of a group of small hydropower stations in southern China as an example, after considering the temporal and spatial distribution of precipitation, the prediction accuracy of the proposed method is as high as 93%, which is approximately 5.8% higher than before considering the temporal and spatial distribution of precipitation. In addition, compared with mainstream methods such as support vector regression (SVR) and the long–short-term memory network (LSTM) (the average accuracy is about 87%), and the average accuracy improvement of the proposed method is approximately 6%. [ABSTRACT FROM AUTHOR]

With the development of online cars, the demand for travel prediction is increasing in order to reduce the information asymmetry between passengers and drivers of online car-hailing. This paper proposes a travel demand forecasting model named OC-CNN based on the convolutional neural network to forecast the travel demand. In order to make full use of the spatial characteristics of the travel demand distribution, this paper meshes the prediction area and creates a travel demand data set of the graphical structure to preserve its spatial properties. Taking advantage of the convolutional neural network in image feature extraction, the historical demand data of the first twenty-five minutes of the entire region are used as a model input to predict the travel demand for the next five minutes. In order to verify the performance of the proposed method, one-month data from online car-hailing of the Chengdu Fourth Ring Road are used. The results show that the model successfully extracts the spatiotemporal features of the data, and the prediction accuracies of the proposed method are superior to those of the representative methods, including the Bayesian Ridge Model, Linear Regression, Support Vector Regression, and Long Short-Term Memory networks. [ABSTRACT FROM AUTHOR]

It is important for equipment to operate safely and reliably so that the working state of mechanical parts pushes forward an immense influence. Therefore, in order to enhance the dependability and security of mechanical equipment, to accurately predict the changing trend of mechanical components in advance plays a significant role. This paper introduces a novel condition prediction method, named error fusion of hybrid neural networks (EFHNN), by combining the error fusion of multiple sparse auto-encoders with convolutional neural networks for predicting the mechanical condition. First, to improve prediction accuracy, we can use the error fusion of multiple sparse auto-encoders to collect multi-feature information, and obtain a trend curve representing machine condition as well as a threshold line that can indicate the beginning of mechanical failure by computing the square prediction error (SPE). Then, convolutional neural networks predict the state of the machine according to the original data when the SPE value exceeds the threshold line. It can be seen from this result that the EFHNN method in the prediction of mechanical fault time series is available and superior. [ABSTRACT FROM AUTHOR]

Wavelet transform is a well-known multi-resolution tool to analyze the time series in the time-frequency domain. Wavelet basis is diverse but predefined by manual without taking the data into the consideration. Hence, it is a great challenge to select an appropriate wavelet basis to separate the low and high frequency components for the task on the hand. Inspired by the lifting scheme in the second-generation wavelet, the updater and predictor are learned directly from the time series to separate the low and high frequency components of the time series. An adaptive multi-scale wavelet neural network (AMSW-NN) is proposed for time series classification in this paper. First, candidate frequency decompositions are obtained by a multi-scale convolutional neural network in conjunction with a depthwise convolutional neural network. Then, a selector is used to choose the optimal frequency decomposition from the candidates. At last, the optimal frequency decomposition is fed to a classification network to predict the label. A comprehensive experiment is performed on the UCR archive. The results demonstrate that, compared with the classical wavelet transform, AMSW-NN could improve the performance based on different classification networks. [ABSTRACT FROM AUTHOR]

The prediction of time series data applied to the energy sector (prediction of renewable energy production, forecasting prosumers' consumption/generation, forecast of country-level consumption, etc.) has numerous useful applications. Nevertheless, the complexity and non-linear behaviour associated with such kind of energy systems hinder the development of accurate algorithms. In such a context, this paper investigates the use of a state-of-art deep learning architecture in order to perform precise load demand forecasting 24-h-ahead in the whole country of France using RTE data. To this end, the authors propose an encoder-decoder architecture inspired by WaveNet, a deep generative model initially designed by Google DeepMind for raw audio waveforms. WaveNet uses dilated causal convolutions and skip-connection to utilise long-term information. This kind of novel ML architecture presents different advantages regarding other statistical algorithms. On the one hand, the proposed deep learning model's training process can be parallelized in GPUs, which is an advantage in terms of training times compared to recurrent networks. On the other hand, the model prevents degradations problems (explosions and vanishing gradients) due to the residual connections. In addition, this model can learn from an input sequence to produce a forecast sequence in a one-shot manner. For comparison purposes, a comparative analysis between the most performing state-of-art deep learning models and traditional statistical approaches is presented: Autoregressive-Integrated Moving Average (ARIMA), Long-Short-Term-Memory, Gated-Recurrent-Unit (GRU), Multi-Layer Perceptron (MLP), causal 1D-Convolutional Neural Networks (1D-CNN) and ConvLSTM (Encoder-Decoder). The values of the evaluation indicators reveal that WaveNet exhibits superior performance in both forecasting accuracy and robustness. [ABSTRACT FROM AUTHOR]

Wind speed prediction with spatio–temporal correlation is among the most challenging tasks in wind speed prediction. In this paper, the problem of predicting wind speed for multiple sites simultaneously is investigated by using spatio–temporal correlation. This paper proposes a model for wind speed prediction with spatio–temporal correlation, i.e., the predictive deep convolutional neural network (PDCNN). The model is a unified framework, integrating convolutional neural networks (CNNs) and a multi-layer perceptron (MLP). Firstly, the spatial features are extracted by CNNs located at the bottom of the model. Then, the temporal dependencies among these extracted spatial features are captured by the MLP. In this way, the spatial and temporal correlations are captured by PDCNN intrinsically. Finally, PDCNN generates the predicted wind speed by using the learnt spatio–temporal correlations. In addition, three error indices are defined to evaluate the prediction accuracy of the model on the wind turbine array. Experiment results on real-world data show that PDCNN can capture the spatio–temporal correlation effectively, and it outperforms the conventional machine learning models, including multi-layer perceptron, support vector regressor, decision tree, etc. [ABSTRACT FROM AUTHOR]

In recent years, prognostic and health management (PHM) has played an important role in industrial engineering. Efficient remaining useful life (RUL) prediction can ensure the development of maintenance strategies and reduce industrial losses. Recently, data-driven based deep learning RUL prediction methods have attracted more attention. The convolution neural network (CNN) is a kind of deep neural network widely used in RUL prediction. It shows great potential for application in RUL prediction. A CNN is used to extract the features of time-series data according to the spatial feature method. This way of processing features without considering the time dimension will affect the prediction accuracy of the model. On the contrary, the commonly used long short-term memory (LSTM) network considers the timing of the data. However, compared with CNN, it lacks spatial data extraction capabilities. This paper proposes a double-channel hybrid prediction model based on the CNN and a bidirectional LSTM network to avoid those drawbacks. The sliding time window is used for data preprocessing, and an improved piece-wise linear function is used for model validating. The prediction model is evaluated using the C-MAPSS dataset provided by NASA. The predicted results show the proposed prediction model to have a better prediction performance compared with other state-of-the-art models. [ABSTRACT FROM AUTHOR]

Air pollution is becoming a rising and serious environmental problem, especially in urban areas affected by an increasing migration rate. The large availability of sensor data enables the adoption of analytical tools to provide decision support capabilities. Employing sensors facilitates air pollution monitoring, but the lack of predictive capability limits such systems' potential in practical scenarios. On the other hand, forecasting methods offer the opportunity to predict the future pollution in specific areas, potentially suggesting useful preventive measures. To date, many works tackled the problem of air pollution forecasting, most of which are based on sequence models. These models are trained with raw pollution data and are subsequently utilized to make predictions. This paper proposes a novel approach evaluating four different architectures that utilize camera images to estimate the air pollution in those areas. These images are further enhanced with weather data to boost the classification accuracy. The proposed approach exploits generative adversarial networks combined with data augmentation techniques to mitigate the class imbalance problem. The experiments show that the proposed method achieves robust accuracy of up to 0.88, which is comparable to sequence models and conventional models that utilize air pollution data. This is a remarkable result considering that the historic air pollution data is directly related to the output—future air pollution data, whereas the proposed architecture uses camera images to recognize the air pollution—which is an inherently much more difficult problem. [ABSTRACT FROM AUTHOR]

With the development of wireless networks and mobile devices, interest on indoor localization systems (ILSs) has increased. In particular, Wi-Fi-based ILSs are widely used because of the good prediction accuracy without additional hardware. However, as the prediction accuracy decreases in environments with natural noise, some studies were conducted to remove it. So far, two representative methods, i.e., the filtering-based method and deep learning-based method, have shown a significant effect in removing natural noise. However, the prediction accuracy of these methods severely decreased under artificial noise caused by adversaries. In this paper, we introduce a new media access control (MAC) spoofing attack scenario injecting artificial noise, where the prediction accuracy of Wi-Fi-based indoor localization system significantly decreases. We also propose a new deep learning-based indoor localization method using random forest(RF)-filter to provide the good prediction accuracy under the new MAC spoofing attack scenario. From the experimental results, we show that the proposed indoor localization method provides much higher prediction accuracy than the previous methods in environments with artificial noise. [ABSTRACT FROM AUTHOR]

The forthcoming fifth-generation networks require improvements in cognitive radio intelligence, going towards more smart and aware radio systems. In the emerging radio intelligence approach, the empowerment of cognitive capabilities is performed through the adoption of machine learning techniques. This paper investigates the combined application of the convolutional and recurrent neural networks for the channel state information forecasting, providing a multivariate scalar time series prediction by taking into account the multiple factors dependence of the channel state conditions. Finally, the system performance has been analyzed in terms of prediction accuracy expressed as absolute deviation error and mean percentage error, in comparison with an alternative machine learning method recently proposed in the literature with the aim at solving the same prediction problem. [ABSTRACT FROM AUTHOR]

Early detection of faults in rotating machinery systems is crucial in preventing system failure, increasing safety, and reducing maintenance costs. Current methods of fault detection suffer from the lack of efficient feature extraction method, the need for designating a threshold producing minimal false alarm rates, and the need for expert domain knowledge, which is costly. In this paper, we propose a novel data-driven health division method based on convolutional neural networks using a graphical representation of time series data, called a nested scatter plot. The proposed method trains the model with a small amount of labeled data and does not require a threshold value to predict the health state of rotary machines. Notwithstanding the lack of datasets that show the ground truth of health stages, our experiments with two open datasets of run-to-failure bearing demonstrated that our method is able to detect the early symptoms of bearing wear earlier and more efficiently than other threshold-based health indicator methods. [ABSTRACT FROM AUTHOR]

This paper proposes an effective deep learning framework for Short-Term Load Forecasting (STLF) of multivariate time series. The proposed model consists of a hybrid Convolutional neural network-Bidirectional Long Short-Term Memory (CBiLSTM) based on the Evolution Strategy (ES) method and the Savitzky–Golay (SG) filter (SG-CBiLSTM). The adopted methodology incorporates the virtue of different prepossessing blocks to enhance the performance of the CBiLSTM model. In particular, a data-augmentation strategy is employed to synthetically improve the feature representation of the CBiLSTM model. The augmented data is forwarded to the Partial Least Square (PLS) method to select the most informative features above the predefined threshold. Next, the SG algorithm is computed for smoothing the load to enhance the learning capabilities of the underlying system. The structure of the SG-CBiLSTM for the ISO New England dataset is optimized using the ES technique. Finally, the CBiLSTM model generates output forecasts. The proposed approach demonstrates a remarkable improvement in the performance of the original CBiLSTM model. Furthermore, the experimental results strongly confirm the high effectiveness of the proposed SG-CBiLSTM model compared to the state-of-the-art techniques. [ABSTRACT FROM AUTHOR]

Rainfall prediction is an important task due to the dependence of many people on it, especially in the agriculture sector. Prediction is difficult and even more complex due to the dynamic nature of rainfalls. In this study, we carry out monthly rainfall prediction over Simtokha a region in the capital of Bhutan, Thimphu. The rainfall data were obtained from the National Center of Hydrology and Meteorology Department (NCHM) of Bhutan. We study the predictive capability with Linear Regression, Multi-Layer Perceptron (MLP), Convolutional Neural Network (CNN), Long Short Term Memory (LSTM), Gated Recurrent Unit (GRU), and Bidirectional Long Short Term Memory (BLSTM) based on the parameters recorded by the automatic weather station in the region. Furthermore, this paper proposes a BLSTM-GRU based model which outperforms the existing machine and deep learning models. From the six different existing models under study, LSTM recorded the best Mean Square Error (MSE) score of 0.0128. The proposed BLSTM-GRU model outperformed LSTM by 41.1% with a MSE score of 0.0075. Experimental results are encouraging and suggest that the proposed model can achieve lower MSE in rainfall prediction systems. [ABSTRACT FROM AUTHOR]