Search

De-mining operations are of critical importance for humanitarian efforts and safety in conflict-affected regions. In this paper, we address the challenge of enhancing the accuracy and efficiency of mine detection systems. We present an innovative Deep Learning architecture tailored for pulse induction-based Metallic Mine Detectors (MMD), so called DL-MMD. Our methodology leverages deep neural networks to distinguish amongst nine distinct materials with an exceptional validation accuracy of 93.5%. This high level of precision enables us not only to differentiate between anti-personnel mines, without metal plates but also to detect minuscule 0.2-g vertical paper pins in both mineralized soil and non-mineralized environments. Moreover, through comparative analysis, we demonstrate a substantial 3% and 7% improvement (approx.) in accuracy performance compared to the traditional K-Nearest Neighbors and Support Vector Machine classifiers, respectively. The fusion of deep neural networks with the pulse induction-based MMD not only presents a cost-effective solution but also significantly expedites decision-making processes in de-mining operations, ultimately contributing to improved safety and effectiveness in these critical endeavors. [ABSTRACT FROM AUTHOR]

This paper explores the application of multi-objective optimization techniques, including MOPSO, NSGA II, and SPEA2, to optimize the hyperparameters of artificial neural networks (ANNs) and support vector machines (SVMs) for predicting the physical properties of textile polymer composite materials (TPCMs). The optimization process utilizes data on the physical characteristics of the constituent fibers and fabrics used to manufacture these composites. By employing optimization algorithms, we aim to enhance the predictive accuracy of the ANN and SVM models, thereby facilitating the design and development of high-performance textile polymer composites. The effectiveness of the proposed approach is demonstrated through comparative analyses and validation experiments, highlighting its potential for optimizing complex material systems. [ABSTRACT FROM AUTHOR]

This research paper aims to ensure the reliable and efficient operation of grid-connected solid-state transformers (SSTs) by detecting and evaluating various undesirable operating conditions. The study considers different types of faults, including internal faults like open switches and open capacitors, external faults such as symmetrical and asymmetrical faults occurring at various locations of the SST, and abnormalities on the grid side known as sympathetic inrush conditions. To analyze these operating conditions, the secondary current of the high-frequency transformer is normalized and decomposed using the discrete wavelet transform (DWT) and wavelet packet transform (WPT). From the DWT and WPT decomposition at multiple levels, several statistical parameters are calculated. These statistical parameters are carefully selected from different decomposition levels to enhance the effectiveness of the detection algorithm utilizing DWT and WPT. In order to quickly identify and classify all operating conditions that impact the performance of the grid-connected SST, a three-layer feedforward artificial neural network (ANN) is employed, using the selected statistical features. The accuracy and efficiency of the ANN-based classification approach are evaluated by assessing the effectiveness of the statistical features obtained from DWT and WPT. Simulation results have been altered by introducing various noise levels to systematically assess the performance of the proposed algorithms. The average accuracy of the DWT-ANN algorithm stands at 97.89%, while the WPT-ANN algorithm achieves a slightly elevated accuracy level of 98.01%. This notable similarity in accuracy curtails from the careful selection of the wavelet function, decomposition level, and feature sets. [ABSTRACT FROM AUTHOR]

This paper presents the results of a study on data preprocessing and modeling for predicting corrosion in water pipelines of a steel industrial plant. The use case is a cooling circuit consisting of both direct and indirect cooling. In the direct cooling circuit, water comes into direct contact with the product, whereas in the indirect one, it does not. In this study, advanced machine learning techniques, such as extreme gradient boosting and deep neural networks, have been employed for two distinct applications. Firstly, a virtual sensor was created to estimate the corrosion rate based on influencing process variables, such as pH and temperature. Secondly, a predictive tool was designed to foresee the future evolution of the corrosion rate, considering past values of both influencing variables and the corrosion rate. The results show that the most suitable algorithm for the virtual sensor approach is the dense neural network, with MAPE values of (25 ± 4)% and (11 ± 4)% for the direct and indirect circuits, respectively. In contrast, different results are obtained for the two circuits when following the predictive tool approach. For the primary circuit, the convolutional neural network yields the best results, with MAPE = 4% on the testing set, whereas for the secondary circuit, the LSTM recurrent network shows the highest prediction accuracy, with MAPE = 9%. In general, models employing temporal windows have emerged as more suitable for corrosion prediction, with model performance significantly improving with a larger dataset. [ABSTRACT FROM AUTHOR]

Demand response management (DRM) plays a crucial role in the prospective development of smart grids. The precise estimation of electricity demand for individual houses is vital for optimizing the operation and planning of the power system. Accurate forecasting of the required components holds significance as it can substantially impact the final cost, mitigate risks, and support informed decision-making. In this paper, a forecasting approach employing neural networks for smart grid demand-side management is proposed. The study explores various enhanced artificial neural network (ANN) architectures for forecasting smart grid consumption. The performance of the ANN approach in predicting energy demands is evaluated through a comparison with three statistical models: a time series model, an auto-regressive model, and a hybrid model. Experimental results demonstrate the ability of the proposed neural network framework to deliver accurate and reliable energy demand forecasts. [ABSTRACT FROM AUTHOR]

Nowadays, trajectory control is a significant issue for unmanned micro aerial vehicles (MAVs) due to large disturbances such as wind and storms. Trajectory control is typically implemented using a proportional–integral–derivative (PID) controller. In order to achieve high accuracy in trajectory tracking, it is essential to set the PID gain parameters to optimum values. For this reason, separate gain values are set for roll, pitch and yaw movements before autonomous flight in quadrotor systems. Traditionally, this adjustment is performed manually or automatically in autotune mode. Given the constraints of narrow orchard corridors, the use of manual or autotune mode is neither practical nor effective, as the quadrotor system has to fly in narrow apple orchard corridors covered with hail nets. These reasons require the development of an innovative solution specific to quadrotor vehicles designed for constrained areas such as apple orchards. This paper recognizes the need for effective trajectory control in quadrotors and proposes a novel neural network-based approach to tuning the optimal PID control parameters. This new approach not only improves trajectory control efficiency but also addresses the unique challenges posed by environments with constrained locational characteristics. Flight simulations using the proposed neural network models have demonstrated successful trajectory tracking performance and highlighted the superiority of the feed-forward back propagation network (FFBPN), especially in latitude tracking within 7.52745 × 10−5 RMSE trajectory error. Simulation results support the high performance of the proposed approach for the development of automatic flight capabilities in challenging environments. [ABSTRACT FROM AUTHOR]

Operational load monitoring (OLM) is an industrial process related to structural health monitoring, where fatigue of the structure is tracked. Artificial intelligence methods, such as artificial neural networks (ANNs) or Gaussian processes, are utilized to improve efficiency of such processes. This paper focuses on moving such processes towards green computing by deploying and executing the algorithm on low-power consumption FPGA where high-throughput and truly parallel computations can be performed. In the following paper, the OLM process of typical aerostructure (hat-stiffened composite panel) is performed using ANN. The ANN was trained using numerically generated data, of every possible load case, to be working with sensor measurements as inputs. The trained ANN was deployed to Xilinx Artix-7 A100T FPGA of a real-time microcontroller. By executing the ANN on FPGA (where every neuron of a given layer can be processed at the same time, without limiting the number of parallel threads), computation time could be reduced by 70% as compared to standard CPU execution. Series of real-time experiments were performed that have proven the efficiency and high accuracy of the developed FPGA-based algorithm. Adjusting the ANN algorithm to FPGA requirements takes some effort, however it can lead to high performance increase. FPGA has the advantages of many more potential parallel threads than a standard CPU and much lower consumption than a GPU. This is particularly important taking into account potential embedded and remote applications, such as widely performed monitoring of airplane structures. [ABSTRACT FROM AUTHOR]

During the development of the nervous system, neuronal cells extend axons and dendrites that form complex neuronal networks, which are essential for transmitting and processing information. Understanding the physical processes that underlie the formation of neuronal networks is essential for gaining a deeper insight into higher-order brain functions such as sensory processing, learning, and memory. In the process of creating networks, axons travel towards other recipient neurons, directed by a combination of internal and external cues that include genetic instructions, biochemical signals, as well as external mechanical and geometrical stimuli. Although there have been significant recent advances, the basic principles governing axonal growth, collective dynamics, and the development of neuronal networks remain poorly understood. In this paper, we present a detailed analysis of nonlinear dynamics for axonal growth on surfaces with periodic geometrical patterns. We show that axonal growth on these surfaces is described by nonlinear Langevin equations with speed-dependent deterministic terms and gaussian stochastic noise. This theoretical model yields a comprehensive description of axonal growth at both intermediate and long time scales (tens of hours after cell plating), and predicts key dynamical parameters, such as speed and angular correlation functions, axonal mean squared lengths, and diffusion (cell motility) coefficients. We use this model to perform simulations of axonal trajectories on the growth surfaces, in turn demonstrating very good agreement between simulated growth and the experimental results. These results provide important insights into the current understanding of the dynamical behavior of neurons, the self-wiring of the nervous system, as well as for designing innovative biomimetic neural network models. [ABSTRACT FROM AUTHOR]

Natural streamflow data is required in many hydrological applications. However, many basins are located in data-scarce regions or are impacted by human construction and activities. In this paper, we explore three machine learning algorithms, namely artificial neural networks, random forest and light gradient boosting machine, to simultaneously estimate all the parameters of the coupled modèle du Génie Rural à 4 paramètres Journaliers (GR4J) and snow accounting routine called CemaNeige model. A database of 675 basins in the USA and Quebec is used to train and test ensembles. After using the estimated parameters in GR4J, the resulting naturalized streamflow series are compared with those obtained by the established drainage area ratio and spatial proximity transfer methods in 11 test basins. The results indicate that the machine learning algorithms outperform the drainage area ratio and spatial proximity transfer methods. Among machine learning algorithms, random forests obtain lower (better) continuous ranked probability scores than the other methods for 10 out of 11 test basins. [ABSTRACT FROM AUTHOR]

In this paper we present a novel methodology, referenced as ORFEO (Ordinal classifier and Regressor Fusion for Estimating an Ordinal categorical target), to enhance the performance in ordinal classification problems for which the latent variable is observable. ORFEO is an artificial neural network model incorporating two outputs, one for ordinal classification, using the cumulative link model, and one for regression, using a linear model. Both outputs are simultaneously optimised considering a loss function that linearly combines both classification and regression losses. The main motivation behind developing the proposed approach is to enhance the performance of a standard ordinal classifier. This improvement is facilitated by considering the regression output, which allows the model to differentiate between patterns within the same category. The ORFEO model is applied to two problems in the field of marine and ocean engineering: short-term prediction of both significant wave height and flux of energy. Both problems are addressed considering four different coastal zones of the United States of America, using 13 datasets formed by buoys measurements and reanalysis data. A comprehensive comparison against 20 methodologies, including regression and nominal/ordinal classification approaches is performed, by using diverse nominal and ordinal performance metrics. Ranks achieved indicate that ORFEO outperforms all the compared methodologies in terms of all the performance measures, demonstrating the efficacy and robustness of the proposal. Finally, a statistical analysis is conducted, concluding that there are statistically significant differences across ordinal and nominal performance metrics in favour of the proposed ORFEO model. [ABSTRACT FROM AUTHOR]

In the realm of aircraft design, there is a prevalent need for surrogate modeling techniques capable of efficiently and accurately modeling objects with high evaluation costs and uneven sensitivity distributions, such as those encountered in the nonlinear buckling of thin-walled structures and aerodynamics at transonic speeds. However, the non-stationary Gaussian Process Regression (GPR) model requires extensive hyperparameters or judicious assumptions, limiting its applications in such tasks, and the commonly used K-Fold methodology suffers from inherent instability. Addressing these issues, this paper proposes an active learning method for surrogate modeling in systems featuring uneven sensitivity distribution, integrating non-stationary-noise GPR and K-Fold Artificial Neural Network (ANN) methodology, namely NSN-GPR-KF. Instead of relying on a non-stationary kernel function, the algorithm regards noise as a non-stationary factor within a stationary GPR framework, with noise levels estimated via the K-Fold ANN methodology, allowing GPR to efficiently adapt to non-stationary systems while avoiding the aforementioned requirements for non-stationary GPR. Case validations, performed on two test functions with pronounced uneven spatial sensitivity, demonstrate that NSN-GPR-KF outperforms commonly used stationary GPR and pure K-Fold methodology. It synthesizes the exploration capabilities of GPR with the exploitation proficiency of the K-Fold methodology, achieving comparable global accuracy with reduced sample sizes—up to 26 % and 22 % less than the other two algorithms, respectively. The algorithm was successfully applied to predict the buckling load of thin-walled pipe beams, demonstrating accelerated convergence and approximately 25 % greater accuracy compared to pure K-Fold model. These results suggest that NSN-GPR-KF can serve as an efficient and precise modeling tool for engineering tasks with high evaluation costs and complex sensitivity distributions. [ABSTRACT FROM AUTHOR]

Accurate forecasting of regional solar photovoltaic power (SPVP) generation is essential for efficient energy management and planning. Existing approaches have shown the effectiveness of decomposing the time series to model the stochastic variability in SPVP data. However, these approaches have limitations in extracting and exploiting both spatial and temporal information from complex and high-dimensional data from multiple sources with intricate relationships, which can impact the accuracy of predictions. In this paper, we propose a novel approach called multilevel data fusion and neural basis expansion analysis (MF-NBEA) for forecasting aggregated regional-level SPVP generation. MF-NBEA integrates exogenous data at multiple levels, uses supervised and unsupervised encoders to provide compact data representation, and enhances model learning from complex data by incorporating spatial information. It also includes a sequence analyser module based on a neural network decomposition mechanism to learn the variability in data and incorporates a residuals learner module to improve overall predictions. We evaluate MF-NBEA using two real-world datasets and find that it outperforms state-of-the-art deep learning methods in terms of forecast accuracy. Furthermore, MF-NBEA facilitates information fusion and knowledge extraction to provide interpretable predictions regarding trend, seasonality, and residual components. The insights gained from our approach inform decision-making for energy management and planning, and can lead to more efficient and sustainable resource utilisation. • MF-NBEA for multivariate solar power time series forecasting. • A 3D autoencoder encodes spatial and temporal information from heterogeneous sources. • Interpretable forecasting in terms of trend, seasonality, and residuals. [ABSTRACT FROM AUTHOR]

The burner combustion tuning is a complex problem that has been studied through flame monitoring and characterization. It has been observed that the flame electromagnetic spectrum and flickering contain specific flame information in combustion processes. This information is helpful for combustion stoichiometry tuning on burners. This paper described a method for selecting the best flame feature subset that can be computed from the scanner signal, in order to get the flame index and induce combustion stoichiometry on burners under specific combustion conditions. We propose a method for selecting a reduced subset with only the useful flame features for flame index classification. To extract the most relevant flame features we use a feature subset selection (FSS) algorithm and to determine the combustion state in burners, five flame indices were defined that represent the most common flame states in oil fuel-fired boilers. FSS includes complete, sequential, and random searches in order to eliminate redundant and noisy flame features to decrease the flame feature set dimension. A probabilistic neural network (PNN) algorithm was implemented for flame feature clustering. Signals from the actual flame scanner system and relevant variables from the boiler data acquisition system were used by the algorithms to calculate the burner flame index. A set of parametric tests was done in a heavy oil-fired boiler under well-known flame and index conditions to train and test the flame classifier. The results showed that only the four more relevant features are enough to classify flames with a good performance (92.3% accuracy), which is useful for burner combustion monitoring and optimization. • A new approach to defining/selecting critical features in the combustion process. • A new approach to classifying flames in industrial heavy oil-fired boilers. • The proposed algorithms are tested & evaluated in a real industrial process. • The overall methodology ensures that the combustion process guarantees safety. [ABSTRACT FROM AUTHOR]

As the "respiratory tract" of the air breathing engine, the hypersonic inlet plays the role of compressing, decelerating, and pressurizing flow. However, research on the traditional inlet design is mainly based on gas dynamics theory and experience, which not only leads to a long design period but also fails to ensure the performance of the inlet at non-design points under broad working conditions. In recent years, with the further development of flow physics, a variety of advanced inlet design methods have been proposed, and a large number of valuable data have been accumulated by applying high-fidelity computational fluid dynamics numerical simulation and ground wind tunnel tests. A new generation of machine learning technologies, typically represented by deep learning, is developing vigorously. By building a deep neural network structure and using data-driven methods to carry out model training, it can realize typical feature extraction automatically, efficiently, and accurately, which is helpful to deeply explore the hidden flow mechanism between data and establish a fast prediction model of inlet performance. The optimal inlet design scheme can be obtained by applying the performance intelligent prediction model and the multi-objective intelligent evolution algorithm. This paper provides a detailed overview of the latest progress in inlet design by applying traditional ideas, expounds the basic principles and typical applications of some representative and prospective machine learning methods, and especially reports the current research status of the combination of machine learning and inlet. Finally, the future development trends and potential applications of several research directions are summarized. [ABSTRACT FROM AUTHOR]

Activation functions play an important role in deep learning models by introducing non-linearity to the output of a neuron, enabling the network to learn complex patterns and non-linear relationships in data and make predictions on more complex tasks. Deep learning models' most commonly used activation functions are Purelin, Sigmoid, Tansig, Rectified Linear Unit (ReLU), and Exponential Linear Unit (ELU), which exhibit limitations such as non-differentiability, vanishing gradients, and neuron inactivity with negative values. These functions are typically defined over a finite range, and their outputs are integers or real numbers. Using fractional calculus in designing activation functions for neural networks has shown promise in improving the performance of deep learning models in specific applications. These activation functions can capture more complex non-linearities than traditional integer-order activation functions, improving performance on tasks such as image classification and time series prediction. This paper focuses on deriving and testing linear and non-linear fractional-order forms of activation functions and their variants. The linear activation function includes Purelin. In contrast, the non-linear activation functions are Binary Step, Sigmoid, Tansig, ReLU, ELU, Gaussian Error Linear Unit (GELU), Hexpo, and their variants. Besides, the standard formula has been implemented and used in developing the fractional-order linear activation function. Furthermore, various expansion series, such as Euler and Maclaurin, have been used to design non-linear fractional-order activation functions and their variants. The single- and multi-layer fractional-order neural network models have been developed using the designed fractional-order activation functions. The simulation study uses developed fractional-order neural network models for predicting the Texas wind turbine systems' generated power. The performance of single and multi-layer fractional-order neural network models has been evaluated by changing the activation functions in the hidden layer while keeping the Purelin function constant at the output layer. Experiments on neural network models demonstrate that the designed fractional-order activation functions outperform traditional functions like Sigmoid, Tansig, ReLU, ELU, and their variants, effectively addressing limitations. • Activation functions are derived into fractional functions using fractional calculus. • The fractional neural network models have been made by adopting derived functions. • A Case study has been done on the Texas wind turbine with the models to predict the power. • The models' performance has been evaluated using the fractional functions. [ABSTRACT FROM AUTHOR]