Search

Convolutional Neural Networks (CNNs) are a kind of artificial neural network designed to extract features and find out patterns for tasks such as segmentation, recognizing objects, and drawing up classification. Within a CNNs architecture, pooling operations are used until the number of parameters and the computational complexity are reduced. Numerous papers have focused on investigating the impact of pooling on the performance of Convolutional Neural Networks (CNNs), leading to the development of various pooling models. Recently, a fuzzy pooling operation based on type-1 fuzzy sets was introduced to cope with the local imprecision of the feature maps. However, in fuzzy set theory, it is not always accurate to assume that the degree of non-membership of an element in a fuzzy set is simply the complement of the degree of membership. This is due to the potential existence of a hesitation degree, which implies a certain level of uncertainty. To overcome this limitation, intuitionistic fuzzy sets (IFS) were introduced to incorporate the concept of a degree of hesitation. In this paper, we introduce a novel pooling operation based on intuitionistic fuzzy sets to incorporate the degree of hesitation heretofore neglected by a fuzzy pooling operation based on classical fuzzy sets, and we investigate its performance in the context of image classification. Intuitionistic pooling is performed in four steps: bifuzzification (by the transformation of data through the use of membership and non-membership maps), first aggregation (through the transformation of the IFS into a standard fuzzy set, second aggregation (through the transformation and use of a sum operator), and the defuzzification of feature map neighborhoods by using a max operator. IFS pooling is used for the construction of an intuitionistic pooling layer that can be applied as a drop-in replacement for the current, fuzzy (type-1) and crisp, pooling layers of CNN architectures. Various experiments involving multiple datasets demonstrate that an IFS-based pooling can enhance the classification performance of a CNN. A benchmarking study reveals that this significantly outperforms even the most recent pooling models, especially in stochastic environments. [ABSTRACT FROM AUTHOR]

Deep learning, a crucial technique for achieving artificial intelligence (AI), has been successfully applied in many fields. The gradual application of the latest architectures of deep learning in the field of time series forecasting (TSF), such as Transformers, has shown excellent performance and results compared to traditional statistical methods. These applications are widely present in academia and in our daily lives, covering many areas including forecasting electricity consumption in power systems, meteorological rainfall, traffic flow, quantitative trading, risk control in finance, sales operations and price predictions for commercial companies, and pandemic prediction in the medical field. Deep learning-based TSF tasks stand out as one of the most valuable AI scenarios for research, playing an important role in explaining complex real-world phenomena. However, deep learning models still face challenges: they need to deal with the challenge of large-scale data in the information age, achieve longer forecasting ranges, reduce excessively high computational complexity, etc. Therefore, novel methods and more effective solutions are essential. In this paper, we review the latest developments in deep learning for TSF. We begin by introducing the recent development trends in the field of TSF and then propose a new taxonomy from the perspective of deep neural network models, comprehensively covering articles published over the past five years. We also organize commonly used experimental evaluation metrics and datasets. Finally, we point out current issues with the existing solutions and suggest promising future directions in the field of deep learning combined with TSF. This paper is the most comprehensive review related to TSF in recent years and will provide a detailed index for researchers in this field and those who are just starting out. [ABSTRACT FROM AUTHOR]

Pattern recognition systems always misclassify anomalies, which can be dangerous for uninformed users. Therefore, anomalies must be filtered out from each classification. The main challenge for the anomaly filter design is the huge number of possible anomaly samples compared with the number of samples in the training set. Tailoring the filter for the given classifier is just the first step in this reduction. Paper tests the hypothesis that the filter trained in avoiding "near" anomalies will also refuse the "far" anomalies, and the anomaly detector is then just a classifier distinguishing between "far real" and "near anomaly" samples. As a "far real" samples generator was used, a Generative Adversarial Network (GAN) fake generator that transforms normally distributed random seeds into fakes similar to the training samples. The paper proves the assumption that seeds unused in fake training will generate anomalies. These seeds are distinguished according to their Chebyshev norms. While the fakes have seeds within the hypersphere with a given radius, the near anomalies have seeds within the sphere near cover. Experiments with various anomaly test sets have shown that GAN-based anomaly detectors create a reliable anti-anomaly shield using the abovementioned assumptions. The proposed anomaly detector is tailored to the given classifier, but its limitation is due to the need for the availability of the database on which the classifier was trained. [ABSTRACT FROM AUTHOR]

Recent research has revealed that subtle imperceptible perturbations can deceive well-trained neural network models, leading to inaccurate outcomes. These instances, known as adversarial examples, pose significant threats to the secure application of machine learning techniques in safety-critical systems. In this paper, we delve into the study of one-pixel attacks in deep neural networks, recently reported as a kind of adversarial examples. To identify such one-pixel attacks, most existing methodologies rely on the differential evolution method, which utilizes random selection from the current population to escape local optima. However, the differential evolution technique might waste search time and overlook good solutions if the number of iterations is insufficient. Hence, in this paper, we propose a gradient ascent with momentum approach to efficiently discover good solutions for the one-pixel attack problem. As our method takes a more direct route to the goal compared to existing methods relying on blind random walks, it can effectively identify one-pixel attacks. Our experiments conducted on popular CNNs demonstrate that, in comparison with existing methodologies, our technique can detect one-pixel attacks significantly faster. [ABSTRACT FROM AUTHOR]

This correction notice provides updates and corrections to a research paper on deep machine learning model-based cyber-attacks detection in smart power systems. The paper proposes a deep learning-based attack detection model that addresses system disturbances caused by natural events and cyber-attacks. It discusses the use of principal component analysis (PCA) for feature selection and the potential of deep learning-based and decision tree classifiers for detecting cyber-attacks in intelligent energy grids. The notice also includes updates to references, clarifications on the experimental data set, and feature selection based on PCA. The study evaluates the effectiveness of the proposed model using various assessment indexes and compares it to conventional methods, concluding that the proposed model is effective in detecting cyber-attacks and demonstrates good performance in detecting destructive attacks. [Extracted from the article]

This paper studies an artificial neural network (ANN) for multi-asset European options. Firstly, a simple three-layer ANN-3 is established with undetermined weights and bias. Secondly, the time–space discrete PDE of the multi-asset option is given and the corresponding discrete data are fed into the ANN-3. Then, using least squares error as the objective function, the weights and bias of ANN-3 are trained well. Numerical examples are carried out to confirm the stability, accuracy and efficiency. Experiments show the ANN's relative error is about  0.8 % . This method can be extended into multi-layer ANN- q (q > 3)  and extended into American options. [ABSTRACT FROM AUTHOR]

With the rapid development of sensor technology, the anomaly detection of multi-source time series data becomes more and more important. Traditional anomaly detection methods deal with the temporal and spatial information in the data independently, and fail to make full use of the potential of spatio-temporal information. To address this issue, this paper proposes a novel integration method that combines sensor embeddings and temporal representation networks, effectively exploiting spatio-temporal dynamics. In addition, the graph neural network is introduced to skillfully simulate the complexity of multi-source heterogeneous data. By applying a dual loss function—consisting of a reconstruction loss and a prediction loss—we further improve the accuracy of anomaly detection. This strategy not only promotes the ability to learn normal behavior patterns from historical data, but also significantly improves the predictive ability of the model, making anomaly detection more accurate. Experimental results on four multi-source sensor datasets show that our proposed method performs better than the existing models. In addition, our approach enhances the ability to interpret anomaly detection by analyzing the sensors associated with the detected anomalies. [ABSTRACT FROM AUTHOR]

Wireless traffic prediction is essential to developing intelligent communication networks that facilitate efficient resource allocation. Along this line, decentralized wireless traffic prediction under the paradigm of federated learning is becoming increasingly significant. Compared to traditional centralized learning, federated learning satisfies network operators' requirements for sensitive data protection and reduces the consumption of network resources. In this paper, we propose a novel communication-efficient federated learning framework, named FedCE, by developing a gradient compression scheme and an adaptive aggregation strategy for wireless traffic prediction. FedCE achieves gradient compression through top-K sparsification and can largely relieve the communication burdens between local clients and the central server, making it communication-efficient. An adaptive aggregation strategy is designed by quantifying the different contributions of local models to the global model, making FedCE aware of spatial dependencies among various local clients. We validate the effectiveness of FedCE on two real-world datasets. The results demonstrate that FedCE can improve prediction accuracy by approximately 27% with only 20% of communications in the baseline method. [ABSTRACT FROM AUTHOR]

Addressing real-time optimization problems becomes increasingly challenging as their complexity continues to escalate over time. So bio-optimization algorithms (BoAs) come into the picture to solve such problems due to their global search capability, adaptability, versatility, parallelism, and robustness. This article aims to perform hyperparameter tuning of machine learning (ML) models by integrating them with BoAs. Aiming to maximize the accuracy of the hybrid bio-optimized defect prediction (HBoDP) model, this research paper develops four novel hybrid BoAs named the gravitational force Lévy flight grasshopper optimization algorithm (GFLFGOA), the gravitational force Lévy flight grasshopper optimization algorithm–sparrow search algorithm (GFLFGOA-SSA), the gravitational force grasshopper optimization algorithm–sparrow search algorithm (GFGOA-SSA), and the Lévy flight grasshopper optimization algorithm–sparrow search algorithm (LFGOA-SSA). These aforementioned algorithms are proposed by integrating the good exploration capacity of the SSA with the faster convergence of the LFGOA and GFGOA. The performances of the GFLFGOA, GFLFGOA-SSA, GFGOA-SSA, and LFGOA-SSA are verified by conducting two different experiments. Firstly, the experimentation was conducted on nine benchmark functions (BFs) to assess the mean, standard deviation (SD), and convergence rate. The second experiment focuses on boosting the accuracy of the HBoDP model through the fine-tuning of the hyperparameters in the artificial neural network (ANN) and XGBOOST (XGB) models. To justify the effectiveness and performance of these hybrid novel algorithms, we compared them with four base algorithms, namely the grasshopper optimization algorithm (GOA), the sparrow search algorithm (SSA), the gravitational force grasshopper optimization algorithm (GFGOA), and the Lévy flight grasshopper optimization algorithm (LFGOA). Our findings illuminate the effectiveness of this hybrid approach in enhancing the convergence rate and accuracy. The experimental results show a faster convergence rate for BFs and improvements in software defect prediction accuracy for the NASA defect datasets by comparing them with some baseline methods. [ABSTRACT FROM AUTHOR]

Financial time series data are characterized by non-linearity, non-stationarity, and stochastic complexity, so predicting such data presents a significant challenge. This paper proposes a novel hybrid model for financial forecasting based on CEEMDAN-SE and ARIMA- CNN-LSTM. With the help of the CEEMDAN-SE method, the original data are decomposed into several IMFs and reconstructed via sample entropy into a lower-complexity stationary high-frequency component and a low-frequency component. The high-frequency component is predicted by the ARIMA statistical forecasting model, while the low-frequency component is predicted by a neural network model combining CNN and LSTM. Compared to some classical prediction models, our algorithm exhibits superior performance in terms of three evaluation indexes, namely, RMSE, MAE, and MAPE, effectively enhancing model accuracy while reducing computational overhead. [ABSTRACT FROM AUTHOR]

Deep neural networks (DNNs) have achieved breakthrough progress in various fields, largely owing to the support of large-scale datasets with manually annotated labels. However, obtaining such datasets is costly and time-consuming, making high-quality annotation a challenging task. In this work, we propose an improved noisy sample selection method, termed "sample selection framework", based on a mixup loss and recalibration strategy (SMR). This framework enhances the robustness and generalization abilities of models. First, we introduce a robust mixup loss function to pre-train two models with identical structures separately. This approach avoids additional hyperparameter adjustments and reduces the need for prior knowledge of noise types. Additionally, we use a Gaussian Mixture Model (GMM) to divide the entire training set into labeled and unlabeled subsets, followed by robust training using semi-supervised learning (SSL) techniques. Furthermore, we propose a recalibration strategy based on cross-entropy (CE) loss to prevent the models from converging to local optima during the SSL process, thus further improving performance. Ablation experiments on CIFAR-10 with 50% symmetric noise and 40% asymmetric noise demonstrate that the two modules introduced in this paper improve the accuracy of the baseline (i.e., DivideMix) by 1.5% and 0.5%, respectively. Moreover, the experimental results on multiple benchmark datasets demonstrate that our proposed method effectively mitigates the impact of noisy labels and significantly enhances the performance of DNNs on noisy datasets. For instance, on the WebVision dataset, our method improves the top-1 accuracy by 0.7% and 2.4% compared to the baseline method. [ABSTRACT FROM AUTHOR]

Breast cancer is one of the most common causes of death in women. Early signs of breast cancer can be an abnormality depicted on breast images like breast ultrasonography. Unfortunately, ultrasound images contain a lot of noise, which greatly increases the difficulty for doctors to interpret them. In recent years, computer-aided diagnosis (CAD) has been widely used in medical images, reducing the workload of doctors and the probability of misdiagnosis. However, it still faces the following challenges in clinical practice: one is the lack of interpretability, and another is that the accuracy is not high enough. In this paper, we propose a classification model of breast ultrasound images that leverages tumor boundaries as prior knowledge and strengthens the model to guide classification. Furthermore, we employ the advantages of convolutional neural network (CNN) to extract local features and Transformer to extract global features to achieve information balance and complementarity between the two neural network models which increase the recognition performance of the model. Additionally, an explanation method is used to generate visual results, thereby improving the poor interpretability of deep learning models. Finally, we evaluate the model on the BUSI dataset and compare it with other CNN and Transformer models. Experimental results show that the proposed model obtains an accuracy of 0.9870 and an F1 score of 0.9872, achieving state-of-the-art performance. [ABSTRACT FROM AUTHOR]

In Structural Health Monitoring (SHM) of bridges, accurately assessing damage is critical to maintaining the safety and integrity of a structure. One of the primary challenges in damage assessment is the precise localization and quantification of defects, which is essential for making timely maintenance decisions and reducing the risk of structural failures. This paper introduces a novel damage detection method for SHM of a truss bridge by coupling a Deep Neural Network (DNN) model with an evolved Artificial Rabbit Optimization (EVARO) algorithm. The integration of DNN with the stochastic search capability of the EVARO algorithm helps to avoid local minima, thereby ensuring more accurate and reliable results. Additionally, the optimization algorithm's effectiveness is further enhanced by incorporating evolving predator features and the Cauchy motion search mechanism. The proposed method is first validated using various data benchmark problems, demonstrating its effectiveness compared to other well-known algorithms. Secondly, a case study involving the Chuong Duong truss bridge under different simulated damage scenarios further confirms the superiority of the proposed method in both localizing and quantifying damages. [ABSTRACT FROM AUTHOR]

Siamese network trackers based on pre-trained depth features have achieved good performance in recent years. However, the pre-trained depth features are trained in advance on large-scale datasets, which contain feature information of a large number of objects. There may be a pair of interference and redundant information for a single tracking target. To learn a more accurate target feature information, this paper proposes a lightweight target-aware attention learning network to learn the most effective channel features of the target online. The lightweight network uses a designed attention learning loss function to learn a series of channel features with weights online with no complex parameters. Compared with the pre-trained features, the channel features with weights can represent the target more accurately. Finally, the lightweight target-aware attention learning network is unified into a Siamese tracking network framework to implement target tracking effectively. Experiments on several datasets demonstrate that the tracker proposed in this paper has good performance. [ABSTRACT FROM AUTHOR]

Wind power has become an indispensable part of renewable energy development in various countries. Due to the high cost and complex structure of wind turbines, it is important to design a method that can quickly and effectively determine the structural health of the generator set. This research proposes a method that could determine structural damage or weaknesses in the blades at an early stage via a model to monitor the sound of the wind turbine blades, so as to reduce the quantity of labor required and frequency of regular maintenance, and to repair the damage rapidly in the future. This study used the operating sounds of normal and abnormal blades as a dataset. The model used discrete wavelet transform (DWT) to decompose the sound into different frequency components, performed feature extraction in a statistical measure, and combined with outlier exposure technique to train a deep neural network model that could capture abnormal values deviating from the normal samples. In addition, this paper observed that the performance of the monitoring model on the MIMII dataset was also better than the anomaly detection models proposed by other papers. [ABSTRACT FROM AUTHOR]

Three-wheeled omnidirectional mobile robots (TOMRs) are widely used to accomplish precise transportation tasks in narrow environments owing to their stability, flexible operation, and heavy loads. However, these robots are susceptible to slippage. For wheeled robots, almost all faults and slippage will directly affect the power consumption. Thus, using the energy consumption model data and encoder data in the healthy condition as a reference to diagnose robot slippage and other system faults is the main issue considered in this paper. We constructed an energy model for the TOMR and analyzed the factors that affect the power consumption in detail, such as the position of the gravity center. The study primarily focuses on the characteristic relationship between power consumption and speed when the robot experiences slippage or common faults, including control system faults. Finally, we present the use of a table-based artificial neural network (ANN) to indicate the type of fault by comparing the modeled data with the measured data. The experiments proved that the method is accurate and effective for diagnosing faults in TOMRs. [ABSTRACT FROM AUTHOR]

Patient-specific 3D models of the human mandible are finding increasing utility in medical fields such as oral and maxillofacial surgery, orthodontics, dentistry, and forensic sciences. The efficient creation of personalized 3D bone models poses a key challenge in these applications. Existing solutions often rely on 3D statistical models of human bone, offering advantages in rapid bone geometry adaptation and flexibility by capturing a range of anatomical variations, but also a disadvantage in terms of reduced precision in representing specific shapes. Considering this, the proposed parametric model allows for precise manipulation using morphometric parameters acquired from medical images. This paper highlights the significance of employing the parametric model in the creation of a personalized bone model, exemplified through a case study targeting mandibular prognathism reconstruction. A personalized model is described as 3D point cloud determined through the utilization of series of parametric functions, determined by the application of geometrical morphometrics, morphology properties, and artificial neural networks in the input dataset of human mandible samples. With 95.05% of the personalized model's surface area displaying deviations within −1.00–1.00 mm relative to the input polygonal model, and a maximum deviation of 2.52 mm, this research accentuates the benefits of the parametric approach, particularly in the preoperative planning of mandibular deformity surgeries. [ABSTRACT FROM AUTHOR]

Featured Application: The Deep Neural Network model employed in this work will help build a system for the pre-diagnosis of retinopathies that can lead to blindness. The main intention of this type of system is to support the work performed by ophthalmology specialists. Computer-based pre-diagnosis of diseases through medical imaging is a task worked on for many years. The so-called fundus images stand out since they do not have uniform illumination and are highly sensitive to noise. One of the diseases that can be pre-diagnosed through fundus images is age-related macular degeneration, which initially manifests as the appearance of lesions called drusen. Several ways of pre-diagnosing macular degeneration have been proposed, methods based entirely on the segmentation of drusen with prior image processing have been designed and applied, and methods based on image pre-processing and subsequent conversion to feature vectors, or patterns, to be classified by a Machine-Learning model have also been developed. Finally, in recent years, the use of Deep-Learning models, particularly Convolutional Networks, has been proposed and used in classification problems where the data are only images. The latter has allowed the so-called transfer learning, which consists of using the learning achieved in the solution of one problem to solve another. In this paper, we propose the use of transfer learning through the Xception Deep Convolutional Neural Network to detect age-related macular degeneration in fundus images. The performance of the Xception model was compared against six other state-of-the-art models with a dataset created from images available in public and private datasets, which were divided into training/validation and test; with the training/validation set, the training was made using 10-fold cross-validation. The results show that the Xception neural network obtained a validation accuracy that surpasses other models, such as the VGG-16 or VGG-19 networks, and had an accuracy higher than 80% in the test set. We consider that the contributions of this work include the use of a Convolutional Neural Network model for the detection of age-related macular degeneration through the classification of fundus images in those affected by AMD (drusen) and the images of healthy patients. The performance of this model is compared against other methods featured in the state-of-the-art approaches, and the best model is tested on a test set outside the training and validation set. [ABSTRACT FROM AUTHOR]

Interior permanent magnet synchronous machines (IPMSMs) driven with a square-wave control (i.e., six-step, block, or 120° control), known commonly as brushless direct current (BLDC) drives, are used widely due to their high power density and control simplicity. The advance firing (AF) angle is employed to achieve improved operation characteristics of the drive. The AF angle is, in general, applied to compensate for the commutation effects. In the case of an IPMSM, the AF angle can also be adjusted to exploit reluctance torque. In this paper, a detailed study was performed to understand its effect on the drive's performance in regard to reluctance torque. Furthermore, a multi-objective optimization of the machine's cross-section using neural network models was conducted to enhance performance at a constant AF angle. The reference and improved machine designs were evaluated in a system-level simulation, where the impact was considered of the commutation of currents. A significant improvement in the machine performance was achieved after optimizing the geometry and implementing a fixed AF angle of 10°. [ABSTRACT FROM AUTHOR]

In this paper, the fixed-time and preassigned-time synchronization issues of fully quaternion-valued fuzzy memristive neural networks are studied based on the dynamic event-triggered control mechanism. Initially, the fuzzy rules are defined within the quaternion domain and the relevant properties are established through rigorous analysis. Subsequently, to conserve resources and enhance the efficiency of the controller, a kind of dynamic event-triggered control mechanism is introduced for the fuzzy memristive neural networks. Based on the non-separation analysis, fixed-time and preassigned-time synchronization criteria are presented and the Zeno phenomenon under the event-triggered mechanism is excluded successfully. Finally, the effectiveness of the theoretical results is verified through numerical simulations. [ABSTRACT FROM AUTHOR]

Physics-Informed Neural Networks (PINNs) improve the efficiency of data utilization by combining physical principles with neural network algorithms and thus ensure that their predictions are consistent and stable with the physical laws. PINNs open up a new approach to address inverse problems in fluid mechanics. Based on the single-relaxation-time lattice Boltzmann method (SRT-LBM) with the Bhatnagar–Gross–Krook (BGK) collision operator, the PINN-SRT-LBM model is proposed in this paper for solving the inverse problem in fluid mechanics. The PINN-SRT-LBM model consists of three components. The first component involves a deep neural network that predicts equilibrium control equations in different discrete velocity directions within the SRT-LBM. The second component employs another deep neural network to predict non-equilibrium control equations, enabling the inference of the fluid's non-equilibrium characteristics. The third component, a physics-informed function, translates the outputs of the first two networks into physical information. By minimizing the residuals of the physical partial differential equations (PDEs), the physics-informed function infers relevant macroscopic quantities of the flow. The model evolves two sub-models that are applicable to different dimensions, named the PINN-SRT-LBM-I and PINN-SRT-LBM-II models according to the construction of the physics-informed function. The innovation of this work is the introduction of SRT-LBM and discrete velocity models as physical drivers into a neural network through the interpretation function. Therefore, the PINN-SRT-LBM allows a given neural network to handle inverse problems of various dimensions and focus on problem-specific solving. Our experimental results confirm the accurate prediction by this model of flow information at different Reynolds numbers within the computational domain. Relying on the PINN-SRT-LBM models, inverse problems in fluid mechanics can be solved efficiently. [ABSTRACT FROM AUTHOR]

Label corruption leads to a significant challenge in supervised learning, particularly in deep neural networks. This paper considers recovering a small corrupted subset of data samples which are typically caused by non-expert sources, such as automatic classifiers. Our aim is to recover the corrupted data samples by exploiting a finite query-testing system as an additional expert. The task involves identifying the corrupted data samples with minimal expert queries and finding them to their true label values. The proposed query-testing system uses a random selection of a subset of data samples and utilizes finite field operations to construct combined responses. In this paper, we demonstrate an information-theoretic lower bound on the minimum number of queries required for recovering corrupted labels. The lower bound can be represented as a function of joint entropy with an imbalanced rate of data samples and mislabeled probability. In addition, we find an upper bound on the error probability using maximum a posteriori decoding. [ABSTRACT FROM AUTHOR]

This paper assesses the fault-detection capabilities of modern deep-learning models. It highlights that a naive deep-learning approach optimized for accuracy is unsuitable for learning fault-detection models from time-series data. Consequently, out-of-the-box deep-learning strategies may yield impressive accuracy results but are ill-equipped for real-world applications. The paper introduces a methodology for estimating fault-detection delays when no oracle information on fault occurrence time is available. Moreover, the paper presents a straightforward approach to implicitly achieve the objective of minimizing fault-detection delays. This approach involves using pseudo-multi-objective deep optimization with data windowing, which enables the utilization of standard deep-learning methods for fault detection and expanding their applicability. However, it does introduce an additional hyperparameter that needs careful tuning. The paper employs the Tennessee Eastman Process dataset as a case study to demonstrate its findings. The results effectively highlight the limitations of standard loss functions and emphasize the importance of incorporating fault-detection delays in evaluating and reporting performance. In our study, the pseudo-multi-objective optimization could reach a fault-detection accuracy of 95% in just a fifth of the time it takes the best naive approach to do so. [ABSTRACT FROM AUTHOR]

Stagnation at local optima represents a significant challenge in bio-inspired optimization algorithms, often leading to suboptimal solutions. This paper addresses this issue by proposing a hybrid model that combines the Orca predator algorithm with deep Q-learning. The Orca predator algorithm is an optimization technique that mimics the hunting behavior of orcas. It solves complex optimization problems by exploring and exploiting search spaces efficiently. Deep Q-learning is a reinforcement learning technique that combines Q-learning with deep neural networks. This integration aims to turn the stagnation problem into an opportunity for more focused and effective exploitation, enhancing the optimization technique's performance and accuracy. The proposed hybrid model leverages the biomimetic strengths of the Orca predator algorithm to identify promising regions nearby in the search space, complemented by the fine-tuning capabilities of deep Q-learning to navigate these areas precisely. The practical application of this approach is evaluated using the high-dimensional Heartbeat Categorization Dataset, focusing on the feature selection problem. This dataset, comprising complex electrocardiogram signals, provided a robust platform for testing the feature selection capabilities of our hybrid model. Our experimental results are encouraging, showcasing the hybrid strategy's capability to identify relevant features without significantly compromising the performance metrics of machine learning models. This analysis was performed by comparing the improved method of the Orca predator algorithm against its native version and a set of state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

This paper discusses a type of mixed-delay quaternion-valued neural networks (QVNNs) under impulsive and stochastic disturbances. The considered QVNNs model are treated as a whole, rather than as complex-valued neural networks (NNs) or four real-valued NNs. Using the vector Lyapunov function method, some criteria are provided for securing the mean-square exponential stability of the mixed-delay QVNNs under impulsive and stochastic disturbances. Furthermore, a type of chaotic QVNNs under stochastic and impulsive disturbances is considered using a previously established stability analysis method. After the completion of designing the linear feedback control law, some sufficient conditions are obtained using the vector Lyapunov function method for determining the mean-square exponential synchronization of drive–response systems. Finally, two examples are provided to demonstrate the correctness and feasibility of the main findings and one example is provided to validate the use of QVNNs for image associative memory. [ABSTRACT FROM AUTHOR]

The existence of chaos is particularly relevant, as the identification of a chaotic behavior in a time series could lead to reliable short-term forecasting. This paper evaluates the existence of nonlinearity and chaos in the underlying process of the spot prices of the Spanish electricity market. To this end, we used daily data spanning from 1 January 2013, to 31 March 2021 and we applied a comprehensive framework that encompassed a wide range of techniques. Nonlinearity was analyzed using the BDS method, while the existence of a chaotic structure was studied through Lyapunov exponents, recurrence plots, and quantitative recurrence analysis. While nonlinearity was detected in the underlying process, conclusive evidence supporting chaos was not found. In addition, the generalized autoregressive conditional heteroscedastic (GARCH) model accounts for part of the nonlinear structure that is unveiled in the electricity market. These findings hold substantial value for electricity market forecasters, traders, producers, and market regulators. [ABSTRACT FROM AUTHOR]

The squeeze film damper (SFD) is proven to be highly effective in mitigating rotor vibration as it traverses the critical speed, thus making it extensively utilized in the aeroengine domain. In this paper, we investigate the stiffness and damping of SFD using the Reynolds equation and neural network models. Our specific focus includes examining the structural and operating parameters of SFDs, such as clearance, feed pressure of oil, rotor whirl, and rotational speed. Firstly, the pressure distribution analytical model of the oil film inside the SFD based on the hydrodynamic lubrication theory is established, as described by the Reynolds equation. It obtained oil film forces, pressure, stiffness, and damping values under various sets of structural, lubrication, and operating parameters, including length, clearance, boundary pressure at both sides, rotational speed, and whirling motion, by applying difference computations to the Reynolds equation. Secondly, according to the significant analyses of the obtained oil film stiffness and damping, the following three parameters of the most significance are found: clearance, rotational speed, and rotor whirl. Furthermore, neural network models, including GA-BP and decision tree models, are established based on the obtained results of difference computation. The numerical simulation and calculation of these models are then applied to show their validity with all given parameters and the three significant parameters separately as two sets of model input. Regardless of either set of model inputs, these established neural network models are capable of predicting the nonlinear stiffness and damping of the oil film inside an SFD. These sensitive parameters merely require measurement, followed by the utilization of a neural network to predict stiffness and damping instead of the Reynolds equation. This process serves structural enhancement, facilitates parameter optimization in SFDs, and provides crucial support for refining the design parameters of SFDs. [ABSTRACT FROM AUTHOR]

Lightweight and adaptive adjustment are key research directions for deep neural networks (DNNs). In coal industry mining, frequent changes in raw coal sources and production batches can cause uneven distribution of appearance features, leading to concept drift problems. The network architecture and parameters should be adjusted frequently to avoid a decline in model accuracy. This poses a significant challenge for those without specialist expertise. Although the Neural Architecture Search (NAS) has a strong ability to automatically generate networks, enabling the automatic design of highly accurate networks, it often comes with complex internal topological connections. These redundant architectures do not always effectively improve network performance, especially in resource-constrained environments, where their computational efficiency is significantly reduced. In this paper, we propose a method called Topology Complexity Neural Architecture Search (TCNAS). TCNAS proposes a new method for evaluating the topological complexity of neural networks and uses both topological complexity and accuracy to guide the search, effectively obtaining lightweight and efficient networks. TCNAS employs an adaptive shrinking search space optimization method, which gradually eliminates poorly performing cells to reduce the search space, thereby improving search efficiency and solving the problem of space explosion. In the classification experiments of coal and gangue, the optimal network designed by TCNAS has an accuracy of 83.3%. And its structure is much simpler, which is about 1/53 of the parameters of the network dedicated to coal and gangue recognition. Experiments have shown that TCNAS is able to generate networks that are both efficient and simple for resource-constrained industrial applications. [ABSTRACT FROM AUTHOR]

The accuracy of short-term traffic flow prediction is one of the important issues in the construction of smart cities, and it is an effective way to solve the problem of traffic congestion. Most previous studies could not effectively mine the potential relationship between the temporal and spatial dimensions of traffic data flow. Due to the large variability in the traffic flow data of road conditions, we analyzed it with "dynamic", using a dynamic-aware graph neural network model for the hidden relationships between space-time in the deep learning segment. In this paper, we propose a dynamic perceptual graph neural network model for the temporal and spatial hidden relationships of deep learning segments. This model mixes temporal features and spatial features with graphs and expresses them. The temporal features and spatial features are connected to each other to learn potential relationships, so as to more accurately predict the traffic speed in the future time period, we performed experiments on real data sets and compared with some baseline models. The experiments show that the method proposed in this paper has certain advantages. [ABSTRACT FROM AUTHOR]

The issue of climate change holds immense significance, affecting various aspects of life, including the environment, the interaction between soil conditions and the atmosphere, and agriculture. Over the past few decades, a range of spatio-temporal and Deep Neural Network (DNN) techniques had been proposed within the field of Machine Learning (ML) for climate forecasting, using spatial and temporal data. The forecasting model in this paper is highly complex, particularly due to the presence of nonlinear data in the residual modeling of General Space-Time Autoregressive Integrated Moving Average (GSTARIMA), which represented nonstationary data with time and location dependencies. This model effectively captured trends and seasonal data with time and location dependencies. On the other hand, DNNs proved reliable for modeling nonlinear data that posed challenges for spatio-temporal approaches. This research presented a comprehensive overview of the integrated approach between the GSTARIMA model and DNNs, following the six-stage Data Analytics Lifecycle methodology. The focus was primarily on previous works conducted between 2013 and 2022. The review showed that the GSTARIMA–DNN integration model was a promising tool for forecasting climate in a specific region in the future. Although spatio-temporal and DNN approaches have been widely employed for predicting the climate and its impact on human life due to their computational efficiency and ability to handle complex problems, the proposed method is expected to be universally accepted for integrating these models, which encompass location and time dependencies. Furthermore, it was found that the GSTARIMA–DNN method, incorporating multivariate variables, locations, and multiple hidden layers, was suitable for short-term climate forecasting. Finally, this paper presented several future directions and recommendations for further research. [ABSTRACT FROM AUTHOR]

Hydraulic turbines constitute an essential component within the hydroelectric power generation industry, contributing to renewable energy production with minimal environmental pollution. Maintaining stable turbine operation presents a considerable challenge, which necessitates effective fault diagnosis and warning systems. Timely and efficient fault w arnings are particularly vital, as they enable personnel to address emerging issues promptly. Although backpropagation (BP) networks are frequently employed in fault warning systems, they exhibit several limitations, such as susceptibility to local optima. To mitigate this issue, this paper introduces an improved social engineering optimizer (ISEO) method aimed at optimizing BP networks for developing a hydraulic turbine warning system. Experimental results reveal that the ISEO-BP-based approach offers a highly effective fault warning system, as evidenced by superior performance metrics when compared to alternative methods. [ABSTRACT FROM AUTHOR]

Foundation models trained on vast quantities of data have demonstrated impressive performance in capturing complex nonlinear relationships and accurately predicting neuronal responses. Due to the fact that deep learning neural networks depend on massive amounts of data samples and high energy consumption, foundation models based on spiking neural networks (SNNs) have the potential to significantly reduce calculation costs by training on neuromorphic hardware. In this paper, a visually inspired computational model composed of an SNN and echo state network (ESN) is proposed for the recognition of optic flow. The visually inspired SNN model serves as a foundation model that is trained using spike-timing-dependent plasticity (STDP) for extracting core features. The ESN model makes readout decisions for recognition tasks using the linear regression method. The results show that STDP can perform similar functions as non-negative matrix decomposition (NMF), i.e., generating sparse and linear superimposed readouts based on basis flow fields. Once the foundation model is fully trained from enough input samples, it can considerably reduce the training samples required for ESN readout learning. Our proposed SNN-based foundation model facilitates efficient and cost-effective task learning and could also be adapted to new stimuli that are not included in the training of the foundation model. Moreover, compared with the NMF algorithm, the foundation model trained using STDP does not need to be retrained during the testing procedure, contributing to a more efficient computational performance. [ABSTRACT FROM AUTHOR]

Data envelopment analysis (DEA) is a leading approach in performance analysis and discovering newer benchmarks, and the traditional DEA models cannot forecast the future efficiency of decision-making units (DMUs). Machine learning, such as the artificial neural networks (ANNs), support vector machine/regression (SVM/SVR), projection pursuit regression (PPR), etc., have been viewed as beneficial for managers in predicting system behaviors. PPR is especially suitable for small and non-normal distribution samples, the usual cases in DEA analysis. This paper integrates DEA and PPR to cover the shortcomings we faced while using DEA and DEA-BPNN, DEA-SVR, etc. This study explores the advantages of combining these complementary methods into an integrated performance measurement and prediction model. Firstly, the DEA approach is used to evaluate and rank the efficiency of DMUs. Secondly, we establish two DEA-PPR combined models to describe the DEA efficiency scores (also called the production function) and the DEA-efficient frontier function. The first combined model's input variables are input–output indicators in the DEA model, and the output variable is the DEA efficiency. In the second model, its input variables are input or output indicators in the DEA model, and the output variable is the optimal input indicator for input-oriented DEA or the output indicator for output-oriented DEA. We conducted positive research on two examples with actual data and virtual small, medium-sized, and large samples. Compared with the DEA-BPNN and DEA-SVR models, the results show that the DEA-PPR combined model has more vital global optimization ability, better convergence, higher accuracy, and a simple topology. The DEA-PPR model can obtain robust results for both small and large cases. The DEA-BPNN and DEA-SVR models cannot obtain robust results for small and medium-sized samples due to overfitting. For large samples, the DEA-PPR model outperforms DEA-BPNN, DEA-SVR, etc. The DEA-PPR combined model possesses better suitability, applicability, and reliability than the DEA-BPNN model, the DEA-SVR model, etc. [ABSTRACT FROM AUTHOR]

Dynamic neural networks (DNNs) are a type of artificial neural network (ANN) designed to work with sequential data where context in time is important. Unlike traditional static neural networks that process data in a fixed order, dynamic neural networks use information about past inputs, which is important if the dynamic of a certain process is emphasized. They are commonly used in natural language processing, speech recognition, and time series prediction. In industrial processes, their use is interesting for the prediction of difficult-to-measure process variables. In an industrial isomerization process, it is crucial to measure the quality attributes that affect the octane number of gasoline. Process analyzers commonly used for this purpose are expensive and subject to failure. Therefore, to achieve continuous production in the event of a malfunction, mathematical models for estimating product quality attributes are imposed as a solution. In this paper, mathematical models were developed using dynamic recurrent neural networks (RNNs), i.e., their subtype of a long short-term memory (LSTM) architecture. The results of the developed models were compared with the results of several types of other data-driven models developed for an isomerization process, such as multilayer perceptron (MLP) artificial neural networks, support vector machines (SVM), and dynamic polynomial models. The obtained results are satisfactory, suggesting a good possibility of application. [ABSTRACT FROM AUTHOR]

The single-layer perceptron, introduced by Rosenblatt in 1958, is one of the earliest and simplest neural network models. However, it is incapable of classifying linearly inseparable patterns. A new era of neural network research started in 1986, when the backpropagation (BP) algorithm was rediscovered for training the multilayer perceptron (MLP) model. An MLP with a large number of hidden nodes can function as a universal approximator. To date, the MLP model is the most fundamental and important neural network model. It is also the most investigated neural network model. Even in this AI or deep learning era, the MLP is still among the few most investigated and used neural network models. Numerous new results have been obtained in the past three decades. This survey paper gives a comprehensive and state-of-the-art introduction to the perceptron model, with emphasis on learning, generalization, model selection and fault tolerance. The role of the perceptron model in the deep learning era is also described. This paper provides a concluding survey of perceptron learning, and it covers all the major achievements in the past seven decades. It also serves a tutorial for perceptron learning. [ABSTRACT FROM AUTHOR]

Motivated by the idea that there should be a close relationship between biological significance and low power driving of spike neural networks (SNNs), this paper aims to focus on spike-frequency adaptation, which deviates significantly from existing biological meaningfulness, and develop a new spike-frequency adaptation with more biological characteristics. As a result, this paper proposes the s e n s o r y a d a p t a t i o n method that reflects the mechanisms of the human sensory organs, and studies network architectures and neuron models for the proposed method. Next, this paper introduces a dedicated SNN simulator that can selectively apply the conventional spike-frequency adaptation and the proposed method, and provides the results of functional verification and effectiveness evaluation of the proposed method. Through intensive simulation, this paper reveals that the proposed method can produce a level of training and testing performance similar to the conventional method while significantly reducing the number of spikes to 32.66% and 45.63%, respectively. Furthermore, this paper contributes to SNN research by showing an example based on in-depth analysis that embedding biological meaning in SNNs may be closely related to the low-power driving characteristics of SNNs. [ABSTRACT FROM AUTHOR]

This paper introduces a novel synchronization scheme for fractional-order neural networks with time delays and reaction-diffusion terms via pinning control. We consider Caputo fractional derivatives, constant delays and distributed delays in our model. Based on the stability behavior, fractional inequalities and Lyapunov-type functions, several criteria are derived, which ensure the achievement of a synchronization for the drive-response systems. The obtained criteria are easy to test and are in the format of inequalities between the system parameters. Finally, numerical examples are presented to illustrate the results. The obtained criteria in this paper consider the effect of time delays as well as the reaction-diffusion terms, which generalize and improve some existing results. [ABSTRACT FROM AUTHOR]

Miscanthus is a perennial energy crop that produces high yields and has the potential to be converted into energy. The ultimate analysis determines the composition of the biomass and the energy value in terms of the higher heating value (HHV), which is the most important parameter in determining the quality of the fuel. In this study, an artificial neural network (ANN) model based on the principle of supervised learning was developed to predict the HHV of miscanthus biomass. The developed ANN model was compared with the models of predictive regression models (suggested from the literature) and the accuracy of the developed model was determined by the coefficient of determination. The paper presents data from 192 miscanthus biomass samples based on ultimate analysis and HHV. The developed model showed good properties and the possibility of prediction with high accuracy (R2 = 0.77). The paper proves the possibility of using ANN models in practical application in determining fuel properties of biomass energy crops and greater accuracy in predicting HHV than the regression models offered in the literature. [ABSTRACT FROM AUTHOR]

Artificial intelligence (AI) has made many breakthroughs in the perfect information game. Nevertheless, Bridge, a multiplayer imperfect information game, is still quite challenging. Bridge consists of two parts: bidding and playing. Bidding accounts for about 75% of the game and playing for about 25%. Expert-level teams are generally indistinguishable at the playing level, so bidding is the more decisive factor in winning or losing. The two teams can communicate using different systems during the bidding phase. However, existing bridge bidding models focus on at most one bidding system, which does not conform to the real game rules. This paper proposes a deep reinforcement learning model that supports multiple bidding systems, which can compete with players using different bidding systems and exchange hand information normally. The model mainly comprises two deep neural networks: a bid selection network and a state evaluation network. The bid selection network can predict the probabilities of all bids, and the state evaluation network can directly evaluate the optional bids and make decisions based on the evaluation results. Experiments show that the bidding model is not limited by a single bidding system and has superior bidding performance. [ABSTRACT FROM AUTHOR]

Despite advancements in smart grid (SG) technology, effective load forecasting utilizing big data or large-scale datasets remains a complex task for energy management, planning, and control. The Saudi SGs, in alignment with the Saudi Vision 2030, have been envisioned as future electrical grids with a bidirectional flow of power and data. To that end, data analysis and predictive models can enhance Saudi SG planning and control via artificial intelligence (AI). Recently, many AI methods including deep learning (DL) algorithms for SG applications have been published in the literature and have shown superior time series predictions compared with conventional prediction models. Current load-prediction research for the Saudi grid focuses on identifying anticipated loads and consumptions, on utilizing limited historical data and the behavior of the load's consumption, and on conducting shallow forecasting models. However, little scientific proof on complex DL models or real-life application has been conducted by researchers; few articles have studied sophisticated large-scale prediction models for Saudi grids. This paper proposes hybrid DL methods to enhance the outcomes in Saudi SG load forecasting, to improve problem-relevant features, and to accurately predict complicated power consumption, with the goal of developing reliable forecasting models and of obtaining knowledge of the relationships between the various features and attributes in the Saudi SGs. The model in this paper utilizes a real dataset from the Jeddah and Medinah grids in Saudi Arabia for a full year, 2021, with a one-hour time resolution. A benchmark strategy using different conventional DL methods including artificial neural network, recurrent neural network (RNN), conventional neural networks (CNN), long short-term memory (LSTM), gated recurrent unit (GRU), and different real datasets is used to verify the proposed models. The prediction results demonstrate the effectiveness of the proposed hybrid DL models, with CNN–GRU and CNN–RNN with NRMSE obtaining 1.4673% and 1.222% improvements, respectively, in load forecasting accuracy. [ABSTRACT FROM AUTHOR]

With the development of data collection and storage capabilities in recent decades, abundant data have been accumulated in geotechnical engineering fields, providing opportunities for the usage of machine learning approaches. Thus, a rising number of scholars are adopting machine learning techniques to settle geotechnical issues. In this paper, the application of three popular machine learning algorithms, support vector machine (SVM), artificial neural network (ANN), and decision tree (DT), as well as other representative algorithms in geotechnical engineering, is reviewed. Meanwhile, the applicability of diverse machine learning algorithms in settling specific geotechnical engineering issues is compared. The main findings are as follows: ANN, SVM, and DT have been widely adopted to solve a variety of geotechnical engineering issues, such as the classification of soil and rock types, predicting the properties of geotechnical materials, etc. Based on the collected relevant research, the performance of random forest (RF) in sorting soil types and assessing landslide susceptibility is satisfying; SVM has high precision in classifying rock types and forecasting rock deformation; and backpropagation ANNs and Hopfield ANNs are recommended to forecast rock compressive strength and soil settlement, respectively. [ABSTRACT FROM AUTHOR]

This paper introduces a new approach to controlling Pressure Swing Adsorption (PSA) using a neural network controller based on a Model Predictive Control (MPC) process. We use a Hammerstein–Wiener (HW) model representing the real PSA process data. Then, we design an MPC-controlled model based on the HW model to maintain the bioethanol purity near 99 % molar fraction. This work proposes an Artificial Neural Network (ANN) that captures the dynamics of the PSA model controlled by the MPC strategy. Both controllers are validated using the HW model of the PSA process, showing great performance and robustness against disturbances. The results show that we can follow the desired trajectory and attenuate disturbances, achieving the purity of bioethanol at a molar fraction value of 0.99 using the ANN based on the MPC strategy with 94 % of fit in the control signal and a 97 % fit in the purity signal, so we can conclude that our ANN can be used to attenuate disturbances and maintain purity in the PSA process. [ABSTRACT FROM AUTHOR]

Recently, there has been a growth in the number of studies addressing the automatic processing of low-resource languages. The lack of speech and text data significantly hinders the development of speech technologies for such languages. This paper introduces an automatic speech recognition system for Livvi-Karelian. Acoustic models based on artificial neural networks with time delays and hidden Markov models were trained using a limited speech dataset of 3.5 h. To augment the data, pitch and speech rate perturbation, SpecAugment, and their combinations were employed. Language models based on 3-grams and neural networks were trained using written texts and transcripts. The achieved word error rate metric of 22.80% is comparable to other low-resource languages. To the best of our knowledge, this is the first speech recognition system for Livvi-Karelian. The results obtained can be of a certain significance for development of automatic speech recognition systems not only for Livvi-Karelian, but also for other low-resource languages, including the fields of speech recognition and machine translation systems. Future work includes experiments with Karelian data using techniques such as transfer learning and DNN language models. [ABSTRACT FROM AUTHOR]

In this paper, the adaptive synchronization problem of quaternion-valued Cohen–Grossberg neural networks (QVCGNNs), with and without known parameters, is investigated. On the basis of constructing an appropriate Lyapunov function, and utilizing parameter identification theory and decomposition methods, two effective adaptive feedback schemes are proposed, to guarantee the realization of global synchronization of CGQVNNs. The control gain of the above schemes can be obtained using the Matlab LMI toolbox. The theoretical results presented in this work enrich the literature exploring the adaptive synchronization problem of quaternion-valued neural networks (QVNNs). Finally, the reliability of the theoretical schemes derived in this work is shown in two interesting numerical examples. [ABSTRACT FROM AUTHOR]

Robotic systems have experienced exponential growth in their utilization for manufacturing applications over recent decades. Control systems responsible for executing desired robot motion planning face increasingly stringent performance requirements. These demands encompass high precision, efficiency, stability, robustness, ease of use, and simplicity of the user interface. Furthermore, diverse modern manufacturing applications primarily employ robotic systems within disturbed operating scenarios. This paper presents a novel neural motion-tracking control scheme for mobile manipulation robotic systems. Dynamic position output error feedback and B–Spline artificial neural networks are integrated in the design process of the introduced adaptive robust control strategy to perform efficient and robust tracking of motion-planning trajectories in robotic systems. Integration of artificial neural networks demonstrates performance improvements in the control scheme while effectively addressing common issues encountered in manufacturing environments. Parametric uncertainty, unmodeled dynamics, and unknown disturbance torque terms represent some adverse influences to be compensated for by the robust control scheme. Several case studies prove the robustness of the adaptive neural control scheme in highly coupled nonlinear six-degree-of-freedom mobile manipulation robotic systems. Case studies provide valuable insights and validate the efficacy of the proposed adaptive multivariable control scheme in manufacturing applications. [ABSTRACT FROM AUTHOR]

Even though beam-type elements are widely adopted in the industry due to their low computational cost and potential time savings when modeling, they present a significant shortcoming given by their own formulation, which makes them incapable of accounting for local joint topology, which has a notable influence on the behavior of these structures. In this scenario, solutions that can mitigate this drawback while still providing improved results with simple models are of special interest. Many research works have focused on joint-specific approaches, as reflected in the literature. This paper introduces a novel generally improved beam model. This model uniquely features 4 nodes, 12 elastic elements, and 1 beam, contrasting starkly with the conventional beam elements that consist of merely 2 nodes and 1 element. This innovative model enhances the adaptability of modeled structures at the joint level. Crucially, it necessitates a methodology for the precise estimation of the elastic elements at the joint level. This article explores the capabilities of artificial neural networks for predicting the stiffness values derived from the calculated displacements at specific points within a complete structure. This research provides a complete analysis of the proposed methodology showing the significant limitations encountered for ANN when predicting finite element methodology (FEM)-derived values. The results and findings obtained in the article serve as a valuable reference paving the way for future studies involving finite element models and artificial neural networks. [ABSTRACT FROM AUTHOR]

With the widespread use of deep-learning models in production environments, the value of deep-learning models has become more prominent. The key issues are the rights of the model trainers and the security of the specific scenarios using the models. In the commercial domain, consumers pay different fees and have access to different levels of services. Therefore, dividing the model into several shadow models with multiple weights is necessary. When holders want to use the model, they can recover the model whose performance corresponds to the number and weights of the collected shadow models so that access to the model can be controlled progressively, i.e., progressive recovery is significant. This paper proposes a neural network model secret sharing scheme (NNSS) with multiple weights for progressive recovery. The scheme uses Shamir's polynomial to control model parameters' sharing and embedding phase, which in turn enables hierarchical performance control in the secret model recovery phase. First, the important model parameters are extracted. Then, effective shadow parameters are assigned based on the holders' weights in the sharing phase, and t shadow models are generated. The holders can obtain a sufficient number of shadow parameters for recovering the secret parameters with a certain probability during the recovery phase. As the number of shadow models obtained increases, the probability becomes larger, while the performance of the extracted models is related to the participants' weights in the recovery phase. The probability is proportional to the number and weights of the shadow models obtained in the recovery phase, and the probability of the successful recovery of the shadow parameters is 1 when all t shadow models are obtained, i.e., the performance of the reconstruction model can reach the performance of the secret model. A series of experiments conducted on VGG19 verify the effectiveness of the scheme. [ABSTRACT FROM AUTHOR]

Extracting structured information from massive and heterogeneous text is a hot research topic in the field of natural language processing. It includes two key technologies: named entity recognition (NER) and relation extraction (RE). However, previous NER models consider less about the influence of mutual attention between words in the text on the prediction of entity labels, and there is less research on how to more fully extract sentence information for relational classification. In addition, previous research treats NER and RE as a pipeline of two separated tasks, which neglects the connection between them, and is mainly focused on the English corpus. In this paper, based on the self-attention mechanism, bidirectional long short-term memory (BiLSTM) neural network and conditional random field (CRF) model, we put forth a Chinese NER method based on BiLSTM-Self-Attention-CRF and a RE method based on BiLSTM-Multilevel-Attention in the field of Chinese literature. In particular, considering the relationship between these two tasks in terms of word vector and context feature representation in the neural network model, we put forth a joint learning method for NER and RE tasks based on the same underlying module, which jointly updates the parameters of the shared module during the training of these two tasks. For performance evaluation, we make use of the largest Chinese data set containing these two tasks. Experimental results show that the proposed independently trained NER and RE models achieve better performance than all previous methods, and our joint NER-RE training model outperforms the independently-trained NER and RE model. [ABSTRACT FROM AUTHOR]

New propulsion systems in aircrafts must meet strict regulations and emission limitations. The Flightpath 2050 goals set by the Advisory Council for Aviation Research and Innovation in Europe (ACARE) include reductions of 75%, 90%, and 65% in CO2, NOx, and noise, respectively. These goals are not fully satisfied by marginal improvements in gas turbine technology or aircraft design. A novel control design procedure for the next generation of turbofan engines is proposed in this paper to improve Full Authority Digital Engine Control (FADEC) systems and reduce the emission levels to meet the Flightpath 2050 regulations. Hence, an Adaptive Network–based Fuzzy Inference System (ANFIS), nonlinear autoregressive network with exogenous inputs (NARX) techniques, and the block-structure Hammerstein–Wiener approach are used to develop a model for a turbofan engine. The Min–Max control structure is chosen as the most widely used practical control algorithm for gas turbine aero engines. The objective function is considered to minimize the emission level for the engine in a pre-defined maneuver while keeping the engine performance in different aspects. The Genetic Algorithm (GA) is applied to find the optimized control structure. The results confirm the effectiveness of the proposed approach in emission reduction for the next generation of turbofan engines. [ABSTRACT FROM AUTHOR]

In the paper by Jovanovic et al. [[11]], the authors propose a hybrid ML and swarm intelligence approach to address credit card fraud detection. 10.3390/math10081232 11 Jovanovic D., Antonijevic M., Stankovic M., Zivkovic M., Tanaskovic M., Bacanin N. Tuning Machine Learning Models Using a Group Search Firefly Algorithm for Credit Card Fraud Detection. Swarm and evolutionary computation (SEC) [[1]] is a broad and growing area of modern computer sciences, dealing with nature-inspired systems that are capable of displaying intelligent behaviour, thus optimising a vast range of challenging real-world scenarios that cannot be addressed via the direct application of purely theoretical exact approaches (e.g., [[2]]). [Extracted from the article]