Search

This document is a summary of a special issue of the journal Sensors, titled "Emerging AI+X-Based Sensor and Networking Technologies including Selected Papers from ICGHIT 2022–2023." The special issue features selected papers from the 10th and 11th International Conferences on Green and Human Information Technology (ICGHITs), which were held in Korea and Thailand. The conferences focused on the theme of "Emerging Artificial Intelligent (AI)+X technology" and "Hyper Automation + Human AI" respectively. The selected papers cover various topics such as network security, routing protocols, signal detection, and clustering mechanisms, all incorporating AI-based methods. The issue also includes papers on topics like secure authentication, distance estimation in RFID systems, energy optimization in smart homes, blockchain technology, and radar signal detection. The authors emphasize the importance of both technology and humanity in advancing green and information technologies. [Extracted from the article]

Forecasting has extreme importance in industry due to the numerous competitive advantages that it provides, allowing to foresee what might happen and adjust management decisions accordingly. Industries increasingly use sensors, which allow for large-scale data collection. Big datasets enable training, testing and application of complex predictive algorithms based on machine learning models. The present paper focuses on predicting values from sensors installed on a pulp paper press, using data collected over three years. The variables analyzed are electric current, pressure, temperature, torque, oil level and velocity. The results of XGBoost and artificial neural networks, with different feature vectors, are compared. They show that it is possible to predict sensor data in the long term and thus predict the asset's behaviour several days in advance. [ABSTRACT FROM AUTHOR]

In this study, we propose the use of artificial synaptic transistors with coplanar-gate structures fabricated on paper substrates comprising biocompatible and low-cost potato-starch electrolyte and indium–gallium–zinc oxide (IGZO) channels. The electrical double layer (EDL) gating effect of potato-starch electrolytes enabled the emulation of biological synaptic plasticity. Frequency dependence measurements of capacitance using a metal-insulator-metal capacitor configuration showed a 1.27 μF/cm2 at a frequency of 10 Hz. Therefore, strong capacitive coupling was confirmed within the potato-starch electrolyte/IGZO channel interface owing to EDL formation because of internal proton migration. An electrical characteristics evaluation of the potato-starch EDL transistors through transfer and output curve resulted in counterclockwise hysteresis caused by proton migration in the electrolyte; the hysteresis window linearly increased with maximum gate voltage. A synaptic functionality evaluation with single-spike excitatory post-synaptic current (EPSC), paired-pulse facilitation (PPF), and multi-spike EPSC resulted in mimicking short-term synaptic plasticity and signal transmission in the biological neural network. Further, channel conductance modulation by repetitive presynaptic stimuli, comprising potentiation and depression pulses, enabled stable modulation of synaptic weights, thereby validating the long-term plasticity. Finally, recognition simulations on the Modified National Institute of Standards and Technology (MNIST) handwritten digit database yielded a 92% recognition rate, thereby demonstrating the applicability of the proposed synaptic device to the neuromorphic system. [ABSTRACT FROM AUTHOR]

In recent years, the wide application of deep neural network models has brought serious risks of intellectual property rights infringement. Embedding a watermark in a network model is an effective solution to protect intellectual property rights. Although researchers have proposed schemes to add watermarks to models, they cannot prevent attackers from adding and overwriting original information, and embedding rates cannot be quantified. Therefore, aiming at these problems, this paper designs a high embedding rate and tamper-proof watermarking scheme. We employ wet paper coding (WPC), in which important parameters are regarded as wet blocks and the remaining unimportant parameters are regarded as dry blocks in the model. To obtain the important parameters more easily, we propose an optimized probabilistic selection strategy (OPSS). OPSS defines the unimportant-level function and sets the importance threshold to select the important parameter positions and to ensure that the original function is not affected after the model parameters are changed. We regard important parameters as an unmodifiable part, and only modify the part that includes the unimportant parameters. We selected the MNIST, CIFAR-10, and ImageNet datasets to test the performance of the model after adding a watermark and to analyze the fidelity, robustness, embedding rate, and comparison schemes of the model. Our experiment shows that the proposed scheme has high fidelity and strong robustness along with a high embedding rate and the ability to prevent malicious tampering. [ABSTRACT FROM AUTHOR]

Although deep learning (DL) algorithms have been proved to be effective in diverse research domains, their application in developing models for tabular data remains limited. Models trained on tabular data demonstrate higher efficacy using traditional machine learning models than DL models, which are largely attributed to the size and structure of tabular datasets and the specific application contexts in which they are utilized. Thus, the primary objective of this paper is to propose a method to use the supremacy of Stacked Bidirectional LSTM (Long Short-Term Memory) deep learning algorithms in pattern discovery incorporating tabular data with customized 3D tensor modeling in feeding neural networks. Our findings are empirically validated using six diverse, publicly available datasets each varying in size and learning objectives. This paper proves that the proposed model based on time-sequence DL algorithms, which were generally described as inadequate when dealing with tabular data, yields satisfactory results and competes effectively with other algorithms specifically designed for tabular data. An additional benefit of this approach is its ability to preserve simplicity while ensuring fast model training also with large datasets. Even with extremely small datasets, models can be applied to achieve exceptional predictive results and fully utilize their capacity. [ABSTRACT FROM AUTHOR]

This research paper explores the realm of fault detection in distributed motors through the vision of the Internet of electrical drives. This paper aims at employing artificial neural networks supported by the data collected by the Internet of distributed devices. Cross-verification of results offers reliable diagnosis of industrial motor faults. The proposed methodology involves the development of a cyber–physical system architecture and mathematical modeling framework for efficient fault detection. The mathematical model is designed to capture the intricate relationships within the cyber–physical system, incorporating the dynamic interactions between distributed motors and their edge controllers. Fast Fourier transform is employed for signal processing, enabling the extraction of meaningful frequency features that serve as indicators of potential faults. The artificial neural network based fault detection system is integrated with the solution, utilizing its ability to learn complex patterns and adapt to varying motor conditions. The effectiveness of the proposed framework and model is demonstrated through experimental results. The experimental setup involves diverse fault scenarios, and the system's performance is evaluated in terms of accuracy, sensitivity, and false positive rates. [ABSTRACT FROM AUTHOR]

This paper proposes a scheme for predicting ground reaction force (GRF) and center of pressure (CoP) using low-cost FSR sensors. GRF and CoP data are commonly collected from smart insoles to analyze the wearer's gait and diagnose balance issues. This approach can be utilized to improve a user's rehabilitation process and enable customized treatment plans for patients with specific diseases, making it a useful technology in many fields. However, the conventional measuring equipment for directly monitoring GRF and CoP values, such as F-Scan, is expensive, posing a challenge to commercialization in the industry. To solve this problem, this paper proposes a technology to predict relevant indicators using only low-cost Force Sensing Resistor (FSR) sensors instead of expensive equipment. In this study, data were collected from subjects simultaneously wearing a low-cost FSR Sensor and an F-Scan device, and the relationship between the collected data sets was analyzed using supervised learning techniques. Using the proposed technique, an artificial neural network was constructed that can derive a predicted value close to the actual F-Scan values using only the data from the FSR Sensor. In this process, GRF and CoP were calculated using six virtual forces instead of the pressure value of the entire sole. It was verified through various simulations that it is possible to achieve an improved prediction accuracy of more than 30% when using the proposed technique compared to conventional prediction techniques. [ABSTRACT FROM AUTHOR]

Multiphase fluids are common in many industries, such as oil and petrochemical, and volume fraction measurement of their phases is a vital subject. Hence, there are lots of scientists and researchers who have introduced many methods and equipment in this regard, for example, photon attenuation sensors, capacitance-based sensors, and so on. These approaches are non-invasive and for this reason, are very popular and widely used. In addition, nowadays, artificial neural networks (ANN) are very attractive in a lot of fields and this is because of their accuracy. Therefore, in this paper, to estimate volume proportion of a three-phase homogeneous fluid, a new system is proposed that contains an MLP ANN, standing for multilayer perceptron artificial neural network, a capacitance-based sensor, and a photon attenuation sensor. Through computational methods, capacities and mass attenuation coefficients are obtained, which act as inputs for the proposed network. All of these inputs were divided randomly in two main groups to train and test the presented model. To opt for a suitable network with the lowest rate of mean absolute error (MAE), a number of architectures with different factors were tested in MATLAB software R2023b. After receiving MAEs equal to 0.29, 1.60, and 1.67 for the water, gas, and oil phases, respectively, the network was chosen to be presented in the paper. Hence, based on outcomes, the proposed approach's novelty is being able to predict all phases of a homogeneous flow with very low error. [ABSTRACT FROM AUTHOR]

Reservoir productivity prediction is a key component of oil and gas field development, and the rapid and accurate evaluation of reservoir productivity plays an important role in evaluating oil field development potential and improving oil field development efficiency. Fracture-vuggy reservoirs are characterized by strong heterogeneity, complex distribution, and irregular development, causing great difficulties in the efficient prediction of fracture-vuggy reservoirs' productivity. Therefore, a PSO-BP fracture-vuggy reservoir productivity prediction model optimized by feature optimization was proposed in this paper. The Chatterjee correlation coefficient was used to select the appropriate combination of seismic attributes as the input of the prediction model, and we applied the PSO-BP model to predict oil wells' production in a typical fracture-vuggy reservoir area of Tahe Oilfield, China, with the selected seismic attributes and compared the accuracy with that provided by the BP neural network, linear support vector machine, and multiple linear regression. The prediction results using the four models based on the test set showed that compared with the other three models, the MSE of the PSO-BP model increased by 23% to 62%, the RMSE increased by 12 to 38 percent, the MAE increased by 18 to 44 percent, the SSE increased by 23 to 62 percent, and the R-square value increased by 2 to 13 percent. This comparison proves that the PSO-BP neural network model proposed in this paper is suitable for the productivity prediction of fracture-vuggy reservoirs and has better performance, which is of guiding significance for the development and production of fracture-vuggy reservoirs. [ABSTRACT FROM AUTHOR]

Understanding road conditions is essential for implementing effective road safety measures and driving solutions. Road situations encompass the day-to-day conditions of roads, including the presence of vehicles and pedestrians. Surveillance cameras strategically placed along streets have been instrumental in monitoring road situations and providing valuable information on pedestrians, moving vehicles, and objects within road environments. However, these video data and information are stored in large volumes, making analysis tedious and time-consuming. Deep learning models are increasingly utilized to monitor vehicles and identify and evaluate road and driving comfort situations. However, the current neural network model requires the recognition of situations using time-series video data. In this paper, we introduced a multi-directional detection model for road situations to uphold high accuracy. Deep learning methods often integrate long short-term memory (LSTM) into long-term recurrent network architectures. This approach effectively combines recurrent neural networks to capture temporal dependencies and convolutional neural networks (CNNs) to extract features from extensive video data. In our proposed method, we form a multi-directional long-term recurrent convolutional network approach with two groups equipped with CNN and two layers of LSTM. Additionally, we compare road situation recognition using convolutional neural networks, long short-term networks, and long-term recurrent convolutional networks. The paper presents a method for detecting and recognizing multi-directional road contexts using a modified LRCN. After balancing the dataset through data augmentation, the number of video files increased, resulting in our model achieving 91% accuracy, a significant improvement from the original dataset. [ABSTRACT FROM AUTHOR]

Establishing an accurate and robust feature fusion mechanism is key to enhancing the tracking performance of single-object trackers based on a Siamese network. However, the output features of the depth-wise cross-correlation feature fusion module in fully convolutional trackers based on Siamese networks cannot establish global dependencies on the feature maps of a search area. This paper proposes a dynamic cascade feature fusion (DCFF) module by introducing a local feature guidance (LFG) module and dynamic attention modules (DAMs) after the depth-wise cross-correlation module to enhance the global dependency modeling capability during the feature fusion process. In this paper, a set of verification experiments is designed to investigate whether establishing global dependencies for the features output by the depth-wise cross-correlation operation can significantly improve the performance of fully convolutional trackers based on a Siamese network, providing experimental support for rational design of the structure of a dynamic cascade feature fusion module. Secondly, we integrate the dynamic cascade feature fusion module into the tracking framework based on a Siamese network, propose SiamDCFF, and evaluate it using public datasets. Compared with the baseline model, SiamDCFF demonstrated significant improvements. [ABSTRACT FROM AUTHOR]

Simple Summary: Artificial intelligence has become essential for aiding in different knowledge domains by improving knowledge extraction from raw data and process automation. In dairy production, artificial intelligence offers promising applications in detecting and managing bovine mastitis, the most critical disease affecting the mammary gland in dairy cows, impacting milk production and profitability in dairy farms. This research evaluated the evolution of artificial intelligence applications in bovine mastitis between 2011 and 2021 using the Scopus database and the frequency of terms cited in titles, abstracts, and keywords. We selected the 62 papers that were the most relevant according to their citation index. Our results pointed out that the terms "machine learning" and "mastitis" were the most cited, with a significant increase between 2018 and 2021. There was an increase in artificial intelligence applications for bovine mastitis per country, showing applications primarily aimed at improving the current mastitis detection systems. The most cited model was artificial neural networks. We concluded that using artificial intelligence in bovine mastitis was related to mastitis detection as a vital tool to prevent this disease, considering its major impacts on dairy production and economic return. Mastitis, an important disease in dairy cows, causes significant losses in herd profitability. Accurate diagnosis is crucial for adequate control. Studies using artificial intelligence (AI) models to classify, identify, predict, and diagnose mastitis show promise in improving mastitis control. This bibliometric review aimed to evaluate AI and bovine mastitis terms in the most relevant Scopus-indexed papers from 2011 to 2021. Sixty-two documents were analyzed, revealing key terms, prominent researchers, relevant publications, main themes, and keyword clusters. "Mastitis" and "machine learning" were the most cited terms, with an increasing trend from 2018 to 2021. Other terms, such as "sensors" and "mastitis detection", also emerged. The United States was the most cited country and presented the largest collaboration network. Publications on mastitis and AI models notably increased from 2016 to 2021, indicating growing interest. However, few studies utilized AI for bovine mastitis detection, primarily employing artificial neural network models. This suggests a clear potential for further research in this area. [ABSTRACT FROM AUTHOR]

Side-scan sonar plays a crucial role in underwater exploration, and the autonomous detection of side-scan sonar images is vital for detecting unknown underwater environments. However, due to the complexity of the underwater environment, the presence of a few highlighted areas on the targets, blurred feature details, and difficulty in collecting data from side-scan sonar, achieving high-precision autonomous target recognition in side-scan sonar images is challenging. This article addresses this problem by improving the You Only Look Once v7 (YOLOv7) model to achieve high-precision object detection in side-scan sonar images. Firstly, given that side-scan sonar images contain large areas of irrelevant information, this paper introduces the Swin-Transformer for dynamic attention and global modeling, which enhances the model's focus on the target regions. Secondly, the Convolutional Block Attention Module (CBAM) is utilized to further improve feature representation and enhance the neural network model's accuracy. Lastly, to address the uncertainty of geometric features in side-scan sonar target features, this paper innovatively incorporates a feature scaling factor into the YOLOv7 model. The experiment initially verified the necessity of attention mechanisms in the public dataset. Subsequently, experiments on our side-scan sonar (SSS) image dataset show that the improved YOLOv7 model has 87.9% and 49.23% in its average accuracy ( m A P 0.5 ) and ( m A P 0.5:0.95), respectively. These results are 9.28% and 8.41% higher than the YOLOv7 model. The improved YOLOv7 algorithm proposed in this paper has great potential for object detection and the recognition of side-scan sonar images. [ABSTRACT FROM AUTHOR]

In this paper, the effect evaluation and production prediction of staged fracturing for horizontal wells in tight reservoirs are studied. Firstly, the basic characteristics and value of horizontal wells in tight reservoirs are introduced, their geological characteristics, flow mechanism and permeability model are analyzed and the application of grey theory in effect analysis is discussed. Considering the problems of staged fracturing effect evaluation and the production prediction of horizontal wells in tight reservoirs, a BP neural network model based on deep learning is proposed. Due to the interference of multiple physical parameters and the complex functional relationship in the development of tight reservoir fracturing, the traditional prediction method has low accuracy and it is difficult to establish an accurate mapping relationship. In this paper, a BP neural network is used to simulate multivariable nonlinear mapping by modifying the model, and its advantages in solving the coupling relationship of complex functions are brought into play. A neural network model with fracturing parameters as input and oil and gas production as output is designed. Through the training and testing of data sets, the accuracy and applicability of the proposed model for effect evaluation and yield prediction are verified. The research results show that the model can fit the complex mapping relationship between fracturing information and production and provide an effective evaluation and prediction tool for the development of the staged fracturing of horizontal wells in tight reservoirs. [ABSTRACT FROM AUTHOR]

Forest biomass estimation is undoubtedly one of the most pressing research subjects at present. Combining multi-source remote sensing information can give full play to the advantages of different remote sensing technologies, providing more comprehensive and rich information for aboveground biomass (AGB) estimation research. Based on Landsat 8, Sentinel-2A, and ALOS2 PALSAR data, this paper takes the artificial coniferous forests in the Saihanba Forest of Hebei Province as the object of study, fully explores and establishes remote sensing factors and information related to forest structure, gives full play to the advantages of spectral signals in detecting the horizontal structure and multi-dimensional synthetic aperture radar (SAR) data in detecting the vertical structure, and combines environmental factors to carry out multivariate synergistic methods of estimating the AGB. This paper uses three variable selection methods (Pearson correlation coefficient, random forest significance, and the least absolute shrinkage and selection operator (LASSO)) to establish the variable sets, combining them with three typical non-parametric models to estimate AGB, namely, random forest (RF), support vector regression (SVR), and artificial neural network (ANN), to analyze the effect of forest structure on biomass estimation, explore the suitable AGB of artificial coniferous forests estimation of machine learning models, and develop the method of quantifying saturation value of the combined variables. The results show that the horizontal structure is more capable of explaining the AGB compared to the vertical structure information, and that combining the multi-structure information can improve the model results and the saturation value to a great extent. In this study, different sets of variables can produce relatively superior results in different models. The variable set selected using LASSO gives the best results in the SVR model, with an R 2 values of 0.9998 and 0.8792 for the training and the test set, respectively, and the highest saturation value obtained is 185.73 t/ha, which is beyond the range of the measured data. The problem of saturation in biomass estimation in boreal medium- and high-density forests was overcome to a certain extent, and the AGB of the Saihanba area was better estimated. [ABSTRACT FROM AUTHOR]

This paper introduces a novel one-dimensional convolutional neural network that utilizes clinical data to accurately detect choledocholithiasis, where gallstones obstruct the common bile duct. Swift and precise detection of this condition is critical to preventing severe complications, such as biliary colic, jaundice, and pancreatitis. This cutting-edge model was rigorously compared with other machine learning methods commonly used in similar problems, such as logistic regression, linear discriminant analysis, and a state-of-the-art random forest, using a dataset derived from endoscopic retrograde cholangiopancreatography scans performed at Olive View–University of California, Los Angeles Medical Center. The one-dimensional convolutional neural network model demonstrated exceptional performance, achieving 90.77% accuracy and 92.86% specificity, with an area under the curve of 0.9270. While the paper acknowledges potential areas for improvement, it emphasizes the effectiveness of the one-dimensional convolutional neural network architecture. The results suggest that this one-dimensional convolutional neural network approach could serve as a plausible alternative to endoscopic retrograde cholangiopancreatography, considering its disadvantages, such as the need for specialized equipment and skilled personnel and the risk of postoperative complications. The potential of the one-dimensional convolutional neural network model to significantly advance the clinical diagnosis of this gallstone-related condition is notable, offering a less invasive, potentially safer, and more accessible alternative. [ABSTRACT FROM AUTHOR]

This review explores recent advancements in hydrogen gas (H2) safety through the lens of artificial intelligence (AI) techniques. As hydrogen gains prominence as a clean energy source, ensuring its safe handling becomes paramount. The paper critically evaluates the implementation of AI methodologies, including artificial neural networks (ANN), machine learning algorithms, computer vision (CV), and data fusion techniques, in enhancing hydrogen safety measures. By examining the integration of wireless sensor networks and AI for real-time monitoring and leveraging CV for interpreting visual indicators related to hydrogen leakage issues, this review highlights the transformative potential of AI in revolutionizing safety frameworks. Moreover, it addresses key challenges such as the scarcity of standardized datasets, the optimization of AI models for diverse environmental conditions, etc., while also identifying opportunities for further research and development. This review foresees faster response times, reduced false alarms, and overall improved safety for hydrogen-related applications. This paper serves as a valuable resource for researchers, engineers, and practitioners seeking to leverage state-of-the-art AI technologies for enhanced hydrogen safety systems. [ABSTRACT FROM AUTHOR]

This document discusses the degradation and failure mechanisms of dielectric insulation in medium- and high-voltage power equipment. It highlights the importance of controlling insulation material degradation to prevent equipment failures and reduce the risk of environmental pollution. The document includes several research papers that address various topics related to the measurement, monitoring, and improvement of power equipment components. These papers cover issues such as winding breakdown faults in transformers, overvoltages caused by vacuum circuit breaker interruptions, insulation resistance degradation in cables, temperature rise in composite insulators, partial discharges and their effects on insulation, and acoustic inspection for detecting partial discharges. The document also presents studies on the technical condition of on-load tap changers, the behavior of silicone elastomers under electrical and mechanical stress, and the percolation phenomenon in square matrices. [Extracted from the article]

Aiming at the shortcomings of single-sensor sensing information characterization ability, which is easily interfered with by external environmental factors, a method of intelligent perception is proposed in this paper. This method integrates multi-source and multi-level information, including spindle temperature field, spindle thermal deformation, operating parameters, and motor current. Firstly, the internal and external thermal-error-related signals of the spindle system are collected by sensors, and the feature parameters are extracted; then, the radial basis function (RBF) neural network is utilized to realize the preliminary integration of the feature parameters because of the advantages of the RBF neural network, which offers strong multi-dimensional solid nonlinear mapping ability and generalization ability. Thermal-error decision values are then generated by a weighted fusion of different pieces of evidence by considering uncertain information from multiple sources. The spindle thermal-error sensing experiment was based on the spindle system of the VMC850 (Yunnan Machine Tool Group Co., LTD, Yunnan, China) vertical machining center of the Yunnan Machine Tool Factory. Experiments were designed for thermal-error sensing of the spindle under constant speed (2000 r/min and 4000 r/min), standard variable speed, and stepped variable speed conditions. The experiment's results show that the prediction accuracy of the intelligent-sensing model with multi-source information fusion can reach 98.1%, 99.3%, 98.6%, and 98.8% under the above working conditions, respectively. The intelligent-perception model proposed in this paper has higher accuracy and lower residual error than the traditional BP neural network perception and wavelet neural network models. The research in this paper provides a theoretical basis for the operation, maintenance management, and performance optimization of machine tool spindle systems. [ABSTRACT FROM AUTHOR]

This paper addresses issues concerning biometric authentication based on handwritten signatures. Our research aimed to check whether a handwritten signature acquired with a mobile device can effectively verify a user's identity. We present a novel online signature verification method using coordinates of points and pressure values at each point collected with a mobile device. Convolutional neural networks are used for signature verification. In this paper, three neural network models are investigated, i.e., two self-made light SigNet and SigNetExt models and the VGG-16 model commonly used in image processing. The convolutional neural networks aim to determine whether the acquired signature sample matches the class declared by the signer. Thus, the scenario of closed set verification is performed. The effectiveness of our method was tested on signatures acquired with mobile phones. We used the subset of the multimodal database, MobiBits, that was captured using a custom-made application and consists of samples acquired from 53 people of diverse ages. The experimental results on accurate data demonstrate that developed architectures of deep neural networks can be successfully used for online handwritten signature verification. We achieved an equal error rate (EER) of 0.63% for random forgeries and 6.66% for skilled forgeries. [ABSTRACT FROM AUTHOR]

Radio frequency interference (RFI) significantly hampers the target detection performance of frequency-modulated continuous-wave radar. To address the problem and maintain the target echo signal, this paper proposes a priori assumption on the interference component nature in the radar received signal, as well as a method for interference estimation and mitigation via time–frequency analysis. The solution employs Fourier synchrosqueezed transform to implement the radar's beat signal transformation from time domain to time–frequency domain, thus converting the interference mitigation to the task of time–frequency distribution image restoration. The solution proposes the use of image processing based on the dual-tree complex wavelet transform and combines it with the spatial domain-based approach, thereby establishing a dual-domain fusion interference filter for time–frequency distribution images. This paper also presents a convolutional neural network model of structurally improved UNet++, which serves as the interference estimator. The proposed solution demonstrated its capability against various forms of RFI through the simulation experiment and showed a superior interference mitigation performance over other CNN model-based approaches. [ABSTRACT FROM AUTHOR]

This document is a summary of a journal article titled "Artificial Intelligence in Modeling and Simulation." The article discusses the integration of artificial intelligence (AI) into modeling and simulation (M&S) processes. It highlights the various applications of AI in fields such as engineering, physics, social sciences, and biology. The article also provides an overview of 11 selected papers from a special issue on AI and M&S, covering topics such as AI techniques for simulation and optimization, AI in agent-based modeling, AI for data processing and classification models, and artificial neural network (ANN) methods for improved M&S. The papers explore different methodologies and approaches to enhance the efficiency and validity of modeling and simulation using AI. The article concludes by emphasizing the progress and diverse uses of AI in M&S and expressing gratitude to the authors, reviewers, and editorial team involved in the special issue. [Extracted from the article]

Convolutional Neural Networks (CNNs) are a kind of artificial neural network designed to extract features and find out patterns for tasks such as segmentation, recognizing objects, and drawing up classification. Within a CNNs architecture, pooling operations are used until the number of parameters and the computational complexity are reduced. Numerous papers have focused on investigating the impact of pooling on the performance of Convolutional Neural Networks (CNNs), leading to the development of various pooling models. Recently, a fuzzy pooling operation based on type-1 fuzzy sets was introduced to cope with the local imprecision of the feature maps. However, in fuzzy set theory, it is not always accurate to assume that the degree of non-membership of an element in a fuzzy set is simply the complement of the degree of membership. This is due to the potential existence of a hesitation degree, which implies a certain level of uncertainty. To overcome this limitation, intuitionistic fuzzy sets (IFS) were introduced to incorporate the concept of a degree of hesitation. In this paper, we introduce a novel pooling operation based on intuitionistic fuzzy sets to incorporate the degree of hesitation heretofore neglected by a fuzzy pooling operation based on classical fuzzy sets, and we investigate its performance in the context of image classification. Intuitionistic pooling is performed in four steps: bifuzzification (by the transformation of data through the use of membership and non-membership maps), first aggregation (through the transformation of the IFS into a standard fuzzy set, second aggregation (through the transformation and use of a sum operator), and the defuzzification of feature map neighborhoods by using a max operator. IFS pooling is used for the construction of an intuitionistic pooling layer that can be applied as a drop-in replacement for the current, fuzzy (type-1) and crisp, pooling layers of CNN architectures. Various experiments involving multiple datasets demonstrate that an IFS-based pooling can enhance the classification performance of a CNN. A benchmarking study reveals that this significantly outperforms even the most recent pooling models, especially in stochastic environments. [ABSTRACT FROM AUTHOR]

Giga-casting, a revolutionary approach for manufacturing large, single-piece car body components from aluminium, has emerged as a potential game-changer in the automotive industry. However, these large, thin-walled castings are prone to distortions during solidification and heat treatment processes. Straightening these distortions is crucial to ensure structural integrity, facilitate downstream assembly, and maintain aesthetic qualities. This paper proposes a novel method for straightening giga-cast components using a multi-pin straightening machine. The machine's versatility stems from its ability to adapt to various geometries through multiple strategically controlled straightening pins. This paper introduces the concept of a "straightening stroke decision algorithm" to achieve precise straightening and overcome the challenges of complex shapes. This algorithm determines the stroke length for each pin, combining a polynomial model representing the global stiffness of the component with a machine learning model that captures the stiffness changes arising from the current geometry. The effectiveness of the proposed approach is evaluated through comprehensive numerical experiments using finite element analyses. The straightening performance is assessed for the straightening algorithm with different machine learning models (deep neural network and XGBoost) and compared to a traditional optimisation method. The proposed surrogate models decided the straightening strokes so that the maximum remaining distortion became 0.02% of the largest dimension of each target geometry. The results of the numerical experiment showed that the proposed straightening method is suitable for straightening distortion in large thin-walled components. [ABSTRACT FROM AUTHOR]

Deep learning, a crucial technique for achieving artificial intelligence (AI), has been successfully applied in many fields. The gradual application of the latest architectures of deep learning in the field of time series forecasting (TSF), such as Transformers, has shown excellent performance and results compared to traditional statistical methods. These applications are widely present in academia and in our daily lives, covering many areas including forecasting electricity consumption in power systems, meteorological rainfall, traffic flow, quantitative trading, risk control in finance, sales operations and price predictions for commercial companies, and pandemic prediction in the medical field. Deep learning-based TSF tasks stand out as one of the most valuable AI scenarios for research, playing an important role in explaining complex real-world phenomena. However, deep learning models still face challenges: they need to deal with the challenge of large-scale data in the information age, achieve longer forecasting ranges, reduce excessively high computational complexity, etc. Therefore, novel methods and more effective solutions are essential. In this paper, we review the latest developments in deep learning for TSF. We begin by introducing the recent development trends in the field of TSF and then propose a new taxonomy from the perspective of deep neural network models, comprehensively covering articles published over the past five years. We also organize commonly used experimental evaluation metrics and datasets. Finally, we point out current issues with the existing solutions and suggest promising future directions in the field of deep learning combined with TSF. This paper is the most comprehensive review related to TSF in recent years and will provide a detailed index for researchers in this field and those who are just starting out. [ABSTRACT FROM AUTHOR]

Pattern recognition systems always misclassify anomalies, which can be dangerous for uninformed users. Therefore, anomalies must be filtered out from each classification. The main challenge for the anomaly filter design is the huge number of possible anomaly samples compared with the number of samples in the training set. Tailoring the filter for the given classifier is just the first step in this reduction. Paper tests the hypothesis that the filter trained in avoiding "near" anomalies will also refuse the "far" anomalies, and the anomaly detector is then just a classifier distinguishing between "far real" and "near anomaly" samples. As a "far real" samples generator was used, a Generative Adversarial Network (GAN) fake generator that transforms normally distributed random seeds into fakes similar to the training samples. The paper proves the assumption that seeds unused in fake training will generate anomalies. These seeds are distinguished according to their Chebyshev norms. While the fakes have seeds within the hypersphere with a given radius, the near anomalies have seeds within the sphere near cover. Experiments with various anomaly test sets have shown that GAN-based anomaly detectors create a reliable anti-anomaly shield using the abovementioned assumptions. The proposed anomaly detector is tailored to the given classifier, but its limitation is due to the need for the availability of the database on which the classifier was trained. [ABSTRACT FROM AUTHOR]

Deep neural networks (DNNs) are increasingly important in the medical diagnosis of electrocardiogram (ECG) signals. However, research has shown that DNNs are highly vulnerable to adversarial examples, which can be created by carefully crafted perturbations. This vulnerability can lead to potential medical accidents. This poses new challenges for the application of DNNs in the medical diagnosis of ECG signals. This paper proposes a novel network Channel Activation Suppression with Lipschitz Constraints Net (CASLCNet), which employs the Channel-wise Activation Suppressing (CAS) strategy to dynamically adjust the contribution of different channels to the class prediction and uses the 1-Lipschitz's ℓ∞ distance network as a robust classifier to reduce the impact of adversarial perturbations on the model itself in order to increase the adversarial robustness of the model. The experimental results demonstrate that CASLCNet achieves A C C r o b u s t scores of 91.03% and 83.01% when subjected to PGD attacks on the MIT-BIH and CPSC2018 datasets, respectively, which proves that the proposed method in this paper enhances the model's adversarial robustness while maintaining a high accuracy rate. [ABSTRACT FROM AUTHOR]

This document is an editorial for a special issue titled "Machine Learning in Computer Vision and Image Sensing: Theory and Applications." The editorial highlights the diverse applications of machine learning (ML) models in various domains such as medical imaging, signal processing, remote sensing, and human activity detection. The special issue includes 11 papers that cover topics such as image segmentation, fluvial navigation, Alzheimer's disease classification, pneumothorax detection, lung cancer malignancy prediction, amniotic fluid volume detection, COVID-19 detection, and Parkinson's disease detection. The papers showcase the progress and potential of ML models in computer vision applications and provide valuable insights for future research. [Extracted from the article]

This paper investigates a method for precise mapping of human arm movements using sEMG signals. A multi-channel approach captures the sEMG signals, which, combined with the accurately calculated joint angles from an Inertial Measurement Unit, allows for action recognition and mapping through deep learning algorithms. Firstly, signal acquisition and processing were carried out, which involved acquiring data from various movements (hand gestures, single-degree-of-freedom joint movements, and continuous joint actions) and sensor placement. Then, interference signals were filtered out through filters, and the signals were preprocessed using normalization and moving averages to obtain sEMG signals with obvious features. Additionally, this paper constructs a hybrid network model, combining Convolutional Neural Networks and Artificial Neural Networks, and employs a multi-feature fusion algorithm to enhance the accuracy of gesture recognition. Furthermore, a nonlinear fitting between sEMG signals and joint angles was established based on a backpropagation neural network, incorporating momentum term and adaptive learning rate adjustments. Finally, based on the gesture recognition and joint angle prediction model, prosthetic arm control experiments were conducted, achieving highly accurate arm movement prediction and execution. This paper not only validates the potential application of sEMG signals in the precise control of robotic arms but also lays a solid foundation for the development of more intuitive and responsive prostheses and assistive devices. [ABSTRACT FROM AUTHOR]

With the continuous development and progress of wireless self-organizing network communication technology, how to carry out long-distance cooperative control of multiple intelligences under the framework of an air–ground integrated wireless high-mobility self-organizing network has become a hot and difficult topic that needs to be solved urgently. This paper takes the air–ground integrated wireless high-mobility self-organizing network system as the basic framework and focuses on solving the long-distance cooperative fault-tolerant control of multi-intelligent bodies and the topological stability of a wireless mobile self-organizing network. To solve the above problems, a direct neural network with a robust adaptive fault-tolerant controller is designed in this paper. By constructing a symmetric population neural network model and combining it with the Lyapunov stabilization criterion, the system feedback matrix K has the ability of autonomous adaptive learning, and symmetrically distorts, rotates, or scales the training data to instantly adjust the system's fault-tolerant corrections and adaptive adjusting factors to resist the unknown disturbances and faults, to achieve the goals of multi-intelligent body stable control and the stable operation of a wireless high-mobility self-organizing network topology. Simulation results show that with the feedback adjustment of the multi-system under the designed controller, the multi-system as a whole has good fault-tolerant performance and autonomous learning approximation performance, and the tracking error asymptotically converges to zero. The experimental results show that the multi-flight subsystems fly stably, the air–ground integrated wireless high-mobility self-organizing network topology has good stability performance, and the maximum relative improvement of the topology stability performance is 50%. [ABSTRACT FROM AUTHOR]

The research on baggage flow plays a pivotal role in achieving the efficient and intelligent allocation and scheduling of airport service resources, as well as serving as a fundamental element in determining the design, development, and process optimization of airport baggage handling systems. This paper examines baggage checked in by departing passengers at airports. The crrent state of the research on baggage flow demand is first reviewed and analyzed. Then, using examples of objective data, it is concluded that while there is a significant correlation between airport passenger flow and baggage flow, an increase in passenger flow does not necessarily result in a proportional increase in baggage flow. According to the existing research results on the influencing factors of baggage flow sorting and classification, the main influencing factors of baggage flow are divided into two categories: macro-influencing factors and micro-influencing factors. When studying the relationship between the economy and baggage flow, it is recommended to use a comprehensive analysis that includes multiple economic indicators, rather than relying solely on GDP. This paper provides a brief overview of prevalent transportation flow prediction methods, categorizing algorithmic models into three groups: based on mathematical and statistical models, intelligent algorithmic-based models, and combined algorithmic models utilizing artificial neural networks. The structures, strengths, and weaknesses of various transportation flow prediction algorithms are analyzed, as well as their application scenarios. The potential advantages of using artificial neural network-based combined prediction models for baggage flow forecasting are explained. It concludes with an outlook on research regarding the demand for baggage flow. This review may provide further research assistance to scholars in airport management and baggage handling system development. [ABSTRACT FROM AUTHOR]

Contactless and non-destructive measuring tools can facilitate the moisture monitoring of bagged or bulk grain during transportation and storage. However, accurate target recognition and size prediction always impede the effectiveness of contactless monitoring in actual use. This paper developed a novel 3D reconstruction method upon multi-angle point clouds using a binocular depth camera and a proper Yolo-based neural model to resolve the problem. With this method, this paper developed an embedded and low-cost monitoring system for the in-warehouse grain bags, which predicted targets' 3D size and boosted contactless grain moisture measuring. Identifying and extracting the object of interest from the complex background was challenging in size prediction of the grain silo-bag on a conveyor. This study first evaluated a series of Yolo-based neural network models and explored the most appropriate neural network structure for accurately extracting the grain bag. In point-cloud processing, this study constructed a rotation matrix to fuse multi-angle point clouds to generate a complete one. This study deployed all the above methods on a Raspberry Pi-embedded board to perform the grain bag's 3D reconstruction and size prediction. For experimental validation, this study built the 3D reconstruction platform and tested grain bags' reconstruction performance. First, this study determined the appropriate positions (−60°, 0°, 60°) with the least positions and high reconstruction quality. Then, this study validated the efficacy of the embedded system by evaluating its speed and accuracy and comparing it to the original Torch model. Results demonstrated that the NCNN-accelerated model significantly enhanced the average processing speed, nearly 30 times faster than the Torch model. The proposed system predicted the objects' length, width, and height, achieving accuracies of 97.76%, 97.02%, and 96.81%, respectively. The maximum residual value was less than 9 mm. And all the root mean square errors were less than 7 mm. In the future, the system will mount three depth cameras for achieving real-time size prediction and introduce a contactless measuring tool to finalize grain moisture detection. [ABSTRACT FROM AUTHOR]

The life expectancy of power transformers is primarily determined by the integrity of the insulating oil and cellulose paper between the conductor turns, phases and phase to earth. During the course of their in-service lifetime, the solid insulating system of windings is contingent on long-standing ageing and decomposition. The decomposition of the cellulose paper insulation is strikingly grievous, as it reduces the tensile strength of the cellulose paper and can trigger premature failure. The latter can trigger premature failure, and to realize at which point during the operational life this may occur is a daunting task. Various methods of estimating the DP have been proposed in the literature; however, these methods yield different results, making it difficult to accurately estimate a reliable DP. In this work, a novel approach based on the Feedforward Backpropagation Artificial Neural Network has been proposed to predict the amount of DP in transformer cellulose insulation. Presently, no ANN model has been proposed to predict the remaining DP using 2FAL concentration. A databank comprising 100 data sets—70 for training and 30 for testing—is used to develop the proposed ANN using 2-furaldehyde (2FAL) as an input and DP as an output. The proposed model yields a correlation coefficient of 0.958 for training, 0.915 for validation, 0.996 for testing and an overall correlation of 0.958 for the model. [ABSTRACT FROM AUTHOR]

The current seismic prediction methods of the shale brittleness index are all based on the pre-stack seismic inversion of elastic parameters, and the elastic parameters are transformed by Rickman and other simple linear mathematical relationship formulas. In order to address the low accuracy of the seismic prediction results for the brittleness index, this study proposes a method for predicting the brittleness index of shale reservoirs based on an error backpropagation neural network (BP neural network). The continuous static rock elastic parameters were calculated by fitting the triaxial test data with well logging data, and the static elastic parameters with good correlation with the brittleness index of shale minerals were selected as the sample data of the BP neural network model. A dataset of 1970 data points, characterized by Young's modulus, Poisson's ratio, shear modulus, and the mineral brittleness index, was constructed. A total of 367 sets of data points from well Z4 were randomly retained as model validation data, and 1603 sets of data points from the other three wells were divided into model training data and test data at a ratio of 7:3. The calculation accuracy of the model with different numbers of nodes was analyzed and the key parameters of the BP neural network structure such as the number of input layers, the number of output layers, the number of hidden layers, and the number of neurons were determined. The gradient descent method was used to determine the weight and bias of the model parameters with the smallest error, the BP neural network model was trained, and the stability of the brittleness index prediction model of the BP neural network was verified by posterior data. After obtaining Young's modulus, Poisson's ratio, and shear modulus through pre-stack seismic inversion, the BP neural network model established in this study was used to predict the brittleness index distribution of the target layer in the study area. Compared with the conventional Rickman method, the prediction coincidence rate is 69.16%, and the prediction coincidence rate between the prediction results and the real value is 95.79%, which is 26.63% higher. The BP neural network method proposed in this paper provides a reliable new method for seismic prediction of the shale reservoir brittleness index, which has important practical significance for clarifying the shale gas development scheme and improving shale gas exploitation efficiency. [ABSTRACT FROM AUTHOR]

This paper proposes an Artificial Neural Network (ANN) model using a Multi-Stage method to optimize the configuration of an External Lightning Protection System (ELPS) and grounding system. ELPS is a system designed to protect an area from damage caused by lightning strikes. Meanwhile, the grounding system functions to direct excess electric current from lightning strikes into the ground. This study identifies the optimal protection system configuration, reducing the need for excessive components. The ELPS configuration includes the number of protection pole units and the height of the protection poles. In contrast, the grounding system configuration consists of the number of electrode units and the length of the electrodes. This study focuses on the protection system configuration at a Photovoltaic Power Station, where the area is highly vulnerable to lightning strikes. Several aspects need to be considered in determining the appropriate configuration, such as average thunderstorm days per year, ELPS efficiency, total area of photovoltaic module, area to be protected, soil resistivity, electrode spacing factor, and the total required electrode resistance. The proposed multi-stage ANN model consists of three processing stages, each responsible for handling a portion of the overall system tasks. The first stage is responsible for determining the protection pole configuration. In the second stage, the Lightning Protection Level (LPL) classification is performed. Then, in the third stage, the process of determining the grounding configuration is handled. The analysis results show that the Multi-Stage ANN model can effectively determine the configuration with a low error rate: MAE of 0.265, RMSE of 0.314, and MPE of 9.533%. This model can also explain data variation well, as indicated by the high R 2 value of 0.961. The comparison results conducted with ATP/EMTP software show that the configuration produced by ANN results in fewer protection pole units but with greater height. Meanwhile, ANN produces a configuration with shorter electrode lengths but fewer units in the grounding system. [ABSTRACT FROM AUTHOR]

In this article, a deep neural network (DNN)-based underwater acoustic (UA) communication receiver is proposed. Conventional orthogonal frequency-division multiplexing (OFDM) receivers perform channel estimation using linear interpolation. However, due to the significant delay spread in multipath UA channels, the frequency response often exhibits strong non-linearity between pilot subcarriers. Since the channel delay profile is generally unknown, this non-linearity cannot be modeled precisely. A neural network (NN)-based receiver effectively tackles this challenge by learning and compensating for the non-linearity through NN training. The performance of the DNN-based UA communication receiver was tested recently in river trials in Western Australia. The results obtained from the trials prove that the DNN-based receiver performs better than the conventional least-squares (LS) estimator-based receiver. This paper suggests that UA communication using DNN receivers holds great potential for revolutionizing underwater communication systems, enabling higher data rates, improved reliability, and enhanced adaptability to changing underwater conditions. [ABSTRACT FROM AUTHOR]

Artificial intelligence technologies are becoming increasingly prevalent in resource-constrained, safety-critical embedded systems. Numerous methods exist to enhance the resilience of AI systems against disruptive influences. However, when resources are limited, ensuring cost-effective resilience becomes crucial. A promising approach for reducing the resource consumption of AI systems during test-time involves applying the concepts and methods of dynamic neural networks. Nevertheless, the resilience of dynamic neural networks against various disturbances remains underexplored. This paper proposes a model architecture and training method that integrate dynamic neural networks with a focus on resilience. Compared to conventional training methods, the proposed approach yields a 24% increase in the resilience of convolutional networks and a 19.7% increase in the resilience of visual transformers under fault injections. Additionally, it results in a 16.9% increase in the resilience of convolutional network ResNet-110 and a 21.6% increase in the resilience of visual transformer DeiT-S under adversarial attacks, while saving more than 30% of computational resources. Meta-training the neural network model improves resilience to task changes by an average of 22%, while achieving the same level of resource savings. [ABSTRACT FROM AUTHOR]

This paper studies an artificial neural network (ANN) for multi-asset European options. Firstly, a simple three-layer ANN-3 is established with undetermined weights and bias. Secondly, the time–space discrete PDE of the multi-asset option is given and the corresponding discrete data are fed into the ANN-3. Then, using least squares error as the objective function, the weights and bias of ANN-3 are trained well. Numerical examples are carried out to confirm the stability, accuracy and efficiency. Experiments show the ANN's relative error is about  0.8 % . This method can be extended into multi-layer ANN- q (q > 3)  and extended into American options. [ABSTRACT FROM AUTHOR]

With the rapid development of sensor technology, the anomaly detection of multi-source time series data becomes more and more important. Traditional anomaly detection methods deal with the temporal and spatial information in the data independently, and fail to make full use of the potential of spatio-temporal information. To address this issue, this paper proposes a novel integration method that combines sensor embeddings and temporal representation networks, effectively exploiting spatio-temporal dynamics. In addition, the graph neural network is introduced to skillfully simulate the complexity of multi-source heterogeneous data. By applying a dual loss function—consisting of a reconstruction loss and a prediction loss—we further improve the accuracy of anomaly detection. This strategy not only promotes the ability to learn normal behavior patterns from historical data, but also significantly improves the predictive ability of the model, making anomaly detection more accurate. Experimental results on four multi-source sensor datasets show that our proposed method performs better than the existing models. In addition, our approach enhances the ability to interpret anomaly detection by analyzing the sensors associated with the detected anomalies. [ABSTRACT FROM AUTHOR]

The paper demonstrates the effectiveness of the SNOWED dataset, specifically designed for identifying water bodies in Sentinel-2 images, in developing a remote sensing system based on deep neural networks. For this purpose, a system is implemented for monitoring the Po River, Italy's most important watercourse. By leveraging the SNOWED dataset, a simple U-Net neural model is trained to segment satellite images and distinguish, in general, water and land regions. After verifying its performance in segmenting the SNOWED validation set, the trained neural network is employed to measure the area of water regions along the Po River, a task that involves segmenting a large number of images that are quite different from those in SNOWED. It is clearly shown that SNOWED-based water area measurements describe the river status, in terms of flood or drought periods, with a surprisingly good accordance with water level measurements provided by 23 in situ gauge stations (official measurements managed by the Interregional Agency for the Po). Consequently, the sensing system is used to take measurements at 100 "virtual" gauge stations along the Po River, over the 10-year period (2015–2024) covered by the Sentinel-2 satellites of the Copernicus Programme. In this way, an overall space-time monitoring of the Po River is obtained, with a spatial resolution unattainable, in a cost-effective way, by local physical sensors. Altogether, the obtained results demonstrate not only the usefulness of the SNOWED dataset for deep learning-based satellite sensing, but also the ability of such sensing systems to effectively complement traditional in situ sensing stations, providing precious tools for environmental monitoring, especially of locations difficult to reach, and permitting the reconstruction of historical data related to floods and draughts. Although physical monitoring stations are designed for rapid monitoring and prevention of flood or other disasters, the developed tool for remote sensing of water bodies could help decision makers to define long-term policies to reduce specific risks in areas not covered by physical monitoring or to define medium- to long-term strategies such as dam construction or infrastructure design. [ABSTRACT FROM AUTHOR]

Wi-Fi fingerprint indoor localization uses Wi-Fi signal strength measurements obtained from a number of access points. This method needs manual data collection across a positioning area and an annotation process to label locations to the measurement sets. To reduce the cost and effort, this paper proposes a Wi-Fi Semi-Supervised Generative Adversarial Network (SSGAN), which produces artificial but realistic trainable fingerprint data. The Wi-Fi SSGAN is based on a deep learning, which is extended from GAN in a semi-supervised learning manner. It is designed to create location-labeled Wi-Fi fingerprint data, which is different to unlabeled data generation by a normal GAN. Also, the proposed Wi-Fi SSGAN network includes a positioning model, so it does not need a external positioning method. When the Wi-Fi SSGAN is applied to a multi-story landmark localization, the experimental results demonstrate a 35% more accurate performance in comparison to a standard supervised deep neural network. [ABSTRACT FROM AUTHOR]

Autonomous driving systems are a rapidly evolving technology. Trajectory prediction is a critical component of autonomous driving systems that enables safe navigation by anticipating the movement of surrounding objects. Lidar point-cloud data provide a 3D view of solid objects surrounding the ego-vehicle. Hence, trajectory prediction using Lidar point-cloud data performs better than 2D RGB cameras due to providing the distance between the target object and the ego-vehicle. However, processing point-cloud data is a costly and complicated process, and state-of-the-art 3D trajectory predictions using point-cloud data suffer from slow and erroneous predictions. State-of-the-art trajectory prediction approaches suffer from handcrafted and inefficient architectures, which can lead to low accuracy and suboptimal inference times. Neural architecture search (NAS) is a method proposed to optimize neural network models by using search algorithms to redesign architectures based on their performance and runtime. This paper introduces TrajectoryNAS, a novel neural architecture search (NAS) method designed to develop an efficient and more accurate LiDAR-based trajectory prediction model for predicting the trajectories of objects surrounding the ego vehicle. TrajectoryNAS systematically optimizes the architecture of an end-to-end trajectory prediction algorithm, incorporating all stacked components that are prerequisites for trajectory prediction, including object detection and object tracking, using metaheuristic algorithms. This approach addresses the neural architecture designs in each component of trajectory prediction, considering accuracy loss and the associated overhead latency. Our method introduces a novel multi-objective energy function that integrates accuracy and efficiency metrics, enabling the creation of a model that significantly outperforms existing approaches. Through empirical studies, TrajectoryNAS demonstrates its effectiveness in enhancing the performance of autonomous driving systems, marking a significant advancement in the field. Experimental results reveal that TrajcetoryNAS yields a minimum of 4.8 higger accuracy and 1.1* lower latency over competing methods on the NuScenes dataset. [ABSTRACT FROM AUTHOR]

Water leakage defects often occur in underground structures, leading to accelerated structural aging and threatening structural safety. Leakage identification can detect early diseases of underground structures and provide important guidance for reinforcement and maintenance. Deep learning-based computer vision methods have been rapidly developed and widely used in many fields. However, establishing a deep learning model for underground structure leakage identification usually requires a lot of training data on leakage defects, which is very expensive. To overcome the data shortage, a deep neural network method for leakage identification is developed based on transfer learning in this paper. For comparison, four famous classification models, including VGG16, AlexNet, SqueezeNet, and ResNet18, are constructed. To train the classification models, a transfer learning strategy is developed, and a dataset of underground structure leakage is created. Finally, the classification performance on the leakage dataset of different deep learning models is comparatively studied under different sizes of training data. The results showed that the VGG16, AlexNet, and SqueezeNet models with transfer learning can overall provide higher and more stable classification performance on the leakage dataset than those without transfer learning. The ResNet18 model with transfer learning can overall provide a similar value of classification performance on the leakage dataset than that without transfer learning, but its classification performance is more stable than that without transfer learning. In addition, the SqueezeNet model obtains an overall higher and more stable performance than the comparative models on the leakage dataset for all classification metrics. [ABSTRACT FROM AUTHOR]

The significance of model updating methods is becoming increasingly evident as the demand for greater precision in numerical models rises. In recent years, with the advancement of deep learning technology, model updating methods based on various deep learning algorithms have begun to emerge. These methods tend to be complicated in terms of methodological architectures and mathematical processes. This paper introduces an innovative model updating approach using a deep learning model: the deep neural network (DNN). This approach diverges from conventional methods by streamlining the process, directly utilizing the results of modal analysis and numerical model simulations as deep learning input, bypassing any additional complex mathematical calculations. Moreover, with a minimalist neural network architecture, a model updating method has been developed that achieves both accuracy and efficiency. This distinctive application of DNN has seldom been applied previously to model updating. Furthermore, this research investigates the impact of prefabricated partition walls on the overall stiffness of buildings, a field that has received limited attention in the previous studies. The main finding was that the deep neural network method achieved a Modal Assurance Criterion (MAC) value exceeding 0.99 for model updating in the minimally disturbed 1st and 2nd order modes when compared to actual measurements. Additionally, it was discovered that prefabricated partitions exhibited a stiffness ratio of about 0.2–0.3 compared to shear walls of the same material and thickness, emphasizing their role in structural behavior. [ABSTRACT FROM AUTHOR]

The orthogonal frequency-division multiplexing (OFDM) mode with a linear frequency modulation (LFM) signal as the baseband waveform has been widely studied and applied in multiple-input multiple-output (MIMO) radar systems. However, its high sidelobe levels after pulse compression affect the target detection of radar systems. For this paper, theoretical analysis was performed, to investigate the causes of high sidelobe levels in OFDM-LFM waveforms, and a novel waveform optimization design method based on deep neural networks is proposed. This method utilizes the classic ResNeXt network to construct dual-channel neural networks, and a new loss function is employed to design the phase and bandwidth of the OFDM-LFM waveforms. Meanwhile, the optimization factor is exploited, to address the optimization problem of the peak sidelobe levels (PSLs) and integral sidelobe levels (ISLs). Our numerical results verified the correctness of the theoretical analysis and the effectiveness of the proposed method. The designed OFDM-LFM waveforms exhibited outstanding performance in pulse compression and improved the detection performance of the radar. [ABSTRACT FROM AUTHOR]

Simple Summary: Nonlinear curve fitting of the pharmacokinetic model to DCE-MRI concentration curves is highly time-consuming. The estimation of highly non-linear dispersion-related parameter in MR dispersion imaging (MRDI) makes the process even more tedious. The fast MRDI (fMRDI) model is proposed to simplify and accelerate the MRDI model by representing the dispersion-applied arterial input function (AIF) as the weighted-sum of a fast and a slow population-based AIFs. A deep learning-based two-stage inference method is proposed to accelerate quantitative MRDI. The deep learning model makes a initial estimation of the parameters directly from the concentration curves and the parameters is then refined by a number of iterative optimization. Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) measures microvascular perfusion by capturing the temporal changes of an MRI contrast agent in a target tissue, and it provides valuable information for the diagnosis and prognosis of a wide range of tumors. Quantitative DCE-MRI analysis commonly relies on the nonlinear least square (NLLS) fitting of a pharmacokinetic (PK) model to concentration curves. However, the voxel-wise application of such nonlinear curve fitting is highly time-consuming. The arterial input function (AIF) needs to be utilized in quantitative DCE-MRI analysis. and in practice, a population-based arterial AIF is often used in PK modeling. The contribution of intravascular dispersion to the measured signal enhancement is assumed to be negligible. The MR dispersion imaging (MRDI) model was recently proposed to account for intravascular dispersion, enabling more accurate PK modeling. However, the complexity of the MRDI hinders its practical usability and makes quantitative PK modeling even more time-consuming. In this paper, we propose fast MR dispersion imaging (fMRDI) to effectively represent the intravascular dispersion and highly accelerated PK parameter estimation. We also propose a deep learning-based, two-stage framework to accelerate PK parameter estimation. We used a deep neural network (NN) to estimate PK parameters directly from enhancement curves. The estimation from NN was further refined using several steps of NLLS, which is significantly faster than performing NLLS from random initializations. A data synthesis module is proposed to generate synthetic training data for the NN. Two data-processing modules were introduced to improve the model's stability against noise and variations. Experiments on our in-house clinical prostate MRI dataset demonstrated that our method significantly reduces the processing time, produces a better distinction between normal and clinically significant prostate cancer (csPCa) lesions, and is more robust against noise than conventional DCE-MRI analysis methods. [ABSTRACT FROM AUTHOR]

Short-term load forecasting is a challenging research problem and has a tremendous impact on electricity generation, transmission, and distribution. A robust forecasting algorithm can help power system operators to better tackle the ever-changing electric power demand. This paper presents a novel deep neural network for short-term electric load forecasting for the St. John's campus of Memorial University of Newfoundland (MUN). The electric load data are obtained from the Memorial University of Newfoundland and combined with metrological data from St. John's. This dataset is used to formulate a multivariate time-series forecasting problem. A novel deep learning algorithm is presented, consisting of a 1D Convolutional Neural Network, which is followed by an encoder–decoder-based network with attention. The input used for this model is the electric load consumption and metrological data, while the output is the hourly prediction of the next day. The model is compared with Gated Recurrent Unit (GRU) and Long Short Term Memory (LSTM)-based Recurrent Neural Network. A CNN-based encoder–decoder model without attention is also tested. The proposed model shows a lower mean absolute error (MAE), mean squared error (MSE), mean absolute percentage error (MAPE), and higher R2 score. These evaluation metrics show an improved performance compared to GRU and LSTM-based RNNs as well as the CNN encoder–decoder model without attention. [ABSTRACT FROM AUTHOR]

Artificial neural networks (ANNs) can be used for accurate heat load forecasting in district heating systems (DHSs). This paper presents an application of a shallow ANN with two hidden layers in the case of a local DHS. The developed model was used to write a simple application in Python 3.10 that can be used in the operation of a district heating plant to carry out a preliminary analysis of heat demand, taking into account the ambient temperature on a given day. The model was trained using the real data from the period 2019–2022. The training was sufficient for the number of 150 epochs. The prediction effectiveness indicator was proposed. In the considered case, the effectiveness of the trained network was 85% and was better in comparison to five different regression models. The developed tool was based on an open-source programming environment and proved its ability to predict heating load. [ABSTRACT FROM AUTHOR]

A photovoltaic (PV) power forecasting prediction is a crucial stage to utilize the stability, quality, and management of a hybrid power grid due to its dependency on weather conditions. In this paper, a short-term PV forecasting prediction model based on actual operational data collected from the PV experimental prototype installed at the engineering college of Misan University in Iraq is designed using various machine learning techniques. The collected data are initially classified into three diverse groups of atmosphere conditions—sunny, cloudy, and rainy meteorological cases—for various seasons. The data are taken for 3 min intervals to monitor the swift variations in PV power generation caused by atmospheric changes such as cloud movement or sudden changes in sunlight intensity. Then, an artificial neural network (ANN) technique is used based on the gray wolf optimization (GWO) and genetic algorithm (GA) as learning methods to enhance the prediction of PV energy by optimizing the number of hidden layers and neurons of the ANN model. The Python approach is used to design the forecasting prediction models based on four fitness functions: R2, MAE, RMSE, and MSE. The results suggest that the ANN model based on the GA algorithm accommodates the most accurate PV generation pattern in three different climatic condition tests, outperforming the conventional ANN and GWO-ANN forecasting models, as evidenced by the highest Pearson correlation coefficient values of 0.9574, 0.9347, and 0.8965 under sunny, cloudy, and rainy conditions, respectively. [ABSTRACT FROM AUTHOR]

Accurately classifying the intra-pulse modulations of radar emitter signals is important for radar systems and can provide necessary information for relevant military command strategy and decision making. As strong additional white Gaussian noise (AWGN) leads to a lower signal-to-noise ratio (SNR) of received signals, which results in a poor classification accuracy on the classification models based on deep neural networks (DNNs), in this paper, we propose an effective denoising method based on a denoising diffusion probabilistic model (DDPM) for increasing the quality of signals. Trained with denoised signals, classification models can classify samples denoised by our method with better accuracy. The experiments based on three DNN classification models using different modal input, with undenoised data, data denoised by the convolutional denoising auto-encoder (CDAE), and our method's denoised data, are conducted with three different conditions. The extensive experimental results indicate that our proposed method could denoise samples with lower values of the SNR, and that it is more effective for increasing the accuracy of DNN classification models for radar emitter signal intra-pulse modulations, where the average accuracy is increased from around 3 to 22 percentage points based on three different conditions. [ABSTRACT FROM AUTHOR]