Search

Rock Paper Scissors is one of the most popular games in the world, because of their easy and simple way to play among young and elderly people. The point of this game is to do the draw or just to find out who loses or wins. The pandemic conditions made people unable to meet face-to-face and could only play this game virtually. To carry out this activity in a virtual way, this research facilitates a model in the form of image classification to distinguish the hand gestures s in the form of rock, paper, and scissors. This classification process utilizes the Convolutional Neural Network (CNN) method. This method is one type of artificial neural network in terms of image classification. CNN uses three stages, namely convolutional layer, pooling layer, and fully connected layer. The implementation of this method for hand gesture classification in the form of rock, scissors, and paper images in this study shows an increased average accuracy towards the previous study from 97.66% to 99%.

To explore whether the brain contains pattern differences in the rock–paper–scissors (RPS) imagery task, this paper attempts to classify this task using fNIRS and deep learning. In this study, we designed an RPS task with a total duration of 25 min and 40 s, and recruited 22 volunteers for the experiment. We used the fNIRS acquisition device (FOIRE-3000) to record the cerebral neural activities of these participants in the RPS task. The time series classification (TSC) algorithm was introduced into the time-domain fNIRS signal classification. Experiments show that CNN-based TSC methods can achieve 97% accuracy in RPS classification. CNN-based TSC method is suitable for the classification of fNIRS signals in RPS motor imagery tasks, and may find new application directions for the development of brain–computer interfaces (BCI).

To explore whether the brain contains pattern differences in the rock–paper–scissors (RPS) imagery task, this paper attempts to classify this task using fNIRS and deep learning. In this study, we designed an RPS task with a total duration of 25 min and 40 s, and recruited 22 volunteers for the experiment. We used the fNIRS acquisition device (FOIRE-3000) to record the cerebral neural activities of these participants in the RPS task. The time series classification (TSC) algorithm was introduced into the time-domain fNIRS signal classification. Experiments show that CNN-based TSC methods can achieve 97% accuracy in RPS classification. CNN-based TSC method is suitable for the classification of fNIRS signals in RPS motor imagery tasks, and may find new application directions for the development of brain–computer interfaces (BCI). [ABSTRACT FROM AUTHOR]

With the establishment of the "double carbon" goal, various industries are actively exploring ways to reduce carbon emissions. Cloud data centers, represented by cloud computing, often have the problem of mismatch between load requests and resource supply, resulting in excessive carbon emissions. Based on this, this paper proposes a complete method for cloud computing carbon emission prediction. Firstly, the convolutional neural network and bidirectional long-term and short-term memory neural network (CNN-BiLSTM) combined model are used to predict the cloud computing load. The real-time prediction power is obtained by real-time prediction load of cloud computing, and then the carbon emission prediction is obtained by power calculation. Develop a dynamic server carbon emission prediction model, so that the server carbon emission can change with the change of CPU utilization, so as to achieve the purpose of low carbon emission reduction. In this paper, Google cluster data is used to predict the load. The experimental results show that the CNN-BiLSTM combined model has good prediction effect. Compared with the multi-layer feed forward neural network model (BP), long short-term memory network model (LSTM), bidirectional long short-term memory network model (BiLSTM), modal decomposition and convolution long time series neural network model (CEEMDAN-ConvLSTM), the MSE index decreased by 52 % , 50 % , 34 % and 45 % respectively. [ABSTRACT FROM AUTHOR]

In this paper, research was conducted on anomaly detection of wheel flats. In the railway sector, conducting tests with actual railway vehicles is challenging due to safety concerns for passengers and maintenance issues as it is a public industry. Therefore, dynamics software was utilized. Next, STFT (short-time Fourier transform) was performed to create spectrogram images. In the case of railway vehicles, control, monitoring, and communication are performed through TCMS, but complex analysis and data processing are difficult because there are no devices such as GPUs. Furthermore, there are memory limitations. Therefore, in this paper, the relatively lightweight models LeNet-5, ResNet-20, and MobileNet-V3 were selected for deep learning experiments. At this time, the LeNet-5 and MobileNet-V3 models were modified from the basic architecture. Since railway vehicles are given preventive maintenance, it is difficult to obtain fault data. Therefore, semi-supervised learning was also performed. At this time, the Deep One Class Classification paper was referenced. The evaluation results indicated that the modified LeNet-5 and MobileNet-V3 models achieved approximately 97% and 96% accuracy, respectively. At this point, the LeNet-5 model showed a training time of 12 min faster than the MobileNet-V3 model. In addition, the semi-supervised learning results showed a significant outcome of approximately 94% accuracy when considering the railway maintenance environment. In conclusion, considering the railway vehicle maintenance environment and device specifications, it was inferred that the relatively simple and lightweight LeNet-5 model can be effectively utilized while using small images. [ABSTRACT FROM AUTHOR]

Introduction: Recently, the Transformer model and its variants have been a great success in terms of computer vision, and have surpassed the performance of convolutional neural networks (CNN). The key to the success of Transformer vision is the acquisition of short-term and long-term visual dependencies through selfattention mechanisms; this technology can efficiently learn global and remote semantic information interactions. However, there are certain challenges associated with the use of Transformers. The computational cost of the global self-attention mechanism increases quadratically, thus hindering the application of Transformers for high-resolution images. Methods: In view of this, this paper proposes a multi-view brain tumor segmentation model based on cross windows and focal self-attention which represents a novel mechanism to enlarge the receptive field by parallel cross windows and improve global dependence by using local fine-grained and global coarse-grained interactions. First, the receiving field is increased by parallelizing the self-attention of horizontal and vertical fringes in the cross window, thus achieving strong modeling capability while limiting the computational cost. Second, the focus on self-attention with regards to local fine-grained and global coarse-grained interactions enables the model to capture short-term and longterm visual dependencies in an efficient manner. Results: Finally, the performance of the model on Brats2021 verification set is as follows: dice Similarity Score of 87.28, 87.35 and 93.28%; Hausdorff Distance (95%) of 4.58 mm, 5.26 mm, 3.78 mm for the enhancing tumor, tumor core and whole tumor, respectively. Discussion: In summary, the model proposed in this paper has achieved excellent performance while limiting the computational cost. [ABSTRACT FROM AUTHOR]

At present, a large number of rumors are mixed in with various kinds of news, such as current affairs, politics, social economy, and military activities, which seriously reduces the credibility of Internet information and hinders the positive development of various fields. In previous research on rumors, most scholars have focused their attention on the textual features, contextual semantic features, or single-emotion features of rumors but have not paid attention to the chain reaction caused by the hidden emotions in comments in social groups. Therefore, this paper comprehensively uses the emotional signals in rumor texts and comments to extract emotional features and determines the relationship between them to establish dual-emotion features. The main research achievements include the following aspects: (1) this study verifies that, in the field of affective characteristics, the combination of rumor-text emotion and comment emotion is superior to other baseline affective characteristics, and the detection performance of each component is outstanding; (2) the results prove that the combination of dual-emotion features and a semantic-feature-based detector (BiGRU and CNN) can improve the effectiveness of the detector; (3) this paper proposes reconstructing the dataset according to time series to verify the generalization ability of dual affective features; (4) the attention mechanism is used to combine domain features and semantic features to extract more fine-grained features. A large number of data experiments show that the dual-emotion features can be effectively compatible with an existing rumor detector, enhance the detector's performance, and improve the detection accuracy. [ABSTRACT FROM AUTHOR]

Analysis of unintended compromising emissions from Video Display Units (VDUs) is an important topic in research communities. This paper examines the feasibility of recovering the information displayed on the monitor from reconstructed video frames. The study holds particular significance for our understanding of security vulnerabilities associated with the electromagnetic radiation of digital displays. Considering the amount of noise that reconstructed TEMPEST video frames have, the work in this paper focuses on two different approaches to de-noising images for efficient optical character recognition. First, an Adaptive Wiener Filter (AWF) with adaptive window size implemented in the spatial domain was tested, and then a Convolutional Neural Network (CNN) with an encoder–decoder structure that follows both classical auto-encoder model architecture and U-Net architecture (auto-encoder with skip connections). These two techniques resulted in an improvement of more than two times on the Structural Similarity Index Metric (SSIM) for AWF and up to four times for the SSIM for the Deep Learning (DL) approach. In addition, to validate the results, the possibility of text recovery from processed noisy frames was studied using a state-of-the-art Tesseract Optical Character Recognition (OCR) engine. The present work aims to bring to attention the security importance of this topic and the non-negligible character of VDU information leakages. [ABSTRACT FROM AUTHOR]

The existing deep estimation networks often overlook the issue of computational efficiency while pursuing high accuracy. This paper proposes a lightweight self-supervised network that combines convolutional neural networks (CNN) and Transformers as the feature extraction and encoding layers for images, enabling the network to capture both local geometric and global semantic features for depth estimation. First, depth-separable convolution is used to construct a dilated convolution residual module based on a shallow network to improve the shallow CNN feature extraction receptive field. In the transformer, a multidepth separable convolution head transposed attention module is proposed to reduce the computational burden of spatial self-attention. In the feedforward network, a two-step gating mechanism is proposed to improve the nonlinear representation ability of the feedforward network. Finally, the CNN and transformer are integrated to implement a depth estimation network with a local-global context interaction function. Compared with other lightweight models, this model has fewer model parameters and higher estimation accuracy. It also has better generalizability for different outdoor datasets. Additionally, the inference speed can reach 87 FPS, achieving better real-time performance and accounting for both inference speed and estimation accuracy. [ABSTRACT FROM AUTHOR]

Time-of-use pricing of electric energy, as an important part of the national policy of energy conservation and emission reduction, requires accurate electric energy data as support. However, due to various reasons, the electric energy data are often missing. To address this thorny problem, this paper constructs a CNN and GRU-based recovery model (RCNN-BiGRU) for electric energy data by taking the missing data as the output and the historical data of the neighboring moments as the input. Firstly, a convolutional network with a residual structure is used to capture the local dependence and periodic patterns of the input data, and then a bidirectional GRU network utilizes the extracted potential features to model the temporal relationships of the data. Aiming at the difficult selection of network structure parameters and training process parameters, an accelerated adaptive differential evolution (AADE) algorithm is proposed to optimize the electrical energy data recovery model. The algorithm designs an accelerated mutation operator and at the same time adopts an adaptive strategy to set the two key parameters. A large amount of real grid data are selected as samples to train the network, and the comparison results verify that the proposed combined model outperforms the related CNN and GRU networks. The comparison experimental results with other optimization algorithms also show that the AADE algorithm proposed in this paper has better data recovery performance on the training set and significantly better performance on the test set. [ABSTRACT FROM AUTHOR]

The classification of human face shapes, a pivotal aspect of one's appearance, plays a crucial role in diverse fields like beauty, cosmetics, healthcare, and security. In this paper, we present a multi-step methodology for face shape classification, harnessing the potential of transfer learning and a pretrained EfficientNetV2S neural network. Our approach comprises key phases, including preprocessing, augmentation, training, and testing, ensuring a comprehensive and reliable solution. The preprocessing step involves precise face detection, cropping, and image scaling, laying a solid foundation for accurate feature extraction. Our methodology utilizes a publicly available dataset of female celebrities, comprising five face shape classes: heart, oblong, oval, round, and square. By augmenting this dataset during training, we magnify its diversity, enabling better generalization and enhancing the model's robustness. With the EfficientNetV2S neural network, we employ transfer learning, leveraging pretrained weights to optimize accuracy, training speed, and parameter size. The result is a highly efficient and effective model, which outperforms state-of-the-art approaches on the same dataset, boasting an outstanding overall accuracy of 96.32%. Our findings demonstrate the efficiency of our approach, proving its potential in the field of face shape classification. The success of our methodology holds promise for various applications, offering valuable insights into beauty analysis, cosmetic recommendations, and personalized healthcare. [ABSTRACT FROM AUTHOR]

The objective of the medical image analysis is to increase the effectiveness of the diagnosis options. The Coevolution Neural Network (CNN) is the predominant neural network architecture used in Deep Learning (DL) for medical image analysis. Recently, various innovative technics of DL such as different activation functions, optimization technics, and loss functions have enhanced the performance of CNNs. The Deep Learning CNN (DL-CNN) assists as valuable tool to assist radiologist in diagnosis and improves efficiency and accuracy. Numerous DL-CNN methods have been published to analyze medical images. This paper compiles the performance metrics of DL-CNN, as presented by various authors. This paper reviews the image analysis of six different diseases, viz., lung cancer, colorectal cancer, liver cancer, stomach cancer, breast cancer, and brain tumors. [ABSTRACT FROM AUTHOR]

This paper aims to use deep learning algorithms to identify and study the stability of breakwater armor blocks. It introduces a posture identification model for fender blocks using a Mask Region-based Convolutional Neural Network (R-CNN), which has been enhanced by considering factors affecting breakwater fender blocks. Furthermore, a wave prediction model for breakwaters is developed by integrating Bidirectional Encoder Representations from Transformers (BERTs) with Bidirectional Long Short-Term Memory (BiLSTM). The performance of these models is evaluated. The results show that the accuracy of the Mask R-CNN and its comparison algorithms initially increases and then decreases with higher Intersection Over Union (IOU) thresholds, peaking at 95.16% accuracy at an IOU threshold of 0.5. The BERT-BiLSTM wave prediction model maintains a loss value around 0.01 and an accuracy of approximately 90.00%. These results suggest that the proposed models offer more accurate stability assessments of breakwater armor blocks. By combining the random forest prediction model with BiLSTM, the wave characteristics and fender posture can be predicted better, offering reliable decision support for breakwater engineering. [ABSTRACT FROM AUTHOR]

The rapid advancement of autonomous vehicle technology has brought into focus the critical need for enhanced road safety systems, particularly in the areas of road damage detection and surface classification. This paper explores these two essential components, highlighting their importance in autonomous driving. In the domain of road damage detection, this study explores a range of deep learning methods, particularly focusing on one-stage and two-stage detectors. These methodologies, including notable ones like YOLO and SSD for one-stage detection and Faster R-CNN for two-stage detection, are critically analyzed for their efficacy in identifying various road damages under diverse conditions. The review provides insights into their comparative advantages, balancing between real-time processing and accuracy in damage localization. For road surface classification, the paper investigates the classification techniques based on both environmental conditions and material road composition. It highlights the role of different convolutional neural network architectures and innovations at the neural level in enhancing classification accuracy under varying road and weather conditions. The main finding of this work is that it offers a comprehensive overview of the current state of the art, showcasing significant strides in utilizing deep learning for road analysis in autonomous vehicle systems. The study concludes by underscoring the importance of continued research in these areas to further refine and improve the safety and efficiency of autonomous driving. [ABSTRACT FROM AUTHOR]

De-mining operations are of critical importance for humanitarian efforts and safety in conflict-affected regions. In this paper, we address the challenge of enhancing the accuracy and efficiency of mine detection systems. We present an innovative Deep Learning architecture tailored for pulse induction-based Metallic Mine Detectors (MMD), so called DL-MMD. Our methodology leverages deep neural networks to distinguish amongst nine distinct materials with an exceptional validation accuracy of 93.5%. This high level of precision enables us not only to differentiate between anti-personnel mines, without metal plates but also to detect minuscule 0.2-g vertical paper pins in both mineralized soil and non-mineralized environments. Moreover, through comparative analysis, we demonstrate a substantial 3% and 7% improvement (approx.) in accuracy performance compared to the traditional K-Nearest Neighbors and Support Vector Machine classifiers, respectively. The fusion of deep neural networks with the pulse induction-based MMD not only presents a cost-effective solution but also significantly expedites decision-making processes in de-mining operations, ultimately contributing to improved safety and effectiveness in these critical endeavors. [ABSTRACT FROM AUTHOR]

AI plays a pivotal role in predicting plant growth in agricultural contexts and in creating optimized environments for cultivation. However, unlike agriculture, the application of AI in aquaculture is predominantly focused on diagnosing animal conditions and monitoring them for users. This paper introduces an Automated Fish-feeding System (AFS) based on Convolutional Neural Networks (CNNs) and Gated Recurrent Units (GRUs), aiming to establish an automated system akin to smart farming in the aquaculture sector. The AFS operates by precisely calculating feed rations through two main modules. The Fish Growth Measurement Module (FGMM) utilizes fish data to assess the current growth status of the fish and transmits this information to the Feed Ration Prediction Module (FRPM). The FRPM integrates sensor data from the fish farm, fish growth data, and current feed ration status as time-series data, calculating the increase or decrease rate of ration based on the present fish conditions. This paper automates feed distribution within fish farms through these two modules and verifies the efficiency of automated feed distribution. Simulation results indicate that the FGMM neural network model effectively identifies fish body length with a minor deviation of less than 0.1%, while the FRPM neural network model demonstrates proficiency in predicting ration using a GRU cell with a structured layout of 64 × 48. [ABSTRACT FROM AUTHOR]

Handwriting is a biometric behavioral characteristic with evident individual distinctiveness. With the rise of the deep learning trend and demands for forensic identification, handwriting identification has become one of the focal points of research in the field of pattern recognition. Research in handwriting identification for major global languages has matured. However, in China, there is limited attention in the field of writer identification for minority languages such as Mongolian, making it challenging to resolve criminal cases involving handwriting issues. This paper initiates an initial exploration of Mongolian handwriting identification by constructing a structurally simple convolutional neural network. This convolutional neural network, consisting of 12 convolution operations and designed for Mongolian handwriting identification, is referred to as MWInet-12. In this paper, the model evaluation experiments were conducted using a dataset comprising 156,372 samples contributed by 125 writers from the MOLHW dataset. The dataset was divided into training, validation, and test sets in an 8:1:1 ratio. The final results of the experiments reveal impressive accuracy on the test set, achieving a top-1 accuracy of 89.60% and a top-5 accuracy of 97.53%. Furthermore, through comparative experiments involving Resnet50, Fragnet, GRRNN, VGG16, and VGG19 models, this paper establishes that the proposed model yields the most favorable results for Mongolian handwriting identification. The exploratory research on Mongolian handwriting identification in this paper contributes to increasing awareness of information processing for minority languages. It aids in advancing research on classifying writers of Mongolian historical texts and provides technical support for judicial authentication involving handwriting issues. [ABSTRACT FROM AUTHOR]

A full connected world is expected to be introduced in the sixth generation mobile network (6G). As a typical fully connected scenario, the internet of vehicle (IoV) enables intelligent vehicle operations via artificial intelligence (AI) and edge computing technologies. Thus, integrating intelligence into edge computing is, no doubt, a promising development trend. In the future of vehicular networks, a massive variety of services need powerful computing resources and higher quality of service (QoS). Existing computing resources are insufficient to match those increasing requirements. Most works on this problem focused on finding the power-delay's trade-off, ignoring QoS and stable load balance. In this study, we found that the computing power and redundancy of vehicles' in IoV is increasing. So, those redundant computing resources are possible to be used to solve the shortage of computing resource. CNN is a typical AI technique. This technology is very suitable for solving the problems in this article. So, we adopted CNN technique of AI to design and algorithm of convolutional long short-term memory (CN_LSTM) based traffic prediction (ACLBTP). ACLBTP was designed to gain the predicted number of vehicles belonging to the edge node. Secondly, according to the problem of insufficient computing resources on remote servers, we found that a large amount of redundant computing resources exist in edge nodes. So, we used edge computing technique to solve the problem of insufficient computing resources on remote servers. ASOBCL was designed to distribute computing tasks to edge nodes. Meanwhile, an intelligent service offloading framework was provided in this article. Based on the framework, an algorithm of improved gradient descent (AIGD) was created to accelerate the speed of iteration. So, the ACLBTP's convergence of convolutional neural network (CNN) based on AIGD was able to be accelerated too. In ASOBCL, a sorting technique was adopted to speed up the offloading work. Simulation results demonstrated the fact that the prediction strategy designed in this paper had high accuracy. The low offloading time and maintaining stable load balance were gained via running ASOBCL. Low offloading time means short response time. Additionally, the QoS was guaranteed. So, these strategies designed in this paper were effective and valuable. [ABSTRACT FROM AUTHOR]

In recent years, the increasing popularity of smart mobile devices has made the interaction between devices and users, particularly through voice interaction, more crucial. By enabling smart devices to better understand users' emotional states through voice data, it becomes possible to provide more personalized services. This paper proposes a novel machine learning model for speech emotion recognition called CLDNN, which combines convolutional neural networks (CNN), long short-term memory neural networks (LSTM), and deep neural networks (DNN). To design a system that closely resembles the human auditory system in recognizing audio signals, this article uses the Mel-frequency cepstral coefficients (MFCCs) of audio data as the input of the machine learning model. First, the MFCCs of the voice signal are extracted as the input of the model. Local feature learning blocks (LFLBs) composed of one-dimensional CNNs are employed to calculate the feature values of the data. As audio signals are time-series data, the resulting feature values from LFLBs are then fed into the LSTM layer to enhance learning on the time-series level. Finally, fully connected layers are used for classification and prediction. The experimental evaluation of the proposed model utilizes three databases: RAVDESS, EMO-DB, and IEMOCAP. The results demonstrate that the LSTM model effectively models the features extracted from the 1D CNN due to the time-series characteristics of speech signals. Additionally, the data augmentation method applied in this paper proves beneficial in improving the recognition accuracy and stability of the systems for different databases. Furthermore, according to the experimental results, the proposed system achieves superior recognition rates compared to related research in speech emotion recognition. [ABSTRACT FROM AUTHOR]

Personalized recommendation systems learn user preference characteristics by analyzing behavioral data such as ratings and comments generated by users in the Internet, and provide precise recommendations for individual users accordingly. However, in real life, users often conduct group activities like group buying and traveling together. How to recommend for groups has become a heated research topic in recent years. Most existing group recommendation algorithms are recommended for given divided groups by collectively combining the preferences of members in the group. However, in most cases, users' group properties are fickle. As the results of group detection are decisive to the performance of group recommendation, group detection is particularly important to the group recommendation algorithm. After analyzing problems of existing group recommendation algorithms, this paper proposes the density peak clustering group detection algorithm based on GRU-CNN and the group recommendation algorithm based on the mechanism. With respect to group detection, most of the existing group detection algorithms suffer from certain deficiencies: First, depending solely on the users' static preference features while ignoring the variation of users' interest over time when finding the group structure in the network; second, group division based on users' topic features extracted from reviews is difficult to support further digging of the in-depth features in reviews. To address the above-mentioned problems, this paper proposes a density peak clustering group detection algorithm based on CNN-GRU. It would first extract representative keywords in the reviews with LDA topic model, and then model time series information based on GRU attaining users' dynamic topic features. Coupling with deeper characteristics cored out by CNN, density peak clustering algorithm completes its group detection finally. Experiments on real dataset indicate that the features mined by the fusion depth neural network model effectively capture users' dynamic preferences, and yield better results of group detection than that of existing algorithms. [ABSTRACT FROM AUTHOR]

Notably, 6D pose estimation is a critical technology that enables robotics to perceive and interact with their operational environment. However, occlusion causes a loss of local features, which, in turn, restricts the estimation accuracy. To address these challenges, this paper proposes an end-to-end pose-estimation network based on a multi-channel attention mechanism, DA2Net. Firstly, a multi-channel attention mechanism, designated as "DA2Net", was devised using A2-Nets as its foundation. This mechanism is constructed in two steps. In the first step, the essential characteristics are extracted from the global feature space through the second-order attention pool. In the second step, a feature map is generated by the integration of position and channel attention. Subsequently, the extracted key features are assigned to each position of the feature map, enhancing both the feature representation capacity and the overall performance. Secondly, the designed attention mechanism is introduced into both the feature fusion and pose iterative refinement networks to enhance the network's capacity to acquire local features thus improving its overall performance. The experimental results demonstrated that the estimation accuracy of DenseFusion-DA2 on the LineMOD dataset was approximately 3.4% higher than that of DenseFusion. Furthermore, the estimation accuracy surpassed that of PoseCNN, PVNet, SSD6D, and PointFusion by 8.3%, 11.1%, 20.3%, and 23.8%, respectively. The estimation accuracy also shows a significant advantage on the Occluded LineMOD and HR-Vision datasets. This research not only presents a more efficient solution for robot perception but also introduces novel ideas and methods for technological advancements and applications in related fields. [ABSTRACT FROM AUTHOR]

Deep neural networks (DNNs) are fundamental to modern applications like face recognition and autonomous driving. However, their security is a significant concern due to various integrity risks, such as backdoor attacks. In these attacks, compromised training data introduce malicious behaviors into the DNN, which can be exploited during inference or deployment. This paper presents a novel game-theoretic approach to model the interactions between an attacker and a defender in the context of a DNN backdoor attack. The contribution of this approach is multifaceted. First, it models the interaction between the attacker and the defender using a game-theoretic framework. Second, it designs a utility function that captures the objectives of both parties, integrating clean data accuracy and attack success rate. Third, it reduces the game model to a two-player zero-sum game, allowing for the identification of Nash equilibrium points through linear programming and a thorough analysis of equilibrium strategies. Additionally, the framework provides varying levels of flexibility regarding the control afforded to each player, thereby representing a range of real-world scenarios. Through extensive numerical simulations, the paper demonstrates the validity of the proposed framework and identifies insightful equilibrium points that guide both players in following their optimal strategies under different assumptions. The results indicate that fully using attack or defense capabilities is not always the optimal strategy for either party. Instead, attackers must balance inducing errors and minimizing the information conveyed to the defender, while defenders should focus on minimizing attack risks while preserving benign sample performance. These findings underscore the effectiveness and versatility of the proposed approach, showcasing optimal strategies across different game scenarios and highlighting its potential to enhance DNN security against backdoor attacks. [ABSTRACT FROM AUTHOR]

In this paper, we predict crude oil price using various factors that may influence its price. The factors considered are physical market, financial, and trading market factors, including seven key factors and the dollar index. Firstly, we select the main factors that may greatly influence the prices. Then, we develop a hybrid model based on a convolutional neural network (CNN) and long short-term memory (LSTM) network to predict the prices. Lastly, we compare the CNN–LSTM model with other models, namely gradient boosting (GB), decision trees (DTs), random forests (RFs), neural networks (NNs), CNN, LSTM, and bidirectional LSTM (Bi–LSTM). The empirical results show that the CNN–LSTM model outperforms these models. [ABSTRACT FROM AUTHOR]

The recognition of telugu hand written text is been one of the problems in many applications. To overcome the problem a deep learning technique is proposed in this work i.e. a Dense convolutional neural network (DCNN) model. A telugu dataset which is taken form IIIT-HW-Telugu is utilized to perform the proposed model. In this paper a four stage telugu word retrieval is performed, initially thinning of image is performed using morphological operation, secondly Densenet-CNN is applied for thinning image, thirdly perform OCR based image segmentation, finally two models like HARRIS and BRISK features to extract the features and evaluate information from the given input HWT images. The parameters evaluated are hamming distance, PSNR, MSE, Noise Sensitivity and rate of thinning. The proposed model outperformed well compared to other methods. The PSNR obtained using proposed model is 54.74, hamming distance is 1.2. [ABSTRACT FROM AUTHOR]

Accurate and reliable PV power probabilistic-forecasting results can help grid operators and market participants better understand and cope with PV energy volatility and uncertainty and improve the efficiency of energy dispatch and operation, which plays an important role in application scenarios such as power market trading, risk management, and grid scheduling. In this paper, an innovative deep learning quantile regression ultra-short-term PV power-forecasting method is proposed. This method employs a two-branch deep learning architecture to forecast the conditional quantile of PV power; one branch is a QR-based stacked conventional convolutional neural network (QR_CNN), and the other is a QR-based temporal convolutional network (QR_TCN). The stacked CNN is used to focus on learning short-term local dependencies in PV power sequences, and the TCN is used to learn long-term temporal constraints between multi-feature data. These two branches extract different features from input data with different prior knowledge. By jointly training the two branches, the model is able to learn the probability distribution of PV power and obtain discrete conditional quantile forecasts of PV power in the ultra-short term. Then, based on these conditional quantile forecasts, a kernel density estimation method is used to estimate the PV power probability density function. The proposed method innovatively employs two ways of a priori knowledge injection: constructing a differential sequence of historical power as an input feature to provide more information about the ultrashort-term dynamics of the PV power and, at the same time, dividing it, together with all the other features, into two sets of inputs that contain different a priori features according to the demand of the forecasting task; and the dual-branching model architecture is designed to deeply match the data of the two sets of input features to the corresponding branching model computational mechanisms. The two a priori knowledge injection methods provide more effective features for the model and improve the forecasting performance and understandability of the model. The performance of the proposed model in point forecasting, interval forecasting, and probabilistic forecasting is comprehensively evaluated through the case of a real PV plant. The experimental results show that the proposed model performs well on the task of ultra-short-term PV power probabilistic forecasting and outperforms other state-of-the-art deep learning models in the field combined with QR. The proposed method in this paper can provide technical support for application scenarios such as energy scheduling, market trading, and risk management on the ultra-short-term time scale of the power system. [ABSTRACT FROM AUTHOR]

Crack detection methods of high-rise building walls based on traditional computer vision (CV) heavily rely on manual selection and extraction of design features. Convolutional neural network (CNN)-based CV can actively learn the features of cracks and adapt to complex backgrounds, solving the limitations of traditional crack detection methods. This paper explores faster region-CNN, single shot multibox detector (SSD), You Only Look Once for crack detection, and Mask R-CNN for crack segmentation and proposes a novel automatic crack geometric quantification method by combining CNN-based object detection and segmentation. The contents include (1) crack detection and bounding box extraction, exploring a variety of models, selecting the best model to detect the image taken by an unmanned aerial vehicle (UAV), and extracting the crack region; (2) crack segmentation, using the detection results of the first part as input for more accurate detection and segmentation of cracks; and (3) a novel pixel-level geometric quantization method of crack based on Hough straight-line detection, mainly including crack length and width. Then, the pixel level is transformed into the actual geometric quantization to simply determine the crack severity. The three models generated in these three parts can be used for managing exterior wall cracks in high-rise buildings for different inspection purposes. [ABSTRACT FROM AUTHOR]

Autism Spectrum Illness (ASD), an evolution of the brain disorder, is commonly related with sensory difficulties, such as excessive or insufficient sensitivity to sounds, scents, or touch. Autism Spectrum Disorder (ASD) is evolving at a faster rate than ever before. By screening tests autism detection is very expensive and time consuming. With the advancement of Deep Learning (DL), autism can be predicted from a young age. In this paper we are using Convolutional Neural Network (CNN) with Transfer Learning (TL) models to classify the disease and we will suggest the precautions if it is detected as autism. Here we consider the Autism Master Dataset (AMD) from kaggle.com website, which contains two classes (Autism, Non_Autism). By using this models, we are obtaining good accuracy. [ABSTRACT FROM AUTHOR]

In recent years, with the rapid development of deep learning technology, a large number of excellent convolutional neural networks (CNNs) have been proposed, many of which are based on improvements to classical methods. Based on the Inception family of methods, depthwise separable convolution was applied to Xception to achieve lightweighting, and Inception-ResNet introduces residual connections to accelerate model convergence. However, existing improvements for the Inception module often neglect further enhancement of its receptive field, while increasing the receptive field of CNNs has been widely studied and proven to be effective in improving classification performance. Motivated by this fact, three effective expansion modules are proposed in this paper. The first expansion module, Inception expand (Inception-e) module, is proposed to improve the classification accuracy by concatenating more and deeper convolutional branches. To reduce the number of parameters for Inception e, this paper proposes a second expansion module—Equivalent Inception-e (Eception) module, which is equivalent to Inception-e in terms of feature extraction capability, but which suppresses the growth of the parameter quantity brought by the expansion by effectively reducing the redundant convolutional layers; on the basis of Eception, this paper proposes a third expansion module—Lightweight Eception (Lception) module, which crosses depthwise convolution with ordinary convolution to further effectively reduce the number of parameters. The three proposed modules have been validated on the Cifar10 dataset. The experimental results show that all these extensions are effective in improving the classification accuracy of the models, and the most significant effect is the Lception module, where Lception (rank = 4) on the Cifar10 dataset improves the accuracy by 1.5% compared to the baseline model (Inception module A) by using only 0.15 M more parameters. [ABSTRACT FROM AUTHOR]

How to accurately recognize the mental state of pilots is a focus in civil aviation safety. The mental state of pilots is closely related to their cognitive ability in piloting. Whether the cognitive ability meets the standard is related to flight safety. However, the pilot's working state is unique, which increases the difficulty of analyzing the pilot's mental state. In this work, we proposed a Convolutional Neural Network (CNN) that merges attention to classify the mental state of pilots through electroencephalography (EEG). Considering the individual differences in EEG, semi-supervised learning based on improvedK-Means is used in themodel training to improve the generalization ability of the model. We collected the EEG data of 12 pilot trainees during the simulated flight and compared the method in this paper with other methods on this data. The method in this paper achieved an accuracy of 86.29%, which is better than 4D-aNN and HCNN etc. Negative emotion will increase the probability of fatigue appearing, and emotion recognition is also meaningful during the flight. Then we conducted experiments on the public dataset SEED, and our method achieved an accuracy of 93.68%. In addition, we combine multiple parameters to evaluate the results of the classification network on a more detailed level and propose a corresponding scoring mechanism to display the mental state of the pilots directly. [ABSTRACT FROM AUTHOR]

The anomaly detection of electromagnetic environment situation (EMES) has essential reference value for electromagnetic equipment behavior cognition and battlefield threat assessment. In this paper, we proposed a deep learning-based method for detecting anomalies in EMES to address the problem of relatively low efficiency of electromagnetic environment situation anomaly detection (EMES-AD). Firstly, the convolutional kernel extracts the static features of different regions of the EMES. Secondly, the dynamic features of the region are obtained by using a recurrent neural network (LSTM). Thirdly, the Spatio-temporal features of the region are recovered by using a de-convolutional network and then fused to predict the EMES. The structural similarity algorithm (SSIM) is used to determine whether it is anomalous. We developed the detection framework, de-signed the network parameters, simulated the data sets containing different anomalous types of EMES, and carried out the detection experiments. The experimental results show that the proposed method is effective. [ABSTRACT FROM AUTHOR]

The convolutional neural network (CNN) has brought about a drastic change in the field of image processing and pattern recognition. The filters of CNN model correspond to the activation maps that extract features from the input images. Thus, the number of filters and filter size are of significant importance to learning and recognition accuracy of CNN model-based systems such as the biometric-based person authentication system. The present paper proposes to analyze the impact of varying the number of filters of CNN models on the accuracy of the biometric-based single classifiers using human face, fingerprint and iris for person identification, and also biometric-based super-classification using both bagging- and programming-based boosting methods. The present paper gives an insight to the optimal set of filters in CNN model that gives the maximum overall accuracy of the classifier system. [ABSTRACT FROM AUTHOR]

Estimating depth from RGB images is a long-standing ill-posed problem, which has been explored for decades by the computer vision, graphics, and machine learning communities. Among the existing techniques, stereo matching remains one of the most widely used in the literature due to its strong connection to the human binocular system. Traditionally, stereo-based depth estimation has been addressed through matching hand-crafted features across multiple images. Despite the extensive amount of research, these traditional techniques still suffer in the presence of highly textured areas, large uniform regions, and occlusions. Motivated by their growing success in solving various 2D and 3D vision problems, deep learning for stereo-based depth estimation has attracted a growing interest from the community, with more than 150 papers published in this area between 2014 and 2019. This new generation of methods has demonstrated a significant leap in performance, enabling applications such as autonomous driving and augmented reality. In this paper, we provide a comprehensive survey of this new and continuously growing field of research, summarize the most commonly used pipelines, and discuss their benefits and limitations. In retrospect of what has been achieved so far, we also conjecture what the future may hold for deep learning-based stereo for depth estimation research. [ABSTRACT FROM AUTHOR]

In the realm of prognosticating the remaining useful life (RUL) of pivotal components, such as aircraft engines, a prevalent challenge persists where the available historical life data often proves insufficient. This insufficiency engenders obstacles such as impediments in performance degradation feature extraction, inadequacies in capturing temporal relationships comprehensively, and diminished predictive accuracy. To address this issue, a 1D CNN-GRU prediction model for few-shot conditions is proposed in this paper. In pursuit of more comprehensive data feature extraction and enhanced RUL prognostication precision, the Convolutional Neural Network (CNN) is selected for its capacity to discern high-dimensional features amid the intricate dynamics of the data. Concurrently, the Gated Recurrent Unit (GRU) network is leveraged for its robust capability in extracting temporal features inherent within the data. We combine the two to construct a CNN-GRU hybrid network. Moreover, the integration of data distribution alongside correlation and monotonicity indices is employed to winnow the input of multi-sensor monitoring parameters into the CNN-GRU network. Finally, the engine RULs are predicted by the trained model. In this paper, experiments are conducted on a sub-dataset of the National Aeronautics and Space Administration (NASA) C-MAPSS multi-constraint dataset to validate the effectiveness of the method. Experimental results have demonstrated that this method has high accuracy in RUL prediction tasks, which can powerfully demonstrate its effectiveness. [ABSTRACT FROM AUTHOR]

Agriculture plays a crucial role in fostering sustainable growth through the integration of various technological advancements such as image processing, artificial intelligence, deep learning, and the Internet of Things (IoT). The global population is increasing on a daily basis. The increasing demand within the agriculture industry has necessitated the collective enhancement of plant cultivation and field productivity. This paper emphasizes the significance of effectively managing the crop during its initial growth phase as well as during the harvesting era. Image processing and artificial neural networks are employed as distinct methodologies for detecting illnesses on leaves. When capturing images using drones, the resulting images undergo a process of segmentation and transformation, resulting in the identification of three distinct vectors that represent diseases. These vectors include colour, texture, and morphology. This paper reviews on various disease classification strategies that can be utilized for the detection of plant diseases. [ABSTRACT FROM AUTHOR]

In the realm of autonomous vehicle technology, the multimodal vehicle detection network (MVDNet) represents a significant leap forward, particularly in the challenging context of weather conditions. This paper focuses on the enhancement of MVDNet through the integration of a multi-head attention layer, aimed at refining its performance. The integrated multi-head attention layer in the MVDNet model is a pivotal modification, advancing the network's ability to process and fuse multimodal sensor information more efficiently. The paper validates the improved performance of MVDNet with multi-head attention through comprehensive testing, which includes a training dataset derived from the Oxford Radar RobotCar. The results clearly demonstrate that the multi-head MVDNet outperforms the other related conventional models, particularly in the average precision (AP) of estimation, under challenging environmental conditions. The proposed multi-head MVDNet not only contributes significantly to the field of autonomous vehicle detection but also underscores the potential of sophisticated sensor fusion techniques in overcoming environmental limitations. [ABSTRACT FROM AUTHOR]

With the increasing number of households owning pets, the importance of sensor data for recognizing pet behavior has grown significantly. However, challenges arise due to the costs and reliability issues associated with data collection. This paper proposes a method for classifying pet behavior using cleaned meta pseudo labels to overcome these issues. The data for this study were collected using wearable devices equipped with accelerometers, gyroscopes, and magnetometers, and pet behaviors were classified into five categories. Utilizing this data, we analyzed the impact of the quantity of labeled data on accuracy and further enhanced the learning process by integrating an additional Distance Loss. This method effectively improves the learning process by removing noise from unlabeled data. Experimental results demonstrated that while the conventional supervised learning method achieved an accuracy of 82.9%, the existing meta pseudo labels method showed an accuracy of 86.2%, and the cleaned meta pseudo labels method proposed in this study surpassed these with an accuracy of 88.3%. These results hold significant implications for the development of pet monitoring systems, and the approach of this paper provides an effective solution for recognizing and classifying pet behavior in environments with insufficient labels. [ABSTRACT FROM AUTHOR]

Introduction: This paper introduces a deep learning approach based on Convolutional Neural Networks (CNN), Bidirectional Long Short-Term Memory Networks (BiLSTM), and attention mechanism for stock market prediction and investment decision making in financial management. These methods leverage the advantages of deep learning to capture complex patterns and dependencies in financial time series data. Stock market prediction and investment decisionmaking have always been important issues in financial management. Methods: Traditional statistical models often struggle to handle nonlinear relationships and complex temporal dependencies, thus necessitating the use of deep learning methods to improve prediction accuracy and decision effectiveness. This paper adopts a hybrid deep learning model incorporating CNN, BiLSTM, and attention mechanism. CNN can extract meaningful features from historical price or trading volume data, while BiLSTM can capture dependencies between past and future sequences. The attention mechanism allows the model to focus on the most relevant parts of the data. These methods are integrated to create a comprehensive stock market prediction model. We validate the effectiveness of the proposed methods through experiments on real stock market data. Compared to traditional models, the deep learning model utilizing CNN, BiLSTM, and attention mechanism demonstrates superior performance in stock market prediction and investment decision-making. Results and Discussion: Through ablation experiments on the dataset, our deep learning model achieves the best performance across all metrics. For example, the Mean Absolute Error (MAE) is 15.20, the Mean Absolute Percentage Error (MAPE) is 4.12%, the Root Mean Square Error (RMSE) is 2.13, and the Mean Squared Error (MSE) is 4.56. This indicates that these methods can predict stock market trends and price fluctuations more accurately, providing financial managers with more reliable decision guidance. This research holds significant implications for the field of financial management. It offers investors and financial institutions an innovative approach to better understand and predict stock market behavior, enabling them to make wiser investment decisions. [ABSTRACT FROM AUTHOR]

This paper addresses the persistent threat of botnet attacks on IoT devices, emphasizing their continued existence despite various conventional and deep learning methodologies developed for intrusion detection. Utilizing the Bot-IoT dataset, we propose a hierarchical CNN (HCNN) approach featuring three levels of classification. The HCNN approach, presented in this paper, consists of two networks: the non-hierarchical and the hierarchical network. The hierarchical network works by combining features obtained at a higher level with those of its descender. This combined information is subsequently fed into the following level to extract features for the descendant nodes. The overall network consists of 1790 parameters, with the hierarchical network introducing an additional 942 parameters to the existing backbone. The classification levels comprise a binary classification of normal vs attack in the first level, followed by 5 classes in the second level, and 11 classes in the third level. To assess the effectiveness of our proposed approach, we evaluate performance metrics such as Precision (P), Recall (R), F1 Score (F1), and Accuracy (Acc). Rigorous experiments are conducted to compare the performance of both the hierarchical and non-hierarchical models and existing state-of-the-art approaches, providing valuable insights into the efficiency of our proposed hierarchical CNN approach for addressing botnet attacks on IoT devices. [ABSTRACT FROM AUTHOR]

Delamination represents one of the most significant and dangerous damages in composite plates. Recently, many papers have presented the capability of structural health monitoring (SHM) techniques for the investigation of structural delamination with various shapes and thickness depths. However, few studies have been conducted regarding the utilization of convolutional neural network (CNN) methods for automating the non-destructive testing (NDT) techniques database to identify the delamination size and depth. In this paper, an automated system qualified for distinguishing between pristine and damaged structures and classifying three classes of delamination with various depths is presented. This system includes a proposed CNN model and the Lamb wave technique. In this work, a unidirectional composite plate with three samples of delamination inserted at different depths was prepared for numerical and experimental investigations. In the numerical part, the guided wave propagation and interaction with three samples of delamination were studied to observe how the delamination depth can affect the scattered and trapped waves over the delamination region. This numerical study was validated experimentally using an efficient ultrasonic guided waves technique. This technique involved piezoelectric wafer active sensors (PWASs) and a scanning laser Doppler vibrometer (SLDV). Both numerical and experimental studies demonstrate that the delamination depth has a direct effect on the trapped waves' energy and distribution. Three different datasets were collected from the numerical and experimental studies, involving the numerical wavefield image dataset, experimental wavefield image dataset, and experimental wavenumber spectrum image dataset. These three datasets were used independently with the proposed CNN model to develop a system that can automatically classify four classes (pristine class and three different delamination classes). The results of all three datasets show the capability of the proposed CNN model for predicting the delamination depth with high accuracy. The proposed CNN model results of the three different datasets were validated using the GoogLeNet CNN. The results of both methods show an excellent agreement. The results proved the capability of the wavefield image and wavenumber spectrum datasets to be used as input data to the CNN for the detection of delamination depth. [ABSTRACT FROM AUTHOR]

The technology of handwritten digit and character recognition is the process of identifying handwritten numbers using computers or other devices, machine train itself to recognize the handwritten digits or characters from various sources like bank cheque, mails, images, etc. This paper is about CNN, Logistic Regression, and Random Forest algorithm in handwritten digit or character recognition system, the system works on MNIST dataset for training and testing the models, to get the best accuracy this work rewrites CNN, Logistic Regression, and Random Forest with python libraries. Finally, these algorithms are analyzed by comparing the accuracy and recognition duration. Where CNN got better accuracy than other algorithms. [ABSTRACT FROM AUTHOR]

In this paper, a method based on deep learning to detect abnormal traffic of IoTs in edge computing environment is proposed. Firstly, the data are preprocessed by data cleaning, normalization, oversampling and undersampling, and data set segmentation to obtain a data set with balanced data distribution. Secondly, a method of calculating feature information based on data increment is adopted, which can accurately extract feature information from the dynamic data flow. Finally, the convolution neural network (CNN) is used to extract the local features of the data, and the bi-directional gated loop unit (BiGRU) is used to extract the long sequence correlation of the data. The two networks work together to extract data features. The self-focus mechanism is introduced to deal with redundant data. Experiments show that the accuracy, recall and F 1 value of the proposed method are 97.36%, 98.38% and 97.16%, respectively, in the normal class, which are higher than the comparison algorithm. [ABSTRACT FROM AUTHOR]

In the era of the first Industrial Revolution, many buildings were built with red bricks, and the heritage buildings built at that time are more than 100 years old. In these old heritage buildings, damage is bound to occur due to chemical and physical effects. Technologies such as automatic damage detection can effectively manage damage, but they can be affected by other categories present in heritage buildings. Therefore, this paper proposes a CNN algorithm that can automatically detect cracks and damage that occur in heritage buildings, as well as multi-label classification, such as doors, windows, arches, artwork, brick walls, stonewalls, and vents. A total of 2400 thermal infrared images are collected for 8 categories and automatic classification was performed using the CNN algorithm. The average precision and average sensitivity for the eight categories of heritage buildings are 97.72% and 97.43%, respectively. This paper defines the causes of misclassification as the following two causes: misclassification by multiple objects and misclassification by the perception of the CNN algorithm. [ABSTRACT FROM AUTHOR]