Search

The segmentation of neuronal morphology in electron microscopy images is crucial for the analysis and understanding of neuronal function. However, most of the existing segmentation methods are not suitable for challenging datasets where the neuronal structure is contaminated by noise or has interrupted parts. In this paper, we propose a segmentation method based on deep learning to determine the location information of neurons and reduce the influence of image noise in the data. Specifically, we adapt our neuron dataset based on UNet by using convolution with BN fusion and multi-input feature fusion. The method is named REDAFNet. The model simplifies the model structure and enhances the generalization ability by fusing the convolution layer and BN layer. The noise interference in the data was reduced by multi-input feature fusion, and the ability to understand and express the data was enhanced. The method takes a neuron image as input and its pixel segmentation map as output. Experimental results show that the segmentation accuracy of the proposed method is 91.96%, 93.86% and 80.25% on the ISBI2012 dataset, U-RISC retinal neuron dataset and N2DH-GOWT1 stem cell dataset, respectively. Compared with the existing segmentation methods, the proposed method can extract more complete feature information and achieve more accurate segmentation. [ABSTRACT FROM AUTHOR]

Pedestrian trajectory prediction plays a crucial role in autonomous driving, as its accuracy directly affects the autonomous driving system's comprehension of the environment and subsequent decision-making processes. Current trajectory prediction methods tend to oversimplify pedestrians to mere point coordinates, utilizing positional information to infer interactions among individuals while overlooking the temporal correlations between them, thereby excessively simplifying pedestrian characteristics. To address the aforementioned issues, this paper proposes a trajectory prediction model for autonomous driving applications, that takes into account both pedestrian motion characteristics and scene interaction. The model optimizes the LSTM unit structure twice, serving to learn correlations among long trajectories of pedestrians and to integrate multiple forms of information into the neighborhood interaction module. Furthermore, our model introduces dual attention mechanisms for individuals and scenes, focusing on the key motion points of individual pedestrians and their interactive behavior with others in busy scenarios. The efficacy of the model was validated on the MOT16 pedestrian dataset and the Daimler pedestrian path prediction dataset, outperforming mainstream methods with 8% and 10% reductions in Average Displacement Error and Final Displacement Error respectively. [ABSTRACT FROM AUTHOR]

Parkinson disease (PD) is a type of neurodegenerative disorder that affects the motor movement of the patient. But each technique has its own advantages or disadvantages. In gene, speech and handwriting data model, the feature extraction and reduction is an important step for efficient classification. These two steps require proper attention for selection and also require high processing time as compared to other data model like images. Because in image modality, the deep learning algorithm can be applied that can perform all process and automate the classification. As compared to these domains, the signal produces better and best results. Because the electroencephalogram (EEG) signal are taken from the brain using electrodes and it helps to observe the brain signals effectively and immediately as compared to the other data modals. Hence, in this paper, the wavelet transform will be used to decompose the signals and statistical features will be extracted from the transformed signal. Here, the satin bower bird optimization will be used for both type of wavelet selection and feature reduction process for final classification. The reduced feature set will be classified using Ensemble Neural Network type including InceptionV3, DenseNet, MobileNet, Xception, and NasNet) recently proposed for medical image classification. The whole process will be realized using MATLAB R2021a software and its performance will be evaluated in terms of Accuracy and is compared against Automated Tunable Q-wavelet transform performance. The proposed ensemble method, employing EEG signal processing and neural networks, achieved a 97% success rate in discriminating PD datasets, surpassing Convolutional Neural Network (CNN) and Machine Learning (ML) classifications (88% –92%). Utilizing MATLAB R2021a, its superiority over Q-wavelet transform was evident, signifying improved PD dataset discrimination. [ABSTRACT FROM AUTHOR]

With the development of artificial intelligence, deep-learning-based log anomaly detection proves to be an important research topic. In this paper, we propose LogCSS, a novel log anomaly detection framework based on the Context-Semantics-Statistics Convolutional Neural Network (CSSCNN). It is the first model that uses BERT (Bidirectional Encoder Representation from Transformers) and CNN (Convolutional Neural Network) to extract the semantic, temporal, and correlational features of the logs. We combine the features with the statistic information of log templates for the classification model to improve the accuracy. We also propose a technique, DOOT (Deals with the Out-Of-Templates), for online template matching. The experimental research shows that our framework improves the average F1 score of the six best algorithms in the industry by more than 5% on the open-source dataset HDFS, and improves the average F1 score of the six best algorithms in the industry by more than 8% on the BGL dataset, LogCSS also performs better than other similar methods on our own constructed dataset. [ABSTRACT FROM AUTHOR]

Malware attack is a growing problem on the Android mobile platform due to its popularity and openness. Although numerous malware detection approaches have been proposed, it still remains challenging for malware detection due to a large amount of constantly mutating apps. The opcode, as the most fundamental part of Android app, possesses good resistance against obfuscation and Android version updates. Due to the large number of opcodes, most opcode-based methods employ statistical-based feature selection, which disrupts the correlation and semantic information among opcodes. In this paper, we propose an Android malware detection framework based on sensitive opcodes and deep reinforcement learning. Firstly, we extract sensitive opcode fragments based on sensitive elements and then encode the features using n-gram. Next, we use deep reinforcement learning to select the optimal subset of features. During the process of handling opcodes, we focus on preserving semantic information and the correlation among opcodes. Finally, our experimental results show an accuracy of 0.9670 by using the 25 opcode features we obtained. [ABSTRACT FROM AUTHOR]

Military object military object detection technology serves as the foundation and critical component for reconnaissance and command decision-making, playing a significant role in information-based and intelligent warfare. However, many existing military object detection models focus on exploring deeper and more complex architectures, which results in models with a large number of parameters. This makes them unsuitable for inference on mobile or resource-constrained combat equipment, such as combat helmets and reconnaissance Unmanned Aerial Vehicles (UAVs). To tackle this problem, this paper proposes a lightweight detection framework. A CSP-GhostnetV2 module is proposed in our method to make the feature extraction network more lightweight while extracting more effective information. Furthermore, to fuse multiscale information in low-computational scenarios, GSConv and the proposed CSP-RepGhost are used to form a lightweight feature aggregation network. The experimental results demonstrate that our proposed lightweight model has significant advantages in detection accuracy and efficiency compared to other detection algorithms. [ABSTRACT FROM AUTHOR]

Facial expression recognition has long been an area of great interest across a wide range of fields. Deep learning is commonly employed in facial expression recognition and demonstrates excellent performance in large-sample classification tasks. However, deep learning models often encounter challenges when confronted with small-sample expression classification problems, as they struggle to extract sufficient relevant features from limited data, resulting in subpar performance. This paper presents a novel approach called the Multi-CNN Logical Reasoning System, which is based on local area recognition and logical reasoning. It initiates the process by partitioning facial expression images into two distinct components: eye action and mouth action. Subsequently, it utilizes logical reasoning based on the inherent relationship between local actions and global expressions to facilitate facial expression recognition. Throughout the reasoning process, it not only incorporates manually curated knowledge but also acquires hidden knowledge from the raw data. Experimental results conducted on two small-sample datasets derived from the KDEF and RaFD datasets demonstrate that the proposed approach exhibits faster convergence and higher prediction accuracy when compared to classical deep learning-based algorithms. [ABSTRACT FROM AUTHOR]

Aspect-Based Sentiment Analysis (ABSA) has been the focus of increasing study in recent years. Previous research has demonstrated that incorporating syntactic information, such as dependency trees, can enhance ABSA performance. Despite the widespread use of metaphors in daily life to express emotions more vividly, few studies have integrated this literary device into ABSA. In this paper, we propose a novel ABSA model that utilizes Metaphor Identification Procedure (MIP) to encode both the sentence and aspect word as a single unit, thereby overcoming these limitations. Our experimental results demonstrate that our model achieves competitive performance in ABSA. [ABSTRACT FROM AUTHOR]

Knowledge tracing aims to model learners' knowledge mastery based on their historical interaction records and predict their future performance. Due to its great potential in enabling personalized learning in intelligent tutoring systems, it has received extensive attention. However, most deep learning-based knowledge tracing methods have significant predictive performance. It is difficult to extract meaningful interpretations from the thousands of parameters in neural networks. The interpretability of knowledge tracing refers to the ability of learners to easily understand the predicted results.To address this problem, based on learning factors that influence the learner's exercise performance, this paper proposes a novel knowledge tracing model which is named Integrating Learning factors and Bayesian network for interpretable Knowledge Tracing (LBKT). Firstly, meaningful learning factors, including knowledge mastery, learning ability, and exercise difficulty, are calculated from learners' historical interaction records using deep learning and statistical methods. Then, Bayesian network is constructed to capture the causal relation between the three learning factors and exercise response. Finally, the Bayesian network is generated through structure and parameter learning to obtain interpretable prediction of future exercise performance. The proposed model named LBKT is evaluated on three public real-world educational datasets. The experiment results demonstrate that our approach achieves better predictive performance compared to baseline knowledge tracing methods, while also exhibiting significant superiority in model interpretability. [ABSTRACT FROM AUTHOR]

Nowadays, automatic human activity recognition from video images is necessary for monitoring applications and caring for disabled people. The use of surveillance cameras and the processing of the obtained images leads to the achievement of a smart, accurate system for the recognition of human behavior. Since human detection in different scenes is associated with many challenges, several approaches have been implemented to detect human activity from video image processing. Due to the complexity of human activities, background noises and other factors affect the detection. For the solution of these problems, two deep learning-based algorithms have been described in the current article. According to the convolutional neural networks, the LSTM + CNN method and the 3D CNN method have been used to recognize the human activities in the images of the video. Each algorithm is explained and analyzed in detail. The experiments designed in this paper are performed by two datasets: the HMDB-51 dataset and the UCF101 dataset. In the HMDB-51 dataset, the highest obtained accuracy for CNN + LSTM method was equal to 70.2 and for method 3D CNN equal to 54.4. In the UCF101 dataset, the highest obtained accuracy for CNN + LSTM method was equal to 95.1 and for method 3D CNN equal to 90.8. [ABSTRACT FROM AUTHOR]

In the era of digital economy, the optimization of enterprise supply chain networks has become a key challenge, while the problems of traditional supply chains, including information asymmetry and lack of trust, seriously hinder the development of enterprise supply chain networks. This paper will use the blockchain distributed technology and the digital economy background to explore how to use the blockchain distributed technology to optimize the existing problems. Firstly, study the supply chain information sharing to develop resources to reduce costs, then use the application of block chain technology and smart contract to establish information sharing mechanism to help the supply chain information more transparent and improve trust; secondly, use the block chain technology decentralized storage model to realize the decentralized supply chain research, and finally use the consensus method to improve the privacy protection of information, to avoid information asymmetry among users. Through experiments, it could be found that the optimization method of enterprise supply chain network based on blockchain distributed technology had a traceability accuracy of over 92.35% for the extracted products, with an average traceability accuracy of 93.791% for 10 products. Research on the transparency of different supply chain information was above 89.73% . By utilizing blockchain distributed technology, information protection in enterprise supply chains could be effectively improved; trust mechanisms could be better established; risk control effectiveness could be improved; optimization of enterprise supply chain networks could be better assisted. [ABSTRACT FROM AUTHOR]

As a list of remotely sensed data sources is available, the effective processing of remote sensing images is of great significance in practical applications in various fields. This paper proposes a new lightweight network to solve the problem of remote sensing image processing by using the method of deep learning. Specifically, the proposed model employs ShuffleNet V2 as the backbone network, appropriately increases part of the convolution kernels to improve the classification accuracy of the network, and uses the maximum overlapping pooling layer to enhance the detailed features of the input images. Finally, Squeeze and Excitation (SE) blocks are introduced as the attention mechanism to improve the architecture of the network. Experimental results based on several multisource data show that our proposed network model has a good classification effect on the test samples and can achieve more excellent classification performance than some existing methods, with an accuracy of 91%, and can be used for the classification of remote sensing images. Our model not only has high accuracy but also has faster training speed compared with large networks and can greatly reduce computation costs. The demo code of our proposed method will be available at https://github.com/li-zi-qi. [ABSTRACT FROM AUTHOR]

Medical image classification is an essential task in the fields of computer-aided diagnosis and medical image analysis. In recent years, researchers have made extensive work on medical image classification by computer vision techniques. However, most of the current work is based on deep learning methods, which still suffer from expensive hardware resources, long time consuming and a lot of parameters to be optimized. In this paper, a multi-granularity ensemble algorithm for medical image classification based on broad learning system is proposed, which is an end-to-end lightweight model. On the one hand, the proposed method is designed to address the problem of weak image feature learning ability of broad learning system. The convolution module with fixed weights based on transfer learning is introduced as a feature extractor to extract fusion features of medical images. On the other hand, the multi-granularity ensemble framework is proposed, which learn the fusion features of medical images from fine-grained to coarse-grained respectively, and the prediction results at different granularity levels are integrated by ensemble learning. In this way, the bottom local features can be sufficiently considered, while the global features can also be taken into account. The experimental results show that on the MedMNIST dataset (containing 10 sub-datasets), the proposed method can shorten the training time by tens of times while having similar accuracy to deep convolutional neural networks. On the ChestXRay2017 dataset, the proposed method can achieve an accuracy of 92.5%, and the training time is also significantly better than other methods. [ABSTRACT FROM AUTHOR]

The accurate detection of traffic signs is a critical component of self-driving systems, enabling safe and efficient navigation. In the literature, various methods have been investigated for traffic sign detection, among which deep learning-based approaches have demonstrated superior performance compared to other techniques. This paper justifies the widespread adoption of deep learning due to its ability to provide highly accurate results. However, the current research challenge lies in addressing the need for high accuracy rates and real-time processing requirements. In this study, we propose a convolutional neural network based on the YOLOv8 algorithm to overcome the aforementioned research challenge. Our approach involves generating a custom dataset with diverse traffic sign images, followed by conducting training, validation, and testing sets to ensure the robustness and generalization of the model. Experimental results and performance evaluation demonstrate the effectiveness of the proposed method. Extensive experiments show that our model achieved remarkable accuracy rates in traffic sign detection, meeting the real-time requirements of the input data. [ABSTRACT FROM AUTHOR]

Knowledge tracing (KT), which aims to trace human knowledge learning process by using machines, has widely applied in online learning systems. It dynamically models student's knowledge states in relation to different learning factors through their learning interactions. Recently, KT has attracted many researches attention due to its good performance to using deep learning. Although most of KT models have shown outstanding results, they have limitations: either ignore the human cognitive law and learning behavior, or lack the ability to go deeper modeling to trace knowledge state. In this paper, we propose a deeper knowledge tracking model integrating cognitive theory and learning behavior (CLDKT). It united the advantages of memory network and recurrent neural network of the existing deep learning KT models for modeling student learning. To better implement CLDKT, we add the residual network (ResNet) to realize the deep modeling of learning behaviors. Extensive experiments on three open benchmark datasets to evaluate our model. Experimental results demonstrate that (I) CLDKT outperforms the state-of-the-art KT models on students' performance prediction. (II) CLDKT can deeper modeling to trace knowledge state owing to the ResNet import. (III) CLDKT has better interpretability and predictability, which proves the effectiveness of the knowledge tracing model integrating cognitive law and learning behavior. [ABSTRACT FROM AUTHOR]

The surface roughness of the workpiece is one of the important indicators to measure the quality of the workpiece. Vision-based detection methods are mainly based on human-designed image feature indicators for detection, while the self-extraction method of milling surface features based on deep learning has problems such as poor perception of details, and will be affected by surface rust. In order to solve these problems, this paper proposes a visual inspection method for surface roughness of milling rusted workpieces combined with local equilibrium histogram and CBB-yolo network. Experimental results show that local equilibrium histogram can enhance the milling texture and improve the accuracy of model detection when different degrees of rust appear on the surface of the milled workpiece. The detection accuracy of the model can reach 97.9%, and the Map can reach 99.3. The inference speed can reach 29.04 frames per second. And the inspection of workpieces without rust, this method also has high detection accuracy, can provide automatic visual online measurement of milling surface roughness Theoretical basis. [ABSTRACT FROM AUTHOR]

3D point cloud has irregularity and disorder, which pose challenges for point cloud analysis. In the past, the projection or point cloud voxelization methods often used were insufficient in accuracy and speed. In recent years, the methods using Transformer in the NLP field or ResNet in the deep learning field have shown promising results. This article expands these ideas and introduces a novel approach. This paper designs a model AaDR-PointCloud that combines self-attention blocks and deep residual point blocks and operates iteratively to extract point cloud information. The self-attention blocks used in the model are particularly suitable for point cloud processing because of their order independence. The deep residual point blocks used provide the expression of depth features. The model performs point cloud classification and segmentation tests on two shape classification datasets and an object part segmentation dataset, achieving higher accuracy on these benchmarks. [ABSTRACT FROM AUTHOR]

Speech emotion recognition is of great significance in the industry such as social robots, health care, and intelligent education. Due to the obscurity of emotional expression in speech, most works on speech emotion recognition (SER) ignore the consistency of speech emotion recognition, leading to fuzzy expression and low accuracy in emotional recognition. In this paper, we propose a semantic aware speech emotion recognition model to alleviate this issue. Specifically, a speech feature extraction module based on CNN and Transformer is designed to extract local and global information from the speech. Moreover, a semantic embedding support module is proposed to use text semantic information as auxiliary information to assist the model in extracting emotional features of speech, and can effectively overcome the problem of low recognition rate caused by emotional ambiguity. In addition, the model uses a key-value pair attention mechanism to fuse the features, which makes the fusion of speech and text features preferable. In experiments on two benchmark corpora IEMOCAP and EMO-DB, the recognition rates of 74.3% and 72.5% were obtained under respectively, which show that the proposed model can significantly improve the accuracy of emotion recognition. [ABSTRACT FROM AUTHOR]

Diabetic retinopathy (DR) is one of the leading causes of blindness. However, because the data distribution of classes is not always balanced, it is challenging for automated early DR detection using deep learning techniques. In this paper, we propose an adaptive weighted ensemble learning method for DR detection based on optical coherence tomography (OCT) images. Specifically, we develop an ensemble learning model based on three advanced deep learning models for higher performance. To better utilize the cues implied in these base models, a novel decision fusion scheme is proposed based on the Bayesian theory in terms of the key evaluation indicators, to dynamically adjust the weighting distribution of base models to alleviate the negative effects potentially caused by the problem of unbalanced data size. Extensive experiments are performed on two public datasets to verify the effectiveness of the proposed method. A quadratic weighted kappa of 0.8487 and an accuracy of 0.9343 on the DRAC2022 dataset, and a quadratic weighted kappa of 0.9007 and an accuracy of 0.8956 on the APTOS2019 dataset are obtained, respectively. The results demonstrate that our method has the ability to enhance the ovearall performance of DR detection on OCT images. [ABSTRACT FROM AUTHOR]

Unmanned robotics and autonomous systems (URAS) are integral components of contemporary Cyber-Physical Systems (CPS), allowing vast applications across many domains. However, due to uncertainties and ambiguous data in real-world environments, ensuring robust and efficient decision-making in URAS is difficult. By capturing and reasoning with linguistic data, fuzzy logic has emerged as a potent tool for addressing such uncertainties. Deep Iterative Fuzzy Pooling (DIFP) is a novel method proposed in this paper for improving decision-making in URAS within CPS. The DIFP integrates the capabilities of deep learning and fuzzy logic to effectively pool and aggregate information from multiple sources, thereby facilitating more precise and trustworthy decision-making. This research presents the architecture and operational principles of DIFP and demonstrates its efficacy in various URAS scenarios through extensive simulations and experiments. The proposed method demonstrated a high-performance level, with an accuracy of 98.86%, precision of 95.30%, recall of 97.32%, F score of 96.26%, and a notably low false positive rate of 4.17%. The results show that DIFP substantially improves decision-making performance relative to conventional methods, making it a promising technique for enhancing the autonomy and dependability of URAS in CPS. [ABSTRACT FROM AUTHOR]

Crop diseases pose significant challenges to global food security and agricultural sustainability. Timely and accurate disease detection is crucial for effective disease management and minimizing crop losses. In recent years, hyperspectral imaging has emerged as a promising technology for non-destructive and early disease detection in crops. This research paper presents an advanced deep learning approach for enhancing crop disease detection using hyperspectral imaging. The primary objective is to propose a hybrid Autoencoder-Generative Adversarial Network (AE-GAN) model that effectively extracts meaningful features from hyperspectral images and addresses the limitations of existing techniques. The hybrid AE-GAN model combines the strengths of the Autoencoder for feature extraction and the Generative Adversarial Network for synthetic sample generation. Through extensive evaluation, the proposed model outperforms existing techniques, achieving exceptional accuracy in crop disease detection. The results demonstrate the superiority of the hybrid AE-GAN model, offering substantial advantages in terms of feature extraction, synthetic sample generation, and utilization of spatial and spectral information. The proposed model's contributions to sustainable agriculture and global food security make it a valuable tool for advancing agricultural practices and enhancing crop health monitoring. With its promising implications, the hybrid AE-GAN model represents a significant advancement in crop disease detection, paving the way for a more resilient and food-secure future. [ABSTRACT FROM AUTHOR]

In order to address the problem of decreased accuracy in vehicle object detection models when facing low-light conditions in nighttime environments, this paper proposes a method to enhance the accuracy and precision of object detection by using the image translation technology based on the Generative Adversarial Network (GAN) in the field of computer vision, specifically the CycleGAN, from the perspective of improving the training set of object detection models. This is achieved by transforming the existing well-established daytime vehicle dataset into a nighttime vehicle dataset. The proposed method adopts a comparative experimental approach to obtain translation models with different degrees of fitting by changing the training set capacity, and selects the optimal model based on the evaluation of the effect. The translated dataset is then used to train the YOLO-v5-based object detection model, and the quality of the nighttime dataset is evaluated through the evaluation of annotation confidence and effectiveness. The research results indicate that utilizing the translated nighttime vehicle dataset for training the object detection model can increase the area under the PR curve and the peak F1 score by 10.4% and 9% respectively. This approach improves the annotation accuracy and precision of vehicle object detection models in nighttime environments without requiring additional labeling of vehicles in monitoring videos. [ABSTRACT FROM AUTHOR]

Breast cancer poses a significant health risk for women, demanding early detection to mitigate its mortality impact. Leveraging the power of Deep Learning (DL) in medical imaging, this paper introduces a hybrid model that integrates YOLOv7 and Half UNet for feature extraction. YOLOv7 identifies and localizes potential cancerous regions, while Half UNet focuses on extracting pertinent features with its encoder-decoder structure. The fusion of these discriminative features, coupled with feature selection via Coati Optimization, ensures a comprehensive and optimized dataset. The selected features then feed into the CatBoost classification algorithm, refining parameters iteratively for precise predictions and minimizing the loss function. Evaluation metrics, including precision, recall, specificity, and accuracy, demonstrate the model's superior performance. Notably, the proposed model surpasses existing methods in early-stage breast cancer detection. Beyond numerical metrics, its significance lies in the potential to positively impact patient outcomes and increase survival rates. By amalgamating cutting-edge DL techniques, the model excels in identifying intricate patterns crucial for early cancer detection. The efficient fusion of YOLOv7 and Half UNet, coupled with feature optimization through Coati Optimization, sets this model apart. This research contributes to the evolving landscape of medical imaging and DL applications, emphasizing the potential for enhanced breast cancer diagnosis and improved patient prognoses. [ABSTRACT FROM AUTHOR]

Although deep learning models show powerful performance, they are still easily deceived by adversarial samples. Some methods for generating adversarial samples have the drawback of high time loss, which is problematic for adversarial training, and the existing adversarial training methods are difficult to adapt to the dynamic nature of the model, so it is still challenging to study an efficient adversarial training method. In this paper, we propose an adversarial training method, the core of which is the improved adversarial sample generation method AGFAT for adversarial training and the improved dynamic adversarial training method AGFAT-DAT. AGFAT uses a word frequency-based approach to identify significant words, filter replacement candidates, and use an efficient semantic constraint module as a means to reduce the time of adversarial sample generation; AGFAT-DAT is a dynamic adversarial training approach that uses a cyclic attack on the model after adversarial training and generates adversarial samples for adversarial training again. It is demonstrated that the proposed method can significantly reduce the generation time of adversarial samples, and the adversarial-trained model can also effectively defend against other types of word-level adversarial attacks. [ABSTRACT FROM AUTHOR]

In recent years, 3D object detection based on LiDAR point clouds is a key component of autonomous driving. In pursuit of enhancing the accuracy of 3D point cloud feature extraction and point cloud detection, this paper introduces a novel 3D object detection model, termed as Graph Self-Attention-RCNN (GA-RCNN). This model is designed to integrate voxel information and point location information, enhancing the quality of 3D object proposals while maintaining contextual accuracy. The first stage rectifies the previous approach that relied on local features for preselected boxes, overlooking crucial global contextual information. An improved method is suggested in this work, utilizing BEV to capture long-range dependencies via a cross-attention mechanism. The second stage addresses the overreliance on local neighborhood point feature extraction. The Graph Self-Attention Pooling method is proposed, characterized by its dynamic computation of contribution weights for inputs. This enhances the model's flexibility and generalization performance. Extensive evaluations on KITTI and Waymo datasets demonstrate GA-RCNN's superior accuracy compared to other methods, affirming its efficacy in 3D object detection. [ABSTRACT FROM AUTHOR]

In recent years, UNet and its derivative networks have gained widespread recognition as major methods of medical image segmentation. However, networks like UNet often struggle with Point-of-Care (POC) healthcare applications due to their high number of parameters and computational complexity. To tackle these challenges, this paper introduces an efficient network designed for medical image segmentation called MCU-Net, which leverages ConvNeXt to enhance UNet. 1) Based on ConvNeXt, MCU-Net proposes the MCU Block, which employs techniques such as large kernel convolution, depth-wise separable convolution, and an inverted bottleneck design. To ensure stable segmentation performance, it also integrates global response normalization (GRN) layers and Gaussian Error Linear Unit (GELU) activation functions. 2) Additionally, MCU-Net introduces an enhanced Multi-Scale Convolution Attention (MSCA) module after the original UNet's skip connections, emphasizing medical image features and capturing semantic insights across multiple scales. 3)The downsampling process replaces pooling layers with convolutions, and both upsampling and downsampling stages incorporate batch normalization (BN) layers to enhance model stability during training. The experimental results demonstrate that MCU-Net, with a parameter count of 2.19 million and computational complexity of 19.73 FLOPs, outperforms other segmentation models. The overall performance of MCU-Net in medical image segmentation surpasses that of other models, achieving a Dice score of 91.8% and mIoU of 84.7% on the GlaS dataset. When compared to UNet on the BUSI dataset, MCU-Net shows an improvement of 2% in Dice and 2.9% in mIoU. [ABSTRACT FROM AUTHOR]

Intelligent Transportation Systems (ITS) have experienced significant growth over the past decade thanks to advances in control, communication, and information technology applied to vehicles, roads, and traffic control systems. Vehicle type classification plays a vital role in implementing ITS because of its ability to collect useful traffic information, enable future development of transport infrastructures, and increase human comfort. As a branch of machine learning, deep learning represents a frontier for artificial intelligence, which seeks to be closer to its primary goal. Deep learning is a powerful tool for classifying vehicle types because it can capture complex traffic data characteristics and learn from large amounts of data. This means that it can be used to accurately classify traffic data and generate valuable insights that can be used to improve traffic management. Researchers have successfully adopted these algorithms as a solution to propose optimal vehicle-type classification strategies. This paper highlights the role of deep learning algorithms in solving the vehicle type classification problem, reviewing the state-of-the-art approaches in this field. [ABSTRACT FROM AUTHOR]

With the rapid growth of Internet penetration, identifying emergency information from network news has become increasingly significant for emergency monitoring and early warning. Although deep learning models have been commonly used in Chinese Named Entity Recognition (NER), they require a significant amount of well-labeled training data, which is difficult to obtain for emergencies. In this paper, we propose an NER model that combines bidirectional encoder representations from Transformers (BERT), bidirectional long-short-term memory (BILSTM), and conditional random field (CRF) based on adversarial training (ATBBC) to address this issue. Firstly, we constructed an emergency dataset (ED) based on the classification and coding specifications of the national emergency platform system. Secondly, we utilized the BERT pre-training model with adversarial training to extract text features. Finally, BILSTM and CRF were used to predict the probability distribution of entity labels and decode the probability distribution into corresponding entity labels.Experiments on the ED show that our model achieves an F1-score of 85.39% on the test dataset, which proves the effectiveness of our model. [ABSTRACT FROM AUTHOR]

The concept of endorsing AI in embedded systems is growing in all sectors including the development of Accident Avoidance Systems. Although real-time road crash prediction is vital for enhancing road user safety, there has been limited focus on the analysis of real-time crash events within ensemble and deep learning fused systems. The main aim of this paper is to design an advanced Accident Avoidance System established on a deep learning and ensemble fusion strategy in order to acquire more performant crash predictions. As such, four highly optimized models for crash prediction have been designed based on the popular ensemble techniques: CatBoost, AdaBoost and Bagging and the deep learning CNN. Additionally, four categories of features, including driver inputs, vehicle kinematics, driver states and weather conditions, were measured during the execution of various driving tasks performed on a driving simulator. Moreover, given the infrequent nature of crash events, an imbalance-control procedure was adopted using the SMOTE and ADASYN techniques. The highest performances results have been acquired using CatBoost along with ADASYN on almost all the adopted metrics during the different weather conditions, and more than 50% of all crashes have occurred in rainy weather conditions, whereas 31% have been exhibited in fog patterns. The sensitivity analysis results indicate that the fusing all the acquired features has the highest impact on the prediction performance. To our knowledge, there has been a limited interest, if not at all, at adopting a fused ensemble deep learning system examining the real-time impact of the adopted features' combinations on the prediction of road crashes while taking into account class imbalance. The findings provide new insights into crash prediction and emphasize the relevance of the explanatory features which can be endorsed in designing efficient Accident Avoidance Systems. [ABSTRACT FROM AUTHOR]

The process of partitioning into different objects of an image is segmentation. In different major fields like face tracking, Satellite, Object Identification, Remote Sensing and majorly in medical field segmentation process is very important to find the different objects in the image. To investigate the functions and processes of human boy in radiology magnetic resonance imaging (MRI) will be used. MRI technique is using in many hospitals for the diagnosis purpose widely in finding the stage of a particular disease. In this paper, we proposed a new method for detecting the tumor with enhanced performance over traditional techniques such as K-Means Clustering, fuzzy c means (FCM). Different research methods have been proposed by researchers to detect the tumor in brain. To classify normal and abnormal form of brain, a system for screening is discussed in this paper which is developed with a framework of artificial intelligence with deep learning probabilistic neural networks by focusing on hybrid clustering for segmentation on brain image and crystal contrast enhancement. Feature's extraction and classification are included in the developing process. Performance in Simulation of proposed design has shown the superior results than the traditional methods. [ABSTRACT FROM AUTHOR]

In the present day, online users are incentivized to engage in short text-based communication. These short texts harbor a significant amount of implicit information, including opinions, topics, and emotions, which are of notable value for both exploration and analysis. By alleviating the sparsity in short texts, topic models can be used to discover topics from large collections of short texts. While there is a large body of surveys focused on topic modeling, but only a few of them have focused on the short texts. This paper presents a comprehensive overview of topic modeling methods for short texts from a novel perspective. Firstly, it discusses short text probabilistic topic models and outlines the directions in which they can be improved. Secondly, it explores short text neural topic models, which can be categorized into three groups based on their underlying structures. In addition, this paper provides a detailed investigation of embedding methods in topic modeling. Moreover, various applications and corresponding works are surveyed, with a focus on short texts. The commonly used public corpora and evaluation indicators for topic modeling are also summarized. Finally, the advantages and disadvantages of short text topic modeling are discussed in detail, and future research directions are proposed. [ABSTRACT FROM AUTHOR]

Data driven deep learning methods have become the mainstream method of building extraction from remote sensing images. In this paper, deep learning algorithm is used to classify and extract buildings from remote sensing images of rural areas around the Great Wall in the suburbs of Beijing captured by unmanned aerial vehicles. Aiming at the shortcomings of the current mainstream instance segmentation algorithm Mask R-CNN in feature fusion and poor prediction of instance mask boundaries, this paper proposes a boundary optimization algorithm for building instance segmentation based on discrete wavelet transform. Firstly, the discrete wavelet transform is introduced into the segmentation task branch of Mask R-CNN algorithm to extract the low-frequency and high-frequency information of the real mask, in which the high-frequency information includes the boundary information. Secondly, the pixel by pixel prediction of the mask turns into the learning of the low-frequency and high-frequency information of the real mask. The learning of the high-frequency information helps the segmentation network to learn the boundary features better. Finally, using the reversibility of discrete wavelet transform, the low-frequency and high-frequency information of the learned mask is inversely transformed to reconstruct the final mask. The improved algorithm is evaluated on the dataset COCO, and applied to the automatic extraction of buildings. The DWT Mask R-CNN algorithm model achieved 70.2% segmentation accuracy and 71.4% detection accuracy, which were improved by 1% and 0.7% respectively compared with the Mask R-CNN and Cascade Mask R-CNN models. The experimental results show that the instance segmentation edge optimization algorithm combined with wavelet transform has achieved better results on the segmentation boundary, improved the poor effect of mask edge detection and achieved higher detection accuracy, and can accurately extract village buildings. [ABSTRACT FROM AUTHOR]

Deep learning has dominated the research field of traffic sign detection, but the traffic sign detection algorithms based on deep learning have difficulty in solving the two tasks of localization and classification simultaneously when performing traffic sign detection on realistic and complex traffic scene images, and the images or the types of traffic signs provided by the public dataset used by the relevant algorithm cannot meet the situations encountered in realistic traffic scenes.To solve the above problems, this paper creates a new road traffic sign dataset, and based on the YOLOv4 algorithm, designs a multi-size feature extraction module and an enhanced feature fusion module to improve the algorithm's ability to locate and classify traffic signs simultaneously, in view of the complexity of realistic traffic scene images and the large variation of traffic sign sizes in the images. The experimental results on the newly created dataset show that the improved algorithm achieves 83.63% mean Average Precision (mAP), which is higher than several major object detection algorithms based on deep learning for the same type of task at present. The newly created dataset in this paper is publicly available at . [ABSTRACT FROM AUTHOR]

Multi-modal information outbreak is consistently increasing in social media. Classification of tweet sentiments using various information modalities will help the recommender systems to achieve success in digital marketing. Moreover, aspect-level sentiment analysis categorizes a target's sentiment polarity in a specific environment. Using topic modelling in aspect-level sentiment analysis enables the identification of more accurate aspect-based tweet sentiments. The existing sentiment classification techniques used for the development of recommendation systems do not focus on the aspect-based approach modelled using deep learning classifier with temporal analysis on the social media data. Hence, this paper proposes an efficient sentiment classification model that highlights the impact of topic modelling-based word feature embedding for improvising the classification of Twitter sentiments and product reviews based on temporal reasoning and analysis for performing predictive analysis. For tweets context analysis, Latent Dirichlet Allocation based topic modelling is used in this work which generates the topics. For each topic, the sentiment is calculated separately and the topic guided feature expansion is done using Senti-wordnet. Moreover, an extended deep learning classification algorithm called Long Short-Term Memory (LSTM) with word embedding and temporal reasoning(LSTMWTR) is proposed in this paper for improving the classification accuracy. Finally, the labelled data are classified using the existing machine learning algorithms namely Naïve Bayes, Support Vector Machines and also using the deep learning models such as Convolution Neural Network(CNN),LSTM, Recurrent Neural Networks (RNN) and the transformer model namelyBi-directional Encoder Representation from Transformers (BERT),Convolution Bi-directional Recurrent Neural Network (CBRNN) and the proposed deep learning algorithm namelyLSTMWTR. These sentiment classification algorithms have been evaluated with word embedding for tweet sentiment classification and product review classification. The results obtained from this work show that the proposed LSTMWTR algorithm emerges as the highly accurate model for tweet sentiment and product review classification. [ABSTRACT FROM AUTHOR]

Online shopping is a form of electronic commerce that enables customers to purchase products directly from the seller over the internet using a web browser or a mobile application. With the growing number of research papers on Deep Learning (DL)-based recommendations, DL models have proven to be effective in Recommender systems. Hence in this paper, relevant product accessories recommendation is proposed using deep learning and histogram features. The proposed recommendation describes the novel way of content-based filtering which divides the work into two phases. In phase 1, the implemented approach determines the color and category of the product. In phase 2, the recommendation system retrieves the matching accessories for the chosen product. For phase 1, Decision Tree, Linear Regression, Logistic Regression, Naïve Bayes, Long Short-Term Memory (LSTM), and a novel method of Stack dense Recurrent Neural Network (RNN) along with the color histogram is applied to identify the category and color of the product. It is justified that the proposed technique of stack dense RNN achieves 98% accuracy. In phase 2, from the Machine Learning (ML) perspective, Random Forest (RF) is employed for the recommendation. The RF model finds the matching accessories for the chosen product and retrieves the top relevant items. [ABSTRACT FROM AUTHOR]

The key step in the intelligence of tongue diagnosis is the segmentation of the tongue image, and the accuracy of the segmented edges has a significant impact on the subsequent medical judgment. Deep learning can predict the class of pixel points to achieve pixel-level segmentation of images, so it can be used to handle tongue segmentation tasks. However, different models have different segmentation effects, and they did not learn the connection between space and channels, resulting in inaccurate tongue segmentation. This paper first discussed the choice of model and loss function and then compared the results of different options to find the better model. Associating the red feature of the tongue is very conducive to segmentation as a feature, this paper tested many methods to try to get the color features of the original image to be paid attention to. Finally, this paper proposed an improved Encoder-Decoder network model to solve the problem based on the results. Start with Resnet as the backbone network, then introduce the U-Net model, and then we fused the attention layer, obtained from the source image through convolution and CBAM attention mechanism, and the feature layer obtained from the last upsampling in U-Net. Experimental results show that: The new, improved algorithm results are 2-3 percentage points higher than the popular algorithm, making it more suitable for tongue segmentation tasks. [ABSTRACT FROM AUTHOR]

Web applications play a vital role in modern digital world. Their pervasiveness is mainly underpinned by numerous technological advances that can often lead to misconfigurations, thereby opening a way for a variety of attack vectors. The rapid development of E-commerce, big data, cloud computing and other technologies, further enterprise services are entering to the internet world and have increasingly become the key targets of network attacks. Therefore, the appropriate remedies are essential to maintain the very fabric of security in digital world. This paper aims to identify such vulnerabilities that need to be addressed for ensuring the web security. We identify and compare the static, dynamic, and hybrid tools that can counter the prevalent attacks perpetrated through the identified vulnerabilities. Additionally, we also review the applications of AI in intrusion detection and pinpoint the research gaps. Finally, we cross-compare the various security models and highlight the relevant future research directions. [ABSTRACT FROM AUTHOR]

The rise of social networking in today's society has brought convenience to people's lives, but at the same time people are also suffering from cyberbullying. How to check these bullying languages has become a popular problem. As text is an important vehicle for online social networking, the natural language learning, representation, and training becomes a necessary work for cyberbullying detection. In this paper, we summarize and analyze the existing work by studying it, and then finally propose new ideas and experiments. The specific method is based on the LSTM model, in which the parameters and dimensions are adjusted to demonstrate the best results of the model. And a user rating system is used to detect bullying more effectively. [ABSTRACT FROM AUTHOR]

Nowadays, the massive industrial data has effectively improved the performance of the data-driven deep learning Remaining Useful Life (RUL) prediction method. However, there are still problems of assigning fixed weights to features and only coarse-grained consideration at the sequence level. This paper proposes a Transformer-based end-to-end feature-level mask self-supervised learning method for RUL prediction. First, by proposing a fine-grained feature-level mask self-supervised learning method, the data at different time points under all features in a time window is sent to two parallel learning streams with and without random masks. The model can learn more fine-grained degradation information by comparing the information extracted by the two parallel streams. Instead of assigning fixed weights to different features, the abstract information extracted through the above process is invariable correlations between features, which has a good generalization to various situations under different working conditions. Then, the extracted information is encoded and decoded again using an asymmetric structure, and a fully connected network is used to build a mapping between the extracted information and the RUL. We conduct experiments on the public C-MAPSS datasets and show that the proposed method outperforms the other methods, and its advantages are more obvious in complex multi-working conditions. [ABSTRACT FROM AUTHOR]

Extracting more information from feature interactions is essential to improve click-through rate (CTR) prediction accuracy. Although deep learning technology can help capture high-order feature interactions, the combination of features lacks interpretability. In this paper, we propose a multi-semantic feature interaction learning network (MeFiNet), which utilizes convolution operations to map feature interactions to multi-semantic spaces to improve their expressive ability and uses an improved Squeeze & Excitation method based on SENet to learn the importance of these interactions in different semantic spaces. The Squeeze operation helps to obtain the global importance distribution of semantic spaces, and the Excitation operation helps to dynamically re-assign the weights of semantic features so that both semantic diversity and feature diversity are considered in the model. The generated multi-semantic feature interactions are concatenated with the original feature embeddings and input into a deep learning network. Experiments on three public datasets demonstrate the effectiveness of the proposed model. Compared with state-of-the-art methods, the model achieves excellent performance (+ 0.18% in AUC and - 0.34% in LogLoss VS DeepFM; + 0.19% in AUC and - 0.33% in LogLoss VS FiBiNet). [ABSTRACT FROM AUTHOR]

Arrhythmia disorders are the leading cause of death worldwide and are primarily recognized by the patient's irregular cardiac rhythms. Wearable Internet of Things (IoT) devices can reliably measure patients' heart rhythms by producing electrocardiogram (ECG) signals. Due to their non-invasive nature, ECG signals have been frequently employed to detect arrhythmias. The manual procedure, however, takes a long time and is prone to error. Utilizing deep learning models for early automatic identification of cardiac arrhythmias is a preferable approach that will improve diagnosis and therapy. Though ECG analysis using cloud-based methods can perform satisfactorily, they still suffer from security issues. It is essential to provide secure data transmission and storage for IoT medical data because of its significant development in the healthcare system. So, this paper proposes a secure arrhythmia classification system with the help of effective encryption and a deep learning (DL) system. The proposed method mainly involved two phases: ECG signal transmission and arrhythmia disease classification. In the ECG signal transmission phase, the patient's ECG data collected through the IoT sensors is encrypted using the optimal key-based elgamal elliptic curve cryptography (OKEGECC) mechanism, and the encrypted data is securely transmitted to the cloud. After that, in the arrhythmia disease classification phase, the system collects the data from the Massachusetts Institute of Technology-Beth Israel Hospital (MIT-BIH) database to perform training. The collected data is preprocessed by applying the continuous wavelet transform (CWT) to improve the quality of the ECG data. Next, the feature extraction is carried out by deformable attention-centered residual network 50 (DARNet-50), and finally, the classification is performed using butterfly-optimized Bi-directional long short-term memory (BOBLSTM). The experimental outcomes showed that the proposed system achieves 99.76% accuracy, which is better than the existing related schemes. [ABSTRACT FROM AUTHOR]

Cardiovascular disease is the leading cause of death and more than half million people were died around the world. However, cardiovascular health monitoring is crucial for effective heart disease diagnosis and management. In this paper, a novel deep learning-based YOLO-ECG model is proposed to ECG arrhythmia classification method for portable monitoring. Initially, the ECG signals are gathered using 12-lead electrodes in the real time and these signals are denoised using two-dimensional stationary wavelet transform (2D-SWT). In SWT, zeros are inserted between filter taps rather than decimal points to eliminate repetitions and increase robustness. The denoised ECG signals are fed into the deep learning-based YOLO network with Gaussian error linear unit (GELU) activation function for detecting the ECG abnormalities of arrythmia. ECG waveforms are analyzed for the local fractal dimension at each sample point before heartbeat waveforms are extracted within a set length window. A squeeze and excitation attention (SEAN) module is introduced in the YOLO network for selecting size of 1D convolution kernel, and the dimension is preserved during local cross-channel interactions, decrease network complexity and enhance model efficiency. The classification findings demonstrate that the proposed YOLO-ECG model performs better by ECG recordings from the MIT-BIH arrhythmia dataset. From the experimental analysis, the proposed YOLO-ECG model yields the overall accuracy of 99.16% for efficient classification of arrythmia ECG signals. [ABSTRACT FROM AUTHOR]

Internet of Things (IoT), a distributed healthcare system has integrated different medical resources with sensors and actuators. In this research paper proposes a secure healthcare monitoring system for IoT based distributed healthcare systems in the cloud using blockchain and deep learning (DL) mechanisms. The proposed system involved three phases: secure data transmission, data storage, and disease classification system. Initially, the patients are authenticated via blockchain mechanism and their data is encrypted via Effective Key-based Rivest Shamir Adelman (EKRSA), in which the keys are generated using Circle chaotic map and Linear inertia weight-based Honey Badger Optimization (CLHBO) algorithm. Next, in the data storage phase, these encrypted IoT data are securely stored in the cloud using blockchain technology in a distributed manner. Finally, in the disease classification, the data are gathered from the publicly available dataset, and these collected datasets are preprocessed to handle missing values and data normalization. After that, the proposed system applies a radial basis kernel-based linear discriminant analysis (RBKLDA) model to reduce the dimensionality of the dataset. At last, the disease classification is done by optimal parameter-centered bidirectional long short-term memory (OPCBLSTM). The proposed EKRSA system archives maximum throughput of 99.05% and reliability of 99.66, which is superior to the existing approaches. The OPCBLSTM is investigated for its disease classification process, the proposed one achieves 99.64% accuracy with less processing time of 6 ms, which is superior to the existing classifiers. The experimental analysis proves that the system attained better security and classification metrics results than the existing methods. [ABSTRACT FROM AUTHOR]

Microgrids (MGs) have become a reliable power source for supplying energy to rural areas in a secure, consistent, and low-carbon emission manner. Power quality disturbance (PQD) is a common issue that reduces the MGs networks' reliability and restricts its usage on a small scale. The performance, reliability and lifetime of the various power devices can be affected due to the problem of PQD in the network. Researchers have proposed numerous PQD monitoring techniques based on artificial intelligence. However, they are limited to low margins and accuracy. So, this paper suggests a novel hyperparameter-tuned or optimized deep learning model with an attention-based feature learning mechanism for PQD prediction. The critical stages of the proposed work, such as data collection, feature extraction, and PQD prediction, are as follows. The PQD signals are first produced using the IEEE 1159 standard. Following that, the original time-domain features are directly recovered from the dataset, and the frequency-domain features using discrete wavelet transform (DWT). The extracted features were fed into visual geometry group 16 with multi-head attention and optimal hyperparameter-based bidirectional long short-term memory (V16MHA-OHBM) to perform spatial and temporal feature extraction. These extracted features are concatenated and given to the fully connected layer to forecast the PQD. The results showed that the suggested approach surpasses the prior state-of-the-art algorithms when trained and tested using 16 different types of synthetic noise PQD data produced using mathematical models in line with IEEE 1159. [ABSTRACT FROM AUTHOR]

PCB defect detection aims to identify the presence of gaps, open circuits, short circuits, and other defects in the PCB boards produced in the industry. Designing effective deep learning algorithms is crucial to finding a solution. Previously proposed PCB defect detection algorithms are limited in detecting tiny objects in high-density. Directly applying previous models to tackle PCB defect detection tasks will cause serious issues, such as missed detection and false detection. In this paper, we present a detection algorithm for tiny PCB defect targets in high-density regions to solve the above-mentioned problems. We firstly propose a detection head to detect tiny objects. Then, we design a four-channel feature fusion mechanism to fuse four different scale features and add an attention mechanism to find the attention region in scenarios with dense objects. Finally, we achieved accurate detection of tiny targets in high-density areas. Experiments were performed on the publicly available PCB defect dataset from Peking University. Our mAP@.5:.95 achieves 48.6%, while mAP@0.5 exceeds 90%. Compared with YOLOX and YOLOv5, our improved model can better localize tiny objects in high-density scenes. The experimental results certify that our model can obtain higher performance in comparison with the baseline and the state of the art. [ABSTRACT FROM AUTHOR]

BACKGROUND: With the rapid growth of Deep Neural Networks (DNN) and Computer-Aided Diagnosis (CAD), more significant works have been analysed for cancer related diseases. Skin cancer is the most hazardous type of cancer that cannot be diagnosed in the early stages. OBJECTIVE: The diagnosis of skin cancer is becoming a challenge to dermatologists as an abnormal lesion looks like an ordinary nevus at the initial stages. Therefore, early identification of lesions (origin of skin cancer) is essential and helpful for treating skin cancer patients effectively. The enormous development of automated skin cancer diagnosis systems significantly supports dermatologists. METHODS: This paper performs a classification of skin cancer by utilising various deep-learning frameworks after resolving the class Imbalance problem in the ISIC-2019 dataset. A fine-tuned ResNet-50 model is used to evaluate the performance of original data, augmented data, and after by adding the focal loss. Focal loss is the best technique to solve overfitting problems by assigning weights to hard misclassified images. RESULTS: Finally, augmented data with focal loss is given a good classification performance with 98.85% accuracy, 95.52% precision, and 95.93% recall. Matthews Correlation coefficient (MCC) is the best metric to evaluate the quality of multi-class images. It has given outstanding performance by using augmented data and focal loss. [ABSTRACT FROM AUTHOR]

During the long-term operation of the photovoltaic (PV) system, occlusion will reduce the solar radiation energy received by the PV module, as well as the photoelectric conversion efficiency and economy. However, the occlusion detection of the PV power station has the defects of low efficiency, poor accuracy, and untimely detection, which will cause unknown system losses. Based on the deep learning algorithm, this paper conducts research on PV module occlusion detection. In order to accurately obtain the occlusion area and position information of the PV panel, a PV module occlusion detection model based on the Segment-You Only Look Once (Seg-YOLO) algorithm is established. Based on the YOLOv5 algorithm, the loss function is modified, the Segment Head detection module is introduced, and the convolutional block attention module (CBAM) attention mechanism is added to achieve the accurate detection of small targets by the algorithm model and the fast detection of the PV module occlusion area identify. The model performance research is carried out on three types of occlusion datasets: leaf, bird dropping, and shadow. According to the experimental results, the proposed model has better recognition accuracy and speed than SSD, Faster-Rcnn, YOLOv4, and U-Net. The precision rate, recall rate, and recognition speed can reach 90.52%, 92.41%, and 92.3 FPS, respectively. This model can lay a theoretical foundation for the intelligent operation and maintenance of PV systems. [ABSTRACT FROM AUTHOR]

In modern wireless telecommunication systems, antenna arrays are widely used as elements of multiple – input multiple – output technology. In the fifth-generation systems, arrays are utilized to realize beamforming that forms the radiation pattern of the base station in the direction of the mobile user. This requires the utilization of many-element antenna arrays that are precisely controlled to achieve the required radiation properties. In this paper we apply the concept of deep neural network to model antenna array radiation properties. In this proof-of-concept research we aim at investigating to what extent it is possible to use deep neural networks for modeling antenna arrays. We consider a full-wave model of linear array with a reflector, which was controlled by the phase and amplitude of the signals feeding the elementary radiators. The applied method made it possible to solve the direct and inverse problems. The results that we obtained show that deep neural networks are able to model antenna array properties. [ABSTRACT FROM AUTHOR]

This paper proposes a multi-objective optimization method for permanent magnet motors using a fast optimization algorithm, Covariance Matrix Adaptation Evolution Strategy (CMA-ES), and deep learning. Multi-objective optimization with topology optimization is effective in the design of permanent magnet motors. Although CMA-ES needs fewer population size than genetic algorithm for single objective problems, this is not evident for multi-objective problems. For this reason, the proposed method generates training data by solving the single-objective optimization multiple times using CMA-ES, and constructs a deep neural network (NN) based on the data to predict performance from motor images at high speed. The deep NN is then used for fast solution of multi-objective optimization problems. Numerical examples demonstrate the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

Compared with other facial expression recognition, classroom facial expression recognition should pay more attention to the feature extraction of a specific region to reflect the attention of students. However, most features are extracted with complete facial images by deep neural networks. In this paper, we proposed a new expression recognition based on attention mechanism, where more attention would be paid in the channel information which have much relationship with the expression classification instead of depending on all channel information. A new classroom expression classification has also been concluded with considering the concentration. Moreover, activation function is modified to reduce the number of parameters and computations, at the same time, dropout regularization is added after the pool layer to prevent overfitting of the model. The experiments show that the accuracy of our method named Ixception has an maximize improvement of 5.25% than other algorithms. It can well meet the requirements of the analysis of classroom concentration. [ABSTRACT FROM AUTHOR]