Search

The integration of deep learning, computer vision, and advanced algorithms has ushered in a transformative era in the prediction of human driving behavior, consequently revolutionizing road safety. This paper focuses on an innovative convergence of technology that addresses critical issues like driver fatigue and distracted driving by automatically identifying and categorizing diverse driving behaviors. Neural network architectures, such as VGG16, AlexNet, and ResNet are described in this paper that have propelled accuracy in behavior classification to remarkable levels. However, the quest for safer roads remains ongoing, with promising avenues lying ahead. First and foremost, the creation of extensive, diverse, and meticulously annotated datasets is paramount. These datasets serve as the bedrock upon which future models can be trained, enhancing their robustness and generalizability across a spectrum of driving scenarios. Real-time models represent another pivotal frontier. These models hold the potential to provide timely interventions and support systems for drivers, thus preventing accidents proactively. The exploration of hybrid techniques that amalgamate the strengths of various neural network architectures presents an exciting avenue, promising to further push the boundaries of prediction accuracy. Furthermore, this paper also discusses the fusion of multi-modal data, encompassing sensor data from IoT and smartphone devices, that holds immense promise. This holistic approach promises a more comprehensive understanding of driver behavior by integrating diverse data sources, ultimately contributing to the creation of safer road environments.In this research paper, we also explore these cutting-edge developments in deep learning and computer vision, emphasizing technical novelty and innovation. Through an interdisciplinary approach, we envision a future where the synergy of technology, data, and human behavior leads to a substantial reduction in road accidents and improved road safety. [ABSTRACT FROM AUTHOR]

Major Depressive Disorder (MDD) is characterized by low mood, loss of interest and even suicidal ideation. Electroencephalogram based diagnosis of a variety of neurological conditions has been conducted in recent years using modern neurocomputing and deep learning approaches. Privacy is a high concern for medical data over distributed training scenarios. Hence, this paper aims to develop an EEG-based privacy-preserved system to identify MDD through the Federated Learning (FL) approach. In this study, training for 3-channel EEG-based MDD screening is introduced over FL using deep learning (DL) algorithms such as Long Short-Term Memory (LSTM), Bidirectional LSTM (Bi-LSTM), Gated Recurrent Unit (GRU), and One Dimensional Convolutional Neural Network (1D-CNN). A privacy-preserving solution for MDD patients utilizing FL is advantageous because clinical data is sensitive and most people do not want to share their personal information. Hence, the analysis of the comparative results for multiple applicable strategies including Independent and Identically Disturbed (IID) data, non-IID data, and algorithms provide proof that FL can be used to train DL models. The MODMA dataset of 3-channel EEG with 26 MDD and 29 non-MDD individuals is used in this paper. Future study on MDD has several potential areas of use and these FL approaches can also be coupled with new technologies. [ABSTRACT FROM AUTHOR]

Recently, computer vision and artificial intelligence are being used as enabling technologies for plant phenotyping studies, since they allow the analysis of large amounts of data gathered by the sensors. Plant phenotyping studies can be devoted to the evaluation of complex plant traits either on the aerial part of the plant as well as on the underground part, to extract meaningful information about the growth, development, tolerance, or resistance of the plant itself. All plant traits should be evaluated automatically and quantitatively measured in a non-destructive way. This paper describes a novel approach for identifying plant roots from images of the root system architecture using a convolutional neural network (CNN) that operates on small image patches calculating the probability that the center point of the patch is a root pixel. The underlying idea is that the CNN model should embed as much information as possible about the variability of the patches that can show chaotic and heterogeneous backgrounds. Results on a real dataset demonstrate the feasibility of the proposed approach, as it overcomes the current state of the art. • Root systems must be monitored to assess the growth and well-being of a plant. • State-of-the-art approaches mainly use classic ML or U-networks for segmentation. • CNNs can be used for monitoring considering patch-based information. • These models are simpler and faster, and provide better segmentation performance. [ABSTRACT FROM AUTHOR]

In the past few years, the lane detection technique has become a key factor for autonomous driving systems and self-driving cars on the road. Among the various vehicle subsystems, the lane detection module is one of the essential parts of the Advanced Driver Assistance System (ADAS). Conventional lane detection approaches use machine vision algorithms to find straight lines in road scene images. However, it is challenging to identify straight or curved lane markings in complex environments. To deal with this problem, this paper presents a lane detection technique based on deep learning. It is combined with a 3D convolutional network, so the temporal information is added to the network architecture. Using the front camera images, the system can immediately detect the lane marking information ahead. Moreover, we propose an approach for improvement by adding the time axis to the network architecture. In addition to using 3D-ResNet50, the temporal convolution and spatial convolution are separated for processing. The accuracy is 91.34% improved after adding time and space split convolution with LeakyReLU. The experiments carried out using real scene images have demonstrated the feasibility of the proposed technique for applications to various complex scenes. [ABSTRACT FROM AUTHOR]

Timely and effective fault diagnosis is crucial to guarantee the reliability and durability of proton exchange membrane fuel cell (PEMFC). Segmented cell technology has been proven to be a powerful tool for exploring the internal characteristics of fuel cells, yet it is seldom applied for fault diagnosis. This paper proposes a data-driven fault diagnosis method that combines segmented cell and deep learning technology for PEMFC water management fault diagnosis. The dynamic characteristics of the current distribution of the fuel cell under different levels of faults are explored with segmented cell technology. A dual-input convolutional neural network is applied to combine current distribution data and sensor data for a more comprehensive system status for fault diagnosis. The results show that the model can efficiently identify flooding and drying faults with more than 98.5% accuracy, faster and more accurately than other algorithms. This work highlights the significance of segmented cell technology for the comprehension of water management inside PEMFC and provides a new concept for PEMFC fault diagnosis. [Display omitted] • The segmented cell technology is applied to investigate the current distribution during flooding and drying process. • A dual-input CNN is adopted to establish a fault diagnosis model for PEMFC water management. • The proposed method exhibits excellent diagnostic performance, with an accuracy rate of over 98.5%. [ABSTRACT FROM AUTHOR]

The large number of near-Earth asteroids (NEAs) has greatly impacted human space activities and Earth security. However, detecting NEAs in astronomical images with complex, varying backgrounds is still extremely challenging. In this paper, we propose a deep segmentation assisted asteroid tracking algorithm, termed DSAT, to construct a possible pipeline for faint NEA tracking in astronomical images. First, the single-frame object detection problem is converted to a segmentation problem, enabling robust extraction of faint potential moving objects. Then, a multiframe motion prior-based moving object tracking algorithm is proposed to find real NEAs. We further propose a distance tolerance criterion to help DSAT achieve effective tracking in practical situations when detection has partially failed. Finally, the pipeline is tested with both simulated and real astronomical images at different SNRs and in crowded fields. The results showed that our pipeline has the potential to detect and track faint NEAs in complex backgrounds. Our code is publicly available at https://github.com/zhenhongdu/DeepSegAsteroidTracker. [ABSTRACT FROM AUTHOR]

Spatiotemporal fusion can provide remote sensing images with both high temporal and high spatial resolution for earth observation applications. Most of the state-of-the-art models require three or even five images as input, which may lead to difficulties in practical applications due to bad weather or data missing. In this paper, the enhanced cross-paired wavelet based spatiotemporal fusion networks (ECPW-STFN) are proposed to improve the accuracy and quality of the fusions with fewer remote sensing images as inputs. Wavelet transform is introduced into spatiotemporal image fusion to achieve separate training of the high and low frequency components of the image to better extract features of different levels. In addition, a compound loss function containing wavelet loss is proposed to facilitate the preservation of details. Also, an enhancement module with convolutional block attention is put forward to further refine the prediction quality. Experiments were conducted to compare the proposed ECPW-STFN with five state-of-the-art methods on the public CIA and Daxing datasets. The results show ECPW-STFN is better than GAN-STFM which also requires two images, and not inferior to the methods requiring at least three inputs, even exceeds the optimal MLFF-GAN in some cases, proving its great superiority and potential. The code will be available at https://github.com/lixinghua5540/ECPW-STFN. [ABSTRACT FROM AUTHOR]

In the field of mobile health, portable dynamic electrocardiogram (ECG) monitoring devices often have a limited number of lead electrodes due to considerations, such as portability and battery life. This situation leads to a contradiction between the demand for standard 12‑lead ECG information and the limited number of leads collected by portable devices. This study introduces a composite ECG vector reconstruction network architecture based on convolutional neural network (CNN) combined with recurrent neural network by using leads I, II, and V2. This network is designed to reconstruct three‑lead ECG signals into 12‑lead ECG signals. A 1D CNN abstracts and extracts features from the spatial domain of the ECG signals, and a bidirectional long short-term memory network analyzes the temporal trends in the signals. Then, the ECG signals are inputted into the model in a multilead, single-channel manner. Under inter-patient conditions, the mean reconstructed Root mean squared error (RMSE) for precordial leads V1, V3, V4, V5, and V6 were 28.7, 17.3, 24.2, 36.5, and 25.5 μV, respectively. The mean overall RMSE and reconstructed Correlation coefficient (CC) were 26.44 μV and 0.9562, respectively. This paper presents a solution and innovative approach for recovering 12‑lead ECG information when only three‑lead information is available. After supplementing with comprehensive leads, we can analyze the cardiac health status more comprehensively across 12 dimensions. [ABSTRACT FROM AUTHOR]

Human age and gender prediction from facial images has garnered significant attention due to its importance in various applications. Traditional models struggle with large-scale variations in unfiltered images. Convolutional Neural Networks (CNNs) have emerged as effective tools for facial analysis due to their robust performance. This paper presents a novel CNN approach for robust age and gender classification using unconstrained real-world images. The CNN architecture includes convolution, pooling, and fully connected layers for feature extraction, dimension reduction, and mapping to output classes. Adience and UTKFace datasets were utilized, with the best training and testing accuracies achieved using an 80% training and 20% testing data split. Robust image pre-processing and data augmentation techniques were applied to handle dataset variations. The proposed approach outperformed existing methods, achieving age prediction accuracies of 86.42% and 81.96%, and gender prediction accuracies of 97.65% and 96.32% on the Adience and UTKFace datasets, respectively. [ABSTRACT FROM AUTHOR]

Nowadays, for controlling crime, surveillance cameras are typically installed in all public places to ensure urban safety and security. However, automating Human Activity Recognition (HAR) using computer vision techniques faces several challenges such as lowlighting, complex spatiotemporal features, clutter backgrounds, and inefficient utilization of surveillance system resources. Existing attempts in HAR designed straightforward networks by analyzing either spatial or motion patterns resulting in limited performance while the dual streams methods are entirely based on Convolutional Neural Networks (CNN) that are inadequate to learning the long-range temporal information for HAR. To overcome the above-mentioned challenges, this paper proposes an optimized dual stream framework for HAR which mainly consists of three steps. First, a shots segmentation module is introduced in the proposed framework to efficiently utilize the surveillance system resources by enhancing the lowlight video stream and then it detects salient video frames that consist of human. This module is trained on our own challenging Lowlight Human Surveillance Dataset (LHSD) which consists of both normal and different levels of lowlighting data to recognize humans in complex uncertain environments. Next, to learn HAR from both contextual and motion information, a dual stream approach is used in the feature extraction. In the first stream, it freezes the learned weights of the backbone Vision Transformer (ViT) B-16 model to select the discriminative contextual information. In the second stream, ViT features are then fused with the intermediate encoder layers of FlowNet2 model for optical flow to extract a robust motion feature vector. Finally, a two stream Parallel Bidirectional Long Short-Term Memory (PBiLSTM) is proposed for sequence learning to capture the global semantics of activities, followed by Dual Stream Multi-Head Attention (DSMHA) with a late fusion strategy to optimize the huge features vector for accurate HAR. To assess the strength of the proposed framework, extensive empirical results are conducted on real-world surveillance scenarios and various benchmark HAR datasets that achieve 78.6285%, 96.0151%, and 98.875% accuracies on HMDB51, UCF101, and YouTube Action, respectively. Our results show that the proposed strategy outperforms State-of-the-Art (SOTA) methods. The proposed framework gives superior performance in HAR, providing accurate and reliable recognition of human activities in surveillance systems. [ABSTRACT FROM AUTHOR]

Traffic congestion has become a critical issue in metropolitan areas, inflicting significant hardships on individuals on a daily basis. This adverse situation poses multifaceted challenges, including increased air pollution, heightened fuel consumption, and compromised road safety. Deep learning algorithms, encompassing both Convolutional Neural Networks (CNN), and Recurrent Neural Networks (RNN) have showcased remarkable performance in areas such as computer vision, natural language processing, healthcare, finance, and autonomous systems. This research paper proposes a novel methodology to develop a vehicle detection model - VehiNet, which can subsequently be refined to create an automated traffic signal system. The study explores the effectiveness of various CNN, RNN, and deep learning algorithms and techniques in accomplishing this objective. The dataset picked for the study in addition to being compiled from internet resources, was also painstakingly assembled manually using a variety of methods to collect over 2000 photographs from various angles, lighting conditions, and locations within Bengaluru city. The main motive is to apply CNN, RNN, and other Deep Learning classification techniques for object detection and classification of Indian vehicles and see how well these deep learning algorithms and techniques affect prediction efficiency. This research stands out from others and makes its novelty clear thanks to the carefully collected dataset and the detailed analysis of the methodologies. [ABSTRACT FROM AUTHOR]

The proliferation of fake images in today's digital landscape poses a significant threat to various domains, including media integrity, social media, and online security. Recognizing the urgent need to distinguish real images from their deceptive counterparts, this paper underscores the importance of developing a robust detection system. While substantial efforts have been made in the realms of computer vision and deep learning, the advent of Generative Adversarial Networks (GANs) has added a new layer of complexity to this challenge. In response to these evolving threats, we present a novel two-step methodology for detecting fake images, with a specific focus on those generated by GANs. Our approach harnesses the combined strengths of GANs and traditional Convolutional Neural Networks (CNNs), offering a comprehensive solution that significantly enhances accuracy in identifying both fake images and machine-generated fake images. The results of our experiments demonstrate the efficacy of our methodology. Using CNNs alone, we achieved a training accuracy of 87%. However, when employing the collaborative power of GANs and CNNs, our model exhibited a remarkable accuracy rate of 94.4%. This substantial improvement underscores the superiority of the GANs+CNN approach, suggesting its potential as a groundbreaking solution in the realm of fake image detection. This research opens up new horizons in fields such as media forensics, social media monitoring, and online security, where the ability to discern genuine content from manipulated or synthetic media is of paramount importance. The promising outcomes of this study not only provide an immediate and effective solution but also pave the way for further exploration and innovation in this critical area of digital security. [ABSTRACT FROM AUTHOR]

The image-based automatic plant disease identification has emerged as a prominent research area, driven by recent advancements in machine learning algorithms. Conventional disease detection methods rely on manual feature extraction from acquired images, involving extensive expertise from experts and pathologists. This labor-intensive practice is often time-consuming and impractical. With the recent advancements in digital technologies and computer vision, Deep neural networks address these challenges by learning the features automatically. This paper focuses on the EfficientNet B0 architecture-based deep neural network model integrated with a convolutional block attention mechanism module for identifying major wheat crop diseases. The attention module in the EfficientNet B0 model improves its performance by emphasizing the disease-infected regions in leaf images. To evaluate the proposed methodology, experiments were conducted on the WheatRust21 image dataset, comprising 6556 images of three major fungal diseases, namely, stripe rust, leaf rust, and stem rust, collected in natural field conditions from 2019 to 2021. Our developed EfficientNet B0-CBAM model performed well with a testing accuracy of 98.70% and an impressive F1 score of 98% on the dataset. The Grad-CAM visualization demonstrates that the attention module focuses more on the infected region and plays a crucial role in wheat disease identification. The results are quantitatively substantial, with the model achieving high accuracy and other evaluation metrics scores with an average of 98.5 %. These findings hold promise for practical applications in agriculture and sustainable crop management. [ABSTRACT FROM AUTHOR]

Depth estimation is crucial for scene understanding and downstream tasks, especially the self-supervised training methods showing great potential. The overall structure and local details of the scene are essential for improving the quality of depth estimation. The proposal of Monodepth2 has led to significant progress in self-supervised monocular depth estimation. However, Monodepth2 uses the most basic encoder–decoder architecture. The limited data flow information of the network leads to a large semantic gap between the encoder and the decoder, which reduces the accuracy of the network for fine-grained feature recognition. Monodepth2 adopts Resnet18 pre-trained on the Imagenet dataset as the encoder. This traditional convolutional pooling structure results in a loss of pixel information in the network at every scale. In order to solve this problem, this paper proposes an improved DepthNet. The network adopts Hrnet in semantic segmentation as the base encoder, which adopts an advanced multi-scale fusion method in the whole process, thus avoiding the loss of pixel information. An additional densely connected U-Net is employed at the decoder side to provide more information flow. Furthermore, the semantic gap between the encoder and decoder is reduced by adding different numbers of residual connections and channel attention on each layer. The network structure can be regarded as a collection of fully convolutional networks. Since the deep features of the network have a higher correlation with the vertical position, we add a spatial location attention module to the deep-level network to reduce this semantic gap. The approach performs significantly well on the KITTI dataset benchmark, with several performance criteria comparable to supervised monocular depth inference methods. • This work is a deep estimation network for scene reconstruction and scene understanding. This network redesigns the self-supervised monocular depth framework from an entirely new perspective. The network uses HrNet from the field of semantic segmentation as the base encoder, which employs a progressive multi-scale fusion approach throughout, thus avoiding the loss of pixel information. • An additional densely connected U-Net is used at the decoder side to provide further information flow. To reduce the semantic gap between codecs, we add a different number of residual connections and channel attention on each layer. The network is not trained with the help of other auxiliary networks, and the performance of the depth estimation is improved only by stimulating the network's potential. • This work achieves best-in-class accuracy in monocular depth estimation. When the model in this paper is used for 3D scene reconstruction, it can perform a complete recovery of the scene structure. [ABSTRACT FROM AUTHOR]

Short-term performance degradation prediction is significant for fuel cell system control and health management. This paper presents a hybrid deep learning method by combining the convolutional neural network (CNN) and long short-term memory (LSTM) network to predict the short-term degradation of a 110 kW fuel cell system used for the commercial vehicle. First, the complete ensemble empirical mode decomposition (CEEMD) is applied to decompose the nonlinear and non-stationary voltage sequence extracted by the sliding window into modality sequences with different characteristic time scales. Then, these modality sequences are input into the corresponding CNN-LSTM for voltage prediction. Experimental results show that the proposed CNN-LSTM can reduce the root mean square error (RMSE) by 13.55% and 34.40%, respectively, compared to the single CNN and LSTM because it combines the spatial feature extraction ability of CNN and the powerful prediction ability of LSTM. Furthermore, the CEEMD–CNN–LSTM can reduce RMSE by 36.92% compared to CNN-LSTM since the impact of exogenous factors on the recoverable decay and intrinsic decay of the fuel cell can be separated easily for better model learning. The CEEMD–CNN–LSTM is also compared with other recently published deep learning models based on the same data set, and the results show that the prediction framework in this paper has higher accuracy. • Aging data of a 110 kW fuel cell system is used for model training and validation. • Complete ensemble empirical mode decomposition is applied to decompose voltage time. • Convolutional neural network and long short-term memory network are combined. • The prediction result under the delay condition of 5 h–6 h is still referential. [ABSTRACT FROM AUTHOR]

Video Super-Resolution (VSR) is gaining massive attention in the digital age across various application domains such as video surveillance and ultra-high-definition displays. Deep learning (DL) has recently made significant progress in research and industry domains. Existing researchers used numerous VSR methods based on deep learning to improve the resolution. VSR is based on inter-frame information utilization. Video frames provide the leverage information of data that modalities record sequentially, i.e.; the object's temporal changes cause inconsistent measurements. Consequently, suitable models and algorithms must be developed to provide artifact-free images. This paper goes through two reconstruction methods incorporating various motion data sources. Initially, it describes an iterative approach that implicitly treats dynamic behavior as uncertainty in the forward model. Further direct reconstruction techniques can be derived for an explicit motion map. This paper compares both explicit and implicit motion compensation-based methods. Convolutional neural networks (CNN) and recurrent, residual network (RRN) based methods from a deep learning environment are analyzed to reconstruct the High-Resolution (HR) frames. This paper shows numerical findings for both methods using simulated data. Observations show that RRN can boost the super-resolution (SR) performance and achieve considerable visual quality after reconstruction; however, performance is limited to small datasets due to shallow network parameters. Extensive experiments show that RRN significantly impacts SR results due to its substantial computational efficiency. [ABSTRACT FROM AUTHOR]

In this paper, a three-step model based on the integration of Deep Neural Networks (DNN) and Decision Models is introduced for image classification which is inspired by the human visual system. To make a decision about an object, many actions should be done in a hierarchical process in the brain. First, the retina receives visual stimuli and transfers them to the visual cortex in the brain. The information extracted in the visual cortex, is accumulated over time to select an appropriate response. Many of the current decision-making models do not show how each image is converted into useful information for the decision model. Some models have used neural networks to convert each image into the information needed in the decision-making model; however, the role of the retina is ignored among these models. In this paper, a combination of retina inspired filters, CNN-based description and accumulator-based decision model is used to classify images. This model's structure resembles the human brain due to the usage of the DoG filter bank as retina inspired filter in the first stage of it. This model shows a significant improvement in accuracy in comparison to other models; furthermore, its performance is acceptable even with the small sample training set. [ABSTRACT FROM AUTHOR]

The complex flow of a supersonic jet (Mach number 2.4–2.5) around the blunt aerodynamic body (consisting of a cylinder with a diameter of 16 mm and a truncated cone) was studied using the high-speed shadowgraph technique and computer vision-based visual data processing. The problem considered is directly related to the rocket and space systems stages safe separation problem in a sufficiently dense atmosphere. For systems with a sequential arrangement of stages, their separation often occurs under the rocket engine jet action. The occurrence of lateral forces in violation of axial symmetry can lead to overturning of the discarded stage and undesirable interaction with the outgoing stage. The goals of the paper were to study the pulsation characteristics of the incoming supersonic jet streamlining the body, as well as the pulsations of the bow shock wave in both axisymmetric and asymmetric flows. The recording frame rate in the experiments was up to 775 000 fps. Computer vision and various machine learning approaches were used to process a large number of shadowgraph images. Canny edge detection and Hough transform, as well as a convolutional neural network (CNN) based on YOLOv2 architecture, were used to automatically track the position of the bow shock relative to the body. Jet sound generation was studied - the amplitude dependence on the distance from the nozzle and the evolution in time. The position of the bow shock relative to the streamlined body and flow pulsations over time were analyzed. Bow shock pulsation spectra at zero angle of attack were compared to those at a small angle of attack (α = 2.5°–3°). The power spectral density was also estimated. The slope of the spectra for the zero angle of attack case was found to be horizontal and the spectra for the small angle of attack case had a slope close to −5/3. The strongest of the measured bow shock frequencies were found to be close to those of the jet mixing layer pulsations. The hardware signal spectrum was also measured and this signal can be considered as noise. The described approach makes it possible to obtain the physical characteristics of the flow at any point of interest. It was also shown that the automation of flow visualization experiments using computer vision techniques allows to increase the speed of data processing and obtaining new physical information, which may be important for engineers developing aircraft and spacecraft technologies. • Supersonic jet flow around a blunt body was studied experimentally and also numerically. • Computer vision tools were applied to supersonic flow investigation. • Spectra of jet generated acoustic waves were determined. • Time dependent bow shock positions were automatically measured by the neural network. • Amplitudes of bow shock pulsations and flow fluctuations depend on the angle of the body relative to the jet direction. [ABSTRACT FROM AUTHOR]

In recent years, the advancement of deep learning technologies has significantly impacted various domains and the field of transportation is no exception. As the demand for robust and accurate traffic sign classification systems continues to rise, this study presents an in-depth exploration and comparison of various techniques employed in the field. Focusing on state-of-the-art methodologies, we assess the effectiveness and performance of multiple classification approaches for traffic sign recognition. The review presents an extensive survey of the literature, encompassing traditional computer vision methods, machine learning algorithms, and the latest advancements in deep learning. The comparative analysis aims to identify the strengths and limitations of each technique, considering factors such as computational efficiency and accuracy. Additionally, the paper implements four models—CNN, ResNet50, VGG19, and EfficientNetB7—for traffic sign classification on the GTSRB dataset, the accuracy results are reported as 99.25%, 99.28%, 98.95%, and 98.24% respectively. [ABSTRACT FROM AUTHOR]

This paper identifies the model for classifying the bird sounds using the Convolutional Neural Network (CNN) algorithm. CNN are considered as one of the powerful toolkits developed in the machine learning and that have shown to be more efficient particularly in the field of image processing and sound recognition. The two-step verification process which will participating in the creation of datasets and neural network input. This system uses the collection of labelled and categorized recordings. Spectrograms are generated from the downloaded data which is used as the input for the neural network. The experiments are conducted and it will match with the different configurations, which including the number of bird species and Spectrograms. As a result, we can identify the bird species from its audio recordings. By identifying the bird species on a large scale, it provides a vital information about our ecosystems and biodiversity. The changes in the ecological environment can be reflected by the quantity and composition of bird species. It is one of the major challenges which leads to recognition of many bird species based on their audio. In modern years, the deep learning techniques namely convolutional neural networks (CNN) have played a major role in many areas of science and also successfully provided efficient methodologies, such as pattern recognition, object detection in images, and classification of patterns in audios and speech recognition. [ABSTRACT FROM AUTHOR]

Pulmonary Embolism (PE) is a blood clot in the pulmonary arteries of the lungs. Currently, Computerized Tomography Pulmonary Angiography (CTPA) scans are used to diagnose this condition. However, to manually locate the presence of a PE in the scan is laborious. In this paper, the detection of PE and prediction of its features like location, Right Ventricle to Left Ventricle (RV/LV) ratio, and chronicity are automated. First, for the detection of the embolisms, image features from the RSNA Pulmonary Embolism CT (RSPECT) dataset - containing over 12,000 CTPA studies, are extracted by several pre-trained Convolutional Neural Networks (CNN) - AlexNet, Inception V3, ResNet-18, and ResNet-50. Then, various Machine Learning (ML) classifiers are trained on these features and their performances are compared. Second, for the prediction of labels, multi-label classification is performed by training these networks with Binary Cross Entropy Logits (BCE Logits) loss. The results showed that for the detection task, k-NN classifier trained on ResNet-50 features achieved the highest sensitivity of 0.98 with 1.7 false positives per scan and an AUROC score of 97.4%. This system also improved on the state-of-the-art sensitivity score by 0.0975 and AUROC score by 3.4%. For multi-label classification, ResNet-18 performed comparatively better with the best validation loss of 0.07 and weighted macro-average ROC AUC score of 0.61. [ABSTRACT FROM AUTHOR]

• The deep learning model can better extract the deeper features of the multi-point deformation sequence. • MVMD algorithm reduces the complexity of multi-point displacement sequence. • The model considers the spatiotemporal characteristics of dam deformation, the prediction accuracy is obviously improved. It is difficult for single measuring point model to synchronously characterize the spatial correlation of deformation sequence of concrete dam and the similarity of displacements of different measuring points. Considering the limitation of conventional model in dealing with spatial-temporal data structure, In this study, a deep learning technique for multi-point and multi-output deformation prediction of concrete dams is proposed, which is based on Multivariate Variational Mode Decomposition (MVMD) and three-dimensional convolutional neural network (3D-CNN) combined model. Firstly, the multi-point sequence is decomposed into several relatively stable sub-sequences with different frequency scales by MVMD, which reduces the complexity of the multi-point displacement sequence. Then, In order to enhance the model 's ability to fit the time and spatial features of the sequence, the 3D-CNN model is used to predict the decomposed components and reconstruct the displacement data of the measuring points. This study focuses on the principle, process and calculation steps of the proposed model, and verifies the proposed model through the deformation data of three typical measuring points. The test results show that the prediction model proposed in this paper is an effective method for dam deformation prediction. [ABSTRACT FROM AUTHOR]

Recently, deep learning (DL) has become increasingly important in the field of image processing, and its application in dental radiology has become particularly relevant. DL-based image recognition has become a key component of image interpretation in dental radiology, making it possible to automate diagnosis and treatment planning. These techniques can be applied to areas such as caries, tooth detection, periodontal disease, oral lesions, age determination, gender estimation, and osteoporosis. In addition, recent studies have shown that DL algorithms in these areas have high accuracy, with some studies achieving accuracy rates of over 90%. Such high accuracy can significantly improve the efficiency and accuracy of dental diagnostics and treatment planning. Thus, using DL in dental imaging may become an everyday tool in dentistry with the current advances in applications. In this paper, recent applications and potential challenges of using deep convolutional neural network architectures in dental image analysis will be reviewed. [ABSTRACT FROM AUTHOR]

The attribute network not only has a complex topology, but its nodes also contain rich attribute information. Attribute network embedding methods extract both network topology and node attribute information to learn low-dimensional embedding of large attribute networks, which are of great importance for network analysis. In this paper, we propose attribute network joint embedding based on global attention (GAJE). First, GAJE uses the structure information of the attribute network to obtain the structure embedding vectors of nodes. Second, we propose a global attention method to obtain the attribute embedding vectors of nodes. This method captures the relationships of different attributes within and between nodes through convolutional neural networks and attention mechanisms, respectively. Finally, GAJE concatenates the structure embedding vectors and the attribute embedding vectors to obtain the final joint embedding vectors which simultaneously reflects the network structure and attributes information. For link prediction and node classification, we compared GAJE with nine well-known network embedding methods in four real datasets. The experimental results show that the algorithm has good attribute network embedding effects. Our tensorflow implementation of the GAJE is available at https://github.com/Andrewsama/GAJE-master. • The network structure and the node attribute are extracted simultaneously. • The global attention mechanism gets the correlation information between the nodes. • Joint training captures the interactions between attribute and structure embeddings. [ABSTRACT FROM AUTHOR]

Accurate prediction of remaining useful life (RUL) can ensure the safety and reliability of power batteries during operation, reduce the failure rate and operating costs, and enhance user experience. However, battery degradation is a complex, nonlinear dynamic process that is difficult to fully comprehend and predicting RUL remains a significant challenge. To address this issue, the hybrid data-driven prediction model PCA-CNN-BiLSTM was proposed in this paper, which combines principal component analysis (PCA), convolutional neural network (CNN), and bi-directional long short-term memory (Bi-LSTM) network. PCA was applied to downscale and whiten the health factor (HF) to maximize the extraction of important features of lifespan decay, while reducing the correlation between features. The convolution kernel of the CNN was used to explore the local region feature information of the input information and search for the common patterns among the neighboring data. Additionally, the model parameters and computational efforts were reduced through pooling. Finally, battery RUL prediction was achieved using Bi-LSTM, which has the advantages of effectively enhancing model accuracy and reducing the risk of over-fitting by taking into account both past and future data. The performance of the proposed model was evaluated utilizing NASA and CALCE's battery datasets, and the results suggest that it exhibits a high level of accuracy across various datasets. Compared to other methods, the PCA-CNN-BiLSTM method has the best performance indicators for predicting battery RUL, including RMSE, MAE, MAPE, RUL e and DOL. This indicates that the proposed model has better fitting performance, accuracy, robustness, and generalization ability. [Display omitted] • Propose a novel battery RUL prediction method based on hybrid data-driven model. • Nineteen health factors were extracted, including segmented discharge time and temperature. • The effectiveness of the PCA-CNN-BiLSTM was verified on multiple public datasets. [ABSTRACT FROM AUTHOR]

Recently, hyperspectral image (HSI) classification methods based on deep-learning have attracted widespread attention. Convolutional neural networks, as a crucial deep-learning technique, have exhibited outstanding performance in HSI classification. However, there are still some challenges, such as limited labeled samples, and feature extraction of complex land cover objects. To address these challenges, in this paper, we propose a multiscale cross-fusion network for HSI classification. It consists of three components: a spectral signatures extraction network, a spatial features extraction network and a classification network, which are utilized to extract spectral signatures, extract spatial contextual information and generate classification results, respectively. Specifically, the cross-branch multiscale convolutional block and the channel global contextual attention are integrated to extract spectral signatures, and the cross-hierarchy multiscale convolutional blocks and the spatial global contextual attention are combined to extract spatial features. Furthermore, special fusion strategies are proposed in these blocks to promote the interaction between features and achieve better feature connectivity. A series of experiments are conducted on three public HCI datasets, and the results show that the overall accuracy of the proposed network is 0.57%, 0.61%, and 0.3% higher than that of the state-of-the-art method on the PU, SV, and HH datasets, respectively. [ABSTRACT FROM AUTHOR]

Explosion is a significant threat to chemical process safety, which often occurs suddenly with a wide range of impact, resulting in catastrophic disasters. Predictions of explosion hazards are required for regional safety assessment and disaster resilience enhancement of chemical industrial parks (CIPs). This paper, therefore, aims to develop a conceptual framework for systematically analyzing explosion evolutions and quantifying the potential hazards by combining system-theoretic process analysis (STPA) method with numerical simulation. The proposed framework consists of 5 steps: (i) establishment of hierarchical safe control structures (SCSs) of important chemical processing zones in the CIP, (ii) computational fluid dynamics (CFD) modeling for potential explosion evolutions in each zone by changing the examined parameters randomly, (iii) development of a convolutional neural network (CNN) prediction model through constant self-learning of CFD pressure field data, (iv) comprehensive assessment of blast damage by incorporating the outputs of the above numerical models into existing evaluation methods, (v) identification of unsafety control actions and causes, and safety constraints for the improvement of SCSs. Provided with monitoring data, the developed analysis architecture can predict explosion process hazards and recommend appropriate safety strategies in real time. This would service the multi-level requirements for explosion prevention and protection, supporting better-informed decision-making. The paper describes the concepts and implementation process of the method as a first step. [ABSTRACT FROM AUTHOR]

• Multi-domain characterization of one-dimensional heart sound signals can improve the feature characterization and model feature extraction performance. • A heart sound secondary diagnosis model based on multi-domain and multi-layered cooperative fusion is designed. • The proposed parallel sand cat swarm optimization algorithm is used to select 12 key hyperparameters of the data-driven diagnosis model automatically. • The accuracy of the self-optimization diagnostic model constructed in this paper is over 99.5% and the number of parameters is relatively low. This paper proposes a heart sound diagnosis method based on multi-domain self-learning convolutional computation. It aims to address the limitations of the existing heart sound time-domain samples' own feature expression, the inadequacy of model feature mining and the subjectivity of manual parameter tuning. A multi-domain mapping processing method is used to further expand the self-feature expression ability of heart sound samples. A heart sound feature mining model that fits the multi-domain samples is designed to further mine disease features from different receptive fields and multi-resolutions in each spatial domain. Collaborative computation is employed to enhance the richness of feature mining. Finally, a model optimization strategy based on the parallel sand cat swarm optimization algorithm is constructed to optimize the 12 key hyperparameters of the model, so that the model can more adequately extract the sample discriminative features ultimately realizing the efficient diagnosis of heart sounds. The self-optimization diagnostic model constructed in this paper achieved a diagnostic accuracy of over 99 % in the experiments conducted on two public data sets, Yaseen (2018) and the Heart Sound Classification Challenge B. These results show an improvement of at least 1.27 % and 2.61 % compared to other research methods mentioned in the literature. The proposed method in this paper is feasible and effective, providing theoretical and technical references for the field of heart sound diagnosis and automatic machine learning. It holds certain scientific research value. [ABSTRACT FROM AUTHOR]

In recent years, decomposition-based combination models have been widely used in wind power prediction. This type of method decomposes the highly volatile wind power into some relatively smooth subsequences, which reduces the difficulty of modeling. However, this might use information from future data in advance, creating the illusion of high prediction accuracy. Therefore, this paper proposes a wind power ultra-short-term prediction model based on fixed scale dual mode decomposition (FSDMD) and deep learning networks. First, the wind power series after fixed scale blocking is decomposed using ensemble empirical mode decomposition (EEMD), and use the improved variational mode decomposition (VMD) based on Spearman rank order correlation coefficient (SROCC) to decompose the obtained high-frequency components twice. Then, the appropriate mode components were selected by calculating the SROCC and experimental analysis, and combined with the convolutional neural network (CNN) and the bidirectional long short-term memory (BiLSTM) network to train the model. Finally, the historical data of wind turbines in a wind farm in Northwest China is used for example verification, and the comparison with other models in the two scenarios of sufficient and insufficient features. The results show that the proposed FSDMD–CNN–BiLSTM model has high prediction accuracy in both scenarios. Especially in the scenario of insufficient features, compared with CNN-BiLSTM model, RMSE, MAE and MAPE are reduced by 8.20,14.24 and 0.15, respectively. In addition, this paper verifies that mode decomposition can improve the performance of prediction model without using future features, which provides ideas for solving similar problems. [ABSTRACT FROM AUTHOR]

Accurate detection of pavement markings at the pixel level is crucial for enhancing traffic safety. The majority of current advanced deep-learning networks predominantly focus on localized features, neglecting the global context of pavement image. Such networks often result in discontinuous segmentation outcomes and suboptimal recovery of local details. In this paper, a robust model named C-Transformer is proposed to provide an effective solution to this challenge. The contributions of this paper primarily involve two aspects. Firstly, the proposed C-Transformer is designed to succinctly integrate convolution operations and self-attention, facilitating a comprehensive understanding of essential features. Secondly, an efficient Feed-Forward Network called Inverse Residual Feed-Forward Network is also proposed in this paper and deployed in C-Transformer to improve latent representations. Experimental results demonstrate that, compared to other state-of-the-art networks, the proposed C-Transformer achieves a performance enhancement of 0.93% in F-measure and a 1.64% improvement in Intersection-Over-Union. In particular, the robustness and effectiveness of the C-Transformer in accurate pavement marking detection are proved through field test results. This paper illustrates the feasibility of employing a hybrid Convolutional neural network-Transformer-based network for automatic robust pavement marking detection under noisy conditions. [ABSTRACT FROM AUTHOR]

The paper investigates the application of machine learning (ML) for voltage sag source localization (VSSL) in electrical power systems. To overcome feature-selection challenges for traditional ML methods and provide more meaningful sequential features for deep learning methods, the paper proposes three time-sample-based feature forms, and evaluates an existing feature form. The effectiveness of these feature forms is assessed using k-means clustering with k = 2 referred to as downstream and upstream classes, according to the direction of voltage sag origins. Through extensive voltage sag simulations, including noises in a regional electrical power network, k-means identifies a sequence involving the multiplication of positive-sequence current magnitude with the sine of its angle as the most prominent feature form. The study develops further traditional ML methods such as decision trees (DT), support vector machine (SVM), random forest (RF), k-nearest neighbor (KNN), an ensemble learning (EL), and a designed one-dimensional convolutional neural network (1D-CNN). The results found that the combination of 1D-CNN or SVM with the most prominent feature achieved the highest accuracies of 99.37% and 99.13%, respectively, with acceptable/fast prediction times, enhancing VSSL. The exceptional performance of the CNN was also approved by field measurements in a real power network. However, selecting the best ML methods for deployment requires a trade-off between accuracy and real-time implementation requirements. The research findings benefit network operators, large factory owners, and renewable energy park producers. They enable preventive maintenance, reduce equipment downtime/damage in industry and electrical power systems, mitigate financial losses, and facilitate the assignment of power-quality penalties to responsible parties. • Comprehensive study on enhanced voltage sag source localization assisted by ML. • Proposing three new time sample-based feature forms, effective for ML methods. • Identifying the most influential feature form (form 4) utilizing k-means clustering. • Developing diverse supervised models, including a designed one-dimensional CNN. • CNN-Feature form 4 achieved 99.37% accuracy with an acceptable prediction speed. [ABSTRACT FROM AUTHOR]

• A thorough analysis of the speech data corpora used in various studies, highlighting their size, diversity, and relevance to real-world applications. • An examination of the different speech features employed for emotion classification, including prosody, spectral, and linguistic features, and their impact on classification accuracy. • A comprehensive study table of the dataset features and classifiers commonly used in different research papers on speech emotion classification has been shown to emphasize their strengths and limitations. Emotion recognition from speech has become crucial in human-computer interaction and affective computing applications. This review paper examines the complex relationship between two critical factors: the selection of speech data corpora and the extraction of speech features regarding speech emotion classification accuracy. Through an extensive analysis of literature from 2014 to 2023, publicly available speech datasets are explored and categorized based on their diversity, scale, linguistic attributes, and emotional classifications. The importance of various speech features, from basic spectral features to sophisticated prosodic cues, and their influence on emotion recognition accuracy is analyzed.. In the context of speech data corpora, this review paper unveils trends and insights from comparative studies exploring the repercussions of dataset choice on recognition efficacy. Various datasets such as IEMOCAP, EMODB, and MSP-IMPROV are scrutinized in terms of their influence on classifying the accuracy of the speech emotion recognition (SER) system. At the same time, potential challenges associated with dataset limitations are also examined. Notable features like Mel-frequency cepstral coefficients, pitch, intensity, and prosodic patterns are evaluated for their contributions to emotion recognition. Advanced feature extraction methods, too, are explored for their potential to capture intricate emotional dynamics. Moreover, this review paper offers insights into the methodological aspects of emotion recognition, shedding light on the diverse machine learning and deep learning approaches employed. Through a holistic synthesis of research findings, this review paper observes connections between the choice of speech data corpus, selection of speech features, and resulting emotion recognition accuracy. As the field continues to evolve, avenues for future research are proposed, ranging from enhanced feature extraction techniques to the development of standardized benchmark datasets. In essence, this review serves as a compass guiding researchers and practitioners through the intricate landscape of speech emotion recognition, offering a nuanced understanding of the factors shaping its recognition accuracy of speech emotion. [ABSTRACT FROM AUTHOR]

Surgical robotics tends to develop cognitive control architectures to provide certain degree of autonomy to improve patient safety and surgery outcomes, while decreasing the required surgeons' cognitive load dedicated to low level decisions. Cognition needs workspace perception, which is an essential step towards automatic decision-making and task planning capabilities. Robust and accurate detection and tracking in minimally invasive surgery suffers from limited visibility, occlusions, anatomy deformations and camera movements. This paper develops a robust methodology to detect and track anatomical structures in real time to be used in automatic control of robotic systems and augmented reality. The work focuses on the experimental validation in highly challenging surgery: fetoscopic repair of Open Spina Bifida. The proposed method is based on two sequential steps: first, selection of relevant points (contour) using a Convolutional Neural Network and, second, reconstruction of the anatomical shape by means of deformable geometric primitives. The methodology performance was validated with different scenarios. Synthetic scenario tests, designed for extreme validation conditions, demonstrate the safety margin offered by the methodology with respect to the nominal conditions during surgery. Real scenario experiments have demonstrated the validity of the method in terms of accuracy, robustness and computational efficiency. This paper presents a robust anatomical structure detection in present of abrupt camera movements, severe occlusions and deformations. Even though the paper focuses on a case study, Open Spina Bifida, the methodology is applicable in all anatomies which contours can be approximated by geometric primitives. The methodology is designed to provide effective inputs to cognitive robotic control and augmented reality systems that require accurate tracking of sensitive anatomies. • Cognitive robotics requires robust workspace perception. • Generic mathematical formulation for deformable geometric primitives. • Robust tracking: severe occlusions, deformation and camera movements. • Efficient tracking methodology (POI detection ＋ geometric primitive computation). • AI POI classification in real anatomical scenarios. [ABSTRACT FROM AUTHOR]

Estimating the remaining useful life (RUL) of proton exchange membrane fuel cells (PEMFCs) is key to predicting and increasing their durability. This paper investigates six deep learning techniques – long short-term memory (LSTM) networks, gated recurrent units (GRU), 1-D convolutional neural network (CNN)-LSTMs, 1D–CNN–GRUs, 1D–CNN–Bidirectional-LSTMs, and 1D–CNN–Bidirectional-GRUs – for RUL and long-term degradation trend prediction for a five-cell PEMFC stack operated with and without current ripples. The hyperparameters of all models are optimized for minimum root-mean-square error (RMSE) of the stack voltage using tree-structured Parzen estimators (TPE) with hyperband pruning. The obtained prediction results are benchmarked using the coefficient of determination (R2), RMSE, and mean absolute percentage error (MAPE) in stack voltage predictions and relative error (RE) in RUL estimates. The comparative analysis for models trained on 50% datasets reveals that the best R2, RMSE, MAPE, and RE of 98.87E-2, 1.258E-3, 0.285E-1, and 0.0425E-1 are offered by the LSTM model for the stack without current ripples. Further, for the stack with current ripples, the best R2, RMSE, MAPE, and RE of 99.482E-2, 1.77E-3, 0.444E-1, and 0.089E-1 are exhibited by the 1D–CNN–Bidirectional-GRU model. The LSTM model also reveals excellent transfer learning performance on the stack with current ripples with the best R2, RMSE, MAPE, and RE of 98.91E-2, 2.455E-3, 0.362E-1, and 0.044E-1, respectively. [Display omitted] • Six deep learning models are developed for PEMFC RUL and degradation prediction. • Hyperparameters of each model are optimized using TPE for static and dynamic loading. • Static loading models exhibited excellent transfer learning performance. • All tuned models performed superior to recent reported approaches in RMSE. • LSTM and 1D–CNN–Bidirectional-GRU demonstrated best results trained on 50% data. [ABSTRACT FROM AUTHOR]

Modern and new integrated technologies have changed the traditional systems by using more advanced machine learning, artificial intelligence methods, new generation standards, and smart and intelligent devices. The new integrated networks like the Internet of Things (IoT) and 5G standards offer various benefits and services. However, these networks have suffered from multiple object detection, localization, and classification issues. Conventional Neural Networks (CNN) and their variants have been adopted for object detection, classification, and localization in IoT networks to create autonomous devices to make decisions and perform tasks without human intervention and helpful to learn in-depth features. Motivated by these facts, this paper investigates existing object detection and recognition techniques by using CNN models used in IoT networks. This paper presents a Conventional Neural Networks for 5G-Enabled Internet of Things Network (CNN-5GIoT) model for moving and static objects in IoT networks after a detailed comparison. The proposed model is evaluated with existing models to check the accuracy of real-time tracking. The proposed model is more efficient for real-time object detection and recognition than conventional methods. [ABSTRACT FROM AUTHOR]

The development of stereo matching algorithm is still one of the challenging problems, especially in ill-posed regions. Hence, this article presents a survey on the algorithm frameworks related to the stereo matching algorithm. Based on the early survey that had been conducted, two major frameworks available in current stereo matching algorithm development, they are traditional and artificial intelligence (AI) frameworks. Most of the traditional methods are very low accuracy compared to the AI-based approach. This can be observed in the standard benchmarking dataset, such as from the KITTI and the Middlebury, where AI methods rank at the top of the accuracy list. Additionally, the trend for solving computer vision problems uses AI or machine learning tools that become more apparent in recent years. Thus, this paper is focusing on the survey between the deep learning frameworks, which is one of the machine learning tools related to the convolutional neural network (CNN). Several mixed approaches between CNN based method and traditional handcraft method, as well as the end to end CNN method also discussed in this paper. [ABSTRACT FROM AUTHOR]

In personal identity recognition systems, detecting a person's age, gender, and language using voice signal characteristics is a crucial issue, especially because of the importance of security considerations. Age, gender, and language classification problems are important in signal processing because they are used to analyze and understand human behavior, interactions, and preferences. This can be especially useful in the fields of human-computer interaction, psychology, and social science research. In this paper, a new system for detecting a speaker's age, gender, and language based on deep learning models is presented. Deep learning models have shown great efficacy in various fields of signal processing. For this paper, a range of deep models were tested, including convolutional neural networks (CNNs), recurrent neural network (RNN), and a fine-tuning ResNet34 architecture. Additionally, techniques such as transfer learning were applied to improve the efficiency of the proposed system. The input voice signals are preprocessed by applying the spectro-temporal transform to obtain additional features that can be fed to the ResNet34 model, which is designed specifically for the task of voice signal processing. The dataset used in this paper was sourced from the Mozilla common voice initiative, which is dedicated to advancing speech recognition and language identification technologies. The performance of the proposed algorithm was evaluated in the presence of Gaussian noise to determine its robustness. The experimental results demonstrated that the proposed algorithm significantly outperformed basic algorithms and other deep neural networks in terms of age and gender recognition from voice signals. [ABSTRACT FROM AUTHOR]

[Display omitted] • A fast accurate non-destructive quantitative analysis method of blended fabrics has been developed successfully using NIR and CNN-LSTM. • The CNN network structure in this paper is designed to adapt to a small sample regression. • The CNN-LSTM network designed in this paper can more accurately analyze the cotton content of cotton-polyester blended fabrics than PLS, CNN, and LSTM. • This CNN-LSTM method can accurately predict the cotton content of cotton-polyester blended fabrics with only simple MSC preprocessing. Accurate and rapid quantitative analysis of fiber content is important for blended fabric quality control and supervision. In this paper, a deep learning method based on an improved hybrid network of convolutional neural network (CNN) and long short-term memory (LSTM) to fast and accurate determine cotton content of cotton-polyester blended fabrics using near-infrared (NIR) spectroscopy. The cotton-polyester blended fabric samples were partitioned into training set, validation set and testing set in the ratio of 6:2:2 to develop the quantitative model of cotton content of blended fabric. Firstly, a one-dimensional CNN architecture is designed and modeled to obtain the CNN parameters and to evaluate the spectral preprocessing methods. Then, the CNN structure is modified and improved using LSTM to obtain a CNN-LSTM structure. The root mean square error (RMSE) of the validation set obtained by CNN model is 0.83%, which is 34.03% lower than that of the traditional partial least squares (PLS) model, and the RMSE of the testing set obtained by CNN model is 0.88%, which is 25.88% lower than that of the PLS model. The RMSE of the validation set obtained by CNN-LSTM model is 0.65%, which is 47.85% lower than that of the PLS model, and the RMSE of the testing set obtained by CNN-LSTM model is 0.75%, which is 36.57% lower than that of the PLS model. Compared with PLS and CNN models, the CNN-LSTM model can more accurately analyze the cotton content proportion of cotton-polyester blended fabrics, which provides a new fast and non-invasive method for the quantitative detection of fabrics. [ABSTRACT FROM AUTHOR]

• An edge detection algorithm for thermal infrared weak texture images. • Construct a high-quality thermal infrared image edge dataset RI-BSDS500 for training to improve the training convergence speed and generalization ability of the model. • Different thermal infrared image datasets are tested under different algorithms, and the results are analyzed from the perspectives of objective parameters and subjective effects, which proves that the proposed algorithm in this paper is more effective on thermal infrared images. In order to solve the problems such as difficulties in extracting image edge information caused by low contrast and blurred edges of thermal infrared images, a thermal infrared image edge detection algorithm PiDiNet-TIR constructed based on the PiDiNet model is proposed. On the basis of the visible light image dataset BSDS500, the visible light image is grayed out, noise is added, and contrast is reduced to construct the thermal infrared image edge dataset I R-BSDS500, which provides image data for model training and testing. Deeply study the theory of PiDiNet model, add rich convolution mechanism to its backbone network, improve the activation function, pooling layer and up-sampling module, study the SimAM attention mechanism and add it to the side network. Using the open-source thermal infrared image dataset and homemade thermal infrared images for testing, we compare and analyze the mean square error (MSE), structural similarity of image (SSIM), feature similarity of image (FSIM), and Frames Per Second (FPS)of different detection algorithms, such as HED, RCF, DexiNet, PiDiNet, and the algorithm proposed in this paper. The results of image evaluation parameters prove that the edge detection algorithm proposed in this paper has high feature extraction efficiency and feature expression ability, and the algorithm detection performance is higher than other algorithms. [ABSTRACT FROM AUTHOR]

• We proposed a delineating field parcel model (TSANet) based on satellite image time series. • TSANet learn the relevance of spatial-spectral-temporal feature representation. • TSANet is robust across space and time. • TSANet performs better than pervious methods. • The time series data from the main growing period has a greater impact. Satellite image time series (SITS), such as Sentinel-2 imagery, plays a crucial role in the delineation of agricultural fields by reducing the impacts of ambiguities due to the spatial arrangement of field boundaries. Existing delineate field parcel models rely extensively on spatial features derived from single-date imagery. However, several studies have exploited the potential of SITS to effectively tackle the complexities associated with the intrinsic consistency between agricultural fields and their boundaries. This paper proposes a novel Two-Stream Attention convolutional neural network (TSANet) to capture the subtle difference between agricultural fields from SITS. Specifically, a field temporal semantic stream is introduced to adaptively leverage the significance of spatial-spectral-temporal feature representation associated with the location of agricultural parcels, especially where transitions in crop types take place. Considering the consistency between field parcels and their boundaries, we developed a field boundary prediction stream to enhance the extraction of edge features, particularly for the extraction of small and irregular agricultural parcels. Moreover, a field parcel refining block is employed to further enhance the geometric accuracy of agricultural fields. We conducted experiments on Sentinel-2 images from the Netherlands. Results showed that our approach produced a better layout of agricultural fields, with an average F1-score of 0.91 than the existing 3D-UNet, U-TEA, and BiConvLSTM. In addition, through the analysis of both quantitative and qualitative results, the stronger robustness of the model compared to other algorithms has been verified by temporal transfer and large-scale spatial prediction. We compared the difference between SITS and the corresponding composite images, which further verified the influence of temporal variation on the proposed approach. This paper provides a general guide for delineating agricultural parcels using SITS. [ABSTRACT FROM AUTHOR]

The emergence of IoT has introduced new security concerns, particularly the detection of large-scale network attacks initiated by compromised IoT devices. The diverse nature of IoT devices adds complexity to attack detection, necessitating the classification of devices based on their unique characteristics and behavior patterns. This paper presents a novel device classification method grounded in traffic differentials before and after IoT devices succumb to compromise. The study defines the concept of attack sensitivity and designs a method for calculating the value. The K-means algorithm is used to classify devices into predefined categories based on their attack sensitivity values. The effectiveness of this method is demonstrated through experiments on a public dataset. Additionally, a multi-class classification model is developed to identify newly added devices to the IoT environment, with good results in accuracy, precision, recall, F1 score, and FPR (0.999, 0.997–1,0.997–1,0.998–1,0–0.001). Overall, The device classification method proposed in this paper, based on attack sensitivity, not only enables a rational definition of device categories but also ensures precise classification for devices newly integrated into the IoT environment. This lays the foundation for achieving more precise attack detection and protection, advancing the field towards enhanced cybersecurity measures. [ABSTRACT FROM AUTHOR]

Food safety is an important public health issue, and deep learning (DL) algorithms can provide powerful tools and methods for food safety and authenticity detection. Compared with chemometric algorithms and traditional machine learning algorithms, the performances of DL algorithms are improved in many aspects. By learning and analyzing a large amount of data, DL models can improve the efficiency and accuracy of food safety and authenticity detection, helping to ensure the public health and safety. This paper reviews some commonly used chemometric algorithms, traditional machine learning algorithms, and popular DL algorithms. Among them, special attentions are paid to convolutional neural network (CNN), fully convolutional network (FCN) and generative adversarial network (GAN). Moreover, the auxiliary effect of GAN on CNN is highlighted. Finally, this paper revisits recent applications of DL algorithms in the field of food safety and authenticity detection, and prospects the challenges and future directions of DL algorithms in this field. Although DL has made many achievements in the field of food safety and authenticity detection, there is still a great potential for development. For example, the data augmentation function of GAN can assist CNN to obtain more training samples, thus improving the recognition rate. In addition, multimodal neural network (MNN) or multimodal attention network (MAN) can be also used to achieve the fusion of data from different modalities to further improve the robustness and accuracy of DL algorithms. [Display omitted] • Some popular DL algorithms in food safety and authenticity detection are introduced. • The improvements of DL algorithms to chemometric and ML algorithms are summarized. • Recent applications of DL algorithms in food safety and authenticity detection are reviewed. • Future prospects of DL algorithms in food safety and authenticity detection are discussed. [ABSTRACT FROM AUTHOR]

Because the carbon load inside a diesel particulate filters (DPF) affects the DPF regeneration, and the carbon load recognition is significant for the particulate matter (PM) emission control. It is necessary to investigate an on-board DPF carbon load recognition method because the carbon load cannot be directly measured by sensors. Aiming to build a DPF carbon load prediction model adopting the deep learning method, this paper proposes a DPF carbon load identification model based on different experimental parameters using a layered one dimension convolutional neural network (1D-CNN) method. To improve data validity, this paper adopts two data-processing methods. The data pre-processing adopts data splicing method to complete the construction of the original sample set, and the data after-processing uses wavelet packet transform method to establish the feature sample sets. The model adopts the optimal feature dataset constructed by three input parameters, i.e., temperature difference, pressure difference, and exhaust mass flow, and has both high training accuracy and test accuracy above 90 %. The pressure difference is the most important influencing input parameter, and the three-parameter sample set (Δ T + Δ P + Q) has great recognition accuracy and good model stability with the high training accuracy and test accuracy as well as less iteration. • A heavy-duty diesel engine was tested under various conditions of carbon load inside DPF. • The data processing was done by two methods: data splicing and wavelet packet transform. • We proposed a DPF carbon load identification model based on a one-dimension CNN method. • The model adopts 3 parameters, and the 3-parameter sample set has optimal performance. • The 1D-CNN model has both high training accuracy and test accuracy above 90 %. [ABSTRACT FROM AUTHOR]

Groundwater level (GWL) prediction is important for ecological protection and resource utilization; it helps in formulating policies for artificial groundwater recharge, modifying the number of extraction wells, etc., and can support sustainable human development as well as inform water resource management decisions. However, climate change, anthropogenic impacts, and the complex coupling between surface water and groundwater increase the difficulty of predicting groundwater levels. The model proposed in this paper combines external data as well as multiple models. The method leverages long and short-term memory (LSTM) and convolutional neural network (CNN) models, combined with secondary modal decomposition and slime mould algorithm (SMA), together with an adaptive weight module (AWM). The study applies this method to predict GWL for three different hydrological conditions in China, specifically for the Jinan Baotu Spring, Heihu Spring, and Zhongtianshe watershed of Taihu Lake. A comparison of metrics such as mean absolute error and Nash efficiency coefficient for single and hybrid models shows that the model in this paper is more advantageous than the single model and other hybrid models. The interpretability of the model is enhanced by SHAP values that demonstrate the degree of contribution of the input variables. This paper uses SHAP analyses to identify the key drivers affecting groundwater levels. These factors must be detected in order to develop groundwater resource protection measures. [Display omitted] • Multivariate fusion data including hydrology and meteorology are used as model input. • A secondary modal decomposition module for historical groundwater level data was utilized. • The neural network hyperparameters are optimized using the slime mould algorithm. • Aggregate subsets of prediction with adaptive modules rather than linear summation. • The interpretable SHAP model measures the degree of influence of external variables. [ABSTRACT FROM AUTHOR]

Depression is one of the leading forms of mental health issues encountered by individuals of diverse age groups today worldwide. Like any other mental health concerns, depression too poses diagnostic challenges for medical practitioners and clinical experts, given obvious social reservations and lack of awareness and acceptance in the society. Since long researchers have been looking for methods to identify symptoms of depression among individuals from their speech and responses, by utilizing automation systems and computers. In this paper, we propose an audio based depression detection method, which relies on neural networks for audio spectrogram based feature extraction as well as classification between speech/response patterns of depressed vs. non-depressed persons. We adopt a multi-modal approach in our work, by combining Mel-Frequency Cepstral Coefficients (MFCC) features, as well as Spectrogram features extracted from an audio file, by a novel CNN network. Our CNN model demonstrates optimized residual blocks and the "glorot uniform" kernel initializer. The proposed method's performance is assessed in both multi-modal and multi-feature trials. We show our results on standard benchmark datasets DAIC-WOZ and MODMA, which provide repositories of questionnaire and patient responses, relevant in identification of depressive symptoms. We have also tested our model on standard emotion recognition audio dataset, RAVDESS. The proposed model achieves detection accuracy of over 90% in DAIC-WOZ and MODMA, and over 85% in RAVDESS, which is proven to surpass the present state-of-the-art. • We introduce a novel deep neural network for depression detection through audio signals. • We used a multi-modal concept considering mfcc and spectrogram to detect the depression. • This paper shows optimized residual block to extract the detailed information to enhance the performance of the model. • Our model gets better results on the three benchmark datasets. [ABSTRACT FROM AUTHOR]

Edge detection is of critical importance for middle-level and high-level tasks in computer vision. Existing edge detection methods usually use VGG16 as the encoding network and achieve exceptional performance through transfer learning, which has the characteristics of high parameters and high computational cost. Researchers have implemented edge detection by designing decoding networks. Unlike existing methods, this paper is inspired by the effective mechanisms of edge detection in the parallel pathway of biological vision and proposes a new lightweight encoding–decoding structure for edge detection networks, which we refer to as XYW-Net. In the encoding network, we drew inspiration from the receptive field properties of X-type cells, Y-type cells, and W-type cells involved in the parallel pathway, and developed more meticulous convolutional models. Based on the structure of the parallel pathway, the three cell modules are combined into a novel encoding network and excellent feature extraction performance is obtained. Within the decoding network, this paper draws inspiration from the feature integration ability of the inferotemporal cortex (IT) and introduces a novel feature integration module to constitute the decoding network. Experiments show that the proposed network in this paper obtains the Optimal Dataset Scale (ODS) = 0.812 on the BSDS500 dataset with only 0.79 M parameters. Additionally, the model has exhibited outstanding ODS performance on various publicly available edge detection datasets, including NYUD, BIPEDv1, and Multicue. Moreover, future research could concentrate on implementing more efficient antagonistic mechanisms and devising networks grounded in higher-level visual cortical mechanisms. This could further augment the performance and efficiency of edge detection networks. We encourage researchers to delve into these directions within the field. The codes are available at https://github.com/PXinTao/XYW-Net. [ABSTRACT FROM AUTHOR]

The core of data series classification and clustering is how to evaluate the similarity between time series. However, for one-dimensional time series, the vast majority of similarity measurement methods currently relied on one-dimensional information. Although some classifications of time series were achieved by the images transformed from time series, they mostly relied on a single imaging mechanism (time domain or frequency domain). In order to give a new idea for time series similarity measurement, this paper proposed a similarity measurement method of time series based on the fused images. According to recurrence plots (RP) and wavelet scalogram (WS), the original time series was first transformed into images. Then, RP and WS were fused into an image. Next, the feature in the image was extracted by ResNet-18. Finally, the similarity of the time series can be obtained by the Euclidean distance between the features extracted by ResNet-18. The proposed method was verified by the time series from UCR Time Series Classification/Clustering Homepage. The results showed that the similarity measurement of time series can be effectively improved by fusing the images obtained by different imaging mechanisms in the time domain and frequency domain. • This paper proposes a new similarity measurement method for time series based on the image fusion of different forms. • The time domain and frequency domain information of time series are represented by recurrence plots and wavelet scalogram. • The characteristics of the image fused by recurrence plots and wavelet scalogram are extracted by Convolutional Neural Network to measure the similarity of time series. • 30 sets of time series show the validity and superiority of the proposed method. • The reasons for the effectiveness of the proposed method are analyzed in detail. [ABSTRACT FROM AUTHOR]

The fault management process is facilitated by equipping power distribution systems with automated devices, especially remote-controlled switches (RCSs). Although RCS plays a key role in improving the system's reliability, it imposes significant investment, installation, and maintenance costs. Hence, RCSs should be optimally located in distribution feeders for the highest profit. In previous works, reliability-oriented mathematical optimization models have been formulated to reach this goal. However, the number of test solutions exponentially grows with the problem size to find the globally optimal solution. This paper uses machine learning to propose a scalable and easy-to-implement model for optimal switch placement in real power distribution systems. At first, the features of candidate points for installing RCSs are introduced. Then, a learning model is applied to deeply explore the relationship between these features and optimal locations for installing RCSs. After training, the learning-based surrogate model directly determines the optimal RCS placement strategy in real power distribution systems by leveraging knowledge gained from past experiences. Simulation results demonstrate that the proposed surrogate model is approximately 29 times faster than the integer programming-based mathematical model, without a significant loss of accuracy, when implemented on a modified 11 kV network connected to Bus 4 of the Roy Billiton test system. This paper also employs explainable artificial intelligence (XAI) tools to select the most important features, where the Hamming loss is decreased by approximately 5%. [ABSTRACT FROM AUTHOR]

CAPTCHAs represent a vital technique for protecting the security of websites by differentiating between humans and bots. There have been many successful attacks against text and image CAPTCHAs, demonstrating that they are no longer secure, and blindly using methods to enhance CAPTCHAs robustness may reduce user-friendliness. Slider CAPTCHAs, which are based on behavioral verification, are being used on more and more websites as an alternative to text CAPTCHAs and image CAPTCHAs. However, despite the widespread use of slider CAPTCHAs, their security remains largely unknown. In this paper, we introduce a simple, efficient and generic approach for attacking five widely deployed slider CAPTCHAs, with success rates ranging from 87.5% to 100%. Experimental results proving that behavior-verification-based slider CAPTCHAs do not fully differentiate between humans and bots, especially with regard to mouse operation behavior. Simultaneously, this paper also discusses whether deep learning technology can further improve the security of slider CAPTCHAs by analyzing user behavior trajectories, hoping that our work can provide new inspiration for designers to design more effective CAPTCHAs. [Display omitted] • The first comprehensive cracking and security analysis of behavior-verification-based slider CAPTCHAs. • The method was verified on five mainstream websites, and the highest cracking success rate was 100%. • Through in-depth analysis, human operation and machine simulation were successfully identified with an accuracy rate of 98.06%. [ABSTRACT FROM AUTHOR]

Intelligent fault diagnosis of rolling element bearings gains increasing attention in recent years due to the promising development of artificial intelligent technology. Many intelligent diagnosis methods work well requiring massive historical data of the diagnosed object. However, it is hard to get sufficient fault data in advance in real diagnosis scenario and the diagnosis model constructed on such small dataset suffers from serious overfitting and losing the ability of generalization, which is described as small sample problem in this paper. Focus on the small sample problem, this paper proposes a new intelligent fault diagnosis framework based on dynamic model and transfer learning for rolling element bearings race faults. In the proposed framework, dynamic model of bearing is utilized to generate massive and various simulation data, then the diagnosis knowledge learned from simulation data is leveraged to real scenario based on convolutional neural network (CNN) and parameter transfer strategies. The effectiveness of the proposed method is verified and discussed based on three fault diagnosis cases in detail. The results show that based on the simulation data and parameter transfer strategies in CNN, the proposed method can learn more transferable features and reduce the feature distribution discrepancy, contributing to enhancing the fault identification performance significantly. • A bearing diagnosis framework via simulation auxiliary and parameter transfer for small sample problem. • Exploring effectiveness under diverse transfer strategies. • Leveraging transferable knowledge from simulation data to real scenario. • Robust to CNN architectures with different complexity. [ABSTRACT FROM AUTHOR]