Search

Purpose: Paper-based artifacts hold significant cultural and social values. However, paper is intrinsically fragile to microorganisms, such as mold, due to its cellulose composition, which can serve as a microorganisms' nutrient source. Mold not only can damage papers' structural integrity and pose significant challenges to conservation works but also may subject individuals attending the contaminated artifacts to health risks. Current approaches for strain identification usually require extensive training, prolonged time for analysis, expensive operation costs, and higher risks of secondary damage due to sampling. Thus, in current conservation practices with mold-contaminated artifacts, little pre-screening or strain identification was performed before mold removal, and the cleaning techniques are usually broad-spectrum rather than strain-specific. With deep learning showing promising applications across various domains, this study investigated the feasibility of using a convolutional neural network (CNN) for fast in-situ recognition and classification of mold on paper. Methods: Molds were first non-invasively sampled from ancient Xuan Paper-based Chinese books from the Qing and Ming dynasties. Strains were identified using molecular biology methods and the four most prevalent strains were inoculated on Xuan paper to create mockups for image collection. Microscopic images of the molds as well as their stains situated on paper were collected using a compound microscope and commercial microscope lens for cell phone cameras, which were then used for training CNN models with a transfer learning scheme to perform the classification of mold. To enable involvement and contribution from the research community, a web interface that actuates the process while providing interactive features for users to learn about the information of the classified strain was constructed. Moreover, a feedback functionality in the web interface was embedded for catching potential classification errors, adding additional training images, or introducing new strains, all to refine the generalizability and robustness of the model. Results & Conclusion: In the study, we have constructed a suite of high-confidence classification CNN models for the diagnostic process for mold contamination in conservation. At the same time, a web interface was constructed that allows recurrently refining the model with human feedback through engaging the research community. Overall, the proposed framework opens new avenues for effective and timely identification of mold, thus enabling proactive and targeted mold remediation strategies in conservation. [ABSTRACT FROM AUTHOR]

In an era overwhelmed by academic big data, students grapple with identifying academic papers that resonate with their learning objectives and research interests, due to the sheer volume and complexity of available information. This study addresses the challenge by proposing a novel academic paper recommendation system designed to enhance personalized learning through the nuanced understanding of academic social networks. Utilizing the theory of social homogeneity, the research first constructs a sophisticated academic social network, capturing high-order social relationships, such as co-authorship and advisor–advisee connections, through hypergraph modeling and advanced network representation learning techniques. The methodology encompasses the development and integration of a hypergraph convolutional neural network and a contrastive learning framework to accurately model and recommend academic papers, focusing on aligning with students' unique preferences and reducing reliance on sparse interaction data. The findings, validated across multiple real-world datasets, demonstrate a significant improvement in recommendation accuracy, particularly in addressing the cold-start problem and effectively mapping advisor–advisee relationships. The study concludes that leveraging complex academic social networks can substantially enhance the personalization and precision of academic paper recommendations, offering a promising avenue for addressing the challenges of academic information overload and fostering more effective personalized learning environments. [ABSTRACT FROM AUTHOR]

Herein, the challenge of accurately classifying the manufacturing origin of printing paper, including continent, country, and specific product, was addressed. One-dimensional convolutional neural network (1D CNN) models trained on infrared (IR) spectrum data acquired from printing paper samples were used for the task. The preprocessing of the IR spectra through a second-derivative transformation and the restriction of the spectral range to 1800 to 1200 cm-1 improved the classification performance of the model. The outcomes were highly promising. Models trained on second-derivative IR spectra in the 1800 to 1200-cm-1 range exhibited perfect classification for the manufacturing continent and country, with an impressive F1 score of 0.980 for product classification. Notably, the developed 1D CNN model outperformed traditional machine learning classifiers, such as support vector machines and feed-forward neural networks. In addition, the application of data point attribution enhanced the transparency of the decision-making process of the model, offering insights into the spectral patterns that affect classification. This study makes a considerable contribution to printing paper classification, with potential implications for accurate origin identification in various fields. [ABSTRACT FROM AUTHOR]

The research groups in computer vision, graphics, and machine learning have dedicated a substantial amount of attention to the areas of 3D object reconstruction, augmentation, and registration. Deep learning is the predominant method used in artificial intelligence for addressing computer vision challenges. However, deep learning on three-dimensional data presents distinct obstacles and is now in its nascent phase. There have been significant advancements in deep learning specifically for three-dimensional data, offering a range of ways to address these issues. This study offers a comprehensive examination of the latest advancements in deep learning methodologies. We examine many benchmark models for the tasks of 3D object registration, augmentation, and reconstruction. We thoroughly analyse their architectures, advantages, and constraints. In summary, this report provides a comprehensive overview of recent advancements in three-dimensional deep learning and highlights unresolved research areas that will need to be addressed in the future. [ABSTRACT FROM AUTHOR]

Facility management maintains building service quality through cycles of condition assessments and rehabilitation. Building components, however, differ in their nature, service lives, deterioration patterns, and textual/visual inspection data. This complicates the condition assessment process and subsequent rehabilitation decisions. This paper proposes a smart condition assessment framework that uses different artificial intelligence (AI) techniques that suit the condition data analysis of different building components. The framework has been applied to a dataset of over 2000 maintenance requests for roof and heating, ventilation, and air conditioning (HVAC) systems across a 600-villa portfolio. To address their varying needs, convolutional neural networks were used on images of roof defects, while enhanced data mining was used on textual data of HVAC systems. Accordingly, work packages of deteriorated components were identified, and a 60-day schedule was developed to repair 203 HVAC units. This research shows how AI can assist facility management with respect to condition assessment, rehabilitation planning, and resource allocation. [ABSTRACT FROM AUTHOR]

Sensor data fusion analysis is a crucial process that integrates data from multiple sensors to provide more accurate and comprehensive information. This analysis has various applications in fields such as industry, medicine, robotics, transportation, and information systems. The article highlights sixteen high-quality papers that explore different aspects of sensor data fusion, including facial detection, object detection, odometry systems, geospatial data evaluation, and fault detection. The papers demonstrate the potential of sensor data fusion in improving decision-making, efficiency, and productivity in various industries. Future research in this area will focus on miniaturization, multi-sensor systems, and addressing challenges related to data quality in mobile sensors. [Extracted from the article]

Introduction: In recent years, graph neural network has been extensively applied to drug discovery research. Although researchers have made significant progress in this field, there is less research on bibliometrics. The purpose of this study is to conduct a comprehensive bibliometric analysis of graph neural network applications in drug discovery in order to identify current research hotspots and trends, as well as serve as a reference for future research. Methods: Publications from 2017 to 2023 about the application of graph neural network in drug discovery were collected from the Web of Science Core Collection. Bibliometrix, VOSviewer, and Citespace were mainly used for bibliometric studies. Results and Discussion: In this paper, a total of 652 papers from 48 countries/regions were included. Research interest in this field is continuously increasing. China and the United States have a significant advantage in terms of funding, the number of publications, and collaborations with other institutions and countries. Although some cooperation networks have been formed in this field, extensive worldwide cooperation still needs to be strengthened. The results of the keyword analysis clarified that graph neural network has primarily been applied to drugtarget interaction, drug repurposing, and drug-drug interaction, while graph convolutional neural network and its related optimization methods are currently the core algorithms in this field. Data availability and ethical supervision, balancing computing resources, and developing novel graph neural network models with better interpretability are the key technical issues currently faced. This paper analyzes the current state, hot spots, and trends of graph neural network applications in drug discovery through bibliometric approaches, as well as the current issues and challenges in this field. These findings provide researchers with valuable insights on the current status and future directions of this field. [ABSTRACT FROM AUTHOR]

CNN has demonstrated remarkable performance in EEG signal detection, yet it still faces limitations in terms of global perception. Additionally, due to individual differences in EEG signals, the generalization ability of epilepsy detection models is week. To address this issue, this paper presents a cross-patient epilepsy detection method utilizing a multi-head self-attention mechanism. This method first utilizes Short-Time Fourier Transform (STFT) to transform the original EEG signals into time-frequency features, then models local information using Convolutional Neural Network (CNN), subsequently captures global dependency relationships between features using the multi-head self-attention mechanism of Transformer, and finally performs epilepsy detection using these features. Meanwhile, this model employs a light multi-head attention mechanism module with an alternating structure, which can comprehensively extract multi-scale features while significantly reducing computational costs. Experimental results on the CHB-MIT dataset show that the proposed model achieves accuracy, sensitivity, specificity, F1 score, and AUC of 92.89%, 96.17%, 92.99%, 94.41%, and 96.77%, respectively. Compared to the existing methods, the method proposed in this paper obtains better performance along with better generalization. [ABSTRACT FROM AUTHOR]

The sliding window method is commonly used for non-intrusive load disaggregation. However, it is difficult to choose the appropriate window size, and the disaggregation effect is poor in low-frequency industrial environments. To better handle low-frequency industrial load data, in this paper, we propose a vertical non-intrusive load disaggregation model that is different from the sliding window method. By training multiple electrical parameters at a single point on the bus end with the corresponding load data at the branch end, the proposed method, called multiple electrical parameters to point (Mep2point), takes the electrical parameter data sampled at a single point on the bus end as its input and outputs the load data of the target device sampled at the corresponding point. First, the electrical parameters of the bus end are processed, and each item is normalized to the range from 0–1. Then, the electrical parameters are vertically arranged by their time point, and a convolutional neural network (CNN) is used to train the model. The proposed method is analyzed on low-frequency industrial user data sampled at a frequency of 1/120 Hz in the real world. We compare our method with three advanced sliding window methods, achieving an average improvement ranging from 9.23% to 22.51% in evaluation metrics, while showing substantial superiority in the actual decomposed images. Compared with three classical machine learning algorithms, our model, using the same amount of data, significantly outperforms these methods. Finally, we also compared our method with the multi-channel low window sequence-to-point (MLSP) method, which also selects multiple electrical parameters. Our model's complexity is much less than that of the MLSP model, and its performance remains high. The superiority of our model, as presented in this paper, is fully verified by experimental analysis, which can produce better actual load decomposition results from each branch and contribute to the analysis and monitoring of loads in industrial environments. [ABSTRACT FROM AUTHOR]

The Ultra-Wideband (UWB) Location-Based Service is receiving more and more attention due to its high ranging accuracy and good time resolution. However, the None-Line-of-Sight (NLOS) propagation may reduce the ranging accuracy for UWB localization system in indoor environment. So it is important to identify LOS and NLOS propagations before taking proper measures to improve the UWB localization accuracy. In this paper, a deep learning-based UWB NLOS/LOS classification algorithm called FCN-Attention is proposed. The proposed FCN-Attention algorithm utilizes a Fully Convolution Network (FCN) for improving feature extraction ability and a self-attention mechanism for enhancing feature description from the data to improve the classification accuracy. The proposed algorithm is evaluated using an open-source dataset, a local collected dataset and a mixed dataset created from these two datasets. The experiment result shows that the proposed FCN-Attention algorithm achieves classification accuracy of 88.24% on the open-source dataset, 100% on the local collected dataset and 92.01% on the mixed dataset, which is better than the results from other evaluated NLOS/LOS classification algorithms in most scenarios in this paper. [ABSTRACT FROM AUTHOR]

Aiming at the problems of high stochasticity and volatility of power loads as well as the difficulty of accurate load forecasting, this paper proposes a power load forecasting method based on CEEMDAN (Completely Integrated Empirical Modal Decomposition) and TCN-LSTM (Temporal Convolutional Networks and Long-Short-Term Memory Networks). The method combines the decomposition of raw load data by CEEMDAN and the spatio-temporal modeling capability of TCN-LSTM model, aiming to improve the accuracy and stability of forecasting. First, the raw load data are decomposed into multiple linearly stable subsequences by CEEMDAN, and then the sample entropy is introduced to reorganize each subsequence. Then the reorganized sequences are used as inputs to the TCN-LSTM model to extract sequence features and perform training and prediction. The modeling prediction is carried out by selecting the electricity compliance data of New South Wales, Australia, and compared with the traditional prediction methods. The experimental results show that the algorithm proposed in this paper has higher accuracy and better prediction effect on load forecasting, which can provide a partial reference for electricity load forecasting methods. [ABSTRACT FROM AUTHOR]

This document is a guest editorial from the journal IET Generation, Transmission & Distribution. It discusses the use of artificial intelligence (AI) in reliable forecasting for energy sectors. The editorial highlights the challenges of integrating renewable energy sources and fluctuating electricity demand, and emphasizes the importance of accurate forecasting for system operators. The document also provides summaries of several papers included in a special issue on AI-empowered forecasting in energy sectors, covering topics such as load forecasting, wind power prediction, and control parameter optimization. The editorial concludes by recommending further research and practical implementations of AI approaches in the energy sectors. [Extracted from the article]

This paper provides an overview of the applications of Convolutional Neural Networks (CNN) in the railway maintenance industry. Our research covers specifically the subdomain of railway track maintenance. In this study, we have analyzed the state-of-the-art of CNNs applied to railway track maintenance by conducting an extensive literature review, summarizing different tasks and problems related to the topic and presenting solutions based on CNNs with a special emphasis on the data used to create these models. The results of our research show different applications of CNNs within the scope, including the detection of defects in the surface of railway rails and railway track components, such as fasteners, joints, sleepers, switches and crossings, as well as the recognition of track components, and the continuous monitoring of railway tracks. The architecture of CNNs is fitting to learning spatial hierarchies of features directly from the input data, making them of great use for Computer Vision and other applications related to the topic at hand. The implementation of IoT devices and smart sensors aid the collection of real-time data which can be used to feed powerful CNN models to recognize patterns and identify complex events related to the maintenance of railway tracks. This and more insights are discussed in detail within the contents of this paper. [ABSTRACT FROM AUTHOR]

Introduction: In recent years, the use of EEG signals for seizure detection has gained widespread academic attention. Aiming at the problem of overfitting deep learning models due to the small number of EEG signal data during epilepsy detection, this paper proposes an epilepsy detection method that combines data augmentation and deep learning. Methods: First, the Adversarial and Mixup Data Augmentation (AMDA) method is used to realize the data augmentation, which effectively enriches the number of training samples. To further improve the classification accuracy and robustness of epilepsy detection, this paper proposes a one-dimensional convolutional neural network and gated recurrent unit (AM-1D CNN-GRU) network model based on attention mechanism for epilepsy detection. Results and discussion: The experimental results show that the performance of epilepsy detection achieved by using augmented data is significantly improved, and the accuracy, sensitivity, and area under the subject's working characteristic curve are up to 96.06, 95.48%, and 0.9637, respectively. Compared with the nonaugmented data, all indicators are increased by more than 6.2%. Meanwhile, the detection performance was significantly improved compared with other epilepsy detection methods. The results of this research can provide a reference for the clinical application of epilepsy detection. [ABSTRACT FROM AUTHOR]

This document discusses the recent advancements in decision support systems (DSSs) for disease detection and diagnosis. The combination of biomedical studies and information technology has led to the development of accessible and accurate solutions that can improve patient survival rates. The document highlights several research papers that cover a wide range of topics, including multiple sclerosis detection, neurodegenerative disease detection, breast lesion classification, COVID-19 mortality prediction, melanoma diagnosis, and prediction of second primary skin cancer. The adoption of efficient DSSs can aid clinical assessment, reduce misdiagnosis, and facilitate evidence-based decision-making. However, challenges such as validation, training, and user interface design need to be addressed for widespread application of DSSs in clinical practice. The document concludes by emphasizing the importance of future studies and developments in overcoming limitations and expanding the use of DSSs in different contexts. [Extracted from the article]

Clinical named entity extraction (NER) based on deep learning gained much attention among researchers and data analysts. This paper proposes a NER approach to extract valuable Parkinson’s disease-related information. To develop an effective NER method and to handle problems in disease data analytics, a unique NER technique applies a “recognize-map-extract (RME)” mechanism and aims to deal with complex relationships present in the data. Due to the fast-growing medical data, there is a challenge in the development of suitable deep-learning methods for NER. Furthermore, the traditional machine learning approaches rely on the time-consuming process of creating corpora and cannot extract information for specific needs and locations in certain situations. This paper presents a clinical NER approach based on a convolutional neural network (CNN) for better use of specific features around medical entities and analyzes the performance of the proposed approach through fine-tuning NER with effective pre-training on the BC5CDR dataset. The proposed method uses annotation of entities for various medical concepts. The second stage develops a clinically NER method. This proposed method shows interesting results on the performance measures achieving a precision of 92.57%, recall of 92.22%, and F1- measure of 91.6% [ABSTRACT FROM AUTHOR]

The performance of the existing student classroom behavior detection model is affected by various aspects such as dataset, algorithm and height as well as the differences between different classrooms, and there are problems such as a single dataset, low accuracy and low efficiency. In order to improve the accuracy of student classroom behavior detection algorithm, this paper proposes a student classroom behavior detection method based on improved convolutional neural network algorithm. Firstly, the student behavior detection dataset is constructed, and the student classroom behavior detection technology scheme is designed; secondly, in order to improve the detection accuracy, the features are extracted by using the new jumping bi-directional paths, and the attention mechanism module is added at different positions to improve the path aggregation network; weekly, the embedding positions of the attention mechanism strategy are determined by analyzing multiple sets of experiments, and the proposed student classroom behavior detection algorithm's effectiveness and superiority. [ABSTRACT FROM AUTHOR]

This document discusses the advancements in deep learning technology and image sensing. It highlights the role of deep learning in improving image recognition data and sensor performance in various applications, such as autonomous driving and smartphone camera functionalities. The document presents eleven papers published in a special issue on deep learning technology and image sensing, covering topics like medical imaging, image enhancement, object detection, and innovation in image sensing technologies. The papers demonstrate innovative approaches and methodologies in diverse domains, including liver segmentation, brain tumor classification, optic cup and disc edge detection, image-to-image translation in astronomy, super-resolution imaging, and object detection systems. These studies contribute to the interdisciplinary field of deep learning-based imaging and sensing and offer valuable insights for various fields, including healthcare, astronomy, and robotics. [Extracted from the article]

With the establishment of the "double carbon" goal, various industries are actively exploring ways to reduce carbon emissions. Cloud data centers, represented by cloud computing, often have the problem of mismatch between load requests and resource supply, resulting in excessive carbon emissions. Based on this, this paper proposes a complete method for cloud computing carbon emission prediction. Firstly, the convolutional neural network and bidirectional long-term and short-term memory neural network (CNN-BiLSTM) combined model are used to predict the cloud computing load. The real-time prediction power is obtained by real-time prediction load of cloud computing, and then the carbon emission prediction is obtained by power calculation. Develop a dynamic server carbon emission prediction model, so that the server carbon emission can change with the change of CPU utilization, so as to achieve the purpose of low carbon emission reduction. In this paper, Google cluster data is used to predict the load. The experimental results show that the CNN-BiLSTM combined model has good prediction effect. Compared with the multi-layer feed forward neural network model (BP), long short-term memory network model (LSTM), bidirectional long short-term memory network model (BiLSTM), modal decomposition and convolution long time series neural network model (CEEMDAN-ConvLSTM), the MSE index decreased by 52 % , 50 % , 34 % and 45 % respectively. [ABSTRACT FROM AUTHOR]

This paper proposes applying a novel deep‐learning model, TBDLNet, to recognize CT images to classify multidrug‐resistant and drug‐sensitive tuberculosis automatically. The pre‐trained ResNet50 is selected to extract features. Three randomized neural networks are used to alleviate the overfitting problem. The ensemble of three RNNs is applied to boost the robustness via majority voting. The proposed model is evaluated by five‐fold cross‐validation. Five indexes are selected in this paper, which are accuracy, sensitivity, precision, F1‐score, and specificity. The TBDLNet achieves 0.9822 accuracy, 0.9815 specificity, 0.9823 precision, 0.9829 sensitivity, and 0.9826 F1‐score, respectively. The TBDLNet is suitable for classifying multidrug‐resistant tuberculosis and drug‐sensitive tuberculosis. It can detect multidrug‐resistant pulmonary tuberculosis as early as possible, which helps to adjust the treatment plan in time and improve the treatment effect. [ABSTRACT FROM AUTHOR]

Complex signals can be viewed as compositions of numerous sine waves with different frequencies and amplitudes. As the fundamental unit of perceiving image features, traditional Convolutional Neural Networks (CNNs) typically employ convolutional kernels without direct constraints. However, human perception of the world is inherently structured, relevant studies have indicated that considering the potential underlying correlation structures among data features or variables holds significant value, with particular emphasis on symmetric transformations in representation learning gaining attention in the field of neuroscience. Inspired by the process of human visual concept perception and classic image feature detection operators, when the convolution kernels have a similar scale to the objects, they produce larger responses. This paper introduces constraints on model parameters using centrosymmetric convolutional kernels. Under the influence of nonlinear combinations and local connections in neural networks, these kernels can diversely represent or perceive local image features. Experimental comparisons are conducted, and it is observed that the approach proposed in this paper not only enhances the convergence and accuracy of model, but also reduces the model solution space, resulting in an interpretable perception of local concepts. Furthermore, comparative experiments with classic deep CNNs have demonstrated comparable performance. [ABSTRACT FROM AUTHOR]

Currently, deep learning methods for low‐light image enhancement tasks mainly focus on the illumination of images, while neglecting the problems of image noise and feature loss. To address this issue, this paper proposes a novel low‐light image enhancement network called DAF‐Retinex, based on the Retinex‐Net. To address the issue of image noise, different from traditional image denoise methods, this paper utilizes a fully convolutional neural network to denoise the reflection component, additionally, a denoising loss function is introduced to suppress noise. For preserving image details and extracting features, this paper creatively introduces self‐calibrated convolutions into low‐light image enhancement tasks, furthermore, a feature augmented attention block consisting of feature‐guided attention (FGA) is designed for feature learning to effectively enhance image illumination and extract image detail features. Experimental results demonstrate that the proposed algorithm in this paper effectively removes image noise and extracts detailed features, resulting in visually improved outcomes. On public datasets, the average improvement in objective evaluation metrics of image quality such as PSNR, SSIM, and NIQE are 1.13%, 4.12%, and 1.28%, respectively. [ABSTRACT FROM AUTHOR]

The recognition of food images is of great significance for nutrition monitoring, food retrieval and food recommendation. However, the accuracy of recognition had not been high enough due to the complex background of food images and the characteristics of small inter-class differences and large intra-class differences. To solve these problems, this paper proposed a food image recognition method based on transfer learning and ensemble learning. Firstly, generic image features were extracted by using the convolutional neural network models (VGG19, ResNet50, MobileNet V2, AlexNet) pre-trained on the ImageNet dataset. Secondly, the 4 pre-trained models were transferred to the food image dataset for model fine-tuning. Finally, different basic learner combination strategies were adopted to establish the ensemble model and classify feature information. In this paper, several kinds of experiments were performed to compare the results of food image recognition between single models and ensemble models on food-11 dataset. The experimental results demonstrated that the accuracy of the ensemble model was the highest, reaching 96.88%, which was superior to any base learner. Therefore, the convolutional neural network model based on transfer learning and ensemble learning has strong learning ability and generalization ability, and it is feasible and practical to apply the method to food image recognition. [ABSTRACT FROM AUTHOR]

This document is a guest editorial from the journal IET Generation, Transmission & Distribution. It emphasizes the need to improve the reliability and resilience of modern power systems in the face of various threats. The editorial highlights the importance of modeling, assessing, and enhancing the reliability and resilience of power grids that are increasingly incorporating grid-edge resources. The document also provides a summary of the papers included in a special issue of the journal, which cover topics such as planning reliable energy systems, analyzing power grid operations, and enhancing service restoration and grid-support load response. Additionally, the text discusses the issue of equity in power distribution system restoration processes and proposes a model called the equity-aware power distribution system restoration model. The model aims to balance equity and resilience in restoring power after outages by focusing on fair distribution of energy resources while maintaining operational efficiency. The text also includes brief biographies of several authors who have contributed to the field of power electronics and power system reliability. [Extracted from the article]

This paper addresses the problem of real-time onboard routing for dynamic low earth orbit (LEO) satellite networks. It is difficult to apply general routing algorithms to dynamic LEO networks due to the frequent changes in satellite topology caused by the disconnection between moving satellites. Deep reinforcement learning (DRL) models trained by various dynamic networks can be considered. However, since the inference process with the DRL model requires too long a computation time due to multiple convolutional layer operations, it is not practical to apply to a real-time on-board computer (OBC) with limited computing resources. To solve the problem, this paper proposes a practical co-design method with heterogeneous processors to parallelize and accelerate a part of the multiple convolutional layer operations on a field-programmable gate array (FPGA). The proposed method was tested with a real heterogeneous processor-based OBC and showed that the proposed method was about 3.10 times faster than the conventional method while achieving the same routing results. [ABSTRACT FROM AUTHOR]

In this paper, a method based on transfer learning is proposed to recover the three-dimensional shape of cultural relics faces from a single old photo. It can simultaneously reconstruct the three-dimensional facial structure and align the texture of the cultural relics with fewer training samples. The UV position map is used to represent the three-dimensional shape in space and act as the output of the network. A convolutional neural network is used to reconstruct the UV position map from a single 2D image. In the training process, the human face data is used for pre-training, and then a small amount of artifact data is used for fine-tuning. A deep learning model with strong generalization ability is trained with fewer artifact data, and a three-dimensional model of the cultural relic face can be reconstructed from a single old photograph. The methods can train more complex deep networks without a large amount of cultural relic data, and no over-fitting phenomenon occurs, which effectively solves the problem of fewer cultural relic samples. The method is verified by restoring a Chinese Terracotta Warrior with facial cracks and a Buddha with a broken nose. Other applications can be used in the fields such as texture recovery, facial feature extraction, and three-dimensional model estimation of the damaged cultural relics or sculptures in the photos. [ABSTRACT FROM AUTHOR]

Because of the difficulty in fault detection for and diagnosing the adjustment hydraulic servomotor, this paper uses feature extraction technology to extract the time domain and frequency domain features of the pressure signal of the adjustment hydraulic servomotor and splice the features of multiple pressure signals through the Multi-source Information Fusion (MSIF) method. The comprehensive expression of device status information is obtained. After that, this paper proposes a fault detection Algorithm GA-SVDD-neg, which uses Genetic Algorithm (GA) to optimize Support Vector Data Description with negative examples (SVDD-neg). Through joint optimization with the Mutual Information (MI) feature selection algorithm, the features that are most sensitive to the state deterioration of the adjustment hydraulic servomotor are selected. Experiments show that the MI algorithm has a better performance than other feature dimensionality reduction algorithms in the field of the abnormal detection of adjustment hydraulic servomotors, and the GA-SVDD-neg algorithm has a stronger robustness and generality than other anomaly detection algorithms. In addition, to make full use of the advantages of deep learning in automatic feature extraction and classification, this paper realizes the fault diagnosis of the adjustment hydraulic servomotor based on 1D Convolutional Neural Network (1DCNN). The experimental results show that this algorithm has the same superior performance as the traditional algorithm in feature extraction and can accurately diagnose the known faults of the adjustment hydraulic servomotor. This research is of great significance for the intelligent transformation of adjustment hydraulic servomotors and can also provide a reference for the fault warning and diagnosis of the Electro-Hydraulic (EH) system of the same type of steam turbine. [ABSTRACT FROM AUTHOR]

Using the improved Johnson et al.'s style migration network as a starting point, this paper proposes a new loss function based on the position information Gram matrix. The new method adds the chunked Gram matrix with position information, and simultaneously, the structural similarity between the style map and the resultant image is added to the style training. The style position information is given to the resultant image, and finally, the resolution of the resultant image is improved with the SRGAN. The new model can effectively migrate the texture structure as well as the color space of the style image, while the data of the content image are kept intact. The simulation results reveal that the image processing results of the new model improve those of the classical Johnson et al.'s method, Google Brain team method, and CCPL method, and the SSIM values of the resulting map and style image are all greater than 0.3. As a comparison, the SSIM values of Johnson et al., Google Brain team, and CCPL are 0.14, 0.11, and 0.12, respectively, which is an obvious improvement. Moreover, with deeper training, the new method can improve the similarity of certain resulting images and style images to more than 0.37256. In addition, training other arbitrary content images on the basis of the trained model can quickly yield satisfactory results. [ABSTRACT FROM AUTHOR]

Background: Epilepsy is one of the most common serious chronic neurological disorders, which can have a serious negative impact on individuals, families and society, and even death. With the increasing application of machine learning techniques in medicine in recent years, the integration of machine learning with epilepsy has received close attention, and machine learning has the potential to provide reliable and optimal performance for clinical diagnosis, prediction, and precision medicine in epilepsy through the use of various types of mathematical algorithms, and promises to make better parallel advances. However, no bibliometric assessment has been conducted to evaluate the scientific progress in this area. Therefore, this study aims to visually analyze the trend of the current state of research related to the application of machine learning in epilepsy through bibliometrics and visualization. Methods: Relevant articles and reviews were searched for 2004-2023 using Web of Science Core Collection database, and bibliometric analyses and visualizations were performed in VOSviewer, CiteSpace, and Bibliometrix (R-Tool of R-Studio). Results: A total of 1,284 papers related to machine learning in epilepsy were retrieved from the Wo SCC database. The number of papers shows an increasing trend year by year. These papers were mainly from 1,957 organizations in 87 countries/regions, with the majority from the United States and China. The journal with the highest number of published papers is EPILEPSIA. Acharya, U. Rajendra (Ngee Ann Polytechnic, Singapore) is the authoritative author in the field and his paper "Deep Convolutional Neural Networks for Automated Detection and Diagnosis of Epileptic Seizures Using EEG Signals" was the most cited. Literature and keyword analysis shows that seizure prediction, epilepsy management and epilepsy neuroimaging are current research hotspots and developments. Conclusions: This study is the first to use bibliometric methods to visualize and analyze research in areas related to the application of machine learning in epilepsy, revealing research trends and frontiers in the field. This information will provide a useful reference for epilepsy researchers focusing on machine learning. [ABSTRACT FROM AUTHOR]

The rapid increase in the number of vehicles has led to increasing traffic congestion, traffic accidents, and motor vehicle crime rates. The management of various parking lots has also become increasingly challenging. Vehicle-type recognition technology can reduce the workload of humans in vehicle management operations. Therefore, the application of image technology for vehicle-type recognition is of great significance for integrated traffic management. In this paper, an improved faster region with convolutional neural network features (Faster R-CNN) model was proposed for vehicle-type recognition. Firstly, the output features of different convolution layers were combined to improve the recognition accuracy. Then, the average precision (AP) of the recognition model was improved through the contextual features of the original image and the object bounding box optimization strategy. Finally, the comparison experiment used the vehicle image dataset of three vehicle types, including cars, sports utility vehicles (SUVs), and vans. The experimental results show that the improved recognition model can effectively identify vehicle types in the images. The AP of the three vehicle types is 83.2%, 79.2%, and 78.4%, respectively, and the mean average precision (mAP) is 1.7% higher than that of the traditional Faster R-CNN model. [ABSTRACT FROM AUTHOR]

In the dynamic visual cabinet, the occurrence of motion blur when consumers take out commodities will reduce the accuracy of commodity detection. Recently, although Transformer-based video deblurring networks have achieved results compared to Convolutional Neural Networks in some blurring scenarios, they are still challenging for the non-uniform blurring problem that occurs when consumers pick up the commodities, such as the problem of difficult alignment of blurred video frames of small commodities and the problem of underutilizing the effective information between the video frames of commodities. Therefore, an improved Transformer video deblurring network is proposed. Firstly, a multi-scale Transformer feature extraction method is utilized for non-uniform blurring. Secondly, for the problem of difficult alignment of small-item-blurred video frames, a temporal interactive attention mechanism is designed for video frame alignment. Finally, a feature recurrent fusion mechanism is introduced to supplement the effective information of commodity features. The experimental results show that the proposed method has practical significance in improving the accuracy of commodity detection. Moreover, compared with the recent Transformer deblurring algorithm Video Restoration Transformer, the Peak Signal-to-Noise Ratio of this paper's algorithm is higher than that of the Deep Video Deblurring dataset and the Fuzzy Commodity Dataset by 0.23 dB and 0.81 dB, respectively. [ABSTRACT FROM AUTHOR]

In this paper, we utilize a machine learning model (the convolutional neural network) to analyze aerial images of winter hard red wheat planted areas and cloud coverage over the planted areas as a proxy for future yield forecasts. We trained our model to forecast the futures price 20 days ahead and provide recommendations for either a long or short position on wheat futures. Our method shows that achieving positive alpha within a short time window is possible if the algorithm and data choice are unique. However, the model's performance can deteriorate quickly if the input data become more easily available and/or the trading strategy becomes crowded, as was the case with the aerial imagery we utilized in this paper. [ABSTRACT FROM AUTHOR]

Since plant diseases occurring during the growth process are a significant factor leading to the decline in both yield and quality, the classification and detection of plant leaf diseases, followed by timely prevention and control measures, are crucial for safeguarding plant productivity and quality. As the traditional convolutional neural network structure cannot effectively recognize similar plant leaf diseases, in order to more accurately identify the diseases on plant leaves, this paper proposes an effective plant disease image recognition method aECA-ResNet34. This method is based on ResNet34, and in the first and the last layers of this network, respectively, we add this paper's improved aECAnet with the symmetric structure. aECA-ResNet34 is compared with different plant disease classification models on the peanut dataset constructed in this paper and the open-source PlantVillage dataset. The experimental results show that the aECA-ResNet34 model proposed in this paper has higher accuracy, better performance, and better robustness. The results show that the aECA-ResNet34 model proposed in this paper is able to recognize diseases of multiple plant leaves very accurately. [ABSTRACT FROM AUTHOR]

This document is a special issue of the journal Biomimetics, focusing on the design and control of bio-inspired robots. It explores various aspects of bionics in robotics, including robot design, perception, control, and decision-making, as well as incorporating neuroscience and brain science. The issue covers a wide range of topics, such as stiffness adjustment for continuum robots, biomimetic motor control, stroke rehabilitation, reinforcement learning for quadruped robots, improved spiking neural networks, energy-efficient image segmentation, kinematics analysis, synthetic nervous systems for robotic control, online running-gait generation, and bio-inspired perception and navigation for service robots. The document also discusses specific papers within the special issue that address challenges in robotic perception and navigation, legged robot control, and motion control of continuum robots and robotic arms. It concludes by announcing plans for a second special issue on related topics. [Extracted from the article]

This document is a special issue of the journal "Processes" focused on the application of power electronics technologies in power systems. It contains 15 articles divided into four sections: inverter, converter, control technique, and others. The articles cover topics such as optimal control of inverters, high-efficiency power converters, control methods for power electronics, and various applications of power electronics. The articles provide theoretical analysis, model derivation, actual measurement, and verification, making them valuable for research in this field. The authors express gratitude to all contributors and declare no conflicts of interest. [Extracted from the article]

Kidney diseases pose a significant global health challenge, requiring precise diagnostic tools to improve patient outcomes. This study addresses this need by investigating three main categories of renal diseases: kidney stones, cysts, and tumors. Utilizing a comprehensive dataset of 12,446 CT whole abdomen and urogram images, this study developed an advanced AI-driven diagnostic system specifically tailored for kidney disease classification. The innovative approach of this study combines the strengths of traditional convolutional neural network architecture (AlexNet) with modern advancements in ConvNeXt architectures. By integrating AlexNet's robust feature extraction capabilities with ConvNeXt's advanced attention mechanisms, the paper achieved an exceptional classification accuracy of 99.85%. A key advancement in this study's methodology lies in the strategic amalgamation of features from both networks. This paper concatenated hierarchical spatial information and incorporated self-attention mechanisms to enhance classification performance. Furthermore, the study introduced a custom optimization technique inspired by the Adam optimizer, which dynamically adjusts the step size based on gradient norms. This tailored optimizer facilitated faster convergence and more effective weight updates, imporving model performance. The model of this study demonstrated outstanding performance across various metrics, with an average precision of 99.89%, recall of 99.95%, and specificity of 99.83%. These results highlight the efficacy of the hybrid architecture and optimization strategy in accurately diagnosing kidney diseases. Additionally, the methodology of this paper emphasizes interpretability and explainability, which are crucial for the clinical deployment of deep learning models. [ABSTRACT FROM AUTHOR]

Personal credit assessment plays a crucial role in the financial system, which not only relates to the financial activities of individuals but also affects the overall credit system and economic health of society. However, the current problem of data imbalance affecting classification results in the field of personal credit assessment has not been fully solved. In order to solve this problem better, we propose a data-enhanced classification algorithm based on a Pixel Convolutional Neural Network (PixelCNN) and a Generative Adversarial Network (Wasserstein GAN, WGAN). Firstly, the historical data containing borrowers' borrowing information are transformed into grayscale maps; then, data enhancement of default images is performed using the improved PixelCNN-WGAN model; and finally, the expanded image dataset is inputted into the CNN, AlexNet, SqueezeNet, and MobileNetV2 for classification. The results on the real dataset LendingClub show that the data enhancement algorithm designed in this paper improves the accuracy of the four algorithms by 1.548–3.568% compared with the original dataset, which can effectively improve the classification effect of the credit data, and to a certain extent, it provides a new idea for the classification task in the field of personal credit assessment. [ABSTRACT FROM AUTHOR]

With the development of image feature matching technology, feature matching algorithms based on deep learning have achieved excellent results, but in scenarios with low texture or extreme perspective changes, the matching accuracy is still difficult to guarantee. In this paper, a superresolution reconstruction method based on a Residual-ESPCN (efficient subpixel convolutional neural network) approach is proposed based on LoFTR (local feature matching with transformers). The superresolution method is used to improve the interpolation method used in ASFF (adaptive spatial feature fusion) to increase the image resolution, enhance the detailed information of the image, and make the extracted features richer. Then, ASFF is introduced into the local feature extraction module of LoFTR, which can alleviate the inconsistency problem of information transmission between different scale features of the feature pyramid and lessen the amount of information lost during transmission from low- to high-resolution levels. Moreover, to improve the adaptability of the algorithm to different scenarios, OTSU is introduced to adaptively calculate the threshold of feature matching. The experimental results show that in different indoor or outdoor scenarios, our proposed algorithm for matching features can effectively improve the adaptability of feature matching and can achieve good results in terms of the area under the curve (AUC), accuracy and recall. [ABSTRACT FROM AUTHOR]

Many government institutions in developing countries such as the Kurdistan Region of Iraq (KRI) keep a variety of paper-based records that are available in printed or handwritten format. The need for technology that turns handwritten writing into digital text is therefore highly demanded. E-government in developed and developing countries is a crucial facilitator for the provision of such services. This paper aims to develop a deep learning model based on the mask region convolutional neural network (mask-RCNN) to effectively digitize kurdish handwritten text recognition (KHTR). In this research, typical datasets, which includes the isolated handwritten Central Kurdish character images, an extensive database of 40,410 images, and 390 native writers have been produced to determine the developed approach's performance in terms of identification rates. This approach achieves adequate outcomes in terms of training time and accuracy. The proposed model gives higher performance for detection, localization, and recognition when using a dataset containing many challenges, the results were 80%, 96%, and 87.6 for precision, recall, and F-score respectively. The findings revealed that the proposed model obtained better results compared to other similar works. The accuracy of optical character recognition (OCR) is more than 99%. [ABSTRACT FROM AUTHOR]

Traffic accident data‐based portrait plays a vital role in accident cause investigation, relationship reasoning, prevention, and control. The traffic accident data tend to be multisourced with increasingly hidden and complicated accident relationships. The existing reported research focus more on traffic drivers' measurement of penalty, the relationship among drivers, cars, and dates, etc. How to use multisource data based on deep learning, especially based on the Chinese recent unstructured data and structured data to establish accident portrait for individual and groups of accident drivers, still lacks. Moreover, how to perform multisource accident data label extraction, identity, and relationship extraction are still challenging problems. This paper proposes a multisource accident datasets‐driven deep learning‐based traffic accident portrait method. Our multisource accident datasets‐driven deep learning model is composed of the following three submodels: (1) the structured data accident model using our accident feature‐driven bidirectional long short‐term memory (Bi‐LSTM) and accident feature‐driven bidirectional conditional random field (Bi‐CRF) model to extract labels, (2) the unstructured traffic accident data model using our accident feature‐driven piecewise convolutional neural network (PCNN) model to identify the extracted labels, and (3) the semistructured traffic accident data processing model. Moreover, to solve the problem of how to construct hidden relationship among the multisource accident data, a multisource accident data visualization method based on traffic accident knowledge graph where the accident relational inference algorithm is to complete the hidden relationship between traffic accident data labels is used and then data are visualized using the traffic accident knowledge graph. This paper uses the NER dataset of the People's Daily and a manually labeled dataset to test the Bi‐LSTM + Bi‐CRF model, and it acquires the highest scores of 0.9562 and 0.9779 compared with several other models. This paper uses the DuIE dataset and a manually labeled dataset to test the PCNN model, and it acquires the highest scores of 0.9674 and 0.9108 compared with several other models. Experiments verified our model's merits than other models in regards to accident label extraction, accident identity identification, and accident relationship extraction. [ABSTRACT FROM AUTHOR]

Accurate power load forecasting can provide crucial insights for power system scheduling and energy planning. In this paper, to address the problem of low accuracy of power load prediction, we propose a method that combines secondary data cleaning and adaptive variational mode decomposition (VMD), convolutional neural networks (CNN), bi-directional long short-term memory (BILSTM), and adding attention mechanism (AM). The Inner Mongolia electricity load data were first cleaned use the K-means algorithm, and then further refined with the density-based spatial clustering of applications with the noise (DBSCAN) algorithm. Subsequently, the parameters of the VMD algorithm were optimized using a multi-strategy Cubic-T dung beetle optimization algorithm (CTDBO), after which the VMD algorithm was employed to decompose the twice-cleaned load sequences into a number of intrinsic mode functions (IMFs) with different frequencies. These IMFs were then used as inputs to the CNN-BILSTM-Attention model. In this model, a CNN is used for feature extraction, BILSTM for extracting information from the load sequence, and AM for assigning different weights to different features to optimize the prediction results. It is proved experimentally that the model proposed in this paper achieves the highest prediction accuracy and robustness compared to other models and exhibits high stability across different time periods. [ABSTRACT FROM AUTHOR]

Simple Summary: Accurate identification of individual Amur tigers is vital for their conservation, as it helps us understand their population and distribution. Existing identification methods often fall short in accuracy, and our study focuses on creating a more accurate method for identifying individual Amur tigers using advanced deep learning techniques. We improved an existing neural network model called InceptionResNetV2 by adding features like dropout layers and dual-attention mechanisms to better capture the unique stripe patterns of each tiger and reduce errors during training. We tested our model on a large dataset of tiger images and found it to be highly effective, achieving an average recognition accuracy of over 95% for different body parts, with left stripes reaching the highest 99.37%. This method significantly outperforms previous models and provides a reliable tool for wildlife researchers and conservationists to monitor and protect Amur tigers. By improving the ability to track individual tigers, our research offers practical benefits for preserving this endangered species and enhancing wildlife management practices globally. Accurate and intelligent identification of rare and endangered individuals of flagship wildlife species, such as Amur tiger (Panthera tigris altaica), is crucial for understanding population structure and distribution, thereby facilitating targeted conservation measures. However, many mathematical modeling methods, including deep learning models, often yield unsatisfactory results. This paper proposes an individual recognition method for Amur tigers based on an improved InceptionResNetV2 model. Initially, the YOLOv5 model is employed to automatically detect and segment facial, left stripe, and right stripe areas from images of 107 individual Amur tigers, achieving a high average classification accuracy of 97.3%. By introducing a dropout layer and a dual-attention mechanism, we enhance the InceptionResNetV2 model to better capture the stripe features of individual tigers at various granularities and reduce overfitting during training. Experimental results demonstrate that our model outperforms other classic models, offering optimal recognition accuracy and ideal loss changes. The average recognition accuracy for different body part features is 95.36%, with left stripes achieving a peak accuracy of 99.37%. These results highlight the model's excellent recognition capabilities. Our research provides a valuable and practical approach to the individual identification of rare and endangered animals, offering significant potential for improving conservation efforts. [ABSTRACT FROM AUTHOR]

Tool condition monitoring technology is an indispensable part of intelligent manufacturing. Most current research focuses on complex signal processing techniques or advanced deep learning algorithms to improve prediction performance without fully leveraging the end-to-end advantages of deep learning. The challenge lies in transforming multi-sensor raw data into input data suitable for direct model feeding, all while minimizing data scale and preserving sufficient temporal interpretation of tool wear. However, there is no clear reference standard for this so far. In light of this, this paper innovatively explores the processing methods that transform raw data into input data for deep learning models, a process known as an input paradigm. This paper introduces three new input paradigms: the downsampling paradigm, the periodic paradigm, and the subsequence paradigm. Then an improved hybrid model that combines a convolutional neural network (CNN) and bidirectional long short-term memory (BiLSTM) was employed to validate the model's performance. The subsequence paradigm demonstrated considerable superiority in prediction results based on the PHM2010 dataset, as the newly generated time series maintained the integrity of the raw data. Further investigation revealed that, with 120 subsequences and the temporal indicator being the maximum value, the model's mean absolute error (MAE) and root mean square error (RMSE) were the lowest after threefold cross-validation, outperforming several classical and contemporary methods. The methods explored in this paper provide references for designing input data for deep learning models, helping to enhance the end-to-end potential of deep learning models, and promoting the industrial deployment and practical application of tool condition monitoring systems. [ABSTRACT FROM AUTHOR]

This paper addresses the significant problem of identifying the relevant background and contextual literature related to deep learning (DL) as an evolving technology in order to provide a comprehensive analysis of the application of DL to the specific problem of pneumonia detection via chest X-ray (CXR) imaging, which is the most common and cost-effective imaging technique available worldwide for pneumonia diagnosis. This paper in particular addresses the key period associated with COVID-19, 2020–2023, to explain, analyze, and systematically evaluate the limitations of approaches and determine their relative levels of effectiveness. The context in which DL is applied as both an aid to and an automated substitute for existing expert radiography professionals, who often have limited availability, is elaborated in detail. The rationale for the undertaken research is provided, along with a justification of the resources adopted and their relevance. This explanatory text and the subsequent analyses are intended to provide sufficient detail of the problem being addressed, existing solutions, and the limitations of these, ranging in detail from the specific to the more general. Indeed, our analysis and evaluation agree with the generally held view that the use of transformers, specifically, vision transformers (ViTs), is the most promising technique for obtaining further effective results in the area of pneumonia detection using CXR images. However, ViTs require extensive further research to address several limitations, specifically the following: biased CXR datasets, data and code availability, the ease with which a model can be explained, systematic methods of accurate model comparison, the notion of class imbalance in CXR datasets, and the possibility of adversarial attacks, the latter of which remains an area of fundamental research. [ABSTRACT FROM AUTHOR]

The semiconductor industry is the core industry of the information age. As a key link in the semiconductor industry, wafer fabrication plays a key role in its development. In the testing stage of the wafer, each die of the wafer is detected and marked, and a wafer map with a certain spatial pattern can be formed. The analysis and classification of these spatial patterns can identify the cause of wafer defects, thereby improving production yield. However, as wafer size increases, line widths become smaller, etc., the probability of a mixed defect mode wafer pattern increases. Moreover, the mixed defect mode wafer map is more difficult to identify and classify than the single defect mode wafer map. Therefore, this paper proposes an improved deep convolutional neural network (DCNN) structure model for the recognition and classification of mixed defect pattern wafer maps. From the perspective of increasing the width of the DCNN, the improved network structure can avoid problems such as over-fitting and limited extraction of features due to the continuous deepening of the DCNN. The network is called Multi-Path DCNN (MP-DCNN) structure. The experimental results show that the proposed Multi-Path DCNN structure has better performance and higher classification accuracy than existing methods. [ABSTRACT FROM AUTHOR]

Computer vision in sports analytics is gaining in popularity. Monitoring players' performance using cameras is more flexible and does not interfere with player equipment compared to systems using sensors. This provides a wide set of opportunities for computer vision systems that help coaches, reporters, and audiences. This paper provides an introduction to the problem of measuring boxers' performance, with a comprehensive survey of approaches in current science. The main goal of the paper is to provide a system to automatically detect punches in Olympic boxing using a single static camera. The authors use Euclidean distance to measure the distance between boxers and convolutional neural networks to classify footage frames. In order to improve classification performance, we provide and test three approaches to manipulating the images prior to fitting the classifier. The proposed solution achieves 95% balanced accuracy, 49% F1 score for frames with punches, and 97% for frames without punches. Finally, we present a working system for analyses of a boxing scene that marks boxers and labelled frames with detected clashes and punches. [ABSTRACT FROM AUTHOR]

The maturity grading of walnuts during harvesting relies on experience. In this paper, walnut images in a natural environment were collected to construct a dataset, and deep learning algorithms were utilized to combine walnut internal physical and chemical indicators to carry out research on walnut maturity detection methods and further research on walnut oil content prediction by combining walnut images with walnut oil content indicators. The main contents of this paper include collecting walnut images in a natural environment, constructing datasets, and using deep learning algorithms combined with internal physical and chemical indexes of walnuts to study walnut maturity detection and oil content prediction methods. First, two walnut image acquisition schemes were designed, and a total of 9504 images were collected from 23 August to 21 September 2021. The dataset was expanded to 18,504 images through data preprocessing and image enhancement. A self-supervised Gaussian attention network (GATCluster) walnut ripeness detection method based on image clustering is proposed to develop ripeness criteria through unsupervised clustering, and the accuracy of the criteria is verified by analysis of variance (ANOVA). The maturity detection accuracy of the test set of 1500 images is 88.33%. Secondly, a walnut oil content prediction method based on improved ResNet34 is proposed. The feature extraction capability is improved by introducing the Squeeze-and-Excitation Networks (SENet) channel attention mechanism and the convolutional self-attention module. The prediction results on 50 images show that the root mean square error, average absolute percentage error, and regression coefficient are 2.96, 0.103, and 0.8822, respectively. The experiments show that the method performs well in predicting the oil content of walnuts at different maturity levels. [ABSTRACT FROM AUTHOR]

Hydraulic pumps are the core components that provide power for hydraulic transmission systems, which are widely used in aerospace, marine engineering, and mechanical engineering, and their failure affects the normal operation of the entire system. This paper takes a single axial piston pump as the research object and proposes a small-sample fault diagnosis method based on the model migration strategy for the situation in which only a small number of training samples are available for axial piston pump fault diagnosis. To achieve end-to-end fault diagnosis, a 1D Squeeze-and-Excitation Networks (1D-SENets) model was constructed based on a one-dimensional convolutional neural network and combined with the channel domain attention mechanism. The model was first pre-trained with sufficient labeled fault data from the source conditions, and then, based on the model migration strategy, some of the underlying network parameters were fixed, and a small amount of labeled fault data from the target conditions was used to fine-tune the rest of the parameters of the pre-trained model. In this paper, the proposed method was validated using an axial piston pump fault dataset, and the experimental results show that the method can effectively improve the overfitting problem in the small sample fault diagnosis of axial piston pumps and improve the recognition accuracy. [ABSTRACT FROM AUTHOR]

Self-interference (SI) represents a bottleneck in the performance of full-duplex (FD) communication systems, necessitating robust offsetting techniques to unlock the potential of FD systems. Currently, deep learning has been leveraged within the communication domain to address specific challenges and enhance efficiency. Inspired by this, this paper reviews the self-interference cancellation (SIC) process in the digital domain focusing on SIC capability. The paper introduces a model architecture that integrates CNN and gated recurrent unit (GRU), while also incorporating residual networks and self-attention mechanisms to enhance the identification and elimination of SI. This model is named CGRSA-Net. Firstly, CNN is employed to capture local signal features in the time–frequency domain. Subsequently, a ResNet module is introduced to mitigate the gradient vanishing problem. Concurrently, GRU is utilized to dynamically capture and retain both long- and short-term dependencies during the communication process. Lastly, by integrating the self-attention mechanism, attention weights are flexibly assigned when processing sequence data, thereby focusing on the most important parts of the input sequence. Experimental results demonstrate that the proposed CGRSA-Net model achieves a minimum of 28% improvement in nonlinear SIC capability compared to polynomial and existing neural network-based eliminator. Additionally, through ablation experiments, we demonstrate that the various modules utilized in this paper effectively learn signal features and further enhance SIC performance. [ABSTRACT FROM AUTHOR]

With the rapid advancement of digital technology, three-dimensional designs of Grid Information Models (GIMs) are increasingly applied in the power industry. Addressing the challenges of extracting key parameters during the GIM's process for power grid equipment, this paper explores an innovative approach that integrates artificial intelligence with image recognition technologies into power design engineering. The traditional methods of "template matching, feature extraction and classification, and symbol recognition" have enabled the automated processing of electrical grid equipment engineering drawings, allowing for the extraction of key information related to grid equipment. However, these methods still rely on manually designed and selected feature regions, which limits their potential for achieving full automation. This study introduces an optimized algorithm that combines enhanced Convolutional Neural Networks (CNNs) with Depth-First Search (DFS) strategies, and is specifically designed for the automated extraction of crucial GIM parameters from power grid equipment. Implemented on the design schematics of power engineering projects, this algorithm utilizes an improved CNN to precisely identify component symbols on schematics, and continues to extract text data associated with these symbols. Utilizing a scene text detector, the text data are matched with corresponding component symbols. Finally, the DFS strategy is applied to identify connections between these component symbols in the diagram, thus facilitating the automatic extraction of key GIM parameters. Experimental results demonstrate that this optimized algorithm can accurately identify basic GIM parameters, providing technical support for the automated extraction of parameters using the GIM. This study's recognition accuracy is 91.31%, while a traditional CNN achieves 71.23% and a Faster R-CNN achieves 89.59%. Compared to existing research, the main innovation of this paper lies in the application of the combined enhanced CNN and DFS strategies for the extraction of GIM parameters in the power industry. This method not only improves the accuracy of parameter extraction but also significantly enhances processing speed, enabling the rapid and effective identification and extraction of critical information in complex power design environments. Moreover, the automated process reduces manual intervention, offering a novel solution in the field of power design. These features make this research broadly applicable and of significant practical value in the construction and maintenance of smart grids. [ABSTRACT FROM AUTHOR]