Search

The pulp and paper industry is critical to global industrial and economic development. Recently, India's pulp and paper industries have been facing severe competitive challenges. The challenges have impaired the environmental performance and resulted in the closure of several operations. Assessment and prediction of the performance of the Indian pulp and paper industry using various parameters is a critical task for researchers. This study proposes a framework for performance assessment and prediction based on Data Envelopment Analysis (DEA), Artificial Neural Networks, and Deep Learning (DL) to assist industry administration and decision-making. We presented a case study based on eight industries to demonstrate the methodology's applicability. This study analyses and predicts industry performance based on sample data observations over 30 years. The result suggests the DEA-DL-based efficiency prediction has an overall MSE of 0.08 compared with the actual efficiency. Furthermore, the efficiency rankings are compared between the three techniques. The results suggest that the integrated DEA-DL method is primarily accurate in most scenarios with the actual values. The findings of this study provide a comprehensive analysis of environmental performance for policymakers. [ABSTRACT FROM AUTHOR]

Purpose: Paper-based artifacts hold significant cultural and social values. However, paper is intrinsically fragile to microorganisms, such as mold, due to its cellulose composition, which can serve as a microorganisms' nutrient source. Mold not only can damage papers' structural integrity and pose significant challenges to conservation works but also may subject individuals attending the contaminated artifacts to health risks. Current approaches for strain identification usually require extensive training, prolonged time for analysis, expensive operation costs, and higher risks of secondary damage due to sampling. Thus, in current conservation practices with mold-contaminated artifacts, little pre-screening or strain identification was performed before mold removal, and the cleaning techniques are usually broad-spectrum rather than strain-specific. With deep learning showing promising applications across various domains, this study investigated the feasibility of using a convolutional neural network (CNN) for fast in-situ recognition and classification of mold on paper. Methods: Molds were first non-invasively sampled from ancient Xuan Paper-based Chinese books from the Qing and Ming dynasties. Strains were identified using molecular biology methods and the four most prevalent strains were inoculated on Xuan paper to create mockups for image collection. Microscopic images of the molds as well as their stains situated on paper were collected using a compound microscope and commercial microscope lens for cell phone cameras, which were then used for training CNN models with a transfer learning scheme to perform the classification of mold. To enable involvement and contribution from the research community, a web interface that actuates the process while providing interactive features for users to learn about the information of the classified strain was constructed. Moreover, a feedback functionality in the web interface was embedded for catching potential classification errors, adding additional training images, or introducing new strains, all to refine the generalizability and robustness of the model. Results & Conclusion: In the study, we have constructed a suite of high-confidence classification CNN models for the diagnostic process for mold contamination in conservation. At the same time, a web interface was constructed that allows recurrently refining the model with human feedback through engaging the research community. Overall, the proposed framework opens new avenues for effective and timely identification of mold, thus enabling proactive and targeted mold remediation strategies in conservation. [ABSTRACT FROM AUTHOR]

Background: In low-middle income countries, healthcare providers primarily use paper health records for capturing data. Paper health records are utilized predominately due to the prohibitive cost of acquisition and maintenance of automated data capture devices and electronic medical records. Data recorded on paper health records is not easily accessible in a digital format to healthcare providers. The lack of real time accessible digital data limits healthcare providers, researchers, and quality improvement champions to leverage data to improve patient outcomes. In this project, we demonstrate the novel use of computer vision software to digitize handwritten intraoperative data elements from smartphone photographs of paper anesthesia charts from the University Teaching Hospital of Kigali. We specifically report our approach to digitize checkbox data, symbol-denoted systolic and diastolic blood pressure, and physiological data. Methods: We implemented approaches for removing perspective distortions from smartphone photographs, removing shadows, and improving image readability through morphological operations. YOLOv8 models were used to deconstruct the anesthesia paper chart into specific data sections. Handwritten blood pressure symbols and physiological data were identified, and values were assigned using deep neural networks. Our work builds upon the contributions of previous research by improving upon their methods, updating the deep learning models to newer architectures, as well as consolidating them into a single piece of software. Results: The model for extracting the sections of the anesthesia paper chart achieved an average box precision of 0.99, an average box recall of 0.99, and an mAP0.5-95 of 0.97. Our software digitizes checkbox data with greater than 99% accuracy and digitizes blood pressure data with a mean average error of 1.0 and 1.36 mmHg for systolic and diastolic blood pressure respectively. Overall accuracy for physiological data which includes oxygen saturation, inspired oxygen concentration and end tidal carbon dioxide concentration was 85.2%. Conclusions: We demonstrate that under normal photography conditions we can digitize checkbox, blood pressure and physiological data to within human accuracy when provided legible handwriting. Our contributions provide improved access to digital data to healthcare practitioners in low-middle income countries. [ABSTRACT FROM AUTHOR]

The research groups in computer vision, graphics, and machine learning have dedicated a substantial amount of attention to the areas of 3D object reconstruction, augmentation, and registration. Deep learning is the predominant method used in artificial intelligence for addressing computer vision challenges. However, deep learning on three-dimensional data presents distinct obstacles and is now in its nascent phase. There have been significant advancements in deep learning specifically for three-dimensional data, offering a range of ways to address these issues. This study offers a comprehensive examination of the latest advancements in deep learning methodologies. We examine many benchmark models for the tasks of 3D object registration, augmentation, and reconstruction. We thoroughly analyse their architectures, advantages, and constraints. In summary, this report provides a comprehensive overview of recent advancements in three-dimensional deep learning and highlights unresolved research areas that will need to be addressed in the future. [ABSTRACT FROM AUTHOR]

This document is a summary of a special issue of the journal Sensors, titled "Emerging AI+X-Based Sensor and Networking Technologies including Selected Papers from ICGHIT 2022–2023." The special issue features selected papers from the 10th and 11th International Conferences on Green and Human Information Technology (ICGHITs), which were held in Korea and Thailand. The conferences focused on the theme of "Emerging Artificial Intelligent (AI)+X technology" and "Hyper Automation + Human AI" respectively. The selected papers cover various topics such as network security, routing protocols, signal detection, and clustering mechanisms, all incorporating AI-based methods. The issue also includes papers on topics like secure authentication, distance estimation in RFID systems, energy optimization in smart homes, blockchain technology, and radar signal detection. The authors emphasize the importance of both technology and humanity in advancing green and information technologies. [Extracted from the article]

In the production of paper cups in industrial factories, it is tried to print high quality cups with less waste loss with the help of sensors and heating resistances mounted on the paper cup machine. In this study, a system that detects faulty products based on image processing and removes it by controlling the machine with servo motors, asynchronous motors and programmable logic controller (PLC) is designed. For fault product detection, classification has been performed using real-time Haarcascade algorithm and You Only Look Once (YOLO) algorithm which is a deep learning methods, and real-time object detection has been carried out using the OpenCv library. With this study, an effective faulty product detection and removing hardware system was realized by adapting artificial intelligence algorithms to a machine used in industry. Based on the results, a whole system can be applied to systems that involve removing a faulty product from a band in any production, packaging etc. facility is proposed. A hardware consisting of servo motors, asynchronous motors and PLC was designed to separate faulty cups from the existing paper cup production machine in this study. Then, a data set composed of 1068 images was created with images taken from the camera for faulty and faultless paper cups. Using this dataset, the effect of different deep learning methods on performance in the real-time system has been examined and successful results have been obtained. The optimal outcome was achieved, yielding a real-time application accuracy rate of 90.8% through the utilization of the Yolov5x architecture. [ABSTRACT FROM AUTHOR]

Agriculture holds a crucial position in maintaining livelihoods and securing food sources, particularly in nations such as Ethiopia, where a substantial portion of the population depends on agricultural pursuits. However, meeting the growing demand for food production amidst population growth presents considerable challenges. Recent advancements in technology, particularly in the areas of Machine Learning (ML), Deep Learning (DL), and the Internet of Things (IoT) offer promising solutions to address these challenges. This paper explores the potential of integrating ML, DL, and IoT technologies in agriculture to revolutionize the sector. By harnessing data-driven insights, farmers can make informed decisions regarding crop management, soil health, and weather patterns, leading to optimized resource allocation and increased productivity. Moreover, IoT devices enable the real-time monitoring and control of agricultural operations, enhancing sustainability and productivity. Despite the opportunities presented by these technologies, there are also challenges to overcome, such as data quality, connectivity issues, and the need for farmer education. However, with concerted efforts and investment, Ethiopia and other agricultural regions can unlock the full potential of ML, DL, and IoT technologies to ensure food security, alleviate poverty, and drive economic development. This review paper offers perspectives on the present status, challenges, and future possibilities regarding the integration of ML, DL, and IoT in agriculture. It underscores the transformative potential of these technologies within the sector. [ABSTRACT FROM AUTHOR]

This scientific paper explores the use of correlation coefficients of vibration signals and machine learning algorithms for structural damage assessment in beams under moving loads. The paper discusses the challenges of maintaining structural integrity and the importance of automated, nondestructive monitoring techniques. Preprocessing techniques, such as the random decrement technique (RDT), are highlighted for improving data analysis. Machine learning algorithms are identified as valuable tools for structural damage assessment. The paper concludes by emphasizing the potential of machine learning in safeguarding critical infrastructures. The text also discusses trigger points and the vibration response of a slender beam under a moving load. An artificial neural network (ANN) is proposed as a computational model for identifying non-linear features. Experimental testing on a simulated bridge girder using accelerometers collected data to identify and locate damage in the beam. The ANN achieved high accuracy in detecting damage appearance and location, but further research is needed to improve accuracy in real-world situations. [Extracted from the article]

In recent years, the exploration of knowledge in large-scale human mobility has gained significant attention. In order to achieve a semantic understanding of human behavior and uncover patterns in large-scale human mobility, Named Entity Recognition (NER) is a crucial technology. The rapid advancements in IoT and CPS technologies have led to the collection of massive human mobility data from various sources. Therefore, there's a need for Cross-domain NER which can transfer entity information from the source domain to automatically identify and classify entities in different target domain texts. In the situation of the data-poor, how could we transfer human mobility knowledge over time and space is particularly significant, therefore this paper proposes an Adaptive Text Sequence Enhancement Module (at-SAM) to help the model enhance the association between entities in sentences in the data-poor target domains. This paper also proposes a Predicted Label-Guided Dual Sequence Aware Information Module (Dual-SAM) to improve the transferability of label information. Experiments were conducted in domains that contain hidden knowledge about human mobility, the results show that this method can transfer task knowledge between multiple different domains in the data-poor scenarios and achieve SOTA performance. [ABSTRACT FROM AUTHOR]

The identification of damage to concrete bridge surfaces is of great significance to maintaining the durability and reliability of bridges. However, it is difficult to identify small areas of damage, especially in high-resolution images. To conduct damage identification research in a targeted manner, this paper proposes a method of multidamage identification in high-resolution images based on You Only Look Once version 5 (YOLOv5). In this paper, a data set labeled with four types of damage (crack, spallation, hole, and rebar) is used for training, validation, and testing. To ensure that the network adequately learns the damage features, the high-resolution images are cropped into subimages via the autoadaptive window cropping method (AWCM) proposed in this paper. The cropping method can crop images according to the label information and protect the damage features from destruction during the cropping process. To avoid overfitting, it is necessary to balance the volume of different types of damage. After balancing, the count for each category is as follows: crack (4,980), spallation (5,225), hole (5,211) and rebar (5,020). The balanced data set can be used to train the deep learning network and construct the multidamage identification model. After identification, the subimages, and the prediction boxes of damages in them are restored to their original high-resolution images. The results show that the mean average precision (mAP) of all classes is 94.2%, and the values for cracks, spallation, holes, and rebars are 86.9%, 98.1%, 92.3%, and 99.4%, respectively, which indicates that the proposed method outperforms the other three methods (inputting original images directly, the sliding window cropping method, and the random centroid cropping method). [ABSTRACT FROM AUTHOR]

Accurate identification of structural displacements is important for structural state assessment and performance evaluation. This paper proposes a real-time structural displacement detection model based on computer vision and deep learning. The model consists of three stages: identification, tracking, and displacement resolution. First, the displacement target is identified and tracked by the improved YOLO v7 algorithm and the improved DeepSORT algorithm. Then, the Euclidean distance method based on inverse perspective mapping (IPM-ED) is proposed for the analytical conversion of the displacement. Next, the accuracy and effectiveness of this displacement detection model are evaluated through four groups of bamboo axial compression tests. A comparative analysis is conducted between the IPM-ED displacement analysis method and the commonly used ED displacement analysis method. Finally, the robustness of this method is tested by using a cable breakage test of a cable dome structure as an application case. The research results demonstrate that the maximum average error of the four groups of bamboo displacement tests is only 3.10 mm, and the maximum relative error of peak displacement is only 6.54 mm. The RMSE basically stays around 3.5 mm. The maximum displacement error in the application case is only 4.91 mm, with a maximum MAPE of 4.94%. In addition, the error percentage under the IPM-ED algorithm is basically within 5%, while the error percentage of the ED algorithm is more than 10%. The method in this paper achieves efficient and intelligent identification of structural displacements in a non-contact manner. The proposed method is suitable for environments where the contact displacement sensor is easily affected by vibration, the site is complex and requires additional displacement sensor fixing equipment, the displacement sensor with super-high structure is unsafe to deploy, and the contact displacement sensor in narrow space is inconvenient to deploy, so it has broad application prospects. [ABSTRACT FROM AUTHOR]

This paper proposes a Generalized Multilevel B-spline Approximation (GMBA) method, which addresses scattered data interpolation problems in image processing. Mathematically, the GMBA provides a better solution for the B-spline control lattice by superimposing identical level B-splines compared with traditional Multilevel B-spline Approximation (MBA). Specifically, the GMBA allows the spacing of next control lattice to be subdivided arbitrarily or remained unchanged, which is determined by a predefined spacing set or the current error level. These improvements bring higher approximation accuracy and more flexibility for algorithm design to avoid over-fitting. In this paper, basic GMBA algorithm and its refined algorithm are compiled for image processing. Finally, six relevant cases are involved to test the GMBA, including surface approximation, image enlargement, image completion, and Salt-and-Pepper (SAP) noise removal. The experimental results show that the GMBA has better performance than the MBA in surface approximation and image processing, performs comparatively fast with the best performance on more than half of the standard test images compared with traditional algorithms, and has partially better performance even than deep learning algorithms. The GMBA can effectively recover meaningful details in images contaminated with even extremely high SAP noise level (up to 99%). • We give a generalized multilevel B-spline approximation (GMBA) method. • GMBA allows the control spacing to be subdivided arbitrarily or remained unchanged. • GMBA offers higher approximation accuracy and greater flexibility than traditional MBA. • GMBA provides superior performance and less run time than many of the state-of-the-art methods for SAP noise removal. • GMBA can recovery meaningful detail at noise levels as high as 99% for SAP noise removal. [ABSTRACT FROM AUTHOR]

Deep Neural Networks (DNNs) have revolutionized various fields through their ability to model complex patterns, yet their performance critically hinges on the availability of large-scale, accurately labeled datasets. The costly and time-consuming process of creating such datasets has motivated research into Learning with Noisy Labels (LNL), which aims to reduce reliance on perfect labels. This paper introduces CoFix, an innovative LNL framework that integrates sample selection with semi-supervised learning techniques to address the challenge of noisy labels in training. CoFix employs a Gaussian Mixture Model (GMM) to dynamically segment the training data into clean and noisy subsets, leveraging semi-supervised learning approaches on both. Inspired by the FixMatch algorithm, CoFix refines consistent regularization and pseudo-labeling strategies, enhancing augmentation strategies and temperature sharpening techniques. Additionally, CoFix explores label smoothing to augment the loss function, further refining model performance. Our experiments demonstrate CoFix's superiority over state-of-the-art methods, achieving significant improvements in fewer training epochs, particularly in lower noise scenarios. The robustness and versatility of CoFix are evident through its consistent performance across various benchmark datasets and noise levels. The contributions of this paper include a novel LNL method with enhanced generalization capability, an investigation into the impact of label smoothing on the loss function, and extensive testing that confirms CoFix's efficiency and adaptability to different noise levels. [ABSTRACT FROM AUTHOR]

The fast warning for financial risk of enterprises has always been a realistic demand for their managers. Currently, this mainly relies on expert experience to make comprehensive analysis from massive business data. Benefitting from the strong computational performance of deep learning, this paper proposes a fuzzy neural network (FNN)-based intelligent warning method for financial risk of enterprises. An improved FNN structure with time-varying coefficients and time-varying time lags is established to extract features of enterprises from complex financial context. The algorithm of fuzzy C-means and fuzzy clustering based on sample data are studied. In this paper, the fuzzy C-means algorithm is used to cluster the samples, the input sample set is preprocessed, a new set of learning samples is formed, and then the neural network is trained. The enterprise financial risk sample and its modular FNN model are established, and the evaluation of the enterprise financial risk sample is simulated. Then, a decision part is added following the FNN part to output the warning results. After that, we have also conducted a case study as simulation experiments to evaluate the proposed technical framework. The obtained results show that it can perform well in the fast warning of financial risk for enterprises. [ABSTRACT FROM AUTHOR]

This paper proposes a novel multi-view ensemble predictor model that is designed to address the challenge of determining synergistic drug combinations by predicting both the synergy score value values and synergy class label of drug combinations with cancer cell lines. The proposed methodology involves representing drug features through four distinct views: Simplified Molecular-Input Line-Entry System (SMILES) features, molecular graph features, fingerprint features, and drug-target features. On the other hand, cell line features are captured through four views: gene expression features, copy number features, mutation features, and proteomics features. To prevent overfitting of the model, two techniques are employed. First, each view feature of a drug is paired with each corresponding cell line view and input into a multi-task attention deep learning model. This multi-task model is trained to simultaneously predict both the synergy score value and synergy class label. This process results in sixteen input view features being fed into the multi-task model, producing sixteen prediction values. Subsequently, these prediction values are utilized as inputs for an ensemble model, which outputs the final prediction value. The 'MVME' model is assessed using the O'Neil dataset, which includes 38 distinct drugs combined across 39 distinct cancer cell lines to output 22,737 drug combination pairs. For the synergy score value, the proposed model scores a mean square error (MSE) of 206.57, a root mean square error (RMSE) of 14.30, and a Pearson score of 0.76. For the synergy class label, the model scores 0.90 for accuracy, 0.96 for precision, 0.57 for kappa, 0.96 for the area under the ROC curve (ROC-AUC), and 0.88 for the area under the precision-recall curve (PR-AUC). Scientific contribution: This paper presents an enhanced synergistic drug combination model by utilizing four different feature views for drugs and four views for cancer cell lines. Each view is then input into a multi-task deep learning model to predict both the synergy score and class label simultaneously. To address the challenge of managing diverse views and their corresponding prediction values while avoiding overfitting, an ensemble model is applied. [ABSTRACT FROM AUTHOR]

Purpose: Recent papers suggested a correlation between the risk of distant metastasis (DM) and dose outside the PTV, though conclusions in different publications conflicted. This study resolves these conflicts and provides a compelling explanation of prognostic factors. Materials and methods: A dataset of 478 NSCLC patients treated with SBRT (IMRT or VMAT) was analyzed. We developed a deep learning model for DM prediction and explainable AI was used to identify the most significant prognostic factors. Subsequently, the prognostic power of the extracted features and clinical details were analyzed using conventional statistical methods. Results: Treatment technique, tumor features, and dosiomic features in a 3 cm wide ring around the PTV (PTV3cm) were identified as the strongest predictors of DM. The Hazard Ratio (HR) for Dmean,PTV3cm was significantly above 1 (p < 0.001). There was no significance of the PTV3cm dose after treatment technique stratification. However, the dose in PTV3cm was found to be a highly significant DM predictor (HR > 1, p = 0.004) when analyzing only VMAT patients with small and spherical tumors (i.e., sphericity > 0.5). Conclusions: The main reason for conflicting conclusions in previous papers was inconsistent datasets and insufficient consideration of confounding variables. No causal correlation between the risk of DM and dose outside the PTV was found. However, the mean dose to PTV3cm can be a significant predictor of DM in small spherical targets treated with VMAT, which might clinically imply considering larger PTV margins for smaller, more spherical tumors (e.g., if IGTV > 2 cm, then margin ≤ 7 mm, else margin > 7 mm). [ABSTRACT FROM AUTHOR]

Simple Summary: Through gesture recognition and detection of sika deer, farmers can observe the gestures of sika deer without physical contact, providing data and technical support for the intelligent and welfare-oriented breeding of sika deer. This study is based on the YOLOv8 network model. By optimizing the convolution module, incorporating the attention mechanism, and enhancing the detection head module, a new method for detecting sika deer poses was developed. The method was assessed using four behavioral datasets, which included standing, lying, eating, and attacking. The pose-recognition accuracy of sika deer significantly improved to an average of 91.6%, laying a foundation for the health assessment and information management of sika deer. As the sika deer breeding industry flourishes on a large scale, accurately assessing the health of these animals is of paramount importance. Implementing posture recognition through target detection serves as a vital method for monitoring the well-being of sika deer. This approach allows for a more nuanced understanding of their physical condition, ensuring the industry can maintain high standards of animal welfare and productivity. In order to achieve remote monitoring of sika deer without interfering with the natural behavior of the animals, and to enhance animal welfare, this paper proposes a sika deer individual posture recognition detection algorithm GFI-YOLOv8 based on YOLOv8. Firstly, this paper proposes to add the iAFF iterative attention feature fusion module to the C2f of the backbone network module, replace the original SPPF module with AIFI module, and use the attention mechanism to adjust the feature channel adaptively. This aims to enhance granularity, improve the model's recognition, and enhance understanding of sika deer behavior in complex scenes. Secondly, a novel convolutional neural network module is introduced to improve the efficiency and accuracy of feature extraction, while preserving the model's depth and diversity. In addition, a new attention mechanism module is proposed to expand the receptive field and simplify the model. Furthermore, a new pyramid network and an optimized detection head module are presented to improve the recognition and interpretation of sika deer postures in intricate environments. The experimental results demonstrate that the model achieves 91.6% accuracy in recognizing the posture of sika deer, with a 6% improvement in accuracy and a 4.6% increase in mAP50 compared to YOLOv8n. Compared to other models in the YOLO series, such as YOLOv5n, YOLOv7-tiny, YOLOv8n, YOLOv8s, YOLOv9, and YOLOv10, this model exhibits higher accuracy, and improved mAP50 and mAP50-95 values. The overall performance is commendable, meeting the requirements for accurate and rapid identification of the posture of sika deer. This model proves beneficial for the precise and real-time monitoring of sika deer posture in complex breeding environments and under all-weather conditions. [ABSTRACT FROM AUTHOR]

Monitoring aircraft using synthetic aperture radar (SAR) images is a very important task. Given its coherent imaging characteristics, there is a large amount of speckle interference in the image. This phenomenon leads to the scattering information of aircraft targets being masked in SAR images, which is easily confused with background scattering points. Therefore, automatic detection of aircraft targets in SAR images remains a challenging task. For this task, this paper proposes a framework for speckle reduction preprocessing of SAR images, followed by the use of an improved deep learning method to detect aircraft in SAR images. Firstly, to improve the problem of introducing artifacts or excessive smoothing in speckle reduction using total variation (TV) methods, this paper proposes a new nonconvex total variation (NTV) method. This method aims to ensure the effectiveness of speckle reduction while preserving the original scattering information as much as possible. Next, we present a framework for aircraft detection based on You Only Look Once v8 (YOLOv8) for SAR images. Therefore, the complete framework is called SAR-NTV-YOLOv8. Meanwhile, a high-resolution small target feature head is proposed to mitigate the impact of scale changes and loss of depth feature details on detection accuracy. Then, an efficient multi-scale attention module was proposed, aimed at effectively establishing short-term and long-term dependencies between feature grouping and multi-scale structures. In addition, the progressive feature pyramid network was chosen to avoid information loss or degradation in multi-level transmission during the bottom-up feature extraction process in Backbone. Sufficient comparative experiments, speckle reduction experiments, and ablation experiments are conducted on the SAR-Aircraft-1.0 and SADD datasets. The results have demonstrated the effectiveness of SAR-NTV-YOLOv8, which has the most advanced performance compared to other mainstream algorithms. [ABSTRACT FROM AUTHOR]

Rapid advancements in satellite technology have led to a significant increase in high-resolution remote sensing (RS) images, necessitating the use of advanced processing methods. Additionally, patent analysis revealed a substantial increase in deep learning and machine learning applications in remote sensing, highlighting the growing importance of these technologies. Therefore, this paper introduces the Kolmogorov-Arnold Network (KAN) model to remote sensing to enhance efficiency and performance in RS applications. We conducted several experiments to validate KAN's applicability, starting with the EuroSAT dataset, where we combined the KAN layer with multiple pre-trained CNN models. Optimal performance was achieved using ConvNeXt, leading to the development of the KonvNeXt model. KonvNeXt was evaluated on the Optimal-31, AID, and Merced datasets for validation and achieved accuracies of 90.59%, 94.1%, and 98.1%, respectively. The model also showed fast processing speed, with the Optimal-31 and Merced datasets completed in 107.63 s each, while the bigger and more complicated AID dataset took 545.91 s. This result is meaningful since it achieved faster speeds and comparable accuracy compared to the existing study, which utilized VIT and proved KonvNeXt's applicability for remote sensing classification tasks. Furthermore, we investigated the model's interpretability by utilizing Occlusion Sensitivity, and by displaying the influential regions, we validated its potential use in a variety of domains, including medical imaging and weather forecasting. This paper is meaningful in that it is the first to use KAN in remote sensing classification, proving its adaptability and efficiency. [ABSTRACT FROM AUTHOR]

Acoustic emission (AE) technology, as a non-destructive testing methodology, is extensively utilized to monitor various materials' structural integrity. However, AE signals captured during experimental processes are often tainted with assorted noise factors that degrade the signal clarity and integrity, complicating precise analytical evaluations of the experimental outcomes. In response to these challenges, this paper introduces an unsupervised deep learning-based denoising model tailored for AE signals. It juxtaposes its efficacy against established methods, such as wavelet packet denoising, Hilbert transform denoising, and complete ensemble empirical mode decomposition with adaptive noise denoising. The results demonstrate that the unsupervised skip autoencoder model exhibits substantial potential in noise reduction, marking a significant advancement in AE signal processing. Subsequently, the paper focuses on applying this advanced denoising technique to AE signals collected during the tensile testing of steel fiber-reinforced concrete (SFRC), the tensile testing of steel, and flexural experiments of reinforced concrete beam, and it meticulously discusses the variations in the waveform and the spectrogram of the original signal and the signal after noise reduction. The results show that the model can also remove the noise of AE signals. [ABSTRACT FROM AUTHOR]

Non-destructive testing (NDT) techniques play a crucial role in industrial production, aerospace, healthcare, and the inspection of special equipment, serving as an indispensable part of assessing the safety condition of pressure equipment. Among these, the analysis of NDT data stands as a critical link in evaluating equipment safety. In recent years, object detection techniques have gradually been applied to the analysis of NDT data in pressure equipment inspection, yielding significant results. This paper comprehensively reviews the current applications and development trends of object detection algorithms in NDT technology for pressure-bearing equipment, focusing on algorithm selection, data augmentation, and intelligent defect recognition based on object detection algorithms. Additionally, it explores open research challenges of integrating GAN-based data augmentation and unsupervised learning to further enhance the intelligent application and performance of object detection technology in NDT for pressure-bearing equipment while discussing techniques and methods to improve the interpretability of deep learning models. Finally, by summarizing current research and offering insights for future directions, this paper aims to provide researchers and engineers with a comprehensive perspective to advance the application and development of object detection technology in NDT for pressure-bearing equipment. [ABSTRACT FROM AUTHOR]

Defect detection constitutes one of the most crucial processes in industrial production. With a continuous increase in the number of defect categories and samples, the defect detection model underpinned by deep learning finds it challenging to expand to new categories, and the accuracy and real-time performance of product defect detection are also confronted with severe challenges. This paper addresses the problem of insufficient detection accuracy of existing lightweight models on resource-constrained edge devices by presenting a new lightweight YoloV5 model, which integrates four modules, SCDown, GhostConv, RepNCSPELAN4, and ScalSeq. Here, this paper abbreviates it as SGRS-YoloV5n. Through the incorporation of these modules, the model notably enhances feature extraction and computational efficiency while reducing the model size and computational load, making it more conducive for deployment on edge devices. Furthermore, a cloud-edge collaborative defect detection system is constructed to improve detection accuracy and efficiency through initial detection by edge devices, followed by additional inspection by cloud servers. An incremental learning mechanism is also introduced, enabling the model to adapt promptly to new defect categories and update its parameters accordingly. Experimental results reveal that the SGRS-YoloV5n model exhibits superior detection accuracy and real-time performance, validating its value and stability for deployment in resource-constrained environments. This system presents a novel solution for achieving efficient and accurate real-time defect detection. [ABSTRACT FROM AUTHOR]

The identification of gas leakages is a significant factor to be taken into consideration in various industries such as coal mines, chemical industries, etc., as well as in residential applications. In order to reduce damage to the environment as well as human lives, early detection and gas type identification are necessary. The main focus of this paper is multimodal gas data that were obtained simultaneously by using multiple sensors for gas detection and a thermal imaging camera. As the reliability and sensitivity of low-cost sensors are less, they are not suitable for gas detection over long distances. In order to overcome the drawbacks of relying just on sensors to identify gases, a thermal camera capable of detecting temperature changes is also used in the collection of the current multimodal dataset The multimodal dataset comprises 6400 samples, including smoke, perfume, a combination of both, and neutral environments. In this paper, convolutional neural networks (CNNs) are trained on thermal image data, utilizing variants such as bidirectional long–short-term memory (Bi-LSTM), dense LSTM, and a fusion of both datasets to effectively classify comma separated value (CSV) data from gas sensors. The dataset can be used as a valuable source for research scholars and system developers to improvise their artificial intelligence (AI) models used for gas leakage detection. Furthermore, in order to ensure the privacy of the client's data, this paper explores the implementation of federated learning for privacy-protected gas leakage classification, demonstrating comparable accuracy to traditional deep learning approaches. [ABSTRACT FROM AUTHOR]

Blockchain technology has unlocked the doors of building decentralized applications, where security plays a vital role. Any transaction ever created in a blockchain is recorded permanently. With the increasing usage of social media modalities today, many non-reputable sources create and publish fake and luring news. Due to the easy availability of the internet and excessive use of social media, fake news can spread like a flash. It causes the need to eliminate fake news posted on social media platforms. The main motive of the paper is to develop an ensemble model that assists in the automated identification of fake news. This paper addresses the identified gaps in detecting multi-modal fake news. We propose Fake News Network (FNNet) as a novel secure blockchain-based deep learning model to detect fake news. It uses blockchain and deep learning to assure data integrity and learn data representations, respectively. The proposed model consists of four layers: the node layer, the deep learning layer, the blockchain layer, and the network layer. This is an ensemble deep-learning model that leverages Bi-LSTM and CNN models, where the Bi-LSTM model captures the sequential data in both directions, and CNN captures the hidden features. We use Pheme, CrisisLexT6, and ISOT datasets to train the model. FNNet achieves an average accuracy of 86.93%, 92.22%, and 98.53% on Pheme, CrisisLexT9, and ISOT datasets, respectively. Our results show that the proposed model is robust and applicable to real-time datasets and social media networks to detect fake news effectively. [ABSTRACT FROM AUTHOR]

With the development of mobile edge computing and neural network Deep Learning (DL), more and more scholars are studying the combination of the two. This paper mainly studies the application of mobile edge computing and neural network DL in IoT computing collaboration and data-aware routing algorithms. Therefore, this paper proposes the deployment options of MEC technology and ETSIMEC in mobile edge computing, combining mobile edge computing with DL, designs an optimization algorithm based on Markov decision process and feature expression learning, and then analyzes and optimizes IoT computing and VANET routing algorithm. In order to have a clearer direction for the optimization algorithm, this paper also designs the edge computing model training and experiment comparison, the DL algorithm comparison experiment, and the routing algorithm simulation experiment and performance analysis. Combined with the experimental results, it is optimized and compared with traditional IoT computing and routing algorithms. Finally, it is concluded that the computing efficiency of IoT computing based on edge computing and DL designed in this paper is 21.33% higher than that of traditional IoT computing. The efficiency of the routing algorithm based on edge computing and DL designed in this paper is 9.29% higher than that of the traditional routing algorithm. [ABSTRACT FROM AUTHOR]

Accurate and timely forecasting of critical components is pivotal in intelligent transportation systems and traffic management, crucially mitigating congestion and enhancing safety. This paper aims to comprehensively review deep learning algorithms and classical models employed in traffic forecasting. Spanning diverse traffic datasets, the study encompasses various scenarios, offering a nuanced understanding of traffic forecasting methods. Reviewing 111 seminal research works since the 1980s, encompassing both deep learning and classical models, the paper begins by detailing the data sources utilized in transportation systems. Subsequently, it delves into the theoretical underpinnings of prevalent deep learning algorithms and classical models prevalent in traffic forecasting. Furthermore, it investigates the application of these algorithms and models in forecasting key traffic characteristics, informed by their utility in transport and traffic analyses. Finally, the study elucidates the merits and drawbacks of proposed models through applied research in traffic forecasting. Findings indicate that while deep learning algorithms and classic models serve as valuable tools, their suitability varies across contexts, necessitating careful consideration in future studies. The study underscores research opportunities in road traffic forecasting, providing a comprehensive guide for future endeavors in this domain. [ABSTRACT FROM AUTHOR]

With the acceleration of urbanization, subway construction has become a key part of urban development. However, shield construction often needs to cross existing railway lines, which requires accurate prediction of ground surface settlement of railway operation facilities to ensure railway safety and smooth construction. The existing Internet of Things (IOT) ground surface settlement prediction mainly relies on deep learning algorithms, but these algorithms are often difficult to take into account the extraction of local features and the capture of global features when processing long time sequence data, resulting in the prediction effect is affected when processing long-term dependent ground surface settlement data. In order to solve the above problems, this paper proposes a ground surface settlement prediction method based on T-BiGRU Mask Multi-Head Self-Attention Informer (TM-Informer). First, T-BiGRU is introduced into the model to effectively cover a wide range of time scales and extract the local feature of the settlement sequence data. Second, Mask Multi-Head Self-Attention (MMSA) is used to effectively solve the long-term dependence problem in long time sequence settlement data prediction and enhance the global feature capture ability of the model. In this paper, TM-Informer is compared with Informer, Transformer and LSTM by four evaluation indexes MSE, MAE, RMSE and MAPE. The experimental results show that the MSE, MAE, RMSE and MAPE of TM-Informer are 0.301, 0.432, 0.548 and 2.617, respectively, which are 0.08, 0.04, 0.06 and 0.26 higher than those of Informer, which proves the effectiveness of TM-Informer in railway ground surface settlement monitoring. [ABSTRACT FROM AUTHOR]

In pediatric rehabilitation medicine, manual assessment methods for visual–motor integration result in inconsistent scoring standards. To address these issues, incorporating artificial intelligence (AI) technology is a feasible approach that can reduce time and improve accuracy. Existing research on visual–motor integration scoring has proposed a framework based on convolutional neural networks (CNNs) for the Beery–Buktenica developmental test of visual–motor integration. However, as the number of training questions increases, the accuracy of this framework significantly decreases. This paper proposes a new architecture to reduce the number of features, channels, and overall model complexity. The architectureoptimizes input features by concatenating question numbers with answer features and selecting appropriate channel ratios and optimizes the output vector by designing the task as a multi-class classification. This paper also proposes a model named improved DenseNet. After experimentation, DenseNet201 was identified as the most suitable pre-trained model for this task and was used as the backbone architecture for improved DenseNet. Additionally, new fully connected layers were added for feature extraction and classification, allowing for specialized feature learning. The architecture can provide reasons for unscored results based on prediction results and decoding rules, offering directions for children's training. The final experimental results show that the proposed new architecture improves the accuracy of scoring 6 question graphics by 12.8% and 12 question graphics by 20.14% compared to the most relevant literature. The accuracy of the proposed new architecture surpasses the model frameworks of the most relevant literature, demonstrating the effectiveness of this approach in improving scoring accuracy and stability. [ABSTRACT FROM AUTHOR]

Traffic prediction is crucial for transportation management and user convenience. With the rapid development of deep learning techniques, numerous models have emerged for traffic prediction. Recurrent Neural Networks (RNNs) are extensively utilized as representative predictive models in this domain. This paper comprehensively reviews RNN applications in traffic prediction, focusing on their significance and challenges. The review begins by discussing the evolution of traffic prediction methods and summarizing state-of-the-art techniques. It then delves into the unique characteristics of traffic data, outlines common forms of input representations in traffic prediction, and generalizes an abstract description of traffic prediction problems. Then, the paper systematically categorizes models based on RNN structures designed for traffic prediction. Moreover, it provides a comprehensive overview of seven sub-categories of applications of deep learning models based on RNN in traffic prediction. Finally, the review compares RNNs with other state-of-the-art methods and highlights the challenges RNNs face in traffic prediction. This review is expected to offer significant reference value for comprehensively understanding the various applications of RNNs and common state-of-the-art models in traffic prediction. By discussing the strengths and weaknesses of these models and proposing strategies to address the challenges faced by RNNs, it aims to provide scholars with insights for designing better traffic prediction models. [ABSTRACT FROM AUTHOR]

In orthopedics, bone drilling is a crucial part of a surgical method commonly carried out for internal fixation in bone fracture treatment. The primary purpose of bone drilling is the creation of holes for screw insertion to immobilize fractured parts. The bone drilling task depends on the orthopedist and surgeon's high level of skill and experience. This paper aimed to provide a summary of previously published review studies in the field of bone drilling. This review paper also presents a comprehensive review of the application of machine learning for bone drilling and as a future direction for automation systems. This review can also help medical surgeons and bone drillers understand the latest improvements through parameter selection and optimization strategies to reduce bone damage in bone drilling procedures. Apart from the review, bone drilling vibration data collected in a university laboratory experiment is also presented in this study. The vibration data consist of three different layers of femur cow bone, which are processed and classified using several deep learning (DL) methods such as long short-term memory (LSTM), convolutional neural network (CNN), and recurrent neural network (RNN). These DL methods are used in the bone drilling lab case study to prove that the layers of bone drilling are associated with the vibration signal and that they can be classified and predicted using DL methods. The result shows that LSTM is outperformed by CNN and RNN. [ABSTRACT FROM AUTHOR]

Lung screening is really crucial in the early detection and management of masses, with particular regard to cancer. Studies have shown that lung cancer screening, can reduce lung cancer mortality by 20–30% in high-risk populations. In recent times, the advent of deep learning, with particular regard to computer vision, demonstrated the ability to effectively detect and locate objects from video streams and also (medical) images. Considering these aspects, in this paper, we propose a method aimed to perform instance segmentation, i.e., by providing a mask for each lung mass instance detected, allowing for the identification of individual masses even if they overlap or are close to each other by classifying the detected masses into (generic) nodules, cancer or adenocarcinoma. In this paper, we considered the you-only-look-once model for lung nodule segmentation. An experimental analysis, performed on a set of real-world lung computed tomography images, demonstrated the effectiveness of the proposed method not only in the detection of lung masses but also in lung mass segmentation, thus providing a helpful way not only for radiologist to conduct automatic lung screening but also for discovering very small masses not easily recognizable to the naked eye and that may deserve attention. As a matter of fact, in the evaluation of a dataset composed of 3654 lung scans, the proposed method obtains an average precision of 0.757 and an average recall of 0.738 in the classification task. Additionally, it reaches an average mask precision of 0.75 and an average mask recall of 0.733. These results indicate that the proposed method is capable of not only classifying masses as nodules, cancer, and adenocarcinoma, but also effectively segmenting the areas, thereby performing instance segmentation. [ABSTRACT FROM AUTHOR]

B-mode ultrasound has emerged as a prevalent tool for observing tongue motion in speech production, gaining traction in speech therapy applications. However, the effective analysis of ultrasound tongue image frame sequences (UTIFs) encounters many challenges, such as the presence of high levels of speckle noise and obscured views. Recently, the application of machine learning, especially deep learning techniques, to UTIF interpretation has shown promise in overcoming these hurdles. This paper presents a thorough examination of the existing literature, focusing on UTIF analysis. The scope of our work encompasses four key areas: a foundational introduction to deep learning principles, an exploration of motion tracking methodologies, a discussion of feature extraction techniques, and an examination of cross-modality mapping. The paper concludes with a detailed discussion of insights gleaned from the comprehensive literature review, outlining potential trends and challenges that lie ahead in the field. [ABSTRACT FROM AUTHOR]

3D spatial perception is the problem of building and maintaining an actionable and persistent representation of the environment in real-time using sensor data and prior knowledge. Despite the fast-paced progress in robot perception, most existing methods either build purely geometric maps (as in traditional SLAM) or "flat" metric-semantic maps that do not scale to large environments or large dictionaries of semantic labels. The first part of this paper is concerned with representations: we show that scalable representations for spatial perception need to be hierarchical in nature. Hierarchical representations are efficient to store, and lead to layered graphs with small treewidth, which enable provably efficient inference. We then introduce an example of hierarchical representation for indoor environments, namely a 3D scene graph, and discuss its structure and properties. The second part of the paper focuses on algorithms to incrementally construct a 3D scene graph as the robot explores the environment. Our algorithms combine 3D geometry (e.g., to cluster the free space into a graph of places), topology (to cluster the places into rooms), and geometric deep learning (e.g., to classify the type of rooms the robot is moving across). The third part of the paper focuses on algorithms to maintain and correct 3D scene graphs during long-term operation. We propose hierarchical descriptors for loop closure detection and describe how to correct a scene graph in response to loop closures, by solving a 3D scene graph optimization problem. We conclude the paper by combining the proposed perception algorithms into Hydra, a real-time spatial perception system that builds a 3D scene graph from visual-inertial data in real-time. We showcase Hydra's performance in photo-realistic simulations and real data collected by a Clearpath Jackal robots and a Unitree A1 robot. We release an open-source implementation of Hydra at https://github.com/MIT-SPARK/Hydra. [ABSTRACT FROM AUTHOR]

Although deep learning (DL) algorithms have been proved to be effective in diverse research domains, their application in developing models for tabular data remains limited. Models trained on tabular data demonstrate higher efficacy using traditional machine learning models than DL models, which are largely attributed to the size and structure of tabular datasets and the specific application contexts in which they are utilized. Thus, the primary objective of this paper is to propose a method to use the supremacy of Stacked Bidirectional LSTM (Long Short-Term Memory) deep learning algorithms in pattern discovery incorporating tabular data with customized 3D tensor modeling in feeding neural networks. Our findings are empirically validated using six diverse, publicly available datasets each varying in size and learning objectives. This paper proves that the proposed model based on time-sequence DL algorithms, which were generally described as inadequate when dealing with tabular data, yields satisfactory results and competes effectively with other algorithms specifically designed for tabular data. An additional benefit of this approach is its ability to preserve simplicity while ensuring fast model training also with large datasets. Even with extremely small datasets, models can be applied to achieve exceptional predictive results and fully utilize their capacity. [ABSTRACT FROM AUTHOR]

Predicting the strength of promoters and guiding their directed evolution is a crucial task in synthetic biology. This approach significantly reduces the experimental costs in conventional promoter engineering. Previous studies employing machine learning or deep learning methods have shown some success in this task, but their outcomes were not satisfactory enough, primarily due to the neglect of evolutionary information. In this paper, we introduce the Chaos-Attention net for Promoter Evolution (CAPE) to address the limitations of existing methods. We comprehensively extract evolutionary information within promoters using merged chaos game representation and process the overall information with modified DenseNet and Transformer structures. Our model achieves state-of-the-art results on two kinds of distinct tasks related to prokaryotic promoter strength prediction. The incorporation of evolutionary information enhances the model's accuracy, with transfer learning further extending its adaptability. Furthermore, experimental results confirm CAPE's efficacy in simulating in silico directed evolution of promoters, marking a significant advancement in predictive modeling for prokaryotic promoter strength. Our paper also presents a user-friendly website for the practical implementation of in silico directed evolution on promoters. The source code implemented in this study and the instructions on accessing the website can be found in our GitHub repository https://github.com/BobYHY/CAPE. [ABSTRACT FROM AUTHOR]

In this paper, we propose a representation of the visual information about Multiplayer Online Battle Arena (MOBA) video games using an adapted unsupervised deep learning architecture called Convolutional Accordion Auto-Encoder (Conv_A2E). Our study includes a presentation of current representations of MOBA video game information and why our proposal offers a novel and useful solution to this task. This approach aims to achieve dimensional reduction and refined feature extraction of the visual data. To enhance the model's performance, we tested several attention mechanisms for computer vision, evaluating algorithms from the channel attention and spatial attention families, and their combination. Through experimentation, we found that the best reconstruction of the visual information with the Conv_A2E was achieved when using a spatial attention mechanism, deformable convolution, as its mean squared error (MSE) during testing was the lowest, reaching a value of 0.003893, which means that its dimensional reduction is the most generalist and representative for this case study. This paper presents one of the first approaches to applying attention mechanisms to the case study of MOBA video games, representing a new horizon of possibilities for research. [ABSTRACT FROM AUTHOR]

In order to address the challenge of the small-scale, small-target, and complex scenes often encountered in offshore remote sensing image datasets, this paper employs an interpolation method to achieve super-resolution-assisted target detection. This approach aligns with the logic of popular GANs and generative diffusion networks in terms of super-resolution but is more lightweight. Additionally, the image count is expanded fivefold by supplementing the dataset with DOTA and data augmentation techniques. Framework-wise, based on the Faster R-CNN model, the combination of a residual backbone network and pyramid balancing structure enables our model to adapt to the characteristics of small-target scenarios. Moreover, the attention mechanism, random anchor re-selection strategy, and the strategy of replacing quantization operations with bilinear interpolation further enhance the model's detection capability at a low cost. Ablation experiments and comparative experiments show that, with a simple backbone, the algorithm in this paper achieves a mAP of 71.2% on the dataset, an improvement in accuracy of about 10% compared to the Faster R-CNN algorithm. [ABSTRACT FROM AUTHOR]

This paper proposes a deep learning-based intelligent detection device for insulation pull rod defects, addressing the issues of low detection accuracy, poor timeliness of intelligent analysis, and the difficulty in preserving detection results. Firstly, by constructing the pull rod defects dataset and training the YOLOv5s network, along with commonly used object detection algorithms in industrial defect detection, the feasibility of deep learning networks for insulation pull rod defects detection is explored. Secondly, the trained model is combined to build an intelligent detection device for pull rod defects, integrating insulation pull rod image acquisition and defect detection into a unified system. The research results demonstrate that the YOLOv5s network can quickly and accurately detect pull rod defects. On the test set constructed in this paper, the detection performance metric mAP@0.5:0.95 of the trained model reached 54.7%. Specifically, the mAP@0.5 score was 86.9% at a threshold of 0.5. The detection speed FPS reached 169.5, significantly improving the detection efficiency and accuracy compared to traditional object detection algorithms. By establishing an organic connection between the image hardware acquisition device and the deep learning network, the existing problems of inefficient detection and difficult storage of detection results in pull rod defects detection methods are effectively addressed. This research provides new insights for detecting insulation pull rod defects. [ABSTRACT FROM AUTHOR]

Advances in deep learning and computer vision techniques have made impacts in the field of remote sensing, enabling efficient data analysis for applications such as land cover classification and change detection. Convolutional neural networks (CNNs) and transformer architectures have been utilized in visual perception algorithms due to their effectiveness in analyzing local features and global context. In this paper, we propose a hybrid transformer architecture that consists of a CNN-based encoder and transformer-based decoder. We propose a feature adjustment module that refines the multiscale feature maps extracted from an EfficientNet backbone network. The adjusted feature maps are integrated into the transformer-based decoder to perform the semantic segmentation of the remote sensing images. This paper refers to the proposed encoder–decoder architecture as a semantic feature adjustment network (SFA-Net). To demonstrate the effectiveness of the SFA-Net, experiments were thoroughly conducted with four public benchmark datasets, including the UAVid, ISPRS Potsdam, ISPRS Vaihingen, and LoveDA datasets. The proposed model achieved state-of-the-art accuracy on the UAVid, ISPRS Vaihingen, and LoveDA datasets for the segmentation of the remote sensing images. On the ISPRS Potsdam dataset, our method achieved comparable accuracy to the latest model while reducing the number of trainable parameters from 113.8 M to 10.7 M. [ABSTRACT FROM AUTHOR]

Simple Summary: In the process of large-scale cage chicken breeding, using inspection robots instead of manual detection can solve the problems of large workload and low detection efficiency. However, poor driving stability of an inspection robot will lead to low inspection accuracy. In order to ensure high efficiency, accuracy, and stability of detection, this study takes the stability of visual navigation for inspection robots as the optimization goal, and designs an efficient and accurate road extraction algorithm and a navigation line fitting algorithm with better robustness. The experimental results show that the algorithm proposed in this study can improve the stability of detection, achieve a faster running speed, and achieve a better detection effect and a higher detection efficiency while keeping the detection effect unchanged. The navigation algorithm can accelerate the automation process of large-scale cage chicken breeding and promote the realization of fast and accurate monitoring. The speed and accuracy of navigation road extraction and driving stability affect the inspection accuracy of cage chicken coop inspection robots. In this paper, a new grayscale factor (4B-3R-2G) was proposed to achieve fast and accurate road extraction, and a navigation line fitting algorithm based on the road boundary features was proposed to improve the stability of the algorithm. The proposed grayscale factor achieved 92.918% segmentation accuracy, and the speed was six times faster than the deep learning model. The experimental results showed that at the speed of 0.348 m/s, the maximum deviation of the visual navigation was 4 cm, the average deviation was 1.561 cm, the maximum acceleration was 1.122 m/s2, and the average acceleration was 0.292 m/s2, with the detection number and accuracy increased by 21.125% and 1.228%, respectively. Compared with inertial navigation, visual navigation can significantly improve the navigation accuracy and stability of the inspection robot and lead to better inspection effects. The visual navigation system proposed in this paper has better driving stability, higher inspection efficiency, better inspection effect, and lower operating costs, which is of great significance to promote the automation process of large-scale cage chicken breeding and realize rapid and accurate monitoring. [ABSTRACT FROM AUTHOR]

Simple Summary: Through the non-destructive recognition and tracking algorithm of multi-objective behaviors of beef cattle, practitioners are able to obtain beef cattle feeding information in an all-round way, which lays the foundation for intelligent farming. This study is based on the deep learning recognition algorithm YOLOv8 and tracking algorithm Deep SORT. Through optimizing the convolution module, introducing the attention mechanism, improving the re-identification network, and the trajectory generation and matching process, a new method for the non-destructive identification and tracking of multi-target behaviors of beef cattle is constructed. The average accuracy of nine behaviors can be up to 96.5%, and the accuracy of multi-target tracking is up to 92.1%, which can provide technical support for beef cattle management. The method proposed in this paper provides theoretical and practical support for the intelligent recognition and management of beef cattle. Accurate identification and tracking of beef cattle behaviors are essential components of beef cattle production management. Traditional beef cattle identification and tracking methods are time-consuming and labor-intensive, which hinders precise cattle farming. This paper utilizes deep learning algorithms to achieve the identification and tracking of multi-object behaviors in beef cattle, as follows: (1) The beef cattle behavior detection module is based on the YOLOv8n algorithm. Initially, a dynamic snake convolution module is introduced to enhance the ability to extract key features of beef cattle behaviors and expand the model's receptive field. Subsequently, the BiFormer attention mechanism is incorporated to integrate high-level and low-level feature information, dynamically and sparsely learning the behavioral features of beef cattle. The improved YOLOv8n_BiF_DSC algorithm achieves an identification accuracy of 93.6% for nine behaviors, including standing, lying, mounting, fighting, licking, eating, drinking, working, and searching, with average 50 and 50:95 precisions of 96.5% and 71.5%, showing an improvement of 5.3%, 5.2%, and 7.1% over the original YOLOv8n. (2) The beef cattle multi-object tracking module is based on the Deep SORT algorithm. Initially, the detector is replaced with YOLOv8n_BiF_DSC to enhance detection accuracy. Subsequently, the re-identification network model is switched to ResNet18 to enhance the tracking algorithm's capability to gather appearance information. Finally, the trajectory generation and matching process of the Deep SORT algorithm is optimized with secondary IOU matching to reduce ID mismatching errors during tracking. Experimentation with five different complexity levels of test video sequences shows improvements in IDF1, IDS, MOTA, and MOTP, among other metrics, with IDS reduced by 65.8% and MOTA increased by 2%. These enhancements address issues of tracking omission and misidentification in sparse and long-range dense environments, thereby facilitating better tracking of group-raised beef cattle and laying a foundation for intelligent detection and tracking in beef cattle farming. [ABSTRACT FROM AUTHOR]

As the foundation of circuits and electronic systems, the quality of printed circuit boards (PCBs) is directly related to the reliability of the whole system. At present, deep learning-based target detection technology has a broad application prospect in PCB defect detection. However, there are still some shortcomings in the process of detection. For example, the detection speed is slow, and the detection accuracy is not ideal for defects with small size. Therefore, this paper proposes an improved algorithm based on the YOLOv5s model to improve the detection of PCB defects. The algorithm enhances the connection between the shallow and high layers of the network by improving the backbone network structure. Meanwhile, a self-attention mechanism is introduced into YoloHead to enhance the feature extraction and the ability to focus on the global information of the feature map, and the self-attention mechanism is optimized by combining the computational characteristics of the SENet, the CBAM and the residual unit. While improving the accuracy of PCB defect detection, better computational efficiency is ensured. In subsequent experiments, this paper trains and tests the improved YOLOv5s algorithm using publicly available PCB defect datasets. The results show that the algorithm achieves a detection rate of 39.7 frames per second and a maximum average precision of 96.14%, which is a 4.68% improvement over the original YOLOv5s. [ABSTRACT FROM AUTHOR]

This paper introduces a sophisticated approach to network security, with a primary emphasis on utilizing deep learning for intrusion detection. In real-world scenarios, the high dimensionality of training data poses challenges for simple deep learning models and can lead to vanishing gradient issues with complex neural networks. Additionally, uploading network traffic data to a central server for training raises privacy concerns. To tackle these issues, the paper introduces a Residual Network (ResNet)-based deep learning model trained using a federated learning approach. The ResNet effectively tackles the vanishing gradient problem, while federated learning enables multiple Internet Service Providers (ISPs) or clients to engage in joint training without sharing their data with third parties. This approach enhances accuracy through collaborative learning while maintaining privacy. Experimental results on the X-IIoTID dataset indicate that the proposed model outperforms conventional deep learning and machine learning methods in terms of accuracy and other metrics used for evaluation. Specifically, the proposed methodology achieved 99.43% accuracy in a centralized environment and 99.16% accuracy in a federated environment. [ABSTRACT FROM AUTHOR]

Network‐wide short‐term passenger flow prediction is critical for the operation and management of metro systems. However, it is challenging due to the inherent non‐stationarity, nonlinearity, and spatial–temporal dependencies within passenger flow. To tackle these challenges, this paper introduces a hybrid model called multi‐scale dynamic propagation spatial–temporal network (MSDPSTN). Specifically, the model employs multivariate empirical mode decomposition to jointly decompose the multivariate passenger flow into multi‐scale intrinsic mode functions. Then, a set of dynamic graphs is developed to reveal the passenger propagation law in metro networks. Based on the representation, a deep learning model is proposed to achieve multistep passenger flow prediction, which employs the dynamic propagation graph attention network with long short‐term memory to extract the spatial–temporal dependencies. Extensive experiments conducted on a real‐world dataset from Chengdu, China, validate the superiority of the proposed model. Compared to state‐of‐the‐art baselines, MSDPSTN reduces the mean absolute error, root mean squared error, and mean absolute percentage error by at least 3.243%, 4.451%, and 4.139%, respectively. Further quantitative analyses confirm the effectiveness of the components in MSDPSTN. This paper contributes to addressing inherent features of passenger flow to enhance prediction performance, offering critical insights for decision‐makers in implementing real‐time operational strategies. [ABSTRACT FROM AUTHOR]

Medical image segmentation through the use of deep learning is becoming a trend targeting to automate disease detection and provide effective treatment. Traditionally huge manual efforts are associated with medical image processing by medical staff. The wide use of neural networks driven by the progressive advancement in computing power and the availability of training data provides instrumental means to automate medical image processing. A polyp refers to an abnormal growth that can occur in various parts of the body. While the majority of polyps are noncancerous or benign, there are instances where certain types can develop into cancer. Detecting and segmenting polyps is highly valuable for identifying early signs and potentially enabling more effective treatment of colon cancer. In this paper, we introduce a novel method for segmenting polyp images. The proposed method utilizes convolutional neural networks (CNNs) and employs an enhanced attention mechanism. To cater to a more granular attention view, this paper enhances the Convolutional Block Attention Module by introducing the multi‐focal channel attention (MFCA) concept, which we call MFCA. In the proposed MFCA channel attention, focal attention spots allow us to consider scattered areas of interest more effectively. To evaluate the effectiveness of the proposed method, multiple experiments are conducted on five well‐known benchmark datasets for polyp image segmentation: Kvasir, CVC‐Clinic DB, CVC‐Colon DB, CVC‐T, and ETIS‐Larib. Various testing scenarios are examined, including the impact of two focal attention spots and four focal attention spots. The experimental results demonstrated that the proposed method achieved superior performance compared to previous state‐of‐the‐art techniques on two of the benchmark datasets, and ranked second on a third dataset. [ABSTRACT FROM AUTHOR]

In recent years, advancements in computer vision (CV) and machine learning (ML) have facilitated significant progress in the field of plant disease prediction and detection. The growing danger to worldwide food security because of plant diseases necessitates the development of accurate and efficient methods for early disease identification. This paper provides an extensive overview of the current landscape of plant disease prediction using plant images, focusing on datasets, models, and potential future directions. Initially, publicly available datasets that comprise annotated images of healthy and diseased plants, enabling researchers to develop and evaluate predictive models are analyzed. These datasets, encompassing a wide range of crops and diseases, serve as crucial resources for training and benchmarking various algorithms. Also, explore both traditional and modern approaches, including expert systems, ML, and deep learning (DL) algorithms. Model architectures, transfer learning strategies, and ensemble techniques are discussed in terms of their effectiveness in disease classification and localization. This paper also addresses the challenges faced in plant disease prediction, such as data scarcity, model robustness, and scalability. Provide a rendition of the present state of research and identify potential avenues for future exploration, this paper aims to contribute to the advancement of plant disease prediction methods, fostering more resilient and productive agricultural practices. [ABSTRACT FROM AUTHOR]

Due to the harsh working environments of certain bridges, the bridge structural health monitoring systems (SHMs) are prone to error warning because of anomaly data. Therefore, it is of great significance to accurately classify and locate the anomaly data for effectively addressing these issues. This paper proposes a method for classifying and locating anomaly data utilizing one-dimensional monitoring data based on convolutional neural networks. Compared to previous research reliant on visual features, the proposed method has lower computational costs. By incorporating the anomaly data localization network, manual localization operations for data restoration are replaced. The analysis in this paper is based on monitoring data from a large-span cable-stayed bridge, along with artificially generated anomaly data. The two neural network frameworks proposed in this paper are trained and validated, showcasing precise classification and localization of anomaly data. Furthermore, the paper discusses the impact of common errors in labeling data categories and locating training samples in practical operations. The results demonstrate that even in the presence of noticeable yet non-extreme labeling errors in the training set, the proposed method still achieves accurate classification and localization, highlighting its robustness. [ABSTRACT FROM AUTHOR]

Traffic accident data‐based portrait plays a vital role in accident cause investigation, relationship reasoning, prevention, and control. The traffic accident data tend to be multisourced with increasingly hidden and complicated accident relationships. The existing reported research focus more on traffic drivers' measurement of penalty, the relationship among drivers, cars, and dates, etc. How to use multisource data based on deep learning, especially based on the Chinese recent unstructured data and structured data to establish accident portrait for individual and groups of accident drivers, still lacks. Moreover, how to perform multisource accident data label extraction, identity, and relationship extraction are still challenging problems. This paper proposes a multisource accident datasets‐driven deep learning‐based traffic accident portrait method. Our multisource accident datasets‐driven deep learning model is composed of the following three submodels: (1) the structured data accident model using our accident feature‐driven bidirectional long short‐term memory (Bi‐LSTM) and accident feature‐driven bidirectional conditional random field (Bi‐CRF) model to extract labels, (2) the unstructured traffic accident data model using our accident feature‐driven piecewise convolutional neural network (PCNN) model to identify the extracted labels, and (3) the semistructured traffic accident data processing model. Moreover, to solve the problem of how to construct hidden relationship among the multisource accident data, a multisource accident data visualization method based on traffic accident knowledge graph where the accident relational inference algorithm is to complete the hidden relationship between traffic accident data labels is used and then data are visualized using the traffic accident knowledge graph. This paper uses the NER dataset of the People's Daily and a manually labeled dataset to test the Bi‐LSTM + Bi‐CRF model, and it acquires the highest scores of 0.9562 and 0.9779 compared with several other models. This paper uses the DuIE dataset and a manually labeled dataset to test the PCNN model, and it acquires the highest scores of 0.9674 and 0.9108 compared with several other models. Experiments verified our model's merits than other models in regards to accident label extraction, accident identity identification, and accident relationship extraction. [ABSTRACT FROM AUTHOR]

Optic disc (OD) and optic cup (OC) segmentation is an important task in ophthalmic medicine and is crucial for aiding glaucoma screening. With the development of smart healthcare and the increase of large datasets, there is an increasing number of research efforts targeting OD and OC segmentation, making it particularly important to provide a systematic review of the latest advances in the field. This paper presents a systematic review of commonly used datasets, evaluation metrics, and related research results in the field of OD and OC segmentation. The advantages and disadvantages of segmentation techniques based on traditional and deep learning methods are comparatively analysed. In addition, this study emphasizes the importance of OD and OC segmentation efforts in smart healthcare. Despite the technological advances, the lack of generalization capability is still a major obstacle limiting its clinical application. To address this issue, this study explores unsupervised domain adaptation methods to enhance the generalization performance of segmentation techniques and provide new strategies for clinical diagnosis. Finally, this paper discusses the challenges and future research directions faced by OD and OC segmentation when applied in the medical field to help readers comprehensively grasp the research dynamics in this area. [ABSTRACT FROM AUTHOR]

Building extraction aims to extract building pixels from remote sensing imagery, which plays a significant role in urban planning, dynamic urban monitoring, and many other applications. UNet3+ is widely applied in building extraction from remote sensing images. However, it still faces issues such as low segmentation accuracy, imprecise boundary delineation, and the complexity of network models. Therefore, based on the UNet3+ model, this paper proposes a 3D Joint Attention (3DJA) module that effectively enhances the correlation between local and global features, obtaining more accurate object semantic information and enhancing feature representation. The 3DJA module models semantic interdependence in the vertical and horizontal dimensions to obtain feature map spatial encoding information, as well as in the channel dimensions to increase the correlation between dependent channel graphs. In addition, a bottleneck module is constructed to reduce the number of network parameters and improve model training efficiency. Many experiments are conducted on publicly accessible WHU,INRIA and Massachusetts building dataset, and the benchmarks, BOMSC-Net, CVNet, SCA-Net, SPCL-Net, ACMFNet, MFCF-Net models are selected for comparison with the 3DJA-UNet3+ model proposed in this paper. The experimental results show that 3DJA-UNet3+ achieves competitive results in three evaluation indicators: overall accuracy, mean intersection over union, and F1-score. The code will be available at https://github.com/EnjiLi/3DJA-UNet3Plus. [ABSTRACT FROM AUTHOR]