Search

With the continuous growth of the global population and the increasing demand for crop yield, enhancing crop productivity has emerged as a crucial research objective on a global scale. Weeds, being one of the primary abiotic factors impacting crop yield, contribute to approximately 13.2% of annual food loss. In recent years, Unmanned Aerial Vehicle (UAV) technology has developed rapidly and its maturity has led to widespread utilization in improving crop productivity and reducing management costs. Concurrently, deep learning technology has become a prominent tool in image recognition. Convolutional Neural Networks (CNNs) has achieved remarkable outcomes in various domains, including agriculture, such as weed detection, pest identification, plant/fruit counting, maturity grading, etc. This study provides an overview of the development of UAV platforms, the classification of UAV platforms and their advantages and disadvantages, as well as the types and characteristics of data collected by common vision sensors used in agriculture, and discusses the application of deep learning technology in weed detection. The manuscript presents current advancements in UAV technology and CNNs in weed management tasks while emphasizing the existing limitations and future trends in its development process to assist researchers working on applying deep learning techniques to weed management. [ABSTRACT FROM AUTHOR]

Deep learning (DL) algorithms used for DOTATATE PET lesion detection typically require large, well-annotated training datasets. These are difficult to obtain due to low incidence of gastroenteropancreatic neuroendocrine tumors (GEP-NETs) and the high cost of manual annotation. Furthermore, networks trained and tested with data acquired from site specific PET/CT instrumentation, acquisition and processing protocols have reduced performance when tested with offsite data. This lack of generalizability requires even larger, more diverse training datasets. The objective of this study is to investigate the feasibility of improving DL algorithm performance by better matching the background noise in training datasets to higher noise, out-of-domain testing datasets. 68Ga-DOTATATE PET/CT datasets were obtained from two scanners: Scanner1, a state-of-the-art digital PET/CT (GE DMI PET/CT; n = 83 subjects), and Scanner2, an older-generation analog PET/CT (GE STE; n = 123 subjects). Set1, the data set from Scanner1, was reconstructed with standard clinical parameters (5 min; Q.Clear) and list-mode reconstructions (VPFXS 2, 3, 4, and 5-min). Set2, data from Scanner2 representing out-of-domain clinical scans, used standard iterative reconstruction (5 min; OSEM). A deep neural network was trained with each dataset: Network1 for Scanner1 and Network2 for Scanner2. DL performance (Network1) was tested with out-of-domain test data (Set2). To evaluate the effect of training sample size, we tested DL model performance using a fraction (25%, 50% and 75%) of Set1 for training. Scanner1, list-mode 2-min reconstructed data demonstrated the most similar noise level compared that of Set2, resulting in the best performance (F1 = 0.713). This was not significantly different compared to the highest performance, upper-bound limit using in-domain training for Network2 (F1 = 0.755; p-value = 0.103). Regarding sample size, the F1 score significantly increased from 25% training data (F1 = 0.478) to 100% training data (F1 = 0.713; p < 0.001). List-mode data from modern PET scanners can be reconstructed to better match the noise properties of older scanners. Using existing data and their associated annotations dramatically reduces the cost and effort in generating these datasets and significantly improves the performance of existing DL algorithms. List-mode reconstructions can provide an efficient, low-cost method to improve DL algorithm generalizability. [ABSTRACT FROM AUTHOR]

Recent technological developments have enabled computers to identify and categorize facial expressions to determine a person's emotional state in an image or a video. This process, called "Facial Expression Recognition (FER)", has become one of the most popular research areas in computer vision. In recent times, deep FER systems have primarily concentrated on addressing two significant challenges: the problem of overfitting due to limited training data availability, and the presence of expression-unrelated variations, including illumination, head pose, image resolution, and identity bias. In this paper, a comprehensive survey is provided on deep FER, encompassing algorithms and datasets that offer insights into these intrinsic problems. Initially, this paper presents a detailed timeline showcasing the evolution of methods and datasets in deep facial expression recognition (FER). This timeline illustrates the progression and development of the techniques and data resources used in FER. Then, a comprehensive review of FER methods is introduced, including the basic principles of FER (components such as preprocessing, feature extraction and classification, and methods, etc.) from the pro-deep learning era (traditional methods using handcrafted features, i.e., SVM and HOG, etc.) to the deep learning era. Moreover, a brief introduction is provided related to the benchmark datasets (there are two categories: controlled environments (lab) and uncontrolled environments (in the wild)) used to evaluate different FER methods and a comparison of different FER models. Existing deep neural networks and related training strategies designed for FER, based on static images and dynamic image sequences, are discussed. The remaining challenges and corresponding opportunities in FER and the future directions for designing robust deep FER systems are also pinpointed. [ABSTRACT FROM AUTHOR]

Alzheimer's disease (AD) is a pressing global issue, demanding effective diagnostic approaches. This systematic review surveys the recent literature (2018 onwards) to illuminate the current landscape of AD detection via deep learning. Focusing on neuroimaging, this study explores single- and multi-modality investigations, delving into biomarkers, features, and preprocessing techniques. Various deep models, including convolutional neural networks (CNNs), recurrent neural networks (RNNs), and generative models, are evaluated for their AD detection performance. Challenges such as limited datasets and training procedures persist. Emphasis is placed on the need to differentiate AD from similar brain patterns, necessitating discriminative feature representations. This review highlights deep learning's potential and limitations in AD detection, underscoring dataset importance. Future directions involve benchmark platform development for streamlined comparisons. In conclusion, while deep learning holds promise for accurate AD detection, refining models and methods is crucial to tackle challenges and enhance diagnostic precision. [ABSTRACT FROM AUTHOR]

Wind comfort is an important factor when new buildings in existing urban areas are planned. It is common practice to use computational fluid dynamics (CFD) simulations to model wind comfort. These simulations are usually time-consuming, making it impossible to explore a high number of different design choices for a new urban development with wind simulations. Data-driven approaches based on simulations have shown great promise, and have recently been used to predict wind comfort in urban areas. These surrogate models could be used in generative design software and would enable the planner to explore a large number of options for a new design. In this paper, we propose a novel machine learning workflow (MLW) for direct wind comfort prediction. The MLW incorporates a regression and a classification U-Net, trained based on CFD simulations. Furthermore, we present an augmentation strategy focusing on generating more training data independent of the underlying wind statistics needed to calculate the wind comfort criterion. We train the models based on different sets of training data and compare the results. All trained models (regression and classification) yield an F 1 -score greater than 80% and can be combined with any wind rose statistic. [ABSTRACT FROM AUTHOR]

With the advancement of micro- and nanomanufacturing technologies, electronic components and chips are increasingly being miniaturized. To automatically identify their packaging materials for ensuring the reliability of ICs, a hybrid deep learning framework termed as CNN–transformer interaction (CTI) model is designed on IC packaging images in this paper, in which several cascaded CTI blocks are designed to bidirectionally capture local and global features from the IC packaging image. Each CTI block involves a CNN branch with two designed convolutional neural networks (CNNs) for CNN local features and a transformer branch with two transformers for transformer global features and transformer local-window features. A bidirectional interaction mechanism is designed to interactively transfer the features in channel and spatial dimensions between the CNNs and transformers. Experimental results indicate that the hybrid framework can recognize three types of IC packaging materials with a good performance of 96.16% F1-score and 97.92% accuracy, which is superior to some existing deep learning methods. [ABSTRACT FROM AUTHOR]

Convolutional neural networks (CNN) have provided great advances for the task of sign language recognition (SLR). However, recurrent neural networks (RNN) in the form of long–short-term memory (LSTM) have become a means for providing solutions to problems involving sequential data. This research proposes the development of a sign language translation system that converts Panamanian Sign Language (PSL) signs into text in Spanish using an LSTM model that, among many things, makes it possible to work with non-static signs (as sequential data). The deep learning model presented focuses on action detection, in this case, the execution of the signs. This involves processing in a precise manner the frames in which a sign language gesture is made. The proposal is a holistic solution that considers, in addition to the seeking of the hands of the speaker, the face and pose determinants. These were added due to the fact that when communicating through sign languages, other visual characteristics matter beyond hand gestures. For the training of this system, a data set of 330 videos (of 30 frames each) for five possible classes (different signs considered) was created. The model was tested having an accuracy of 98.8%, making this a valuable base system for effective communication between PSL users and Spanish speakers. In conclusion, this work provides an improvement of the state of the art for PSL–Spanish translation by using the possibilities of translatable signs via deep learning. [ABSTRACT FROM AUTHOR]

In the current era of social media, the proliferation of images sourced from unreliable origins underscores the pressing need for robust methods to detect forged content, particularly amidst the rapid evolution of image manipulation technologies. Existing literature delineates two primary approaches to image manipulation detection: active and passive. Active techniques intervene preemptively, embedding structures into images to facilitate subsequent authenticity verification, whereas passive methods analyze image content for traces of manipulation. This study presents a novel solution to image manipulation detection by leveraging a multi-stream neural network architecture. Our approach harnesses three convolutional neural networks (CNNs) operating on distinct data streams extracted from the original image. We have developed a solution based on two passive detection methodologies. The system utilizes two separate streams to extract specific data subsets, while a third stream processes the unaltered image. Each net independently processes its respective data stream, capturing diverse facets of the image. The outputs from these nets are then fused through concatenation to ascertain whether the image has undergone manipulation, yielding a comprehensive detection framework surpassing the efficacy of its constituent methods. Our work introduces a unique dataset derived from the fusion of four publicly available datasets, featuring organically manipulated images that closely resemble real-world scenarios. This dataset offers a more authentic representation than other state-of-the-art methods that use algorithmically generated datasets based on image patches. By encompassing genuine manipulation scenarios, our dataset enhances the model's ability to generalize across varied manipulation techniques, thereby improving its performance in real-world settings. After training, the merged approach obtained an accuracy of 89.59% in the set of validation images, significantly higher than the model trained with only unaltered images, which obtained 78.64%, and the two other models trained using images with a feature selection method applied to enhance inconsistencies that obtained 68.02% for Error-Level Analysis images and 50.70% for the method using Discrete Wavelet Transform. Moreover, our proposed approach exhibits reduced accuracy variance compared to alternative models, underscoring its stability and robustness across diverse datasets. The approach outlined in this work needs to provide information about the specific location or type of tempering, which limits its practical applications. [ABSTRACT FROM AUTHOR]

Early blight and late blight are two of the most prevalent and severe diseases affecting potato crops. Efficient and accurate grading of their severity is crucial for effective disease management. However, existing grading methods are limited to assessing the severity of each disease independently, often resulting in low recognition accuracy and slow grading processes. To address these challenges, this study proposes a novel two-stage approach for the rapid severity grading of both early blight and late blight in potato plants. In this research, two lightweight models were developed: Coformer and SegCoformer. In the initial stage, Coformer efficiently categorizes potato leaves into three classes: those afflicted by early blight, those afflicted by late blight, and healthy leaves. In the subsequent stage, SegCoformer accurately segments leaves, lesions, and backgrounds within the images obtained from the first stage. Furthermore, it assigns severity labels to the identified leaf lesions. To validate the accuracy and processing speed of the proposed methods, we conduct experimental comparisons. The experimental results indicate that Coformer achieves a classification accuracy as high as 97.86%, while SegCoformer achieves an mIoU of 88.50% for semantic segmentation. The combined accuracy of this method reaches 84%, outperforming the Sit + Unet_V accuracy by 1%. Notably, this approach achieves heightened accuracy while maintaining a faster processing speed, completing image processing in just 258.26 ms. This research methodology effectively enhances agricultural production efficiency. [ABSTRACT FROM AUTHOR]

Chest X-ray imaging plays a vital and indispensable role in the diagnosis of lungs, enabling healthcare professionals to swiftly and accurately identify lung abnormalities. Deep learning (DL) approaches have attained popularity in recent years and have shown promising results in automated medical image analysis, particularly in the field of chest radiology. This paper presents a novel DL framework specifically designed for the multi-class diagnosis of lung diseases, including fibrosis, opacity, tuberculosis, normal, viral pneumonia, and COVID-19 pneumonia, using chest X-ray images, aiming to address the need for efficient and accessible diagnostic tools. The framework employs a convolutional neural network (CNN) architecture with custom blocks to enhance the feature maps designed to learn discriminative features from chest X-ray images. The proposed DL framework is evaluated on a large-scale dataset, demonstrating superior performance in the multi-class diagnosis of the lung. In order to evaluate the effectiveness of the presented approach, thorough experiments are conducted against pre-existing state-of-the-art methods, revealing significant accuracy, sensitivity, and specificity improvements. The findings of the study showcased remarkable accuracy, achieving 98.88%. The performance metrics for precision, recall, F1-score, and Area Under the Curve (AUC) averaged 0.9870, 0.9904, 0.9887, and 0.9939 across the six-class categorization system. This research contributes to the field of medical imaging and provides a foundation for future advancements in DL-based diagnostic systems for lung diseases. [ABSTRACT FROM AUTHOR]

In this work, an exhaustive analysis of the partial discharges that originate in the bubbles present in dielectric mineral oils is carried out. To achieve this, a low-cost, high-resolution CMOS image sensor is used. Partial discharge measurements using that image sensor are validated by a standard electrical detection system that uses a discharge capacitor. In order to accurately identify the images corresponding to partial discharges, a convolutional neural network is trained using a large set of images captured by the image sensor. An image classification model is also developed using deep learning with a convolutional network based on a TensorFlow and Keras model. The classification results of the experiments show that the accuracy achieved by our model is around 95% on the validation set and 82% on the test set. As a result of this work, a non-destructive diagnosis method has been developed that is based on the use of an image sensor and the design of a convolutional neural network. This approach allows us to obtain information about the state of mineral oils before breakdown occurs, providing a valuable tool for the evaluation and maintenance of these dielectric oils. [ABSTRACT FROM AUTHOR]

Obstructive sleep apnea (OSA), a prevalent sleep disorder, is intimately associated with various other diseases, particularly cardiovascular conditions. The conventional diagnostic method, nocturnal polysomnography (PSG), despite its widespread use, faces challenges due to its high cost and prolonged duration. Recent developments in electrocardiogram-based diagnostic techniques have opened new avenues for addressing these challenges, although they often require a deep understanding of feature engineering. In this study, we introduce an innovative method for OSA classification that combines a composite deep convolutional neural network model with a multimodal strategy for automatic feature extraction. This approach involves transforming the original dataset into scalogram images that reflect heart rate variability attributes and Gramian angular field matrix images that reveal temporal characteristics, aiming to enhance the diversity and richness of data features. The model comprises automatic feature extraction and feature enhancement components and has been trained and validated on the PhysioNet Apnea-ECG database. The experimental results demonstrate the model's exceptional performance in diagnosing OSA, achieving an accuracy of 96.37%, a sensitivity of 94.67%, a specificity of 97.44%, and an AUC of 0.96. These outcomes underscore the potential of our proposed model as an efficient, accurate, and convenient tool for OSA diagnosis. [ABSTRACT FROM AUTHOR]

In Internet of Things-based smart grids, smart meters record and report a massive number of power consumption data at certain intervals to the data center of the utility for load monitoring and energy management. Energy theft is a big problem for smart meters and causes non-technical losses. Energy theft attacks can be launched by malicious consumers by compromising the smart meters to report manipulated consumption data for less billing. It is a global issue causing technical and financial damage to governments and operators. Deep learning-based techniques can effectively identify consumers involved in energy theft through power consumption data. In this study, a hybrid convolutional neural network (CNN)-based energy-theft-detection system is proposed to detect data-tampering cyber-attack vectors. CNN is a commonly employed method that automates the extraction of features and the classification process. We employed CNN for feature extraction and traditional machine learning algorithms for classification. In this work, honest data were obtained from a real dataset. Six attack vectors causing data tampering were utilized. Tampered data were synthetically generated through these attack vectors. Six separate datasets were created for each attack vector to design a specialized detector tailored for that specific attack. Additionally, a dataset containing all attack vectors was also generated for the purpose of designing a general detector. Furthermore, the imbalanced dataset problem was addressed through the application of the generative adversarial network (GAN) method. GAN was chosen due to its ability to generate new data closely resembling real data, and its application in this field has not been extensively explored. The data generated with GAN ensured better training for the hybrid CNN-based detector on honest and malicious consumption patterns. Finally, the results indicate that the proposed general detector could classify both honest and malicious users with satisfactory accuracy. [ABSTRACT FROM AUTHOR]

Real-time and high-precision land cover classification is the foundation for efficient and quantitative research on grassland degradation using remote sensing techniques. In view of the shortcomings of manual surveying and satellite remote sensing, this study focuses on the identification and classification of grass species indicating grassland degradation. We constructed a UAV-based hyperspectral remote sensing system and collected field data in grassland areas. By applying artificial intelligence technology, we developed a 3D_RNet-O model based on convolutional neural networks, effectively addressing technical challenges in hyperspectral remote sensing identification and classification of grassland degradation indicators, such as low reflectance of vegetation, flat spectral curves, and sparse distribution. The results showed that the model achieved a classification accuracy of 99.05% by optimizing hyperparameter combinations based on improving residual block structures. The establishment of the UAV-based hyperspectral remote sensing system and the proposed 3D_RNet-O classification model provide possibilities for further research on low-altitude hyperspectral remote sensing in grassland ecology. [ABSTRACT FROM AUTHOR]

In the evolving landscape of Internet of Things (IoT) and Industrial IoT (IIoT) security, novel and efficient intrusion detection systems (IDSs) are paramount. In this article, we present a groundbreaking approach to intrusion detection for IoT-based electric vehicle charging stations (EVCS), integrating the robust capabilities of convolutional neural network (CNN), long short-term memory (LSTM), and gated recurrent unit (GRU) models. The proposed framework leverages a comprehensive real-world cybersecurity dataset, specifically tailored for IoT and IIoT applications, to address the intricate challenges faced by IoT-based EVCS. We conducted extensive testing in both binary and multiclass scenarios. The results are remarkable, demonstrating a perfect 100% accuracy in binary classification, an impressive 97.44% accuracy in six-class classification, and 96.90% accuracy in fifteen-class classification, setting new benchmarks in the field. These achievements underscore the efficacy of the CNN-LSTM-GRU ensemble architecture in creating a resilient and adaptive IDS for IoT infrastructures. The ensemble algorithm, accessible via GitHub, represents a significant stride in fortifying IoT-based EVCS against a diverse array of cybersecurity threats. [ABSTRACT FROM AUTHOR]

Brain tumors can have fatal consequences, affecting many body functions. For this reason, it is essential to detect brain tumor types accurately and at an early stage to start the appropriate treatment process. Although convolutional neural networks (CNNs) are widely used in disease detection from medical images, they face the problem of overfitting in the training phase on limited labeled and insufficiently diverse datasets. The existing studies use transfer learning and ensemble models to overcome these problems. When the existing studies are examined, it is evident that there is a lack of models and weight ratios that will be used with the ensemble technique. With the framework proposed in this study, several CNN models with different architectures are trained with transfer learning and fine-tuning on three brain tumor datasets. A particle swarm optimization-based algorithm determined the optimum weights for combining the five most successful CNN models with the ensemble technique. The results across three datasets are as follows: Dataset 1, 99.35% accuracy and 99.20 F1-score; Dataset 2, 98.77% accuracy and 98.92 F1-score; and Dataset 3, 99.92% accuracy and 99.92 F1-score. We achieved successful performances on three brain tumor datasets, showing that the proposed framework is reliable in classification. As a result, the proposed framework outperforms existing studies, offering clinicians enhanced decision-making support through its high-accuracy classification performance. [ABSTRACT FROM AUTHOR]

In this paper, we propose a method for estimating the classes and directions of static audio objects using stereo microphones in a drone environment. Drones are being increasingly used across various fields, with the integration of sensors such as cameras and microphones, broadening their scope of application. Therefore, we suggest a method that attaches stereo microphones to drones for the detection and direction estimation of specific emergency monitoring. Specifically, the proposed neural network is configured to estimate fixed-size audio predictions and employs bipartite matching loss for comparison with actual audio objects. To train the proposed network structure, we built an audio dataset related to speech and drones in an outdoor environment. The proposed technique for identifying and localizing sound events, based on the bipartite matching loss we proposed, works better than those of the other teams in our group. [ABSTRACT FROM AUTHOR]

In the current deep learning model, the computation between each feature and parameter is defined in the real number field. This, together with the nonlinearity of the deep learning model, makes it difficult to analyze the relationship between the values of the computational process and the original features from computation in the real number field. We extend the operational rules of the deep learning model in space and propose the orthogonal neural network (ONN) model, in which the features are set orthogonally to each other in space by "modulating" each input feature of the deep learning model to different orthogonal bases. Because the modulated numerical features are orthogonal to each other, they can be separated from the computations of the ONN model. By "demodulating" the model during and after the calculation, we can obtain a numerical relationship between the results and the original features, which can further provide theoretical and computational support for our analysis of the model. Finally, we compute the weights for each input feature as an interpretable deep learning approach, and describe how the model focuses attention on each feature based on the application of the orthogonal neural network model on two typical models: convolutional neural networks and graph neural networks. [ABSTRACT FROM AUTHOR]

Monitoring the correct operation of airport video surveillance systems is of great importance in terms of the image quality provided by the cameras. Performing this task using human resources is time-consuming and usually associated with a delay in diagnosis. For this reason, in this article, an automatic system for image quality assessment (IQA) in airport surveillance systems using deep learning techniques is presented. The proposed method monitors the video surveillance system based on the two goals of "quality assessment" and "anomaly detection in images". This model uses a 3D convolutional neural network (CNN) for detecting anomalies such as jitter, occlusion, and malfunction in frame sequences. Also, the feature maps of this 3D CNN are concatenated with feature maps of a separate 2D CNN for image quality assessment. This combination can be useful in improving the concurrence of correlation coefficients for IQA. The performance of the proposed model was evaluated both in terms of quality assessment and anomaly detection. The results show that the proposed 3D CNN model could correctly detect anomalies in surveillance videos with an average accuracy of 96.48% which is at least 3.39% higher than the compared methods. Also, the proposed hybrid CNN model could assess image quality with an average correlation of 0.9014, which proves the efficiency of the proposed method. [ABSTRACT FROM AUTHOR]

While the term task load (TL) refers to external task demands, the amount of work, or the number of tasks to be performed, mental workload (MWL) refers to the individual's effort, mental capacity, or cognitive resources utilized while performing a task. MWL in multitasking scenarios is often closely linked with the quantity of tasks a person is handling within a given timeframe. In this study, we challenge this hypothesis from the perspective of electroencephalography (EEG) using a deep learning approach. We conducted an EEG experiment with 50 participants performing NASA Multi-Attribute Task Battery II (MATB-II) under 4 different task load levels. We designed a convolutional neural network (CNN) to help with two distinct classification tasks. In one setting, the CNN was used to classify EEG segments based on their task load level. In another setting, the same CNN architecture was trained again to detect the presence of individual MATB-II subtasks. Results show that, while the model successfully learns to detect whether a particular subtask is active in a given segment (i.e., to differentiate between different subtasks-related EEG patterns), it struggles to differentiate between the two highest levels of task load (i.e., to distinguish MWL-related EEG patterns). We speculate that the challenge comes from two factors: first, the experiment was designed in a way that these two highest levels differed only in the quantity of work within a given timeframe; and second, the participants' effective adaptation to increased task demands, as evidenced by low error rates. Consequently, this indicates that under such conditions in multitasking, EEG may not reflect distinct enough patterns to differentiate higher levels of task load. [ABSTRACT FROM AUTHOR]

Simple Summary: Diagnosing glioblastoma multiforme (GBM), solitary brain metastases (SBM), and primary central nervous system lymphoma (PCNSL) in malignant tumors of the central nervous system using multi-modal magnetic resonance imaging (MRI) is significantly important in helping physicians develop treatment plans and enhance patient prognosis. In this paper, MFFC-Net is developed and validated using deep learning methods to predict these three tumor categories from multi-modal MRI without the manual region of interest (ROI). MFFC-Net first uses a multi-encoder with DenseBlocks to extract deep features from multi-modal MRI. Then, the feature fusion layer fuses the deep information between different modalities and tissues. Finally, the spatial-channel attention module suppresses redundant new information and activates tumor classification-related features. Compared with radiomics models, MFFC-Net demonstrated higher accuracy. In addition, the results in the different sequences provide important references for future clinical work on MRI image acquisition. We believe that MFFC-Net has the potential to assist in the diagnosis and treatment of brain tumors in the future. (1) Background: Diagnosis of glioblastoma (GBM), solitary brain metastases (SBM), and primary central nervous system lymphoma (PCNSL) plays a decisive role in the development of personalized treatment plans. Constructing a deep learning classification network to diagnose GBM, SBM, and PCNSL with multi-modal MRI is important and necessary. (2) Subjects: GBM, SBM, and PCNSL were confirmed by histopathology with the multi-modal MRI examination (study from 1225 subjects, average age 53 years, 671 males), 3.0 T T2 fluid-attenuated inversion recovery (T2-Flair), and Contrast-enhanced T1-weighted imaging (CE-T1WI). (3) Methods: This paper introduces MFFC-Net, a classification model based on the fusion of multi-modal MRIs, for the classification of GBM, SBM, and PCNSL. The network architecture consists of parallel encoders using DenseBlocks to extract features from different modalities of MRI images. Subsequently, an L 1 − n o r m feature fusion module is applied to enhance the interrelationships among tumor tissues. Then, a spatial-channel self-attention weighting operation is performed after the feature fusion. Finally, the classification results are obtained using the full convolutional layer (FC) and Soft-max. (4) Results: The ACC of MFFC-Net based on feature fusion was 0.920, better than the radiomics model (ACC of 0.829). There was no significant difference in the ACC compared to the expert radiologist (0.920 vs. 0.924, p = 0.774). (5) Conclusions: Our MFFC-Net model could distinguish GBM, SBM, and PCNSL preoperatively based on multi-modal MRI, with a higher performance than the radiomics model and was comparable to radiologists. [ABSTRACT FROM AUTHOR]

The integration of artificial intelligence (AI) with Digital Twins (DTs) has emerged as a promising approach to revolutionize healthcare, particularly in terms of diagnosis and management of thoracic disorders. This study proposes a comprehensive framework, named Lung-DT, which leverages IoT sensors and AI algorithms to establish the digital representation of a patient's respiratory health. Using the YOLOv8 neural network, the Lung-DT system accurately classifies chest X-rays into five distinct categories of lung diseases, including "normal", "covid", "lung_opacity", "pneumonia", and "tuberculosis". The performance of the system was evaluated employing a chest X-ray dataset available in the literature, demonstrating average accuracy of 96.8%, precision of 92%, recall of 97%, and F1-score of 94%. The proposed Lung-DT framework offers several advantages over conventional diagnostic methods. Firstly, it enables real-time monitoring of lung health through continuous data acquisition from IoT sensors, facilitating early diagnosis and intervention. Secondly, the AI-powered classification module provides automated and objective assessments of chest X-rays, reducing dependence on subjective human interpretation. Thirdly, the twin digital representation of the patient's respiratory health allows for comprehensive analysis and correlation of multiple data streams, providing valuable insights as to personalized treatment plans. The integration of IoT sensors, AI algorithms, and DT technology within the Lung-DT system demonstrates a significant step towards improving thoracic healthcare. By enabling continuous monitoring, automated diagnosis, and comprehensive data analysis, the Lung-DT framework has enormous potential to enhance patient outcomes, reduce healthcare costs, and optimize resource allocation. [ABSTRACT FROM AUTHOR]

Mobile fitness applications provide the opportunity to show users real-time feedback on their current fitness activity. For such applications, it is essential to accurately track the user's current fitness activity using available mobile sensors, such as inertial measurement units (IMUs). Convolutional neural networks (CNNs) have been shown to produce strong results in different time series classification tasks, including the recognition of daily living activities. However, fitness activities can present unique challenges to the human activity recognition task (HAR), including greater similarity between individual activities and fewer available data for model training. In this paper, we evaluate the applicability of CNNs to the fitness activity recognition task (FAR) using IMU data and determine the impact of input data size and sensor count on performance. For this purpose, we adapted three existing CNN architectures to the FAR task and designed a fourth CNN variant, which we call the scaling fully convolutional network (Scaling-FCN). We designed a preprocessing pipeline and recorded a running exercise data set with 20 participants, in which we evaluated the respective recognition performances of the four networks, comparing them with three traditional machine learning (ML) methods commonly used in HAR. Although CNN architectures achieve at least 94% test accuracy in all scenarios, two traditional ML architectures surpass them in the default scenario, with support vector machines (SVMs) achieving 99.00 ± 0.34% test accuracy. The removal of all sensors except one foot sensor reduced the performance of traditional ML architectures but improved the performance of CNN architectures on our data set, with our Scaling-FCN reaching the highest accuracy of 99.86 ± 0.11% on the test set. Our results suggest that CNNs are generally well suited for fitness activity recognition, and noticeable performance improvements can be achieved if sensors are dropped selectively, although traditional ML architectures can still compete with or even surpass CNNs when favorable input data are utilized. [ABSTRACT FROM AUTHOR]

The present study presents a novel approach for identifying epileptogenic tubers in patients with tuberous sclerosis complex (TSC) and automating tuber segmentation using a three-dimensional convolutional neural network (3D CNN). The study retrospectively included 31 TSC patients whose lesions were manually annotated from multiparametric neuroimaging data. Epileptogenic tubers were determined via presurgical evaluation and stereoelectroencephalography recording. Neuroimaging metrics were extracted and compared between epileptogenic and non-epileptogenic tubers. Additionally, five datasets with different preprocessing strategies were used to construct and train 3D CNNs for automated tuber segmentation. The normalized positron emission tomography (PET) metabolic value was significantly lower in epileptogenic tubers defined via presurgical evaluation (p = 0.001). The CNNs showed high performance for localizing tubers, with an accuracy between 0.992 and 0.994 across the five datasets. The automated segmentations were highly correlated with clinician-based features. The neuroimaging characteristics for epileptogenic tubers were demonstrated, increasing surgical confidence in clinical practice. The validated deep learning detection algorithm yielded a high performance in determining tubers with an excellent agreement with reference clinician-based segmentation. Collectively, when coupled with our investigation of minimal input requirements, the approach outlined in this study represents a clinically invaluable tool for the management of TSC. [ABSTRACT FROM AUTHOR]

Several deep learning and transformer models have been recommended in previous research to deal with the classification of hyperspectral images (HSIs). Among them, one of the most innovative is the bidirectional encoder representation from transformers (BERT), which applies a distance-independent approach to capture the global dependency among all pixels in a selected region. However, this model does not consider the local spatial-spectral and spectral sequential relations. In this paper, a dual-dimensional (i.e., spatial and spectral) BERT (the so-called D2BERT) is proposed, which improves the existing BERT model by capturing more global and local dependencies between sequential spectral bands regardless of distance. In the proposed model, two BERT branches work in parallel to investigate relations among pixels and spectral bands, respectively. In addition, the layer intermediate information is used for supervision during the training phase to enhance the performance. We used two widely employed datasets for our experimental analysis. The proposed D2BERT shows superior classification accuracy and computational efficiency with respect to some state-of-the-art neural networks and the previously developed BERT model for this task. [ABSTRACT FROM AUTHOR]

Timely forecasting of aboveground vegetation biomass is crucial for effective management and ensuring food security. However, research on predicting aboveground biomass remains scarce. Artificial intelligence (AI) methods could bridge this research gap and provide early warning to planners and stakeholders. This study evaluates the effectiveness of deep learning (DL) algorithms in predicting aboveground vegetation biomass with limited-size data. It employs an iterative forecasting procedure for four target horizons, comparing the performance of DL models—multi-layer perceptron (MLP), long short-term memory (LSTM), gated recurrent unit (GRU), convolutional neural network (CNN), and CNN-LSTM—against the traditional seasonal autoregressive integrated moving average (SARIMA) model, serving as a benchmark. Five limited-size vegetation biomass time series from Kenyan grasslands with values at 15-day intervals over a 20-year period were chosen for this purpose. Comparing the outcomes of these models revealed significant differences (p < 0.05); however, none of the models proved superior among the five time series and the four horizons evaluated. The SARIMA, CNN, and CNN-LSTM models performed best, with the statistical model slightly outperforming the other two. Additionally, the accuracy of all five models varied significantly according to the prediction horizon (p < 0.05). As expected, the accuracy of the models decreased as the prediction horizon increased, although this relationship was not strictly monotonic. Finally, this study indicated that, in limited-size aboveground vegetation biomass time series, there is no guarantee that deep learning methods will outperform traditional statistical methods. [ABSTRACT FROM AUTHOR]

Invasive plant species pose significant biodiversity and ecosystem threats. Real-time identification of invasive plants is a crucial prerequisite for early and timely prevention. While deep learning has shown promising results in plant recognition, the use of deep learning models often involve a large number of parameters and high data requirements for training. Unfortunately, the available data for various invasive plant species are often limited. To address this challenge, this study proposes a lightweight deep learning model called IPMCNet for the identification of multiple invasive plant species. IPMCNet attains high recognition accuracy even with limited data and exhibits strong generalizability. Simultaneously, by employing depth-wise separable convolutional kernels, splitting channels, and eliminating fully connected layer, the model's parameter count is lower than that of some existing lightweight models. Additionally, the study explores the impact of different loss functions, and the insertion of various attention modules on the model's accuracy. The experimental results reveal that, compared with eight other existing neural network models, IPMCNet achieves the highest classification accuracy of 94.52%. Furthermore, the findings suggest that focal loss is the most effective loss function. The performance of the six attention modules is suboptimal, and their insertion leads to a decrease in model accuracy. [ABSTRACT FROM AUTHOR]

Peanut leaf spot is a worldwide disease whose prevalence poses a major threat to peanut yield and quality, and accurate prediction models are urgently needed for timely disease management. In this study, we proposed a novel peanut leaf spot prediction method based on an improved long short-term memory (LSTM) model and multi-year meteorological data combined with disease survey records. Our method employed a combination of convolutional neural networks (CNNs) and LSTMs to capture spatial–temporal patterns from the data and improve the model's ability to recognize dynamic features of the disease. In addition, we introduced a Squeeze-and-Excitation (SE) Network attention mechanism module to enhance model performance by focusing on key features. Through several hyper-parameter optimization adjustments, we identified a peanut leaf spot disease condition index prediction model with a learning rate of 0.001, a number of cycles (Epoch) of 800, and an optimizer of Adma. The results showed that the integrated model demonstrated excellent prediction ability, obtaining an RMSE of 0.063 and an R 2 of 0.951, which reduced the RMSE by 0.253 and 0.204, and raised the R 2 by 0.155 and 0.122, respectively, compared to the single CNN and LSTM. Predicting the occurrence and severity of peanut leaf spot disease based on the meteorological conditions and neural networks is feasible and valuable to help growers make accurate management decisions and reduce disease impacts through optimal fungicide application timing. [ABSTRACT FROM AUTHOR]

Accurate and reliable estimation of the pelvic tilt is one of the essential pre-planning factors for total hip arthroplasty to prevent common post-operative complications such as implant impingement and dislocation. Inspired by the latest advances in deep learning-based systems, our focus in this paper has been to present an innovative and accurate method for estimating the functional pelvic tilt (PT) from a standing anterior–posterior (AP) radiography image. We introduce an encoder–decoder-style network based on a concurrent learning approach called VGG-UNET (VGG embedded in U-NET), where a deep fully convolutional network known as VGG is embedded at the encoder part of an image segmentation network, i.e., U-NET. In the bottleneck of the VGG-UNET, in addition to the decoder path, we use another path utilizing light-weight convolutional and fully connected layers to combine all extracted feature maps from the final convolution layer of VGG and thus regress PT. In the test phase, we exclude the decoder path and consider only a single target task i.e., PT estimation. The absolute errors obtained using VGG-UNET, VGG, and Mask R-CNN are 3.04 ± 2.49, 3.92 ± 2.92, and 4.97 ± 3.87, respectively. It is observed that the VGG-UNET leads to a more accurate prediction with a lower standard deviation (STD). Our experimental results demonstrate that the proposed multi-task network leads to a significantly improved performance compared to the best-reported results based on cascaded networks. [ABSTRACT FROM AUTHOR]

Simple Summary: This systematic review demonstrated that artificial intelligence (AI) can help detect metastatic prostate cancer with or without lymph node involvement on prostate-specific membrane antigen (PSMA) PET scans with high accuracy. Additional benefits of AI include the ability to estimate the volume of metastatic cancer, prognosticate, and differentiate bony metastasis from post-radiotherapy bone changes. AI can also improve workflow by helping to standardize reporting and automate time-consuming tasks. However, given the variable sensitivity and positive predictive value of AI, it is recommended that an experienced nuclear medicine physician proofread the final report. Larger studies producing more consistent results are needed before AI can be fully integrated into PSMA reporting. Early detection of metastatic prostate cancer (mPCa) is crucial. Whilst the prostate-specific membrane antigen (PSMA) PET scan has high diagnostic accuracy, it suffers from inter-reader variability, and the time-consuming reporting process. This systematic review was registered on PROSPERO (ID CRD42023456044) and aims to evaluate AI's ability to enhance reporting, diagnostics, and predictive capabilities for mPCa on PSMA PET scans. Inclusion criteria covered studies using AI to evaluate mPCa on PSMA PET, excluding non-PSMA tracers. A search was conducted on Medline, Embase, and Scopus from inception to July 2023. After screening 249 studies, 11 remained eligible for inclusion. Due to the heterogeneity of studies, meta-analysis was precluded. The prediction model risk of bias assessment tool (PROBAST) indicated a low overall risk of bias in ten studies, though only one incorporated clinical parameters (such as age, and Gleason score). AI demonstrated a high accuracy (98%) in identifying lymph node involvement and metastatic disease, albeit with sensitivity variation (62–97%). Advantages included distinguishing bone lesions, estimating tumour burden, predicting treatment response, and automating tasks accurately. In conclusion, AI showcases promising capabilities in enhancing the diagnostic potential of PSMA PET scans for mPCa, addressing current limitations in efficiency and variability. [ABSTRACT FROM AUTHOR]

The role of capsule endoscopy and enteroscopy in managing various small-bowel pathologies is well-established. However, their broader application has been hampered mainly by their lengthy reading times. As a result, there is a growing interest in employing artificial intelligence (AI) in these diagnostic and therapeutic procedures, driven by the prospect of overcoming some major limitations and enhancing healthcare efficiency, while maintaining high accuracy levels. In the past two decades, the applicability of AI to gastroenterology has been increasing, mainly because of the strong imaging component. Nowadays, there are a multitude of studies using AI, specifically using convolutional neural networks, that prove the potential applications of AI to these endoscopic techniques, achieving remarkable results. These findings suggest that there is ample opportunity for AI to expand its presence in the management of gastroenterology diseases and, in the future, catalyze a game-changing transformation in clinical activities. This review provides an overview of the current state-of-the-art of AI in the scope of small-bowel study, with a particular focus on capsule endoscopy and enteroscopy. [ABSTRACT FROM AUTHOR]

Artificial neural network models, crucial for accurate predictions, should be meticulously designed for specific problems using deep learning-based algorithms. In this study, we compare four distinct deep learning-based artificial neural network architectures to evaluate their performance in predicting soil consolidation characteristics. The consolidation features of fine-grained soil have a significant impact on the stability of structures, particularly in terms of long-term stability. Precise prediction of soil consolidation under planned structures is vital for effective foundation design. The compression index (Cc) is an important parameter used in predicting consolidation settlement in soils. Therefore, this study examines the use of deep learning techniques, which are types of artificial neural network algorithms with deep layers, in predicting compression index (Cc) in geotechnical engineering. Four neural network models with different architectures and hyperparameters were modeled and evaluated using performance metrics such as mean absolute percentage error (MAPE), mean squared error (MSE), root mean squared error (RMSE), and coefficient of determination (R2). The dataset contains 916 samples with variables such as natural water content (w), liquid limit (LL), plasticity index (PI), and compression index (Cc). This approach allows the results of soil consolidation tests to be seen more quickly at less cost, although predictively. The findings demonstrate that deep learning models are an effective tool in predicting consolidation of fine-grained soil and offering significant opportunities for applications in geotechnical engineering. This study contributes to a more accurate prediction of soil consolidation, which is critical for the long-term stability of structural designs. [ABSTRACT FROM AUTHOR]

Intracerebral hemorrhage (ICH) is a severe cerebrovascular disorder that poses a life-threatening risk, necessitating swift diagnosis and treatment. While CT scans are the most effective diagnostic tool for detecting cerebral hemorrhage, their interpretation typically requires the expertise of skilled professionals. However, in regions with a shortage of such experts or situations with time constraints, delays in diagnosis may occur. In this paper, we propose a method that combines a pre-trained CNN classifier and GPT-2 to generate text for sequentially acquired ICH CT images. Initially, CNN undergoes fine-tuning by learning the presence of ICH in publicly available single CT images, and subsequently, it extracts feature vectors (i.e., matrix) from 3D ICH CT images. These vectors are input along with text into GPT-2, which is trained to generate text for consecutive CT images. In experiments, we evaluated the performance of four models to determine the most suitable image captioning model: (1) In the N-gram-based method, ReseNet50V2 and DenseNet121 showed relatively high scores. (2) In the embedding-based method, DenseNet121 exhibited the best performance. (3) Overall, the models showed good performance in BERT score. Our proposed method presents an automatic and valuable approach for analyzing 3D ICH CT images, contributing to the efficiency of ICH diagnosis and treatment. [ABSTRACT FROM AUTHOR]

Facial expression recognition (FER) plays a crucial role in understanding human emotions and is becoming increasingly relevant in educational contexts, where personalized and empathetic interactions are essential. The problems with existing approaches are typically solved using a single deep learning method, which is not robust with complex datasets, such as FER data, which have a characteristic imbalance and multi-class labels. In this research paper, an innovative approach to FER using a homogeneous ensemble convolutional neural network, called HoE-CNN, is presented for future online learning education. This paper aims to transfer the knowledge of models and FER classification using ensembled homogeneous conventional neural network architectures. FER is challenging to research because there are many real-world applications to consider, such as adaptive user interfaces, games, education, and robot integration. HoE-CNN is used to improve the classification performance on an FER dataset, encompassing seven main multi-classes (Angry, Disgust, Fear, Happy, Sad, Surprise, Neutral). The experiment shows that the proposed framework, which uses an ensemble of deep learning models, performs better than a single deep learning model. In summary, the proposed model will increase the efficiency of FER classification results and solve FER2013 at a accuracy of 75.51%, addressing both imbalanced datasets and multi-class classification to transfer the application of the model to online learning applications. [ABSTRACT FROM AUTHOR]

This paper proposes an improved fault diagnosis algorithm that combines a modified fast kurtogram (FK) method with the lightweight convolutional neural network GhostNet. The FK algorithm can adaptively select resonance demodulation bands for envelope demodulation to extract fault features, but it may be disturbed by non-Gaussian noise. Hence, the fast average kurtogram (FAK) method based on sub-band averaging was introduced. This method effectively weakens the impact of pulse noise on the kurtosis graph by splitting the signal into equal-length sub-signals and calculating the average kurtosis value of all sub-signal filters. Simultaneously, to fully utilize the advantages of deep learning technology in feature extraction and classification, this study used the FAK to convert vibration signals from one-dimensional to two-dimensional kurtosis graphs as the input for the GhostNet model. This combination not only achieved accurate fault diagnosis and classification but also showed significant advantages in processing efficiency and resource utilization. The experimental results indicate that the algorithm excelled in extracting features and diagnosing periodic transient impact faults, and compared with traditional methods, it exhibited noticeable improvements in computational efficiency and resource management. [ABSTRACT FROM AUTHOR]

The hydrodynamic model, based on the strict conservation of momentum and continuity equations, can accurately simulate the distribution of a flow field. However, significant computing time and storage space requirements limit real-time prediction. Machine learning is well known for its fast computing speed and powerful learning ability, but its accuracy depends on an abundance of training data, hindering its wider use in locations without sufficient measurements. Application restrictions in data-deficient areas can be addressed through transfer learning, provided that two areas share common characteristics. In this study, a machine learning method based on a deep super-resolution convolutional neural network (DSRCNN) and transfer learning is proposed, validated, and applied to model two bend flows and one realistic test case. Firstly, the hydrodynamic model was established and validated against measured data. The validated model was considered to have the ability to generate real data and was used to generate a comprehensive data set for training and validating the machine learning model. Three different methods were compared and tested, with Realizable k-ε performing better than the others in predicting the outer bank flow distribution. DSRCNN was compared to a plain SRCNN (PSRCNN), as well as Bilinear, Nearest, and Bicubic methods, and the results showed that DSRCNN had the best performance. We compared Raw, RT, and TL methods, finding that the TL method performed the best overall. Therefore, the research results showed that the developed super-resolution convolutional neural network can provide more reliable predications and serve as an ideal tool for simulating flow field distribution in bends. [ABSTRACT FROM AUTHOR]

In this study, a deep learning network for extracting spatial-temporal features is proposed to estimate significant wave height ( H s ) and wave period ( T s ) from X-band marine radar images. Since the shore-based radar image in this study is interfered with by other radar radial noise lines and solid target objects, to ensure that the proposed convolutional neural network (CNN) extracts the image features accurately, it is necessary to pre-process the radar image to eliminate interference. Firstly, a pre-trained GoogLeNet is used to extract multi-scale depth space features from the radar images to estimate H s and T s . Since CNN-based models cannot analyze the temporal behavior of wave features in radar image sequences, self-attention is connected after the deep convolutional layer of the CNN to construct a convolutional self-attention (CNNSA)-based model that generates spatial-temporal features for H s and T s estimation. Simultaneously, H s and T s measured by nearby buoys are used for model training and reference. The experimental results show that the proposed CNNSA model reduces the RMSD by 0.24 m and 0.11 m, respectively, in H s estimation compared to the traditional SNR-based and CNN-based methods. In T s estimation, the RMSD is reduced by 0.3 s and 0.08 s, respectively. [ABSTRACT FROM AUTHOR]

In recent years, there has been significant progress in human pose estimation, fueled by the widespread adoption of deep convolutional neural networks. However, despite these advancements, multi-person 2D pose estimation still remains highly challenging due to factors such as occlusion, noise, and non-rigid body movements. Currently, most multi-person pose estimation approaches handle joint localization and association separately. This study proposes a direct regression-based method to estimate the 2D human pose from a single image. The authors name this network YOLO-Rlepose. Compared to traditional methods, YOLO-Rlepose leverages Transformer models to better capture global dependencies between image feature blocks and preserves sufficient spatial information for keypoint detection through a multi-head self-attention mechanism. To further improve the accuracy of the YOLO-Rlepose model, this paper proposes the following enhancements. Firstly, this study introduces the C3 Module with Swin Transformer (C3STR). This module builds upon the C3 module in You Only Look Once (YOLO) by incorporating a Swin Transformer branch, enhancing the YOLO-Rlepose model's ability to capture global information and rich contextual information. Next, a novel loss function named Rle-Oks loss is proposed. The loss function facilitates the training process by learning the distributional changes through Residual Log-likelihood Estimation. To assign different weights based on the importance of different keypoints in the human body, this study introduces a weight coefficient into the loss function. The experiments proved the efficiency of the proposed YOLO-Rlepose model. On the COCO dataset, the model outperforms the previous SOTA method by 2.11% in AP. [ABSTRACT FROM AUTHOR]

Wireless physical layer authentication has emerged as a promising approach to wireless security. The topic of wireless node classification and recognition has experienced significant advancements due to the rapid development of deep learning techniques. The potential of using deep learning to address wireless security issues should not be overlooked due to its considerable capabilities. Nevertheless, the utilization of this approach in the classification of wireless nodes is impeded by the lack of available datasets. In this study, we provide two models based on a data-driven approach. First, we used generative adversarial networks to design an automated model for data augmentation. Second, we applied a convolutional neural network to classify wireless nodes for a wireless physical layer authentication model. To verify the effectiveness of the proposed model, we assessed our results using an original dataset as a baseline and a generated synthetic dataset. The findings indicate an improvement of approximately 19% in classification accuracy rate. [ABSTRACT FROM AUTHOR]

Automatic extraction of building contours from high-resolution images is of great significance in the fields of urban planning, demographics, and disaster assessment. Network models based on convolutional neural network (CNN) and transformer technology have been widely used for semantic segmentation of buildings from high resolution remote sensing images (HRSI). However, the fixed geometric structure and the local receptive field of the convolutional kernel are not good at global feature extraction, and the transformer technique with self-attention mechanism introduces computational redundancies and extracts local feature details poorly in the process of modeling the global contextual information. In this paper, a dual-branch fused reconstructive transformer network, DFRTNet, is proposed for efficient and accurate building extraction. In the encoder, the traditional transformer is reconfigured by designing the local and global feature extraction module (LGFE); the branch of global feature extraction (GFE) performs dynamic range attention (DRA) based on the idea of top-k attention for extracting global features; furthermore, the branch of local feature extraction (LFE) is used to obtain fine-grained features. The multilayer perceptron (MLP) is employed to efficiently fuse the local and global features. In the decoder, a simple channel attention module (CAM) is used in the up-sampling part to enhance channel dimension features. Our network achieved the best segmentation accuracy on both the WHU and Massachusetts building datasets when compared to other mainstream and state-of-the-art methods. [ABSTRACT FROM AUTHOR]

(1) Background: This meta-analysis assessed the diagnostic accuracy of deep learning model-based osteoporosis prediction using plain X-ray images. (2) Methods: We searched PubMed, Web of Science, SCOPUS, and Google Scholar from no set beginning date to 28 February 2023, for eligible studies that applied deep learning methods for diagnosing osteoporosis using X-ray images. The quality of studies was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 criteria. The area under the receiver operating characteristic curve (AUROC) was used to quantify the predictive performance. Subgroup, meta-regression, and sensitivity analyses were performed to identify the potential sources of study heterogeneity. (3) Results: Six studies were included; the pooled AUROC, sensitivity, and specificity were 0.88 (95% confidence interval [CI] 0.85–0.91), 0.81 (95% CI 0.78–0.84), and 0.87 (95% CI 0.81–0.92), respectively, indicating good performance. Moderate heterogeneity was observed. Mega-regression and subgroup analyses were not performed due to the limited number of studies included. (4) Conclusion: Deep learning methods effectively extract bone density information from plain radiographs, highlighting their potential for opportunistic screening. Nevertheless, additional prospective multicenter studies involving diverse patient populations are required to confirm the applicability of this novel technique. [ABSTRACT FROM AUTHOR]

During geomagnetic storms, which are a result of solar wind's interaction with the Earth's magnetosphere, geomagnetically induced currents (GICs) begin to flow in the long, high-voltage electrical networks on the Earth's surface. It causes a number of negative phenomena that affect the normal operation of the entire electric power system. To investigate the nature of the phenomenon and its effects on transformers, a GIC monitoring system was created in 2011. The system consists of devices that are installed in the neutrals of autotransformers at five substations of the Kola–Karelian power transit in northwestern Russia. Considering the significant amount of data accumulated over 12 years of operating the GIC monitoring system, manual analysis becomes impractical. To analyze the constantly growing volume of recorded data effectively, a method for the automatic classification of GICs in autotransformer neutrals was proposed. The method is based on a continuous wavelet transform of the neutral current data combined with a convolutional neural network (CNN) to classify the obtained scalogram images. The classifier's performance is evaluated using accuracy and binary cross-entropy loss metrics. As the result of comparing four CNN architectures, a model that showed high GIC classification performance on the validation set was chosen as the final model. The proposed CNN model, in addition to the main layers, includes pre-processing layers and a dropout layer. [ABSTRACT FROM AUTHOR]

Protozoa detection and classification from freshwaters and microscopic imaging are critical components in environmental monitoring, parasitology, science, biological processes, and scientific research. Bacterial and parasitic contamination of water plays an important role in society health. Conventional methods often rely on manual identification, resulting in time-consuming analyses and limited scalability. In this study, we propose a real-time protozoa detection framework using the YOLOv4 algorithm, a state-of-the-art deep learning model known for its exceptional speed and accuracy. Our dataset consists of objects of the protozoa species, such as Bdelloid Rotifera, Stylonychia Pustulata, Paramecium, Hypotrich Ciliate, Colpoda, Lepocinclis Acus, and Clathrulina Elegans, which are in freshwaters and have different shapes, sizes, and movements. One of the major properties of our work is to create a dataset by forming different cultures from various water sources like rainwater and puddles. Our network architecture is carefully tailored to optimize the detection of protozoa, ensuring precise localization and classification of individual organisms. To validate our approach, extensive experiments are conducted using real-world microscopic image datasets. The results demonstrate that the YOLOv4-based model achieves outstanding detection accuracy and significantly outperforms traditional methods in terms of speed and precision. The real-time capabilities of our framework enable rapid analysis of large-scale datasets, making it highly suitable for dynamic environments and time-sensitive applications. Furthermore, we introduce a user-friendly interface that allows researchers and environmental professionals to effortlessly deploy our YOLOv4-based protozoa detection tool. We conducted f1-score 0.95, precision 0.92, sensitivity 0.98, and mAP 0.9752 as evaluating metrics. The proposed model achieved 97% accuracy. After reaching high efficiency, a desktop application was developed to provide testing of the model. The proposed framework's speed and accuracy have significant implications for various fields, ranging from a support tool for paramesiology/parasitology studies to water quality assessments, offering a powerful tool to enhance our understanding and preservation of ecosystems. [ABSTRACT FROM AUTHOR]

The current work proposes a novel super-resolution convolutional transposed network (SRCTN) deep learning architecture for downscaling daily climatic variables. The algorithm was established based on a super-resolution convolutional neural network with transposed convolutions. This study designed synthetic experiments to downscale daily reference evapotranspiration (ET0) data, which are a key indicator for climate change, from low resolutions (2°, 1°, and 0.5°) to a fine resolution (0.25°). The entire time period was divided into two major parts, i.e., training–validation (80%) and test periods (20%), and the training–validation period was further divided into training (80%) and validation (20%) parts. In the comparison of the downscaling performance between the SRCTN and Q-M models, the root-mean-squared error (RMSE) values indicated the accuracy of the models. For the SRCTN model, the RMSE values were reported for different scaling ratios: 0.239 for a ratio of 8, 0.077 for a ratio of 4, and 0.015 for a ratio of 2. In contrast, the RMSE values for the Q-M method were 0.334, 0.208, and 0.109 for scaling ratios of 8, 4, and 2, respectively. Notably, the RMSE values in the SRCTN model were consistently lower than those in the Q-M method across all scaling ratios, suggesting that the SRCTN model exhibited better downscaling performance in this evaluation. The results exhibited that the SRCTN method could reproduce the spatiotemporal distributions and extremes for the testing period very well. The trained SRCTN model in one study area performed remarkably well in a different area via transfer learning without re-training or calibration, and it outperformed the classic downscaling approach. The good performance of the SRCTN algorithm can be primarily attributed to the incorporation of transposed convolutions, which can be partially seen as trainable upsampling operations. Therefore, the proposed SRCTN method is a promising candidate tool for downscaling daily ET0 and can potentially be employed to conduct downscaling operations for other variables. [ABSTRACT FROM AUTHOR]

Deep-learning-based breast cancer image diagnosis is currently a prominent and growingly popular area of research. Existing convolutional-neural-network-related methods mainly capture breast cancer image features based on spatial domain characteristics for classification. However, according to digital signal processing theory, texture images usually contain repeated patterns and structures, which appear as intense energy at specific frequencies in the frequency domain. Motivated by this, we make an attempt to explore a breast cancer histopathology classification application in the frequency domain and further propose a novel multi-branch spectral channel attention network, i.e., the MbsCANet. It expands the interaction of frequency domain attention mechanisms from a multi-branch perspective via combining the lowest frequency features with selected high frequency information from two-dimensional discrete cosine transform, thus preventing the loss of phase information and gaining richer context information for classification. We thoroughly evaluate and analyze the MbsCANet on the publicly accessible BreakHis breast cancer histopathology dataset. It respectively achieves the optimal image-level and patient-level classification results of 99.01% and 98.87%, averagely outperforming the spatial-domain-dominated models by a large margin, and visualization results also demonstrate the effectiveness of the MbsCANet for this medical image application. [ABSTRACT FROM AUTHOR]

All kinds of vessels consist of dozens of complex machineries with rotating parts and electric motors that operate continuously in harsh environments with excess temperature, humidity, vibration, fatigue, and load. A breakdown or malfunction in one of these machineries can significantly impact a vessel's operation and safety and, consequently, the safety of the crew and the environment. To maintain operational efficiency and seaworthiness, the shipping industry invests substantial resources in preventive maintenance and repairs. This study presents the economic and technical benefits of predictive maintenance over traditional preventive maintenance and repair by replacement approaches in the maritime domain. By leveraging modern technology and artificial intelligence, we can analyze the operating conditions of machinery by obtaining measurements either from sensors permanently installed on the machinery or by utilizing portable measuring instruments. This facilitates the early identification of potential damage, thereby enabling efficient strategizing for future maintenance and repair endeavors. In this paper, we propose and develop a convolutional neural network that is fed with raw vibration measurements acquired in a laboratory environment from the ball bearings of a motor. Then, we investigate whether the proposed network can accurately detect the functional state of ball bearings and categorize any possible failures present, contributing to improved maintenance practices in the shipping industry. [ABSTRACT FROM AUTHOR]

Simple Summary: Accurate tumor localization is essential for effective clinical diagnosis and treatment. However, traditional magnetic particle imaging (MPI) algorithms struggle to precisely locate tumors, resulting in challenges when quantifying them. This study aims to address the issue of precise tumor localization in MPI through the application of a deep learning approach. By integrating Convolutional Neural Network (CNN) and Transformer modules, the goal is to improve image quality and enhance the accuracy of tumor quantification in MPI images. The research utilizes a combination of CNN and Transformer modules to capture both global and local features within MPI images. Through the application of deep learning techniques, the study seeks to remove blurry artifacts from reconstructed images, ultimately may help improve the precision of tumor localization and quantification in MPI. This approach holds significant potential for advancing MPI technology and introducing novel methodologies for future medical imaging research. Additionally, the validation of transfer learning on authentic MPI images may enhance the overall accuracy and reliability of MPI image reconstruction. Background: Magnetic Particle Imaging (MPI) is an emerging molecular imaging technique. However, since X-space reconstruction ignores system properties, it can lead to blurring of the reconstructed image, posing challenges for accurate quantification. To address this issue, we propose the use of deep learning to remove the blurry artifacts; (2) Methods: Our network architecture consists of a combination of Convolutional Neural Network (CNN) and Transformer. The CNN utilizes convolutional layers to automatically extract pixel-level local features and reduces the size of feature maps through pooling layers, effectively capturing local information within the images. The Transformer module is responsible for extracting contextual features from the images and efficiently capturing long-range dependencies, enabling a more effective modeling of global features in the images. By combining the features extracted by both CNN and Transformer, we capture both global and local features simultaneously, thereby improving the quality of reconstructed images; (3) Results: Experimental results demonstrate that the network effectively removes blurry artifacts from the images, and it exhibits high accuracy in precise tumor quantification. The proposed method shows superior performance over the state-of-the-art methods; (4) Conclusions: This bears significant implications for the image quality improvement and clinical application of MPI technology. [ABSTRACT FROM AUTHOR]

In recent years, deep learning methods utilizing convolutional neural networks have been extensively employed in hyperspectral image classification (HSI) applications. Nevertheless, while a substantial number of stacked 3D convolutions can indeed achieve high classification accuracy, they also introduce a significant number of parameters to the model, resulting in inefficiency. Furthermore, such intricate models often exhibit limited classification accuracy when confronted with restricted sample data, i.e., small sample problems. Therefore, we propose a spectral–spatial double-branch network (SSDBN) with an attention mechanism for HSI classification. The SSDBN is designed with two independent branches to extract spectral and spatial features, respectively, incorporating multi-scale 2D convolution modules, long short-term memory (LSTM), and an attention mechanism. The flexible use of 2D convolution, instead of 3D convolution, significantly reduces the model's parameter count, while the effective spectral–spatial double-branch feature extraction method allows SSDBN to perform exceptionally well in handling small sample problems. When tested on 5%, 0.5%, and 5% of the Indian Pines, Pavia University, and Kennedy Space Center datasets, SSDBN achieved classification accuracies of 97.56%, 96.85%, and 98.68%, respectively. Additionally, we conducted a comparison of training and testing times, with results demonstrating the remarkable efficiency of SSDBN. [ABSTRACT FROM AUTHOR]

Due to their devastating ability to extract features, convolutional neural network (CNN)-based approaches have achieved tremendous success in hyperspectral image (HSI) classification. However, previous works have been dedicated to constructing deeper or wider deep learning networks to obtain exceptional classification performance, but as the layers get deeper, the gradient disappearance problem impedes the convergence stability of network models. Additionally, previous works usually focused on utilizing fixed-scale convolutional kernels or multiple available, receptive fields with varying scales to capture features, which leads to the underutilization of information and is vulnerable to feature learning. To remedy the above issues, we propose an innovative hybrid-scale feature enhancement network (HFENet) for HSI classification. Specifically, HFENet contains two key modules: a hybrid-scale feature extraction block (HFEB) and a shuffle attention enhancement block (SAEB). HFEB is designed to excavate spectral–spatial structure information of distinct scales, types, and branches, which can augment the multiplicity of spectral–spatial features while modeling the global long-range dependencies of spectral–spatial informative features. SAEB is devised to adaptively recalibrate spectral-wise and spatial-wise feature responses to generate the purified spectral–spatial information, which effectively filters redundant information and noisy pixels and is conducive to enhancing classification performance. Compared with several sophisticated baselines, a series of experiments conducted on three public hyperspectral datasets showed that the accuracies of OA, AA, and Kappa all exceed 99%, demonstrating that the presented HFENet achieves state-of-the-art performance. [ABSTRACT FROM AUTHOR]

The emergence of deep learning-based classification methods has led to considerable advancements and remarkable performance in image recognition. This study introduces the Multiscale Feature Convolutional Neural Network (MSFCNN) for the extraction of complex urban land cover data, with a specific emphasis on buildings and roads. MSFCNN is employed to extract multiscale features from three distinct image types—Unmanned Aerial Vehicle (UAV) images, high-resolution satellite images (HR), and low-resolution satellite images (LR)—all collected within the Fengshan District of Kaohsiung, Taiwan. The model in this study demonstrated remarkable accuracy in classifying two key land cover categories. Its success in extracting multiscale features from different image resolutions. In the case of UAV images, MSFCNN achieved an accuracy rate of 91.67%, with a Producer's Accuracy (PA) of 93.33% and a User's Accuracy (UA) of 90.0%. Similarly, the model exhibited strong performance with HR images, yielding accuracy, PA, and UA values of 92.5%, 93.33%, and 91.67%, respectively. These results closely align with those obtained for LR imagery, which achieved respective accuracy rates of 93.33%, 95.0%, and 91.67%. Overall, the MSFCNN excels in the classification of both UAV and satellite images, showcasing its versatility and robustness across various data sources. The model is well suited for the task of updating cartographic data related to urban buildings and roads. [ABSTRACT FROM AUTHOR]