Search

Detecting emotions from facial images is difficult because facial expressions can vary significantly. Previous research on using deep learning models to classify emotions from facial images has been carried out on various datasets that contain a limited range of expressions. This study expands the use of deep learning for facial emotion recognition (FER) based on Emognition dataset that includes ten target emotions: amusement, awe, enthusiasm, liking, surprise, anger, disgust, fear, sadness, and neutral. A series of data preprocessing was carried out to convert video data into images and augment the data. This study proposes Convolutional Neural Network (CNN) models built through two approaches, which are transfer learning (fine-tuned) with pre-trained models of Inception-V3 and MobileNet-V2 and building from scratch using the Taguchi method to find robust combination of hyperparameters setting. The proposed model demonstrated favorable performance over a series of experimental processes with an accuracy and an average F1-score of 96% and 0.95, respectively, on the test data. [ABSTRACT FROM AUTHOR]

The preservation and transmission of traditional villages is crucial to the prosperity and development of ethnic cultures. However, current traditional village surveys usually require a large number of experts and scholars to conduct field research, which is an expensive and time-consuming method, especially for large-scale tasks. Therefore, this study proposes an automatic classification method based on deep learning (DL) for the identification of traditional village heritage value elements (TVHVE). The study evaluates four selected convolutional neural network (CNN) frames using traditional villages in Hubei Province as a sample dataset. The results show that Residual Network152 (ResNet152) is the most suitable CNN frame for identifying TVHVE in Hubei. The stability and consistency of various TVHVE present in the ResNet152 model were evaluated using Area Under Curve (AUC) and Precision Recall Curve (PRC), which indicated satisfactory prediction performance for most elements, except for specific elements such as tombstones and stone carvings, which showed lower accuracy. In addition, the study sheds light on the areas of concern of the model with respect to different TVHVE images and elucidates the reasons behind the confusion between elements through semantic clustering based on image classification and interpretability analysis using the Gradient-Weighted Class Activation Mapping (Grad-CAM) heat map. By using an automated classification method based on DL, this study significantly reduces the cost and effort associated with traditional surveys. At the same time, insight into areas of concern and confusion in the model improves guidance for conservation efforts and provides valuable references for subsequent research. [ABSTRACT FROM AUTHOR]

Previous instance-relation knowledge distillation methods transfer structural relations between instances from the heavy teacher network to the lightweight student network, effectively enhancing the accuracy of the student. However, these methods have two limitations: (1) The modeling of relation knowledge only relies on the current mini-batch instances, causing the instance relations to be incomplete. (2) The information flow hidden in the evolution of instance relations throughout the network has been neglected. To address these problems, we propose a Global Instance Relation Distillation (GIRD) for convolutional neural network compression, which improves both the instance-level and relation-level globality. Firstly, we design a feature reutilization mechanism to store previously learned features to break through the shackles of the mini-batch. Secondly, we model the pairwise similarity-relation based on stored features to reveal more complete instance relations. Furthermore, we construct the pairwise relation-evolution across different layers to reflect the information flow. Extensive experiments on benchmark datasets demonstrate that our proposed method outperforms state-of-the-art approaches in various visual tasks. [ABSTRACT FROM AUTHOR]

The search for gravitational-wave (GW) signals is limited by non-Gaussian transient noises that mimic astrophysical signals. Temporal coincidence between two or more detectors is used to mitigate contamination by these instrumental glitches. However, when a single detector is in operation, coincidence is impossible, and other strategies have to be used. We explore the possibility of using neural network classifiers and present the results obtained with three types of architectures: convolutional neural network, temporal convolutional network, and inception time. The last two architectures are specifically designed to process time-series data. The classifiers are trained on a month of data from the LIGO Livingston detector during the first observing run (O1) to identify data segments that include the signature of a binary black hole merger. Their performances are assessed and compared. We then apply trained classifiers to the remaining three months of O1 data, focusing specifically on single-detector times. The most promising candidate from our search is 4 January 2016 12:24:17 UTC. Although we are not able to constrain the significance of this event to the level conventionally followed in GW searches, we show that the signal is compatible with the merger of two black holes with masses m 1 = 50.7 − 8.9 + 10.4 M ⊙ and m 2 = 24.4 − 9.3 + 20.2 M ⊙ at the luminosity distance of d L = 564 − 338 + 812 Mpc . [ABSTRACT FROM AUTHOR]

This research paper presents a comprehensive investigation into the utilization of color image processing technologies and deep learning algorithms in the development of a robot vision system specifically designed for 8-ball billiards. The sport of billiards, with its various games and ball arrangements, presents unique challenges for robotic vision systems. The proposed methodology addresses these challenges through two main components: object detection and ball pattern recognition. Initially, a robust algorithm is employed to detect the billiard balls using color space transformation and thresholding techniques. This is followed by determining the position of the billiard table through strategic cropping and isolation of the primary table area. The crucial phase involves the intricate task of recognizing ball patterns to differentiate between solid and striped balls. To achieve this, a modified convolutional neural network is utilized, leveraging the Xception network optimized by an innovative algorithm known as the Improved Chaos African Vulture Optimization (ICAVO) algorithm. The ICAVO algorithm enhances the Xception network's performance by efficiently exploring the solution space and avoiding local optima. The results of this study demonstrate a significant enhancement in recognition accuracy, with the Xception/ICAVO model achieving remarkable recognition rates for both solid and striped balls. This paves the way for the development of more sophisticated and efficient billiards robots. The implications of this research extend beyond 8-ball billiards, highlighting the potential for advanced robotic vision systems in various applications. The successful integration of color image processing, deep learning, and optimization algorithms shows the effectiveness of the proposed methodology. This research has far-reaching implications that go beyond just billiards. The cutting-edge robotic vision technology can be utilized for detecting and tracking objects in different sectors, transforming industrial automation and surveillance setups. By combining color image processing, deep learning, and optimization algorithms, the system proves its effectiveness and flexibility. The innovative approach sets the stage for creating advanced and productive robotic vision systems in various industries. [ABSTRACT FROM AUTHOR]

Objectives. This study aimed to develop an initial deep-learning (DL) model based on computerized tomography (CT) scans for diagnosing lumbar spinal stenosis. Summary of Background Data. Magnetic resonance imaging is commonly used for diagnosing lumbar spinal stenosis due to its high soft tissue resolution, but CT is more portable, cost-effective, and has wider regional coverage. Using DL models to improve the accuracy of CT diagnosis can effectively reduce missed diagnoses and misdiagnoses in clinical practice. Materials and Methods. Axial lumbar spine CT scans obtained between March 2022 and September 2023 were included. The data set was divided into a training set (62.3%), a validation set (22.9%), and a control set (14.8%). All data were labeled by two spine surgeons using the widely accepted grading system for lumbar spinal stenosis. The training and validation sets were used to annotate the regions of interest by the two spine surgeons. First, a region of interest detection model and a convolutional neural network classifier were trained using the training set. After training, the model was preliminarily evaluated using a validation set. Finally, the performance of the DL model was evaluated on the control set, and a comparison was made between the model and the classification performance of specialists with varying levels of experience. Results. The central stenosis grading accuracies of DL Model Version 1 and DL Model Version 2 were 88% and 83%, respectively. The lateral recess grading accuracies of DL Model Version 1 and DL Model Version 2 were 75% and 71%, respectively. Conclusions. Our preliminarily developed DL system for assessing the degree of lumbar spinal stenosis in CT, including the central canal and lateral recess, has shown similar accuracy to experienced specialist physicians. This holds great value for further development and clinical application. [ABSTRACT FROM AUTHOR]

Background: Yam (Dioscorea alata L.) is the staple food of many populations in the intertropical zone, where it is grown. The lack of phenotyping methods for tuber quality has hindered the adoption of new genotypes from breeding programs. Recently, near‐infrared spectroscopy (NIRS) has been used as a reliable tool to characterize the chemical composition of the yam tuber. However, it failed to predict the amylose content, although this trait is strongly involved in the quality of the product. Results: This study used NIRS to predict the amylose content from 186 yam flour samples. Two calibration methods were developed and validated on an independent dataset: partial least squares (PLS) and convolutional neural networks (CNN). To evaluate final model performances, the coefficient of determination (R2), the root mean square error (RMSE), and the ratio of performance to deviation (RPD) were calculated using predictions on an independent validation dataset. The tested models showed contrasting performances (i.e., R2 of 0.72 and 0.89, RMSE of 1.33 and 0.81, RPD of 2.13 and 3.49 respectively, for the PLS and the CNN model). Conclusion: According to the quality standard for NIRS model prediction used in food science, the PLS method proved unsuccessful (RPD < 3 and R2 < 0.8) for predicting amylose content from yam flour but the CNN model proved to be reliable and efficient method. With the application of deep learning methods, this study established the proof of concept that amylose content, a key driver of yam textural quality and acceptance, can be predicted accurately using NIRS as a high throughput phenotyping method. © 2023 The Authors. Journal of The Science of Food and Agriculture published by John Wiley & Sons Ltd on behalf of Society of Chemical Industry. [ABSTRACT FROM AUTHOR]

To improve the defense of CNN network traffic classifiers against adversarial sample attacks, the author proposes a batch adversarial training method that utilizes the characteristics of backpropagation errors during the training process, and completing both sample gradient and parameter gradient calculations in one backpropagation process can significantly improve training efficiency. Meanwhile, since the adversarial samples used for training are generated on the target model, they can effectively defend against white box attacks. The author proposes an enhanced adversarial training method to further defend against black box attacks and overcome the transferability of adversarial samples. Using multiple models to generate adversarial samples with inconsistent sample gradients increases the diversity of adversarial samples and enhances the ability to defend against black box attacks. Through experiments on the actual traffic dataset USTC-TFC2016, we generate network traffic for adversarial samples to simulate attacks. With classification accuracy rates for FGSM adversarial samples of 49.72% and 54.32%, respectively, the experimental results show that the enhanced adversarial approach proposed by the author has a more vital ability to defend adversarial samples than defense distillation and adversarial sample detection. The classification accuracy of enhanced adversarial training can reach 75.37%, significantly higher than defense distillation and adversarial sample detection. The authors suggested adversarial training strategy can successfully improve CNN traffic classifiers' defense capabilities. [ABSTRACT FROM AUTHOR]

• A novel optimization algorithm integrating random and grid search mechanisms as function calls. • A cost-effective low inference time deep learning model for detecting 2D ionospheric plasma structures from all-sky airglow images. • The issue of uncertainty quantification has been addressed using the approach of bootstrapping. The ionosphere, part of the Earth's atmosphere, where different plasma irregularities/structures are generated through various electrodynamical processes. Airglow imaging is one of the tools to observe various morphological features of these irregularities. We aim to help all-sky airglow imaging-based ionospheric research by proposing novel deep learning at the edge framework for the detection of different types of mid-latitude ionospheric plasma structures (medium scale traveling ionospheric disturbances with single and multiple bands, and plasma bubbles). The primary challenge was to find an optimal deep neural network by considering the trade-off between accuracy and inference time. In order to address this, a novel hyperparameter optimization technique has been used that integrates the approaches of random and grid search mechanisms as a compact function. The random function generates the subspace for hyperparameters to check the convergence of the model while the grid search creates possible combinations to tune these hyperparameters. Our novel optimization method for deep learning inference at the edge led us to a low-cost, high-accuracy convolutional neural network (CNN) model, which outperformed the complex state-of-the-art deep learning models such as Inception-v3, DenseNet169, VGG16, and VGG19. For airglow image-based plasma structure detection, the proposed model recorded an accuracy of 99.9% with an inference time of 5.8 s. This was an improvement of about 4% in accuracy while 85% reduction in inference time over the best-performing baseline. There was about 93% reduction in the number of model parameters with respect to the best-performing baseline. Uncertainty quantification has also been performed in the present work through bootstrapping to validate the robustness of the proposed model. The findings of our study show the promise of deep learning at the edge for all-sky airglow imaging systems by demonstrating an alternate low-cost, high-accuracy deep neural network. [ABSTRACT FROM AUTHOR]

Deep learning has emerged as a highly effective and precise method for classifying images. The presence of plant diseases poses a significant threat to food security. However, accurately identifying these diseases in plants is challenging due to limited infrastructure and techniques. Fortunately, the recent advancements in deep learning within the field of computer vision have opened up new possibilities for diagnosing plant pathology. Detecting plant diseases at an early stage is crucial, and this research paper proposes a deep convolutional neural network model that can rapidly and accurately identify plant diseases. Given the minimal variation in image texture and color, deep learning techniques are essential for robust recognition. In this study, we introduce a deep, explainable neural architecture specifically designed for recognizing plant diseases. Fine-tuned deep convolutional neural network is designed by freezing the layers and adjusting the weights of learnable layers. By extracting deep features from a down sampled feature map of a fine-tuned neural network, we are able to classify these features using a customized K-Nearest Neighbors Algorithm. To train and validate our model, we utilize the largest standard plant village dataset, which consists of 38 classes. To evaluate the performance of our proposed system, we estimate specificity, sensitivity, accuracy, and AUC. The results demonstrate that our system achieves an impressive maximum validation accuracy of 99.95% and an AUC of 1, making it the most ideal and highest-performing approach compared to current state-of-the-art deep learning methods for automatically identifying plant diseases. [ABSTRACT FROM AUTHOR]

This paper presents a metallic object classification method using various electromagnetic pulses. Each electromagnetic pulse irradiated eight metallic objects placed at increasing distances from 10 mm to 40 mm relative to the electromagnetic sensing system. The electromagnetic sensing system consisted of two RL circuits placed in close proximity. Objects were classified using linear (perceptron and multiclass logistic regression) and non-linear (neural network, 1D convolutional neural network (CNN) and 2D CNN) machine learning classifiers. The machine learning classifiers were trained on experimental data collected in an electromagnetically shielded laboratory. A 10-fold cross-validation mean classification accuracy of 99.4 ± 0.3% for the 1D CNN classifier, and 92.9 ± 1.2% for the 2D CNN classifier, was achieved using a rectangular chirp electromagnetic pulse. The rectangular chirp pulse outperformed two-sided decaying exponential, Gaussian, triangular, raised cosine, and rectangular pulses. All pulses had equal energy. While the rectangular chirp performed best overall, other pulses more accurately distinguished between some objects. [ABSTRACT FROM AUTHOR]

Accurate prediction of wind power is crucial for the efficient operation and risk management of wind farms. This paper introduces a deep learning model for wind power prediction that integrates an Attention mechanism with a convolutional neural network (CNN) and a gated recurrent unit (GRU) neural network. Addressing the randomness, intermittency, volatility and uncertainty of wind speed, we first apply swarm decomposition (SWD) to preprocess the original wind power data into subsequences. Subsequently, the CNN extracts spatial features, and the GRU identifies temporal correlations. The Attention mechanism enhances feature significance, further optimizing prediction accuracy. Complex error sequences generated by the CNN–GRU–Attention (CGA) model are corrected using the autoregressive integrated moving average (ARIMA). We evaluated the model’s performance using three wind power datasets against 16 other models, employing six evaluation indices (MSE, RMSE, MAPE, Theil’s U, TIC and SPL) and the Diebold–Mariano (DM) test and model confidence set (MCS) for model testing. Our results demonstrate the proposed model’s superior accuracy and efficiency in predicting wind power. [ABSTRACT FROM AUTHOR]

Over the past decades, the software industry has expanded to include all industries. Since stakeholders tend to use it to get their work done, software houses seek to estimate the cost of the software, which includes calculating the effort, time, and resources required. Although many researchers have worked to estimate it, the prediction accuracy results are still inaccurate and unstable. Estimating it requires a lot of effort. Therefore, there is an urgent need for modern techniques that contribute to cost estimation. This paper seeks to present a model based on deep learning and machine learning techniques by combining convolutional neural networks (CNN) and the particle swarm algorithm (PSO) in the context of time series forecasting, which enables feature extraction and automatic tuning of hyperparameters, which reduces the manual effort of selecting parameters and contributes to fine-tuning. The use of PSO also enhances the robustness and generalization ability of the CNN model and its iterative nature allows for efficient discovery of hyperparameter similarity. The model was trained and tested on 13 different benchmark datasets and evaluated through six metrics: mean absolute error (MAE), mean square error (MSE), mean magnitude relative error (MMRE), root mean square error (RMSE), median magnitude relative error (MdMRE), and prediction accuracy (PRED). Comparative results reveal that the performance of the proposed model is better than other methods for all datasets and evaluation criteria. The results were very promising for predicting software cost estimation. [ABSTRACT FROM AUTHOR]

In this paper, a method based on transfer learning is proposed to recover the three-dimensional shape of cultural relics faces from a single old photo. It can simultaneously reconstruct the three-dimensional facial structure and align the texture of the cultural relics with fewer training samples. The UV position map is used to represent the three-dimensional shape in space and act as the output of the network. A convolutional neural network is used to reconstruct the UV position map from a single 2D image. In the training process, the human face data is used for pre-training, and then a small amount of artifact data is used for fine-tuning. A deep learning model with strong generalization ability is trained with fewer artifact data, and a three-dimensional model of the cultural relic face can be reconstructed from a single old photograph. The methods can train more complex deep networks without a large amount of cultural relic data, and no over-fitting phenomenon occurs, which effectively solves the problem of fewer cultural relic samples. The method is verified by restoring a Chinese Terracotta Warrior with facial cracks and a Buddha with a broken nose. Other applications can be used in the fields such as texture recovery, facial feature extraction, and three-dimensional model estimation of the damaged cultural relics or sculptures in the photos. [ABSTRACT FROM AUTHOR]

Purpose Methods Results Conclusions Human monkeypox (MPX) is a viral infection that transmits between individuals via direct contact with animals, bodily fluids, respiratory droplets, and contaminated objects like bedding. Traditional manual screening for the MPX infection is a time‐consuming process prone to human error. Therefore, a computer‐aided MPX screening approach utilizing skin lesion images to enhance clinical performance and alleviate the workload of healthcare providers is needed. The primary objective of this work is to devise an expert system that accurately classifies MPX images for the automatic detection of MPX subjects.This work presents a multi‐modal deep learning system through the fusion of convolutional neural network (CNN) and machine learning algorithms, which effectively and autonomously detect MPX‐infected subjects using skin lesion images. The proposed framework, termed MPXCN‐Net is developed by fusing deep features of three pre‐trained CNNs: MobileNetV2, DarkNet19, and ResNet18. Three classifiers—K‐nearest neighbour, support vector machine (SVM), and ensemble classifier—with various kernel functions, are used to identify infected patients. To validate the efficacy of our proposed system, we employ a publicly accessible MPX skin lesion dataset.By amalgamating features extracted from all three CNNs and utilizing the medium Gaussian kernel of the SVM classifier, our proposed system achieves an outstanding average classification accuracy of 90.4%.Developed MPXCN‐Net is suitable for testing with a large diversified dataset before being used in clinical settings. [ABSTRACT FROM AUTHOR]

A novel deep learning approach for crop disease classification using a Hybrid Convolutional Neural Network (CNN)-Transformer architecture is proposed. Utilizing the Plant Village, corn/maize leaf, and rice disease image datasets, the preprocessing retains essential features to enhance classification accuracy. The CNN extracts local features, while the Vision Transformer (ViT) captures global contexts by segmenting input images into patches. The Feature Attention Module (FAM) enhances crucial features and captures global aspects. The multilevel feature fusion network integrates these features, converting the fused vector into class probabilities. The proposed crop disease classification model provided a higher classification accuracy of 98.92%. [ABSTRACT FROM AUTHOR]

Brain tumor disease has become a topic of research whether it is in the case of segmentation or classification. For the case of classification, the types of brain tumors that are grouped generally consist of high-grade glioma (HGG) and low-grade glioma (LGG) tumors. In this research we are doing, we propose a method for classifying 2 types of tumors, namely HGG and LGG, using the convolutional neural network (CNN) algorithm which is trained and will be tested against the 2018 and 2019 brain tumor segmentation (BRATS) datasets which have 4 modalities, namely fluid-attenuated inversion recovery (FLAIR), T1, T1ce, and T2 totaling 2048 images. The CNN algorithm was chosen because it can directly receive input in the form of a magnetic resonance image (MRI) with the feature extraction process as well as the classification algorithm. By forming a simple CNN algorithm architecture with only 3 convolutional layers which have an input layer in the form of a full MRI image with dimensions of 240×240×3, we obtained a relatively high accuracy result of 94.14%, it can even be said to be better than similar methods but with more complicated architecture. [ABSTRACT FROM AUTHOR]

Multi-modal medical image fusion (MMIF) is crucial for disease diagnosis and treatment because the images reconstructed from signals collected by different sensors can provide complementary information. In recent years, deep learning (DL) based methods have been widely used in MMIF. However, these methods often adopt a serial fusion strategy without feature decomposition, causing error accumulation and confusion of characteristics across different scales. To address these issues, we have proposed the Coupled Image Reconstruction and Fusion (CIRF) strategy. Our method parallels the image fusion and reconstruction branches which are linked by a common encoder. Firstly, CIRF uses the lightweight encoder to extract base and detail features, respectively, through the Vision Transformer (ViT) and the Convolutional Neural Network (CNN) branches, where the two branches interact to supplement information. Then, two types of features are fused separately via different blocks and finally decoded into fusion results. In the loss function, both the supervised loss from the reconstruction branch and the unsupervised loss from the fusion branch are included. As a whole, CIRF increases its expressivity by adding multi-task learning and feature decomposition. Additionally, we have also explored the impact of image masking on the network's feature extraction ability and validated the generalization capability of the model. Through experiments on three datasets, it has been demonstrated both subjectively and objectively, that the images fused by CIRF exhibit appropriate brightness and smooth edge transition with more competitive evaluation metrics than those fused by several other traditional and DL-based methods. [ABSTRACT FROM AUTHOR]

Research on transformers in remote sensing (RS), which started to increase after 2021, is facing the problem of a relative lack of review. To understand the trends of transformers in RS, we undertook a quantitative analysis of the major research on transformers over the past two years by dividing the application of transformers into eight domains: land use/land cover (LULC) classification, segmentation, fusion, change detection, object detection, object recognition, registration, and others. Quantitative results show that transformers achieve a higher accuracy in LULC classification and fusion, with more stable performance in segmentation and object detection. Combining the analysis results on LULC classification and segmentation, we have found that transformers need more parameters than convolutional neural networks (CNNs). Additionally, further research is also needed regarding inference speed to improve transformers' performance. It was determined that the most common application scenes for transformers in our database are urban, farmland, and water bodies. We also found that transformers are employed in the natural sciences such as agriculture and environmental protection rather than the humanities or economics. Finally, this work summarizes the analysis results of transformers in remote sensing obtained during the research process and provides a perspective on future directions of development. [ABSTRACT FROM AUTHOR]

In this study, we propose a deep learning-based nystagmus detection algorithm using video oculography (VOG) data to diagnose benign paroxysmal positional vertigo (BPPV). Various deep learning architectures were utilized to develop and evaluate nystagmus detection models. Among the four deep learning architectures used in this study, the CNN1D model proposed as a nystagmus detection model demonstrated the best performance, exhibiting a sensitivity of 94.06 ± 0.78%, specificity of 86.39 ± 1.31%, precision of 91.34 ± 0.84%, accuracy of 91.02 ± 0.66%, and an F1-score of 92.68 ± 0.55%. These results indicate the high accuracy and generalizability of the proposed nystagmus diagnosis algorithm. In conclusion, this study validates the practicality of deep learning in diagnosing BPPV and offers avenues for numerous potential applications of deep learning in the medical diagnostic sector. The findings of this research underscore its importance in enhancing diagnostic accuracy and efficiency in healthcare. [ABSTRACT FROM AUTHOR]

The aim of this article is to introduce a novel approach to identifying flow regimes and void fractions in microchannel flow boiling, which is based on binary image segmentation using digital image processing and deep learning. The proposed image processing pipeline uses adaptive thresholding, blurring, gamma correction, contour detection, and histogram comparison to separate vapor from liquid areas, while the deep learning method uses a customized version of a convolutional neural network (CNN) called U-net to extract meaningful features from video frames. Both approaches enabled the automatic detection of flow boiling conditions, such as bubbly, slug, and annular flow, as well as automatic void fraction calculation. Especially CNN demonstrated its ability to deliver fast and dependable results, presenting an appealing substitute to manual feature extraction. The U-net-based CNN was able to segment flow boiling images with a Dice score of 99.1% and classify the above flow regimes with an overall classification accuracy of 91%. In addition, the neural network was able to predict resistance sensor readings from image data and assign them to a flow state with a mean squared error (MSE) < 10−6. [ABSTRACT FROM AUTHOR]

Epilepsy is a common neurological disorder, and its diagnosis mainly relies on the analysis of electroencephalogram (EEG) signals. However, the raw EEG signals contain limited recognizable features, and in order to increase the recognizable features in the input of the network, the differential features of the signals, the amplitude spectrum and the phase spectrum in the frequency domain are extracted to form a two-dimensional feature vector. In order to solve the problem of recognizing multimodal features, a neural network model based on a multimodal dual-stream network is proposed, which uses a mixture of one-dimensional convolution, two-dimensional convolution and LSTM neural networks to extract the spatial features of the EEG two-dimensional vectors and the temporal features of the signals, respectively, and combines the advantages of the two networks, using the hybrid neural network to extract both the temporal and spatial features of the signals at the same time. In addition, a channel attention module was used to focus the model on features related to seizures. Finally, multiple sets of experiments were conducted on the Bonn and New Delhi data sets, and the highest accuracy rates of 99.69% and 97.5% were obtained on the test set, respectively, verifying the superiority of the proposed model in the task of epileptic seizure detection. [ABSTRACT FROM AUTHOR]

Radio frequency interference (RFI) significantly hampers the target detection performance of frequency-modulated continuous-wave radar. To address the problem and maintain the target echo signal, this paper proposes a priori assumption on the interference component nature in the radar received signal, as well as a method for interference estimation and mitigation via time–frequency analysis. The solution employs Fourier synchrosqueezed transform to implement the radar's beat signal transformation from time domain to time–frequency domain, thus converting the interference mitigation to the task of time–frequency distribution image restoration. The solution proposes the use of image processing based on the dual-tree complex wavelet transform and combines it with the spatial domain-based approach, thereby establishing a dual-domain fusion interference filter for time–frequency distribution images. This paper also presents a convolutional neural network model of structurally improved UNet++, which serves as the interference estimator. The proposed solution demonstrated its capability against various forms of RFI through the simulation experiment and showed a superior interference mitigation performance over other CNN model-based approaches. [ABSTRACT FROM AUTHOR]

In recent years, Convolutional Neural Network (CNN) models have demonstrated notable advancements in various domains such as image classification and Natural Language Processing (NLP). Despite their success in image classification tasks, their potential impact on medical image retrieval, particularly in text-based medical image retrieval (TBMIR) tasks, has not yet been fully realized. This could be attributed to the complexity of the ranking process, as there is ambiguity in treating TBMIR as an image retrieval task rather than a traditional information retrieval or NLP task. To address this gap, our paper proposes a novel approach to re-ranking medical images using a Deep Matching Model (DMM) and Medical-Dependent Features (MDF). These features incorporate categorical attributes such as medical terminologies and imaging modalities. Specifically, our DMM aims to generate effective representations for query and image metadata using a personalized CNN, facilitating matching between these representations. By using MDF, a semantic similarity matrix based on Unified Medical Language System (UMLS) meta-thesaurus, and a set of personalized filters taking into account some ranking features, our deep matching model can effectively consider the TBMIR task as an image retrieval task, as previously mentioned. To evaluate our approach, we performed experiments on the medical ImageCLEF datasets from 2009 to 2012. The experimental results show that the proposed model significantly enhances image retrieval performance compared to the baseline and state-of-the-art approaches. [ABSTRACT FROM AUTHOR]

Tuberculosis (TB) is an infectious disease caused by Mycobacterium. It primarily impacts the lungs but can also endanger other organs, such as the renal system, spine, and brain. When an infected individual sneezes, coughs, or speaks, the virus can spread through the air, which contributes to its high contagiousness. The goal is to enhance detection recognition with an X-ray image dataset. This paper proposed a novel approach, named the Tuberculosis Segmentation-Guided Diagnosis Model (TSSG-CNN) for Detecting Tuberculosis, using a combined semantic segmentation and adaptive convolutional neural network (CNN) architecture. The proposed approach is distinguished from most of the previously proposed approaches in that it uses the combination of a deep learning segmentation model with a follow-up classification model based on CNN layers to segment chest X-ray images more precisely as well as to improve the diagnosis of TB. It contrasts with other approaches like ILCM, which is optimized for sequential learning, and explainable AI approaches, which focus on explanations. Moreover, our model is beneficial for the simplified procedure of feature optimization from the perspectives of approach using the Mayfly Algorithm (MA). Other models, including simple CNN, Batch Normalized CNN (BN-CNN), and Dense CNN (DCNN), are also evaluated on this dataset to evaluate the effectiveness of the proposed approach. The performance of the TSSG-CNN model outperformed all the models with an impressive accuracy of 98.75% and an F1 score of 98.70%. The evaluation findings demonstrate how well the deep learning segmentation model works and the potential for further research. The results suggest that this is the most accurate strategy and highlight the potential of the TSSG-CNN Model as a useful technique for precise and early diagnosis of TB. [ABSTRACT FROM AUTHOR]

This study introduces a deep-learning-based automatic sleep scoring system to detect sleep apnea using a single-lead electrocardiography (ECG) signal, focusing on accurately estimating the apnea–hypopnea index (AHI). Unlike other research, this work emphasizes AHI estimation, crucial for the diagnosis and severity evaluation of sleep apnea. The suggested model, trained on 1465 ECG recordings, combines the deep-shallow fusion network for sleep apnea detection network (DSF-SANet) and gated recurrent units (GRUs) to analyze ECG signals at 1-min intervals, capturing sleep-related respiratory disturbances. Achieving a 0.87 correlation coefficient with actual AHI values, an accuracy of 0.82, an F1 score of 0.71, and an area under the receiver operating characteristic curve of 0.88 for per-segment classification, our model was effective in identifying sleep-breathing events and estimating the AHI, offering a promising tool for medical professionals. [ABSTRACT FROM AUTHOR]

Diabetic retinopathy (DR) arises from blood vessel damage and is a leading cause of blindness on a global scale. Clinical professionals rely on examining fundus images to diagnose the disease, but this process is frequently prone to errors and is tedious. The usage of computer-assisted techniques offers assistance to clinicians in detecting the severity levels of the disease. Experiments involving automated diagnosis employing convolutional neural networks (CNNs) have produced impressive outcomes in medical imaging. At the same time, retinal image grading for detecting DR severity levels has predominantly focused on spatial features. More spectral features must be explored for a more efficient performance of this task. Analysing spectral features plays a vital role in various tasks, including identifying specific objects or materials, anomaly detection, and differentiation between different classes or categories within an image. In this context, a model incorporating Wavelet CNN and Support Vector Machine has been introduced and assessed to classify clinically significant grades of DR from retinal fundus images. The experiments were conducted on the EyePACS dataset and the performance of the proposed model was evaluated on the following metrics: precision, recall, F1-score, accuracy, and AUC score. The results obtained demonstrate better performance compared to other state-of-the-art techniques. [ABSTRACT FROM AUTHOR]

This paper presents a feature fusion and sparse transformer-based anomalous traffic detection system (FSTDS). FSTDS utilizes a feature fusion network to encode the traffic data sequences and extracting features, fusing them into coding vectors through shallow and deep convolutional networks, followed by deep coding using a sparse transformer to capture the complex relationships between network flows; finally, a multilayer perceptron is used to classify the traffic and achieve anomaly traffic detection. The feature fusion network of FSTDS improves feature extraction from small sample data, the deep encoder enhances the understanding of complex traffic patterns, and the sparse transformer reduces the computational and storage overhead and improves the scalability of the model. Experiments demonstrate that the number of FSTDS parameters is reduced by up to nearly half compared to the baseline, and the success rate of anomalous flow detection is close to 100%. [ABSTRACT FROM AUTHOR]

Partial discharge (PD) is a crucial and intricate electrical occurrence observed in various types of electrical equipment. Identifying and characterizing PDs is essential for upholding the integrity and reliability of electrical assets. This paper proposes an ensemble methodology aiming to strike a balance between the model complexity and the predictive performance in PD pattern recognition. A simple convolutional neural network (SCNN) was constructed to efficiently decrease the model parameters (quantities). A quadratic support vector machine (QSVM) was established and ensembled with the SCNN model to effectively improve the PD recognition accuracy. The input for QSVM consisted of the circular local binary pattern (CLBP) extracted from the enhanced image. A testing prototype with three types of PD was constructed and 3D phase-resolved pulse sequence (PRPS) spectrograms were measured and recorded by ultra-high frequency (UHF) sensors. The proposed methodology was compared with three existing lightweight CNNs. The experiment results from the collected dataset emphasize the benefits of the proposed method, showcasing its advantages in high recognition accuracy and relatively few mode parameters, thereby rendering it more suitable for PD pattern recognition on resource-constrained devices. [ABSTRACT FROM AUTHOR]

The existing change detection methods are difficult to balance local features and global features, and the boundary between change objects and backgrounds is blurred, so this paper proposed a remote sensing image building change detection method based on local-global feature coupling and boundary guidance. In the encoding stage, the method adopted parallel convolutional neural network and Transformer to extract the local features and global representation of remote sensing images, respectively. At different scales, the local-global feature coupling module fused local features and global feature representation to enhance the expression ability of image features. In addition, it introduced the boundary guidance branch to obtain the prior boundary information of the change objects, so that its guide change map can highlight the structural characteristics of the building and promote the accurate boundary location. This paper conducted experiments on the LEVIR-CD and WHU datasets, resulting in F1-score of 91.25% and 91.27%, IoU of 83.90% and 83.95%, respectively. The experimental results show that the method has a great improvement in the detection accuracy and good generalization ability. [ABSTRACT FROM AUTHOR]

Background: Over 60% of epilepsy patients globally are children, whose early diagnosis and treatment are critical for their development and can substantially reduce the disease's burden on both families and society. Numerous algorithms for automated epilepsy detection from EEGs have been proposed. Yet, the occurrence of epileptic seizures during an EEG exam cannot always be guaranteed in clinical practice. Models that exclusively use seizure EEGs for detection risk artificially enhanced performance metrics. Therefore, there is a pressing need for a universally applicable model that can perform automatic epilepsy detection in a variety of complex real-world scenarios. Method: To address this problem, we have devised a novel technique employing a temporal convolutional neural network with self-attention (TCN-SA). Our model comprises two primary components: a TCN for extracting time-variant features from EEG signals, followed by a self-attention (SA) layer that assigns importance to these features. By focusing on key features, our model achieves heightened classification accuracy for epilepsy detection. Results: The efficacy of our model was validated on a pediatric epilepsy dataset we collected and on the Bonn dataset, attaining accuracies of 95.50% on our dataset, and 97.37% (A v. E), and 93.50% (B vs E), respectively. When compared with other deep learning architectures (temporal convolutional neural network, self-attention network, and standardized convolutional neural network) using the same datasets, our TCN-SA model demonstrated superior performance in the automated detection of epilepsy. Conclusion: The proven effectiveness of the TCN-SA approach substantiates its potential as a valuable tool for the automated detection of epilepsy, offering significant benefits in diverse and complex real-world clinical settings. [ABSTRACT FROM AUTHOR]

The evolution of image manipulation techniques has presented a paradoxical scenario in contemporary visual culture. This phenomenon operates as a double-edged sword, offering both creative liberation and ethical dilemmas. Consequently, there is a need to develop automated mechanisms capable of discerning such forged data. The proposed methodology leverages transfer learning, utilising pre-trained deep learning models as a foundation and fine-tuning them specifically for the task of copy-move forgery detection. This approach uses the knowledge learned from large datasets, enhancing the network's ability to discern subtle patterns indicative of copy-move manipulations in images. Further, this research introduces a custom-designed CNN architecture tailored to the intricacies of copy-move forgery, optimising feature extraction and classification. Experimental evaluations conducted on diverse datasets, namely MICC-F220, MICC-F600, MICC-F2000, and CoMoFoD demonstrate the effectiveness of the proposed method with a True Positive Rate (TPR) of 100%. [ABSTRACT FROM AUTHOR]

Human action recognition analyzes the behavior in a scene according to the spatiotemporal features carried in image sequences. Existing works suffers from ineffective spatial–temporal feature learning. For short video sequence, the critical challenge is to extract informative spatiotemporal features from a limited-length video. For long video sequences, combining long-range contextual information can improve recognition performance. However, conventional methods primarily consider modeling the action's spatiotemporal features along a single direction, which is difficult to consider context information and ignores the information from the opposite direction. This article proposes a bi-directional network to simulate the bi-directional Long Short-Term Memory (Bi-LSTM) processing of time series data. Specifically, two 3D Convolutional Neural Networks (3D CNNs) extract spatiotemporal features along the forward and backward image sequence of action for each modality individually. After integrating the features of each branch, a dynamic-fusion strategy is applied to obtain a video-level prediction. We conducted comprehensive experiments on the action recognition dataset UCF101 and HMDB51 and achieved 98.0% and 81.4% recognition accuracy, respectively, with a reduction of three quarters of the inputting RGB images. [ABSTRACT FROM AUTHOR]

Objectives The high incidence of prostate cancer causes prostatic samples to significantly affect pathology laboratories workflow and turnaround times (TATs). Whole-slide imaging (WSI) and artificial intelligence (AI) have both gained approval for primary diagnosis in prostate pathology, providing physicians with novel tools for their daily routine. Methods A systematic review according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines was carried out in electronic databases to gather the available evidence on the application of AI-based algorithms to prostate cancer. Results Of 6290 articles, 80 were included, mostly (59%) dealing with biopsy specimens. Glass slides were digitized to WSI in most studies (89%), roughly two-thirds of which (66%) exploited convolutional neural networks for computational analysis. The algorithms achieved good to excellent results about cancer detection and grading, along with significantly reduced TATs. Furthermore, several studies showed a relevant correlation between AI-identified histologic features and prognostic predictive variables such as biochemical recurrence, extraprostatic extension, perineural invasion, and disease-free survival. Conclusions The published evidence suggests that AI can be reliably used for prostate cancer detection and grading, assisting pathologists in the time-consuming screening of slides. Further technologic improvement would help widening AI's adoption in prostate pathology, as well as expanding its prognostic predictive potential. [ABSTRACT FROM AUTHOR]

To tackle the difficulty of extracting features from one-dimensional spectral signals using traditional spectral analysis, a metabolomics analysis method is proposed to locate two-dimensional correlated spectral feature bands and combine it with deep learning classification for wine origin traceability. Metabolomics analysis was performed on 180 wine samples from 6 different wine regions using UPLC-Q-TOF-MS. Indole, Sulfacetamide, and caffeine were selected as the main differential components. By analyzing the molecular structure of these components and referring to the main functional groups on the infrared spectrum, characteristic band regions with wavelengths in the range of 1000–1400 nm and 1500–1800 nm were selected. Draw two-dimensional correlation spectra (2D-COS) separately, generate synchronous correlation spectra and asynchronous correlation spectra, establish convolutional neural network (CNN) classification models, and achieve the purpose of wine origin traceability. The experimental results demonstrate that combining two segments of two-dimensional characteristic spectra determined by metabolomics screening with convolutional neural networks yields optimal classification results. This validates the effectiveness of using metabolomics screening to determine spectral feature regions in tracing wine origin. This approach effectively removes irrelevant variables while retaining crucial chemical information, enhancing spectral resolution. This integrated approach strengthens the classification model's understanding of samples, significantly increasing accuracy. [ABSTRACT FROM AUTHOR]

With the massive amount of data available on the Internet, many users face problems when they need access to the information and goods they need. Adapting information to user needs has become a complex and time-consuming process. Recommender systems are powerful tools for guiding users in electronic settings to information, services, and goods of interest. With the ability to identify users and predict their preferences, recommender systems can extract information likely to be of interest to users from vast amounts of data and save time and energy by providing them with relevant recommendations. Therefore, in this paper, a framework for a recommender system is proposed, which consists of four main phases. In the first phase, the preprocessing operation is performed. The purpose of this phase is to create an ontology model for products based on the convolutional neural network method. Data collection operations are carried out in the second phase. The purpose of this phase is to receive and store user information based on behavior and different criteria. The third phase is related to creating an ontology. The purpose of this phase is to create an ontology model for user behavior using OWL libraries. Finally, in the last phase, finding similarities and presented a proposal. The purpose of this phase is the necessary calculations of the proposed framework in the similarity finding section using ontology models. Simulation results show that the proposed framework measures MAE (more than 10 and 15%), RMSE (more than 12 and 16%), precision (less than 10 and 13%), recall (more than 25 and 28%), F1-score (higher than 25 and 30%) and Score of User (higher than 15 and 17%) outperform two related approaches, namely CF and CF+ Ontology, respectively. [ABSTRACT FROM AUTHOR]

Given a crowd image, there are two ways for human to approximate the counting number: exactly locating head points in each local region or directly estimating the total number of person based on the whole image. By imitating human visual perception, CNN and transformer are two mainstream models for solving crowd counting challenging, among which CNN has a strong ability to extract locality-oriented feature and transformer is suitable for modeling global dependencies. Based on the fact, in this paper, the proposed CLDE-Net is the first study that fulfills exact localization and direct estimation by designing the hybrid of CNN and transformer, to be specific, CNN searches all candidate head points in each local region and transformer learns the crowd density map with global receptive fields. Furthermore, we adopt two pipelines to further boost crowd counting performance: (1) cross-layer feature interaction module is employed to facilitate information transmission between two network branches of CNN and transformer and (2) dynamic factor generator is designed to adaptively fuse the result of head point localization and density map estimation. Extensive experiments show that the proposed CLDE-Net framework achieves the state-of-the-art performance on multiple data sets for crowd counting. [ABSTRACT FROM AUTHOR]

Re-ranking is a task of refining an initially ranked list of images obtained from an image retrieval technique for a given query image, with the goal of enhancing retrieval performance in an efficient manner. However, existing re-ranking methods suffer from high computational complexity, leading to slow and resource-intensive operations that render them to be impractical for real-life applications. This necessitates the development of a computationally efficient re-ranking approach that effectively improves the retrieval performance. In this paper, we propose a novel and computationally efficient re-ranking method for image retrieval, utilizing the speedy and proficient nature of image hashing techniques for image representation. Use of the hash code of an image using its DCT and DWT coefficients constitutes the basis of the proposed re-ranking technique. Three balanced binary search trees, one using the hash codes of the images corresponding to the DCT coefficients, and the other two using the most significant and the least significant bits of the hash codes corresponding to the DWT coefficients, are formed. Each balanced binary search tree is searched by comparing the hash code of the query image with those of the images in the tree starting from its root to form a set of the images that are comparable to the query image. Finally, the three sets of the images resulting from the three balanced binary search trees are used to obtain the final re-ranked list of retrieved images. Experimental results on the proposed retrieval scheme based on hashing-based re-ranking and various other image retrieval schemes using benchmark datasets demonstrate the superiority of our approach in terms of computational efficiency and retrieval performance. [ABSTRACT FROM AUTHOR]

Objectives: Transcranial sonography has been used as a valid neuroimaging tool to diagnose Parkinson's disease (PD). This study aimed to develop a modified transcranial sonography (TCS) technique based on a deep convolutional neural network (DCNN) model to predict Parkinson's disease. Methods: This retrospective diagnostic study was conducted using 1529 transcranial sonography images collected from 854 patients with PD and 775 normal controls admitted to the Second Affiliated Hospital of Soochow University (Suzhou, Jiangsu, China) between September 2019 and May 2022. The data set was divided into training cohorts (570 PD patients and 541 normal controls), and the validation set (184 PD patients and 234 normal controls). Using these datasets, we developed four different DCNN models (ResNet18, ResNet50, ResNet152, and DenseNet121). We then assessed their diagnostic performance, including the area under the receiver operating characteristic (AUROC) curve, specificity, sensitivity, positive predictive value (PPV), negative predictive value (NPV), and F1 score and compared with traditional diagnostic criteria. Results: Among the 1529 TCS images, 570 PD patients and 541 normal controls from 4 of 6 sonographers of the TCS team were selected as the training cohort, and 184 PD patients and 234 normal controls from the other 2 sonographers were chosen as the validation cohort. There were no sex and age differences between PD patients and normal control subjects in the training and validation cohorts (P values > 0.05). All DCNN models achieved good performance in distinguishing PD patients from normal control subjects on the validation datasets, with diagnostic AUROCs and accuracy of 0.949 (95% CI 0.925, 0.965) and 86.60 for the RestNet18 model, 0.949 (95% CI 0.929, 0.971) and 87.56 for ResNet50, 0.945 (95% CI 0.931, 0.969) and 88.04 for ResNet152, 0.953 (95% CI 0.935, 0.971) and 87.80 for DenseNet121, respectively. On the other hand, the diagnostic accuracy of the traditional diagnostic method was 82.30. The accuracy of all DCNN models was higher than that of traditional diagnostic method. Moreover, the 5k-fold cross-validation results in train datasets showed that these DCNN models are robust. Conclusion: The developed transcranial sonography-based DCNN models performed better than traditional diagnostic criteria, thus improving the sonographer's accuracy in diagnosing PD. [ABSTRACT FROM AUTHOR]

Research on the data-driven health state estimation of lithium-ion batteries has gained significant attention in recent years. However, the practical implementation of obtaining one data point in one cycle has resulted in poor data quality, leading to low accuracy and prediction instability. To overcome this challenge, a two-step approach is proposed. First, available data are enriched using Akima spline curve interpolation, and the overall degradation trend of the battery is extracted as a Sigmoid function, enhancing the data quality. Second, a parallel network model that combines the strengths of the convolutional neural network (CNN) and the long short-term memory network (LSTM) is introduced. This model leverages the ability of one-dimensional convolutional neural network (1DCNN) to effectively capture local features and proficiency of the LSTM in capturing long-term dependencies. By employing this hybrid model, a better understanding and prediction of the remaining battery life is achieved. Finally, based on the NASA public battery dataset, expanded and decomposed data are trained and predicted by the parallel network model. Experimental results demonstrate that the proposed method exhibits high accuracy and strong generalization capability. [ABSTRACT FROM AUTHOR]

Structural damage detection is crucial for ensuring the safety of civil building structures in operational environments. Recently, deep learning-based methods have gained increasing attention from engineers and researchers. The performance of conventional deep learning methods for structural damage detection relies on a large number of labeled training datasets. However, it is difficult or/and impossible to obtain sufficient datasets to cover various damage scenarios for in-service structures. A little research has been conducted to identify both the damage severity and location with limited labeled measurement data. A novel transfer learning-based method for structural damage identification with limited measurements has been proposed utilizing frequency response functions (FRFs) as the input. The real structure is regarded as the target domain and its numerical model is as the source domain. The samples for various damage scenarios are generated using the numerical model, and a designed deep convolutional neural network (CNN) is pre-trained. The knowledge of the pre-trained network is transferred to identify the damage location and severity of the real structure using limited measurement data. Numerical and experimental studies have been conducted on a three-story building structure to verify the performance of the proposed method. To understand transfer learning and model interpretability, the t-SNE feature visualization is adopted to show the feature distribution changes during transfer learning. Numerical and experimental results show that the proposed approach outperforms conventional CNN models, and it is effective and accurate in identifying structural damage location and severity in real structures with limited measurement data. [ABSTRACT FROM AUTHOR]

The efficacy of convolutional neural network (CNN)-enhanced electrocardiography (ECG) in detecting hypertrophic cardiomyopathy (HCM) and dilated HCM (dHCM) remains uncertain in real-world applications. This retrospective study analyzed data from 19,170 patients (including 140 HCM or dHCM) in the Shinken Database (2010–2017). We evaluated the sensitivity, positive predictive rate (PPR), and F1 score of CNN-enhanced ECG in a "basic diagnosis" model (total disease label) and a "comprehensive diagnosis" model (including disease subtypes). Using all-lead ECG in the "basic diagnosis" model, we observed a sensitivity of 76%, PPR of 2.9%, and F1 score of 0.056. These metrics improved in cases with a diagnostic probability of ≥ 0.9 and left ventricular hypertrophy (LVH) on ECG: 100% sensitivity, 8.6% PPR, and 0.158 F1 score. The "comprehensive diagnosis" model further enhanced these figures to 100%, 13.0%, and 0.230, respectively. Performance was broadly consistent across CNN models using different lead configurations, particularly when including leads viewing the lateral walls. While the precision of CNN models in detecting HCM or dHCM in real-world settings is initially low, it improves by targeting specific patient groups and integrating disease subtype models. The use of ECGs with fewer leads, especially those involving the lateral walls, appears comparably effective. [ABSTRACT FROM AUTHOR]

Matching optical and synthetic aperture radar (SAR) images is often challenged by intricate geometric distortion and nonlinear radiation differences, leading to insufficient and unevenly distributed corresponding points. To tackle this issue, we propose a lightweight deep convolutional network with inverted residuals for optical and SAR image matching. Initially, a fully convolutional neural network (FCNN) is designed to extract high-level and semantic features, robustly capturing universal characteristics between optical and SAR images, adept at handling geometric distortion and nonlinear radiation changes. Notably, we integrate a lightweight architecture with inverted residuals into FCNN to adeptly extract local and global contextual information, facilitating feature reuse and minimizing the loss of crucial features. Additionally, a vector-refined module is deployed to refine dense features, filtering out redundant information. Subsequently, a coarse-to-fine strategy is employed to further eliminate gross errors or incorrect matches. Finally, we evaluate the performance of the proposed network in optical and SAR image matching against manually-designed methods and state-of-the-art deep learning techniques. Experimental results demonstrate that our network significantly surpasses existing methods in terms of the number of correct matches and matching accuracy. Specifically, our proposed network achieves at least a 2.8 times increase in correct matches and an 18% improvement in matching accuracy compared to existing methods. [ABSTRACT FROM AUTHOR]

Decomposing an image into meaningful components is an effective way for image processing. Making full use of cartoon features and texture features with deep neural networks may further achieve the stable noise cancellation performance for low-dose computed tomography (LDCT) denoising. However, the performance of conventional deep neural networks is limited by their black-box nature. To overcome this drawback, we proposed an algorithm unrolling approach for LDCT denoising, namely, the cartoon-texture features guided network (CTFG-Net). The CTFG-Net integrates a cartoon sub-network, a texture sub-network, and a fusion sub-network into an end-to-end convolutional neural network model. A cartoon decomposition algorithm and a texture decomposition algorithm were unrolled to the cartoon sub-network and the texture sub-network, respectively. These two sub-networks were employed to decompose a LDCT image into its cartoon components and texture components. During the process of image decomposition, these two sub-networks exploited cartoon features and texture features to greatly suppress noise and remove artifacts in the corresponding components. At last, the final denoised results were yielded through a data fusion of the denoised cartoon components and the denoised texture components. The proposed model was tested with three datasets, Mayo dataset, Piglet dataset, and AbdomenCT-1K dataset. Qualitative results show that the CTFG-Net achieved better denoising effects for LDCT images than the competing algorithms. Compared to the competing algorithms, the proposed CTFG-Net also improved the peak signal-to-noise ratio, structural similarity index measure, and visual information fidelity by (0.3994 dB and 0.7692 dB), (0.0115 and 0.0056), and (0.0751 and 0.0433) with Mayo dataset and Piglet dataset. [ABSTRACT FROM AUTHOR]

We develop a novel framework for the analysis of medical imaging data, including magnetic resonance imaging, functional magnetic resonance imaging, computed tomography and more. Medical imaging data differ from general images in two main aspects: (i) the sample size is often considerably smaller and (ii) the interpretation of the model is usually more crucial than predicting the outcome. As a result, standard methods such as convolutional neural networks cannot be directly applied to medical imaging analysis. Therefore, we propose the deep Kronecker network , which can adapt to the low sample size constraint and offer the desired model interpretation. Our approach is versatile, as it works for both matrix- and tensor-represented image data and can be applied to discrete and continuous outcomes. The deep Kronecker network is built upon a Kronecker product structure, which implicitly enforces a piecewise smooth property on coefficients. Moreover, our approach resembles a fully convolutional network as the Kronecker structure can be expressed in a convolutional form. Interestingly, our approach also has strong connections to the tensor regression framework proposed by Zhou et al. (2013) , which imposes a canonical low-rank structure on tensor coefficients. We conduct both classification and regression analyses using real magnetic resonance imaging data from the Alzheimer's Disease Neuroimaging Initiative to demonstrate the effectiveness of our approach. [ABSTRACT FROM AUTHOR]

Evaluation of left ventricular (LV) function in critical care patients is useful for guidance of therapy and early detection of LV dysfunction, but the tools currently available are too time-consuming. To resolve this issue, we previously proposed a method for the continuous and automatic quantification of global LV function in critical care patients based on the detection and tracking of anatomical landmarks on transesophageal heart ultrasound. In the present study, our aim was to improve the performance of mitral annulus detection in transesophageal echocardiography (TEE). We investigated several state-of-the-art networks for both the detection and tracking of the mitral annulus in TEE. We integrated the networks into a pipeline for automatic assessment of LV function through estimation of the mitral annular plane systolic excursion (MAPSE), called autoMAPSE. TEE recordings from a total of 245 patients were collected from St. Olav's University Hospital and used to train and test the respective networks. We evaluated the agreement between autoMAPSE estimates and manual references annotated by expert echocardiographers in 30 Echolab patients and 50 critical care patients. Furthermore, we proposed a prototype of autoMAPSE for clinical integration and tested it in critical care patients in the intensive care unit. Compared with manual references, we achieved a mean difference of 0.8 (95% limits of agreement: –2.9 to 4.7) mm in Echolab patients, with a feasibility of 85.7%. In critical care patients, we reached a mean difference of 0.6 (95% limits of agreement: –2.3 to 3.5) mm and a feasibility of 88.1%. The clinical prototype of autoMAPSE achieved real-time performance. Automatic quantification of LV function had high feasibility in clinical settings. The agreement with manual references was comparable to inter-observer variability of clinical experts. [ABSTRACT FROM AUTHOR]

Plant diseases cause significant agricultural losses, demanding accurate detection methods. Traditional approaches relying on expert knowledge may be biased, but advancements in computing, particularly deep learning, offer non-experts effective tools. This study focuses on fine-tuning cutting-edge pre-trained CNN and vision transformer models to classify grape leaves and diagnose grape leaf diseases through digital images. Our research examined a PlantVillage dataset, which comprises 4062 leaf images distributed across four categories. Additionally, we utilized the Grapevine dataset, consisting of 500 leaf images. This dataset is organized into five distinct groups, with each group containing 100 images corresponding to one of the five grape types. The PlantVillage dataset focuses on four classes related to grape diseases, namely Black Rot, Leaf Blight, Healthy, and Esca leaves. On the other hand, the Grapevine dataset includes five classes for leaf recognition, specifically Ak, Alaidris, Buzgulu, Dimnit, and Nazli. In experiments with 14 CNN and 17 vision transformer models, deep learning demonstrated high accuracy in distinguishing grape diseases and recognizing leaves. Notably, four models achieved 100% accuracy on PlantVillage and Grapevine datasets, with Swinv2-Base standing out. This approach holds promise for enhancing crop productivity through early disease detection and providing insights into grape variety characterization in agriculture. [ABSTRACT FROM AUTHOR]

Alzheimer’s disease is a degenerative brain disease that impairs memory, thinking skills, and the ability to perform even the most basic tasks. The primary challenge in this domain is accurate early stage disease detection. When the disease is detected at an early stage, medical professionals can prescribe medications to reduce brain shrinkage. Although the disease may not be curable, these interventions can extend the patient’s life by slowing down the rate of shrinkage. The four cognitive states of the human brain are cognitive normal (CN), mild cognitive impairment convertible (MCIc), mild cognitive impairment non-convertible (MCInc), and Alzheimer’s disease (AD). Mild cognitive impairment convertible (MCIc) is the early stage of Alzheimer’s disease. Individuals with MCIc will develop Alzheimer’s disease for a few years. However, it is difficult to detect this state through medical investigations. The mild cognitive impairment non-convertible state (MCInc) is the state immediately before MCIc. MCInc is a common condition in people of all ages, where minor memory issues arise as a result of normal aging. Early detection of AD can be claimed if and only if the transition from MCInc to MCIc is complete. Deep learning algorithms can be promising techniques for identifying the progression stage of a disease using magnetic resonance imaging. In this study, a novel deep learning algorithm was proposed to improve the classification accuracy of MCIc vs. MCInc. This study utilized the advantages of local binary patterns along with squeeze and excitation networks (SENet). Without the squeeze and excitation network, the classification accuracy of MCIc versus MCInc was 82%. The classification accuracy improved by 86% with the use of SENet. The experimental results show that the proposed model achieves better performance for MCInc vs. MCIc classification in terms of accuracy, precision, recall, F1 score, and ROC. [ABSTRACT FROM AUTHOR]

In the bridge structure, the main bearing element is the spans, which are directly subject to random and continuous loads, environmental influences, ageing, etc. These factors are easy to lead to material deterioration. Therefore, this study proposes a novel approach to investigate the mechanical properties of the material. The span of the bridge is the selected structure for investigation. This study focuses on the general evaluation of mechanical factors consistent with reality, so the following main factors are to be carried out. First, the viscoelastic model of material will be applied to set up and solve the governing differential equation of the beams with material characteristics involving the elastic modulus (E) and the viscous coefficient (C). The viscoelastic model is different from the traditional elastic model due to its non-linearity, reflecting the actual state of the structure. Second, the random vibration signal-based Loss Factor function (LF) calculation using the Power Spectral Density (PSD) to detect changes in structures. LF is a feature representing changes in material properties, including elasticity and viscosity, and is suitable for many types of bridge structures. Also, the paper uses Cubic Interpolation (CI) to generate a surface representing the LF distribution. This interpolation results in surfaces with respect to the LF values distributed by frequencies and spectral amplitudes. Finally, the LF distribution-based material investigation using Convolutional Neural Network (CNN) is proposed with high performance and accuracy. This study applies the proposed method to several bridges in Ho Chi Minh City, Vietnam. It demonstrates that LF is highly suitable for bridge health monitoring. [ABSTRACT FROM AUTHOR]

The formation dip angle is an important characteristic parameter that reflects underground structures, and it is widely used in seismic exploration and geological interpretation. However, the routine dip angle calculation method suffers from the problems of artifact interference and insufficient accuracy, which restricts the development of fine exploration technology. More accurately obtaining the formation dip angle has become a general concern. To solve these problems, this paper proposes a method for calculating the formation dip angle using deep learning. The dip angle calculation is considered a regression problem. By establishing a database of synthetic seismic data and dip data tags, data-driven fitting of nonlinear functional relationships between the seismic data and dip angles are achieved, and intelligent dip calculations are realized. The method is verified using the synthetic sedimentary model and actual data and is compared with the mainstream dip angle calculation method in the industry. The results show that this method more realistically reflects the undulating characteristics of a structure with both high accuracy and anti-interference ability. [ABSTRACT FROM AUTHOR]