Search

Recently, coronary heart disease has attracted more and more attention, where segmentation and analysis for vascular lumen contour are helpful for treatment. And intravascular optical coherence tomography (IVOCT) images are used to display lumen shapes in clinic. Thus, an automatic segmentation method for IVOCT lumen contour is necessary to reduce the doctors' workload while ensuring diagnostic accuracy. In this paper, we proposed a deep residual segmentation network of multi-scale feature fusion based on attention mechanism (RSM-Network, Residual Squeezed Multi-Scale Network) to segment the lumen contour in IVOCT images. Firstly, three different data augmentation methods including mirror level turnover, rotation and vertical flip are considered to expand the training set. Then in the proposed RSM-Network, U-Net is contained as the main body, considering its characteristic of accepting input images with any sizes. Meanwhile, the combination of residual network and attention mechanism is applied to improve the ability of global feature extraction and solve the vanishing gradient problem. Moreover, the pyramid feature extraction structure is introduced to enhance the learning ability for multi-scale features. Finally, in order to increase the matching degree between the actual output and expected output, the cross entropy loss function is also used. A series of metrics are presented to evaluate the performance of our proposed network and the experimental results demonstrate that the proposed RSM-Network can learn the contour details better, contributing to strong robustness and accuracy for IVOCT lumen contour segmentation.

In recent years, with the continuous development of deep learning and knowledge graph reasoning methods, more and more researchers have shown great interest in improving knowledge graph reasoning methods by inferring missing facts through reasoning. By searching paths on the knowledge graph and making fact and link predictions based on these paths, deep learning-based Reinforcement Learning (RL) agents can demonstrate good performance and interpretability. Therefore, deep reinforcement learning-based knowledge reasoning methods have rapidly emerged in recent years and have become a hot research topic. However, even in a small and fixed knowledge graph reasoning action space, there are still a large number of invalid actions. It often leads to the interruption of RL agents' wandering due to the selection of invalid actions, resulting in a significant decrease in the success rate of path mining. In order to improve the success rate of RL agents in the early stages of path search, this article proposes a knowledge reasoning method based on Deep Transfer Reinforcement Learning path (DTRLpath). Before supervised pre-training and retraining, a pre-task of searching for effective actions in a single step is added. The RL agent is first trained in the pre-task to improve its ability to search for effective actions. Then, the trained agent is transferred to the target reasoning task for path search training, which improves its success rate in searching for target task paths. Finally, based on the comparative experimental results on the FB15K-237 and NELL-995 datasets, it can be concluded that the proposed method significantly improves the success rate of path search and outperforms similar methods in most reasoning tasks. [ABSTRACT FROM AUTHOR]

Brain tumors are among the most deadly forms of cancer, as the brain is a crucial organ for human activity. Early detection and treatment are key to recovery. An expert's final decision on tumor diagnosis mainly depends on the evaluation of Magnetic Resonance Imaging (MRI) images. However, the traditional manual assessment process is time-consuming, error-prone, and relies on the experience and knowledge of doctors, along with other unstable factors. An automated brain tumor detection system can assist radiologists and internal medicine experts in detecting and diagnosing brain tumors. This study proposes a novel deep learning model that combines residual units with a modified U-Net framework for brain tumor segmentation tasks in brain MR images. In this study, the U-Net-based framework is implemented with a stack of neural units and residual units and uses Leaky Rectified Linear Unit (LReLU) as the model's activation function. First, neural units are added before the first layer of downsampling and upsampling to enhance feature propagation and reuse. Then, the stacking of residual blocks is applied to achieve deep semantic information extraction for downsampling and pixel classification for upsampling. Finally, a single-layer convolution outputs the predicted segmented images. The experimental results show that the segmentation Dice Similarity Coefficient of this model is 90.79%, and the model demonstrates better segmentation accuracy than other research models. [ABSTRACT FROM AUTHOR]

The planet Earth is being affected by a series of wildfires, which have been steadily increasing over the last two decades. Forests have undergone deforestation due to natural forest fires and forest fires caused by man. These events are occurring on a global scale, and in Brazil, these wildfires are having an extreme impact on the Amazon forest as well as other forest biomes. This article proposes a novel lightweight convolutional neural network (CNN) model for wildfire detection through RGB images. This new method presents more advantages than the other methods used for the same task. Our CNN architecture can be used with aerial images from unmanned aerial vehicles and from video surveillance systems, combined with edge computing devices for image processing with a CNN. The proposed system is able to send wildfire alerts. The images do not have to be sent to a cloud computer as they can be processed in an edge device. However, it sends a string of alerts whenever a wildfire is detected. The evaluation of our proposed method showed that it required about 30 ms for the classification time, per image, and achieved an accuracy of 98.97% and an $F1$ -score of 95.77%, which is a very promising result. [ABSTRACT FROM AUTHOR]

• We review artificial intelligence applications of brain image preprocessing. • We investigate several commonly seen brain diseases and survey their intelligence-based methods. • We discuss AI's future in brain disease studies. Brain diseases threaten hundreds of thousands of people over the world. Medical imaging techniques such as MRI and CT are employed for various brain disease studies. As artificial intelligence succeeded in image analysis, scientists employed artificial intelligence, especially deep learning technologies, to assist brain disease studies. The AI applications for brain disease studies can be divided into two categories. The first category is preprocessing, including denoising, registration, skull-stripping, intensity normalization, and data augmentation. The second category is the clinical application that contains lesion segmentation, disease detection, grade classification, and outcome prediction. In this survey, we reviewed over one hundred representative papers on how to apply AI to brain disease studies. We first introduced AI-based preprocessing for brain disease studies. Second, we reviewed the influential works of AI-based brain disease studies. At last, we also discussed three development trends in the future. We hope this survey will inspire both expert-level researchers and entry-level beginners. [ABSTRACT FROM AUTHOR]

Coronary artery disease is among one of the diseases human suffer most. Intravascular coronary arterial image analysis consists of denoising, segmentation, detection, and three-dimensional reconstruction, having a significant meaning for auxiliary diagnosis and treatment of coronary artery disease. Intravascular ultrasound (IVUS) and intravascular optical coherence tomography (IVOCT) are the two most commonly applied intravascular coronary arterial imaging techniques. Based on these fundamental imaging techniques, in recent years, many advanced technologies from traditional machine learning algorithms to deep learning methods were employed in the analysis of intravascular coronary arterial images and made huge progress in this field. In this survey, we reviewed more than one hundred papers published in top journals or conferences such as Neural Networks and MICCAI. These papers proposed approaches or schemes for the intravascular coronary arterial image analysis, including lumen border segmentation, atherosclerotic plaque characterization, media-adventitia segmentation, stent strut detection, and three-dimensional reconstruction. Our survey began with introducing coronary artery intravascular imaging techniques, essential neural networks, and deep learning and then presented an across-the-board review of methods, applications, and trends of intravascular image analysis. This survey is more comprehensive than other articles not only for its scope and reference number but also for discussing the future direction in this field. Compared to other review papers in this field, this article could assist beginners in constructing a basic knowledge frame of coronary artery intravascular image analysis methods and brought state-of-the-art progress in this field to fellow researchers. We hope this paper could benefit either the beginners for coronary arterial image analysis or experienced researchers. [ABSTRACT FROM AUTHOR]

Diabetic Retinopathy (DR) is a severe complication of chronic diabetes causing significant visual deterioration and may lead to blindness with delay of being treated. Exudative diabetic maculopathy, a form of macular edema where hard exudates (HE) develop, is a frequent cause of visual deterioration in DR. The detection of HE comprises a significant role in the DR diagnosis. In this paper, an automatic exudates detection method based on superpixel multi-feature extraction and patch-based deep convolutional neural network is proposed. Firstly, superpixels, regarded as candidates, are generated on each resized image using the superpixel segmentation algorithm called Simple Linear Iterative Clustering (SLIC). Then, 25 features extracted from resized images and patches are generated on each feature. Patches are subsequently used to train a deep convolutional neural network, which distinguishes the hard exudates from the background. Experiments conducted on three publicly available datasets (DiaretDB1, e-ophtha EX and IDRiD) demonstrate that our proposed methodology achieved superior HE detection when compared with current state-of-art algorithms. [ABSTRACT FROM AUTHOR]

In this article, we present a deep learning approach to sketch-based shape retrieval that incorporates a few novel techniques to improve the quality of the retrieval results. First, to address the problem of scarcity of training sketch data, we present a sketch augmentation method that more closely mimics human sketches compared to simple image transformation. Our method generates more sketches from the existing training data by (i) removing a stroke, (ii) adjusting a stroke, and (iii) rotating the sketch. As such, we generate a large number of sketch samples for training our neural network. Second, we obtain the 2D renderings of each 3D model in the shape database by determining the view positions that best depict the 3D shape: i.e., avoiding self-occlusion, showing the most salient features, and following how a human would normally sketch the model. We use a convolutional neural network (CNN) to learn the best viewing positions of each 3D model and generates their 2D images for the next step. Third, our method uses a cross-domain learning strategy based on two Siamese CNNs that pair up sketches and the 2D shape images. A joint Bayesian measure is used to measure the output similarity from these CNNs to maximize inter-class similarity and minimize intra-class similarity. Extensive experiments show that our proposed approach comprehensively outperforms many existing state-of-the-art methods. [ABSTRACT FROM AUTHOR]

The Internet of Things (IoT) technology has been widely introduced to the existing medical system. An eHealth system based on IoT devices has gained widespread popularity. In this article, we propose an IoT eHealth framework to provide an autonomous solution for patients with interventional cardiovascular diseases. In this framework, wearable sensors are used to collect a patient's health data, which is daily monitored by a remote doctor. When the monitoring data is abnormal, the remote doctor will ask for image acquisition of the patient's cardiovascular internal conditions. We leverage edge computing to classify these training images by the local base classifier; thereafter, pseudo-labels are generated according to its output. Moreover, a deep segmentation network is leveraged for the segmentation of stent structs in intravascular optical coherence tomography and intravenous ultrasound images of patients. The experimental results demonstrate that remote and local doctors perform real-time visual communication to complete telesurgery. In the experiments, we adopt the U-net backbone with a pretrained SeResNet34 as the encoder to segment the stent structs. Meanwhile, a series of comparative experiments have been conducted to demonstrate the effectiveness of our method based on accuracy, sensitivity, Jaccard, and dice. [ABSTRACT FROM AUTHOR]

Fault detection and diagnosis (FDD) is crucial for stable, reliable, and safe operation of industrial equipment. In recent years, deep learning models have been widely used in data-driven FDD methods because of their automatic feature learning capability. In general, these models are trained on historical sensor data, and therefore, it is very difficult to meet the real-time requirement of online FDD applications. Since transfer learning can solve different but similar problems in the target domain efficiently and effectively with the knowledge learned from the source domain, this paper proposes an online fault diagnosis method based on a deep transfer convolutional neural network (TCNN) framework. The TCNN framework is made up of an online CNN based on LeNet-5 and several offline CNNs with a shallow structure. First, time-domain signal data are converted into images that contain abundant fault information and are suitable as the input of CNN. Then, the online CNN is constructed to automatically extract representative features from the converted images and classify faults. Finally, in order to improve the real-time performance of the online CNN, several offline CNNs are also constructed and pretrained on related data sets. By directly transferring the shallow layers of the trained offline CNNs to the online CNN, the online CNN can significantly improve the real-time performance and successfully address the issue of achieving the desired diagnostic accuracy within limited training time. The proposed method is validated on two bearing data sets and one pump data set, respectively. The prediction accuracy of the proposed method using three data sets are 99.88%, 99.13%, and 99.98%, respectively. The experimental results also indicate that the improvement of accuracy is 19.21% for the motor bearing case, 29.82% for the rolling mill bearing case, and 33.26% for the pump case during the early stage of learning. [ABSTRACT FROM AUTHOR]

• More than 245 references from top journals are analyzed. • A systematic theoretical analysis of deep learning in dentistry is provided. • Extensive works on deep learning systems of dentistry are well summarized. • Future challenges of deep learning methods in dentistry are analyzed. Oral diseases have a significant impact on human health, often going unnoticed in their early stages. Deep learning, a promising field in artificial intelligence, has shown remarkable success in various domains, especially dentistry. This paper aims to provide an overview of recent research on deep learning applications in dentistry, with a focus on dental imaging. Deep learning algorithms perform well in difficult tasks such as image segmentation and recognition, enabling accurate identification of oral conditions and abnormalities. Integration of deep learning with other oral health data offers a holistic understanding of the relationship between oral and systemic health. However, there are still many challenges that need to be addressed. [ABSTRACT FROM AUTHOR]

Aim: Multiple sclerosis is a severe brain and/or spinal cord disease. It may lead to a wide range of symptoms. Hence, the early diagnosis and treatment is quite important. Method: This study proposed a 14-layer convolutional neural network, combined with three advanced techniques: batch normalization, dropout, and stochastic pooling. The output of the stochastic pooling was obtained via sampling from a multinomial distribution formed from the activations of each pooling region. In addition, we used data augmentation method to enhance the training set. In total 10 runs were implemented with the hold-out randomly set for each run. Results: The results showed that our 14-layer CNN secured a sensitivity of 98.77 ± 0.35%, a specificity of 98.76 ± 0.58%, and an accuracy of 98.77 ± 0.39%. Conclusion: Our results were compared with CNN using maximum pooling and average pooling. The comparison shows stochastic pooling gives better performance than other two pooling methods. Furthermore, we compared our proposed method with six state-of-the-art approaches, including five traditional artificial intelligence methods and one deep learning method. The comparison shows our method is superior to all other six state-of-the-art approaches. [ABSTRACT FROM AUTHOR]

• Real time semantic segmentation for road scene understanding. • Follow two branch network strategy. • Utilize dilated spatial attention and channel attention. • Use supervision to ease the loss propagation. Efficient and accurate semantic segmentation is particularly important in scene understanding for autonomous driving. Although Deep Convolutional Neural Networks(DCNNs) approaches have made a significant improvement for semantic segmentation. However, state-of-the-art models such as Deeplab and PSPNet have complex architectures and high computation complexity. Thus, it is inefficient for realtime applications. On the other hand, many works compromise the performance to obtain real-time inference speed which is critical for developing a light network model with high segmentation accuracy. In this paper, we present a computationally efficient network named DSANet, which follows a two-branch strategy to tackle the problem of real-time semantic segmentation in urban scenes. We first design a Semantic Encoding Branch, which employs channel split and shuffle to reduce the computation and maintain higher segmentation accuracy. Also, we propose a dual attention module consisting of dilated spatial attention and channel attention to make full use of the multi-level feature maps simultaneously, which helps predict the pixel-wise labels in each stage. Meanwhile, Spatial Encoding Network is used to enhance semantic information and preserve the spatial details. To better combine context information and spatial information, we introduce a Simple Feature Fusion Module. We evaluated our model with state-of-the-art semantic image semantic segmentation methods using two challenging datasets. The proposed method achieves an accuracy of 69.9% mean IoU and 71.3% mean IoU at speed of 75.3 fps and 34.08 fps on CamVid and Cityscapes test datasets respectively. [ABSTRACT FROM AUTHOR]

Real-time semantic segmentation provides precise insights into dynamic street environments for autonomous driving, traffic control, and urban planning. However, state-of-the-art models following attention mechanisms and deep convolutional neural networks have improved semantic segmentation at the cost of complex architectures and high computation complexity. The study aims to mitigate the presence of gridding artifacts and enhance semantic segmentation performance. In addition, we propose a multi-level downsampling approach before employing the depth-wise split separable global convolution with the bottleneck to achieve a trade-off between accuracy and inference time. The spatial attention module used in this study effectively keeps low-level spatial characteristics, enhancing the accuracy of localization, robustness against disturbances, processing efficiency, and the ability to handle occlusions. Thorough tests of the Cityscapes and CamVid datasets available for public access indicate that the model presented is capable of efficiently processing high-resolution photos in real time, resulting in exceptional performance. The model has achieved an accuracy of 72.3% on the cityscapes dataset and 72.7% on the CamVid dataset. [ABSTRACT FROM AUTHOR]