Search

Image fusion currently plays an important role in the diagnosis of prostate cancer (PCa). Selecting and developing a good image fusion algorithm is the core task of achieving image fusion, which determines whether the fusion image obtained is of good quality and can meet the actual needs of clinical application. In recent years, it has become one of the research hotspots of medical image fusion. In order to make a comprehensive study on the methods of medical image fusion, this paper reviewed the relevant literature published at home and abroad in recent years. Image fusion technologies were classified, and image fusion algorithms were divided into traditional fusion algorithms and deep learning (DL) fusion algorithms. The principles and workflow of some algorithms were analyzed and compared, their advantages and disadvantages were summarized, and relevant medical image data sets were introduced. Finally, the future development trend of medical image fusion algorithm was prospected, and the development direction of medical image fusion technology for the diagnosis of prostate cancer and other major diseases was pointed out.

Breast cancer is a malignancy caused by the abnormal proliferation of breast epithelial cells, predominantly affecting female patients, and it is commonly diagnosed using histopathological images. Currently, deep learning techniques have made significant breakthroughs in medical image processing, outperforming traditional detection methods in breast cancer pathology classification tasks. This paper first reviewed the advances in applying deep learning to breast pathology images, focusing on three key areas: multi-scale feature extraction, cellular feature analysis, and classification. Next, it summarized the advantages of multimodal data fusion methods for breast pathology images. Finally, the study discussed the challenges and future prospects of deep learning in breast cancer pathology image diagnosis, providing important guidance for advancing the use of deep learning in breast diagnosis.

Organoids are an in vitro model that can simulate the complex structure and function of tissues in vivo . Functions such as classification, screening and trajectory recognition have been realized through organoid image analysis, but there are still problems such as low accuracy in recognition classification and cell tracking. Deep learning algorithm and organoid image fusion analysis are the most advanced organoid image analysis methods. In this paper, the organoid image depth perception technology is investigated and sorted out, the organoid culture mechanism and its application concept in depth perception are introduced, and the key progress of four depth perception algorithms such as organoid image and classification recognition, pattern detection, image segmentation and dynamic tracking are reviewed respectively, and the performance advantages of different depth models are compared and analyzed. In addition, this paper also summarizes the depth perception technology of various organ images from the aspects of depth perception feature learning, model generalization and multiple evaluation parameters, and prospects the development trend of organoids based on deep learning methods in the future, so as to promote the application of depth perception technology in organoid images. It provides an important reference for the academic research and practical application in this field.

Deep learning-based automatic classification of diabetic retinopathy (DR) helps to enhance the accuracy and efficiency of auxiliary diagnosis. This paper presents an improved residual network model for classifying DR into five different severity levels. First, the convolution in the first layer of the residual network was replaced with three smaller convolutions to reduce the computational load of the network. Second, to address the issue of inaccurate classification due to minimal differences between different severity levels, a mixed attention mechanism was introduced to make the model focus more on the crucial features of the lesions. Finally, to better extract the morphological features of the lesions in DR images, cross-layer fusion convolutions were used instead of the conventional residual structure. To validate the effectiveness of the improved model, it was applied to the Kaggle Blindness Detection competition dataset APTOS2019. The experimental results demonstrated that the proposed model achieved a classification accuracy of 97.75% and a Kappa value of 0.971 7 for the five DR severity levels. Compared to some existing models, this approach shows significant advantages in classification accuracy and performance.

High-grade serous ovarian cancer has a high degree of malignancy, and at detection, it is prone to infiltration of surrounding soft tissues, as well as metastasis to the peritoneum and lymph nodes, peritoneal seeding, and distant metastasis. Whether recurrence occurs becomes an important reference for surgical planning and treatment methods for this disease. Current recurrence prediction models do not consider the potential pathological relationships between internal tissues of the entire ovary. They use convolutional neural networks to extract local region features for judgment, but the accuracy is low, and the cost is high. To address this issue, this paper proposes a new lightweight deep learning algorithm model for predicting recurrence of high-grade serous ovarian cancer. The model first uses ghost convolution (Ghost Conv) and coordinate attention (CA) to establish ghost counter residual (SCblock) modules to extract local feature information from images. Then, it captures global information and integrates multi-level information through proposed layered fusion Transformer (STblock) modules to enhance interaction between different layers. The Transformer module unfolds the feature map to compute corresponding region blocks, then folds it back to reduce computational cost. Finally, each STblock module fuses deep and shallow layer depth information and incorporates patient's clinical metadata for recurrence prediction. Experimental results show that compared to the mainstream lightweight mobile visual Transformer (MobileViT) network, the proposed slicer visual Transformer (SlicerViT) network improves accuracy, precision, sensitivity, and F1 score, with only 1/6 of the computational cost and half the parameter count. This research confirms that the proposed algorithm model is more accurate and efficient in predicting recurrence of high-grade serous ovarian cancer. In the future, it can serve as an auxiliary diagnostic technique to improve patient survival rates and facilitate the application of the model in embedded devices.

Mass spectrometry imaging (MSI) is a promising method for characterizing the spatial distribution of compounds. Given the diversified development of acquisition methods and continuous improvements in the sensitivity of this technology, both the total amount of generated data and complexity of analysis have exponentially increased, rendering increasing challenges of data postprocessing, such as large amounts of noise, background signal interferences, as well as image registration deviations caused by sample position changes and scan deviations, and etc. Deep learning (DL) is a powerful tool widely used in data analysis and image reconstruction. This tool enables the automatic feature extraction of data by building and training a neural network model, and achieves comprehensive and in-depth analysis of target data through transfer learning, which has great potential for MSI data analysis. This paper reviews the current research status, application progress and challenges of DL in MSI data analysis, focusing on four core stages: data preprocessing, image reconstruction, cluster analysis, and multimodal fusion. The application of a combination of DL and mass spectrometry imaging in the study of tumor diagnosis and subtype classification is also illustrated. This review also discusses trends of development in the future, aiming to promote a better combination of artificial intelligence and mass spectrometry technology.

In computer-aided medical diagnosis, obtaining labeled medical image data is expensive, while there is a high demand for model interpretability. However, most deep learning models currently require a large amount of data and lack interpretability. To address these challenges, this paper proposes a novel data augmentation method for medical image segmentation. The uniqueness and advantages of this method lie in the utilization of gradient-weighted class activation mapping to extract data efficient features, which are then fused with the original image. Subsequently, a new channel weight feature extractor is constructed to learn the weights between different channels. This approach achieves non-destructive data augmentation effects, enhancing the model's performance, data efficiency, and interpretability. Applying the method of this paper to the Hyper-Kvasir dataset, the intersection over union (IoU) and Dice of the U-net were improved, respectively; and on the ISIC-Archive dataset, the IoU and Dice of the DeepLabV3+ were also improved respectively. Furthermore, even when the training data is reduced to 70 %, the proposed method can still achieve performance that is 95 % of that achieved with the entire dataset, indicating its good data efficiency. Moreover, the data-efficient features used in the method have interpretable information built-in, which enhances the interpretability of the model. The method has excellent universality, is plug-and-play, applicable to various segmentation methods, and does not require modification of the network structure, thus it is easy to integrate into existing medical image segmentation method, enhancing the convenience of future research and applications.

Magnetic resonance imaging(MRI) can obtain multi-modal images with different contrast, which provides rich information for clinical diagnosis. However, some contrast images are not scanned or the quality of the acquired images cannot meet the diagnostic requirements due to the difficulty of patient's cooperation or the limitation of scanning conditions. Image synthesis techniques have become a method to compensate for such image deficiencies. In recent years, deep learning has been widely used in the field of MRI synthesis. In this paper, a synthesis network based on multi-modal fusion is proposed, which firstly uses a feature encoder to encode the features of multiple unimodal images separately, and then fuses the features of different modal images through a feature fusion module, and finally generates the target modal image. The similarity measure between the target image and the predicted image in the network is improved by introducing a dynamic weighted combined loss function based on the spatial domain and K-space domain. After experimental validation and quantitative comparison, the multi-modal fusion deep learning network proposed in this paper can effectively synthesize high-quality MRI fluid-attenuated inversion recovery (FLAIR) images. In summary, the method proposed in this paper can reduce MRI scanning time of the patient, as well as solve the clinical problem of missing FLAIR images or image quality that is difficult to meet diagnostic requirements.

Heart failure is a disease that seriously threatens human health and has become a global public health problem. Diagnostic and prognostic analysis of heart failure based on medical imaging and clinical data can reveal the progression of heart failure and reduce the risk of death of patients, which has important research value. The traditional analysis methods based on statistics and machine learning have some problems, such as insufficient model capability, poor accuracy due to prior dependence, and poor model adaptability. In recent years, with the development of artificial intelligence technology, deep learning has been gradually applied to clinical data analysis in the field of heart failure, showing a new perspective. This paper reviews the main progress, application methods and major achievements of deep learning in heart failure diagnosis, heart failure mortality and heart failure readmission, summarizes the existing problems and presents the prospects of related research to promote the clinical application of deep learning in heart failure clinical research.

In recent years, the application of artificial intelligence technology in the field of orthodontics has gradually increased, and deep learning, as a hot direction, has also been rapidly applied in the detection, evaluation, diagnosis, prediction and effect evaluation. At present, deep learning research has the advantages of high efficiency and accuracy, but it also has limitations such as weak interpretability and insufficient data volume. This paper reviewed the proposal and development of deep learning, the application in orthodontic diagnosis and treatment, as well as the limitations and countermeasures of the popularization, and prospect of the future research.

In recent years, epileptic seizure detection based on electroencephalogram (EEG) has attracted the widespread attention of the academic. However, it is difficult to collect data from epileptic seizure, and it is easy to cause over fitting phenomenon under the condition of few training data. In order to solve this problem, this paper took the CHB-MIT epilepsy EEG dataset from Boston Children's Hospital as the research object, and applied wavelet transform for data augmentation by setting different wavelet transform scale factors. In addition, by combining deep learning, ensemble learning, transfer learning and other methods, an epilepsy detection method with high accuracy for specific epilepsy patients was proposed under the condition of insufficient learning samples. In test, the wavelet transform scale factors 2, 4 and 8 were set for experimental comparison and verification. When the wavelet scale factor was 8, the average accuracy, average sensitivity and average specificity was 95.47%, 93.89% and 96.48%, respectively. Through comparative experiments with recent relevant literatures, the advantages of the proposed method were verified. Our results might provide reference for the clinical application of epilepsy detection.

O 6 -carboxymethyl guanine(O 6 -CMG) is a highly mutagenic alkylation product of DNA that causes gastrointestinal cancer in organisms. Existing studies used mutant Mycobacterium porin A (MspA) nanopore assisted by Phi29 DNA polymerase to localize it. Recently, machine learning technology has been widely used in the analysis of nanopore sequencing data. But the machine learning always need a large number of data labels that have brought extra work burden to researchers, which greatly affects its practicability. Accordingly, this paper proposes a nano-Unsupervised-Deep-Learning method (nano-UDL) based on an unsupervised clustering algorithm to identify methylation events in nanopore data automatically. Specially, nano-UDL first uses the deep AutoEncoder to extract features from the nanopore dataset and then applies the MeanShift clustering algorithm to classify data. Besides, nano-UDL can extract the optimal features for clustering by joint optimizing the clustering loss and reconstruction loss. Experimental results demonstrate that nano-UDL has relatively accurate recognition accuracy on the O smegmatis porin A (MspA) nanopore assisted by Phi29 DNA polymerase to localize it. Recently, machine learning technology has been widely used in the analysis of nanopore sequencing data. But the machine learning always need a large number of data labels that have brought extra work burden to researchers, which greatly affects its practicability. Accordingly, this paper proposes a nano-Unsupervised-Deep-Learning method (nano-UDL) based on an unsupervised clustering algorithm to identify methylation events in nanopore data automatically. Specially, nano-UDL first uses the deep AutoEncoder to extract features from the nanopore dataset and then applies the MeanShift clustering algorithm to classify data. Besides, nano-UDL can extract the optimal features for clustering by joint optimizing the clustering loss and reconstruction loss. Experimental results demonstrate that nano-UDL has relatively accurate recognition accuracy on the O 6 -CMG. In order to further verify the robustness of nano-UDL, hyperparameter sensitivity verification and ablation experiments were carried out in this paper. Using machine learning to analyze nanopore data can effectively reduce the additional cost of manual data analysis, which is significant for many biological studies, including genome sequencing.6 -CMG. In order to further verify the robustness of nano-UDL, hyperparameter sensitivity verification and ablation experiments were carried out in this paper. Using machine learning to analyze nanopore data can effectively reduce the additional cost of manual data analysis, which is significant for many biological studies, including genome sequencing.

In recent years, medical imaging technology and computer technology have made great progress. On the one hand, with the development and popularization of electronic laryngoscope, the image of electronic laryngoscope plays a very important role in the diagnosis of vocal cord lesions. On the other hand, deep learning algorithm，especially convolutional neural networkhas gradually become the first choice of medical image recognition since the foundation of deep learning algorithm. So far, deep learning algorithm has made great contributions in many disciplines. In this paper, the basic concept of deep learning, the current status of image recognition of vocal cord lesions, and the prospect of research based on deep learning in vocal cord image lesions recognition are reviewed., Competing Interests: The authors of this article and the planning committee members and staff have no relevant financial relationships with commercial interests to disclose., (Copyright© by the Editorial Department of Journal of Clinical Otorhinolaryngology Head and Neck Surgery.)

In the 21 st century, the rise of artificial intelligence(AI) marks the arrival of the intelligence era or the era of Industry 4.0. In addition to the rapid development of computer and electronic information science, machine learning, as the core intelligence of AI, provides a new methodology for the modernization of traditional Chinese medicine. The algorithms of machine learning include support vector machine(SVM), extreme learning machine(ELM), convolutional neural network(CNN), and recurrent neural network(RNN). The combination of machine learning algorithms and hyperspectral imaging analysis could be used for the identification of fake and inferior herbs, the origin of herbs and the content determination of bioactive ingredients in herbs, which has largely solved the difficulty in strictly controlling the quality of traditional Chinese medicine. The integration of high spectral imaging(HSI) and deep lear-ning will make the predicted results more reliable and suitable for analysis of great amounts of samples. This paper summarizes the application of hyperspectral imaging technology(HSI) and machine learning algorithms in the field of traditional Chinese medicine in recent years, focuses on the principles of hyperspectral imaging technology, preprocessing methods and deep learning algorithms, and gives the prospects of evolution of hyperspectral imaging technology in the field.

In recent years, deep learning has provided a new method for cancer prognosis analysis. The literatures related to the application of deep learning in the prognosis of cancer are summarized and their advantages and disadvantages are analyzed, which can be provided for in-depth research. Based on this, this paper systematically reviewed the latest research progress of deep learning in the construction of cancer prognosis model, and made an analysis on the strengths and weaknesses of relevant methods. Firstly, the construction idea and performance evaluation index of deep learning cancer prognosis model were clarified. Secondly, the basic network structure was introduced, and the data type, data amount, and specific network structures and their merits and demerits were discussed. Then, the mainstream method of establishing deep learning cancer prognosis model was verified and the experimental results were analyzed. Finally, the challenges and future research directions in this field were summarized and expected. Compared with the previous models, the deep learning cancer prognosis model can better improve the prognosis prediction ability of cancer patients. In the future, we should continue to explore the research of deep learning in cancer recurrence rate, cancer treatment program and drug efficacy evaluation, and fully explore the application value and potential of deep learning in cancer prognosis model, so as to establish an efficient and accurate cancer prognosis model and realize the goal of precision medicine.

Brain image segmentation algorithm based on deep learning is a research hotspot at present. In this paper, firstly, the significance of brain image segmentation and the content of related brain image segmentation algorithm are systematically described, highlighting the advantages of brain image segmentation algorithms based on deep learning. Then, this paper introduces current brain image segmentation algorithms based on deep learning from three aspects: the brain image segmentation algorithms based on problems existent to brain image, the brain image segmentation algorithms based on prior knowledge guidance and the application of general deep learning models in brain image segmentation, so as to enable researchers in relevant fields to understand current research progress more systematically. Finally, this paper provides a general direction for the further research of brain image segmentation algorithm based on deep learning.

Traditional biomedical data analysis technology faces enormous challenges in the context of the big data era. The application of deep learning technology in the field of biomedical analysis has ushered in tremendous development opportunities. In this paper, we reviewed the latest research progress of deep learning in the field of biomedical data analysis. Firstly, we introduced the deep learning method and its common framework. Then, focusing on the proposal of biomedical problems, data preprocessing method, model building method and training algorithm, we summarized the specific application of deep learning in biomedical data analysis in the past five years according to the chronological order, and emphasized the application of deep learning in medical assistant diagnosis. Finally, we gave the possible development direction of deep learning in the field of biomedical data analysis in the future.

Lung cancer is a most common malignant tumor of the lung and is the cancer with the highest morbidity and mortality worldwide. For patients with advanced non-small cell lung cancer who have undergone epidermal growth factor receptor (EGFR) gene mutations, targeted drugs can be used for targeted therapy. There are many methods for detecting EGFR gene mutations, but each method has its own advantages and disadvantages. This study aims to predict the risk of EGFR gene mutation by exploring the association between the histological features of the whole slides pathology of non-small cell lung cancer hematoxylin-eosin (HE) staining and the patient's EGFR mutant gene. The experimental results show that the area under the curve (AUC) of the EGFR gene mutation risk prediction model proposed in this paper reached 72.4% on the test set, and the accuracy rate was 70.8%, which reveals the close relationship between histomorphological features and EGFR gene mutations in the whole slides pathological images of non-small cell lung cancer. In this paper, the molecular phenotypes were analyzed from the scale of the whole slides pathological images, and the combination of pathology and molecular omics was used to establish the EGFR gene mutation risk prediction model, revealing the correlation between the whole slides pathological images and EGFR gene mutation risk. It could provide a promising research direction for this field.

Human motion recognition (HAR) is the technological base of intelligent medical treatment, sports training, video monitoring and many other fields, and it has been widely concerned by all walks of life. This paper summarized the progress and significance of HAR research, which includes two processes: action capture and action classification based on deep learning. Firstly, the paper introduced in detail three mainstream methods of action capture: video-based, depth camera-based and inertial sensor-based. The commonly used action data sets were also listed. Secondly, the realization of HAR based on deep learning was described in two aspects, including automatic feature extraction and multi-modal feature fusion. The realization of training monitoring and simulative training with HAR in orthopedic rehabilitation training was also introduced. Finally, it discussed precise motion capture and multi-modal feature fusion of HAR, as well as the key points and difficulties of HAR application in orthopedic rehabilitation training. This article summarized the above contents to quickly guide researchers to understand the current status of HAR research and its application in orthopedic rehabilitation training.

The application of minimally invasive surgical tool detection and tracking technology based on deep learning in minimally invasive surgery is currently a research hotspot. This paper firstly expounds the relevant technical content of the minimally invasive surgery tool detection and tracking, which mainly introduces the advantages based on deep learning algorithm. Then, this paper summarizes the algorithm for detection and tracking surgical tools based on fully supervised deep neural network and the emerging algorithm for detection and tracking surgical tools based on weakly supervised deep neural network. Several typical algorithm frameworks and their flow charts based on deep convolutional and recurrent neural networks are summarized emphatically, so as to enable researchers in relevant fields to understand the current research progress more systematically and provide reference for minimally invasive surgeons to select navigation technology. In the end, this paper provides a general direction for the further research of minimally invasive surgical tool detection and tracking technology based on deep learning.

Alzheimer's disease (AD) is a typical neurodegenerative disease, which is clinically manifested as amnesia, loss of language ability and self-care ability, and so on. So far, the cause of the disease has still been unclear and the course of the disease is irreversible, and there has been no cure for the disease yet. Hence, early prognosis of AD is important for the development of new drugs and measures to slow the progression of the disease. Mild cognitive impairment (MCI) is a state between AD and healthy controls (HC). Studies have shown that patients with MCI are more likely to develop AD than those without MCI. Therefore, accurate screening of MCI patients has become one of the research hotspots of early prognosis of AD. With the rapid development of neuroimaging techniques and deep learning, more and more researchers employ deep learning methods to analyze brain neuroimaging images, such as magnetic resonance imaging (MRI), for early prognosis of AD. Hence, in this paper, a three-dimensional multi-slice classifiers ensemble based on convolutional neural network (CNN) and ensemble learning for early prognosis of AD has been proposed. Compared with the CNN classification model based on a single slice, the proposed classifiers ensemble based on multiple two-dimensional slices from three dimensions could use more effective information contained in MRI to improve classification accuracy and stability in a parallel computing mode.

Computer-aided diagnosis based on computed tomography (CT) image can realize the detection and classification of pulmonary nodules, and improve the survival rate of early lung cancer, which has important clinical significance. In recent years, with the rapid development of medical big data and artificial intelligence technology, the auxiliary diagnosis of lung cancer based on deep learning has gradually become one of the most active research directions in this field. In order to promote the deep learning in the detection and classification of pulmonary nodules, we reviewed the research progress in this field based on the relevant literatures published at domestic and overseas in recent years. This paper begins with a brief introduction of two widely used lung CT image databases: lung image database consortium and image database resource initiative (LIDC-IDRI) and Data Science Bowl 2017. Then, the detection and classification of pulmonary nodules based on different network structures are introduced in detail. Finally, some problems of deep learning in lung CT image nodule detection and classification are discussed and conclusions are given. The development prospect is also forecasted, which provides reference for future application research in this field.

With the development of image-guided surgery and radiotherapy, the demand for medical image registration is stronger and the challenge is greater. In recent years, deep learning, especially deep convolution neural networks, has made excellent achievements in medical image processing, and its research in registration has developed rapidly. In this paper, the research progress of medical image registration based on deep learning at home and abroad is reviewed according to the category of technical methods, which include similarity measurement with an iterative optimization strategy, direct estimation of transform parameters, etc. Then, the challenge of deep learning in medical image registration is analyzed, and the possible solutions and open research are proposed.

In this paper, the classification and location of neuroblastoma in NMR images are realized by using Deep Neural Network(CNN) algorithm as the core technology. The module is integrated to realize the development of computer-aided diagnostic software. It is used to make up for the gap in the field of intelligent identification and accurate positioning of neuroblastoma in the current nuclear magnetic resonance detection technology, effectively reduce the work intensity of doctors reading films, and further promote the clinical application and technical development of nuclear magnetic resonance detection technology in the diagnosis of neuroblastoma.

The development of computer hardware allows rapid accumulation of medical imaging data. Deep learning has shown great potential in medical imaging data analysis and establish a new area of machine learning. The commonly used deep learning models were firstly introduced in the paper, and then, summarized with the application of deep learning in the detection, classification, diagnosis, segmentation, identification of medical imaging. The application of deep learning in oral and maxillofacial radiology and other discipline of stomatology was proposed. At the end, the paper discussed the problems of deep learning in medical imaging research.

Restless legs syndrome,as a common sleep disorder,has nowadays long been diagnosed by self-rating scale and polysomnography.In this paper,a domestic diagnosis system for early restless legs syndrome based on deep learning is proposed,which is suitable for early patients with unstable symptoms in routine diagnosis.The hardware system is installed in the bed.And the non-contact sleeping dynamic signal acquisition is realized based on the acceleration sensors.The software system uses deep learning to classify and recognize the signals.A Fully Connected Feedforward Network based on Keras framework is constructed to recognize seven kinds of activities during sleeping.The accuracy of comprehensive classification is 97.83%.Based on former results,the periodic limb movement index and awakening index were evaluated to make the diagnosis of restless legs syndrome.

This paper performs a comprehensive study on the computer-aided detection for the medical diagnosis with deep learning. Based on the region convolution neural network and the prior knowledge of target, this algorithm uses the region proposal network, the region of interest pooling strategy, introduces the multi-task loss function: classification loss, bounding box localization loss and object rotation loss, and optimizes it by end-to-end. For medical image it locates the target automatically, and provides the localization result for the next stage task of segmentation. For the detection of left ventricular in echocardiography, proposed additional landmarks such as mitral annulus, endocardial pad and apical position, were used to estimate the left ventricular posture effectively. In order to verify the robustness and effectiveness of the algorithm, the experimental data of ultrasonic and nuclear magnetic resonance images are selected. Experimental results show that the algorithm is fast, accurate and effective.