Search

Abstract Pancreatoscopy plays a significant role in the diagnosis and treatment of pancreatic diseases. However, the risk of pancreatoscopy is remarkably greater than that of other endoscopic procedures, such as gastroscopy and bronchoscopy, owing to its severe invasiveness. In comparison, virtual pancreatoscopy (VP) has shown notable advantages. However, because of the low resolution of current computed tomography (CT) technology and the small diameter of the pancreatic duct, VP has limited clinical use. In this study, an optimal path algorithm and super-resolution technique are investigated for the development of an open-source software platform for VP based on 3D Slicer. The proposed segmentation of the pancreatic duct from the abdominal CT images reached an average Dice coefficient of 0.85 with a standard deviation of 0.04. Owing to the excellent segmentation performance, a fly-through visualization of both the inside and outside of the duct was successfully reconstructed, thereby demonstrating the feasibility of VP. In addition, a quantitative analysis of the wall thickness and topology of the duct provides more insight into pancreatic diseases than a fly-through visualization. The entire VP system developed in this study is available at https://github.com/gaoyi/VirtualEndoscopy.git .

Abstract Textures have become widely adopted as an essential tool for lesion detection and classification through analysis of the lesion heterogeneities. In this study, higher order derivative images are being employed to combat the challenge of the poor contrast across similar tissue types among certain imaging modalities. To make good use of the derivative information, a novel concept of vector texture is firstly introduced to construct and extract several types of polyp descriptors. Two widely used differential operators, i.e., the gradient operator and Hessian operator, are utilized to generate the first and second order derivative images. These derivative volumetric images are used to produce two angle-based and two vector-based (including both angle and magnitude) textures. Next, a vector-based co-occurrence matrix is proposed to extract texture features which are fed to a random forest classifier to perform polyp classifications. To evaluate the performance of our method, experiments are implemented over a private colorectal polyp dataset obtained from computed tomographic colonography. We compare our method with four existing state-of-the-art methods and find that our method can outperform those competing methods over 4%-13% evaluated by the area under the receiver operating characteristics curves.

IntroductionMusculoskeletal system gradually degenerates with aging, and a hypoxia environment at a high altitude may accelerate this process. However, the comprehensive effects of high-altitude environments on bones and muscles remain unclear. This study aims to compare the differences in bones and muscles at different altitudes, and to explore the mechanism and influencing factors of the high-altitude environment on the skeletal muscle system.MethodsThis is a prospective, multicenter, cohort study, which will recruit a total of 4000 participants over 50 years from 12 research centers with different altitudes (50m~3500m). The study will consist of a baseline assessment and a 5-year follow-up. Participants will undergo assessments of demographic information, anthropomorphic measures, self-reported questionnaires, handgrip muscle strength assessment (HGS), short physical performance battery (SPPB), blood sample analysis, and imaging assessments (QCT and/or DXA, US) within a time frame of 3 days after inclusion. A 5-year follow-up will be conducted to evaluate the changes in muscle size, density, and fat infiltration in different muscles; the muscle function impairment; the decrease in BMD; and the osteoporotic fracture incidence. Statistical analyses will be used to compare the research results between different altitudes. Multiple linear, logistic regression and classification tree analyses will be conducted to calculate the effects of various factors (e.g., altitude, age, and physical activity) on the skeletal muscle system in a high-altitude environment. Finally, a provisional cut-off point for the diagnosis of sarcopenia in adults at different altitudes will be calculated.Ethics and disseminationThe study has been approved by the institutional research ethics committee of each study center (main center number: KHLL2021-KY056). Results will be disseminated through scientific conferences and peer-reviewed publications, as well as meetings with stakeholders.Clinical Trial registration numberhttp://www.chictr.org.cn/index.aspx, identifier ChiCTR2100052153.

Abstract Malignant lesions have a high tendency to invade their surrounding environment compared to benign ones. This paper proposes a dynamic lesion model and explores the 2nd order derivatives at each image voxel, which reflect the rate of change of image intensity, as a quantitative measure of the tendency. The 2nd order derivatives at each image voxel are usually represented by the Hessian matrix, but it is difficult to quantify a matrix field (or image) through the lesion space as a measure of the tendency. We conjecture that the three eigenvalues contain important information of the Hessian matrix and are chosen as the surrogate representation of the Hessian matrix. By treating the three eigenvalues as a vector, called Hessian vector, which is defined in a local coordinate formed by three orthogonal Hessian eigenvectors and further adapting the gray level occurrence computing method to extract the vector texture descriptors (or measures) from the Hessian vector, a quantitative presentation for the dynamic lesion model is completed. The vector texture descriptors were applied to differentiate malignant from benign lesions from two pathologically proven datasets: colon polyps and lung nodules. The classification results not only outperform four state-of-the-art methods but also three radiologist experts.

Abstract Background Non-invasive discrimination between lung squamous cell carcinoma (LUSC) and lung adenocarcinoma (LUAD) subtypes of non-small-cell lung cancer (NSCLC) could be very beneficial to the patients unfit for the invasive diagnostic procedures. The aim of this study was to investigate the feasibility of utilizing the multimodal magnetic resonance imaging (MRI) radiomics and clinical features in classifying NSCLC. This retrospective study involved 148 eligible patients with postoperative pathologically confirmed NSCLC. The study was conducted in three steps: (1) feature extraction was performed using the online freely available package with the multimodal MRI data; (2) feature selection was performed using the Student’s t test and support vector machine (SVM)-based recursive feature elimination method with the training cohort (n = 100), and the performance of these selected features was evaluated using both the training and the validation cohorts (n = 48) with a non-linear SVM classifier; (3) a Radscore model was then generated using logistic regression algorithm; (4) Integrating the Radscore with the semantic clinical features, a radiomics–clinical nomogram was developed, and its overall performance was evaluated with both cohorts. Results Thirteen optimal features achieved favorable discrimination performance with both cohorts, with area under the curve (AUC) of 0.819 and 0.824, respectively. The radiomics–clinical nomogram integrating the Radscore with the independent clinical predictors exhibited more favorable discriminative power, with AUC improved to 0.901 and 0.872 in both cohorts, respectively. The Hosmer–Lemeshow test and decision curve analysis results furtherly showed good predictive precision and clinical usefulness of the nomogram. Conclusion Non-invasive histological subtype stratification of NSCLC can be done favorably using multimodal MRI radiomics features. Integrating the radiomics features with the clinical features could further improve the performance of the histological subtype stratification in patients with NSCLC.

Most penalized maximum likelihood methods for tomographic image reconstruction based on Bayes’ law include a freely adjustable hyperparameter to balance the data fidelity term and the prior/penalty term for a specific noise–resolution tradeoff. The hyperparameter is determined empirically via a trial-and-error fashion in many applications, which then selects the optimal result from multiple iterative reconstructions. These penalized methods are not only time-consuming by their iterative nature, but also require manual adjustment. This study aims to investigate a theory-based strategy for Bayesian image reconstruction without a freely adjustable hyperparameter, to substantially save time and computational resources. The Bayesian image reconstruction problem is formulated by two probability density functions (PDFs), one for the data fidelity term and the other for the prior term. When formulating these PDFs, we introduce two parameters. While these two parameters ensure the PDFs completely describe the data and prior terms, they cannot be determined by the acquired data; thus, they are called complete but unobservable parameters. Estimating these two parameters becomes possible under the conditional expectation and maximization for the image reconstruction, given the acquired data and the PDFs. This leads to an iterative algorithm, which jointly estimates the two parameters and computes the to-be reconstructed image by maximizing a posteriori probability, denoted as joint-parameter-Bayes. In addition to the theoretical formulation, comprehensive simulation experiments are performed to analyze the stopping criterion of the iterative joint-parameter-Bayes method. Finally, given the data, an optimal reconstruction is obtained without any freely adjustable hyperparameter by satisfying the PDF condition for both the data likelihood and the prior probability, and by satisfying the stopping criterion. Moreover, the stability of joint-parameter-Bayes is investigated through factors such as initialization, the PDF specification, and renormalization in an iterative manner. Both phantom simulation and clinical patient data results show that joint-parameter-Bayes can provide comparable reconstructed image quality compared to the conventional methods, but with much less reconstruction time. To see the response of the algorithm to different types of noise, three common noise models are introduced to the simulation data, including white Gaussian noise to post-log sinogram data, Poisson-like signal-dependent noise to post-log sinogram data and Poisson noise to the pre-log transmission data. The experimental outcomes of the white Gaussian noise reveal that the two parameters estimated by the joint-parameter-Bayes method agree well with simulations. It is observed that the parameter introduced to satisfy the prior’s PDF is more sensitive to stopping the iteration process for all three noise models. A stability investigation showed that the initial image by filtered back projection is very robust. Clinical patient data demonstrated the effectiveness of the proposed joint-parameter-Bayes and stopping criterion.

Abstract Texture features have played an essential role in the field of medical imaging for computer-aided diagnosis. The gray-level co-occurrence matrix (GLCM)-based texture descriptor has emerged to become one of the most successful feature sets for these applications. This study aims to increase the potential of these features by introducing multi-scale analysis into the construction of GLCM texture descriptor. In this study, we first introduce a new parameter - stride, to explore the definition of GLCM. Then we propose three multi-scaling GLCM models according to its three parameters, (1) learning model by multiple displacements, (2) learning model by multiple strides (LMS), and (3) learning model by multiple angles. These models increase the texture information by introducing more texture patterns and mitigate direction sparsity and dense sampling problems presented in the traditional Haralick model. To further analyze the three parameters, we test the three models by performing classification on a dataset of 63 large polyp masses obtained from computed tomography colonoscopy consisting of 32 adenocarcinomas and 31 benign adenomas. Finally, the proposed methods are compared to several typical GLCM-texture descriptors and one deep learning model. LMS obtains the highest performance and enhances the prediction power to 0.9450 with standard deviation 0.0285 by area under the curve of receiver operating characteristics score which is a significant improvement.

Abstract Tissue texture reflects the spatial distribution of contrasts of image voxel gray levels, i.e., the tissue heterogeneity, and has been recognized as important biomarkers in various clinical tasks. Spectral computed tomography (CT) is believed to be able to enrich tissue texture by providing different voxel contrast images using different X-ray energies. Therefore, this paper aims to address two related issues for clinical usage of spectral CT, especially the photon counting CT (PCCT): (1) texture enhancement by spectral CT image reconstruction, and (2) spectral energy enriched tissue texture for improved lesion classification. For issue (1), we recently proposed a tissue-specific texture prior in addition to low rank prior for the individual energy-channel low-count image reconstruction problems in PCCT under the Bayesian theory. Reconstruction results showed the proposed method outperforms existing methods of total variation (TV), low-rank TV and tensor dictionary learning in terms of not only preserving texture features but also suppressing image noise. For issue (2), this paper will investigate three models to incorporate the enriched texture by PCCT in accordance with three types of inputs: one is the spectral images, another is the co-occurrence matrices (CMs) extracted from the spectral images, and the third one is the Haralick features (HF) extracted from the CMs. Studies were performed on simulated photon counting data by introducing attenuation-energy response curve to the traditional CT images from energy integration detectors. Classification results showed the spectral CT enriched texture model can improve the area under the receiver operating characteristic curve (AUC) score by 7.3%, 0.42% and 3.0% for the spectral images, CMs and HFs respectively on the five-energy spectral data over the original single energy data only. The CM- and HF-inputs can achieve the best AUC of 0.934 and 0.927. This texture themed study shows the insight that incorporating clinical important prior information, e.g., tissue texture in this paper, into the medical imaging, such as the upstream image reconstruction, the downstream diagnosis, and so on, can benefit the clinical tasks.

Abstract Computer aided detection (CADe) of pulmonary nodules plays an important role in assisting radiologists’ diagnosis and alleviating interpretation burden for lung cancer. Current CADe systems, aiming at simulating radiologists’ examination procedure, are built upon computer tomography (CT) images with feature extraction for detection and diagnosis. Human visual perception in CT image is reconstructed from sinogram, which is the original raw data acquired from CT scanner. In this work, different from the conventional image based CADe system, we propose a novel sinogram based CADe system in which the full projection information is used to explore additional effective features of nodules in the sinogram domain. Facing the challenges of limited research in this concept and unknown effective features in the sinogram domain, we design a new CADe system that utilizes the self-learning power of the convolutional neural network to learn and extract effective features from sinogram. The proposed system was validated on 208 patient cases from the publicly available online Lung Image Database Consortium database, with each case having at least one juxtapleural nodule annotation. Experimental results demonstrated that our proposed method obtained a value of 0.91 of the area under the curve (AUC) of receiver operating characteristic based on sinogram alone, comparing to 0.89 based on CT image alone. Moreover, a combination of sinogram and CT image could further improve the value of AUC to 0.92. This study indicates that pulmonary nodule detection in the sinogram domain is feasible with deep learning.

Abstract Background Arterial spin labeling (ASL) provides a noninvasive way to measure cerebral blood flow (CBF). The CBF estimation from ASL is heavily contaminated by noise and the partial volume (PV) effect. The multiple measurements of perfusion signals in the ASL sequence are generally acquired and were averaged to suppress the noise. To correct the PV effect, several methods were proposed, but they were all performed directly on the averaged image, thereby ignoring the inherent perfusion information of mixed tissues that are embedded in multiple measurements. The aim of the present study is to correct the PV effect of ASL sequence using the inherent perfusion information in the multiple measurements. Methods In this study, we first proposed a statistical perfusion model of mixed tissues based on the distribution of multiple measurements. Based on the tissue mixture that was obtained from the high-resolution structural image, a structure-based expectation maximization (sEM) scheme was developed to estimate the perfusion contributions of different tissues in a mixed voxel from its multiple measurements. Finally, the performance of the proposed method was evaluated using both computer simulations and in vivo data. Results Compared to the widely used linear regression (LR) method, the proposed sEM-based method performs better on edge preservation, noise suppression, and lesion detection, and demonstrates a potential to estimate the CBF within a shorter scanning time. For in vivo data, the corrected CBF values of gray matter (GM) were independent of the GM probability, thereby indicating the effectiveness of the sEM-based method for the PV correction of the ASL sequence. Conclusions This study validates the proposed sEM scheme for the statistical perfusion model of mixed tissues and demonstrates the effectiveness of using inherent perfusion information in the multiple measurements for PV correction of the ASL sequence.

Objective: As an effective lesion heterogeneity depiction, texture information extracted from computed tomography has become increasingly important in polyp classification. However, variation and redundancy among multiple texture descriptors render a challenging task of integrating them into a general characterization. Considering these two problems, this work proposes an adaptive learning model to integrate multi-scale texture features. Methods: To mitigate feature variation, the whole feature set is geometrically split into several independent subsets that are ranked by a learning evaluation measure after preliminary classifications. To reduce feature redundancy, a bottom-up hierarchical learning framework is proposed to ensure monotonic increase of classification performance while integrating these ranked sets selectively. Two types of classifiers, traditional (random forest + support vector machine)- and convolutional neural network (CNN)-based, are employed to perform the polyp classification under the proposed framework with extended Haralick measures and gray-level co-occurrence matrix (GLCM) as inputs, respectively. Experimental results are based on a retrospective dataset of 63 polyp masses (defined as greater than 3 cm in largest diameter), including 32 adenocarcinomas and 31 benign adenomas, from adult patients undergoing first-time computed tomography colonography and who had corresponding histopathology of the detected masses. Results: We evaluate the performance of the proposed models by the area under the curve (AUC) of the receiver operating characteristic curve. The proposed models show encouraging performances of an AUC score of 0.925 with the traditional classification method and an AUC score of 0.902 with CNN. The proposed adaptive learning framework significantly outperforms nine well-established classification methods, including six traditional methods and three deep learning ones with a large margin. Conclusions: The proposed adaptive learning model can combat the challenges of feature variation through a multiscale grouping of feature inputs, and the feature redundancy through a hierarchal sorting of these feature groups. The improved classification performance against comparative models demonstrated the feasibility and utility of this adaptive learning procedure for feature integration.

The current standardized scheme for interpreting MRI requires a high level of expertise and exhibits a significant degree of inter-reader and intra-reader variability. An automated prostate cancer (PCa) classification can improve the ability of MRI to assess the spectrum of PCa. The purpose of the study was to evaluate the performance of a texture-based deep learning model (Textured-DL) for differentiating between clinically significant PCa (csPCa) and non-csPCa and to compare the Textured-DL with Prostate Imaging Reporting and Data System (PI-RADS)-based classification (PI-RADS-CLA), where a threshold of PI-RADS ≥ 4, representing highly suspicious lesions for csPCa, was applied. The study cohort included 402 patients (60% (n = 239) of patients for training, 10% (n = 42) for validation, and 30% (n = 121) for testing) with 3T multiparametric MRI matched with whole-mount histopathology after radical prostatectomy. For a given suspicious prostate lesion, the volumetric patches of T2-Weighted MRI and apparent diffusion coefficient images were cropped and used as the input to Textured-DL, consisting of a 3D gray-level co-occurrence matrix extractor and a CNN. PI-RADS-CLA by an expert reader served as a baseline to compare classification performance with Textured-DL in differentiating csPCa from non-csPCa. Sensitivity and specificity comparisons were performed using Mcnemar’s test. Bootstrapping with 1000 samples was performed to estimate the 95% confidence interval (CI) for AUC. CIs of sensitivity and specificity were calculated by the Wald method. The Textured-DL model achieved an AUC of 0.85 (CI [0.79, 0.91]), which was significantly higher than the PI-RADS-CLA (AUC of 0.73 (CI [0.65, 0.80]); p < 0.05) for PCa classification, and the specificity was significantly different between Textured-DL and PI-RADS-CLA (0.70 (CI [0.59, 0.82]) vs. 0.47 (CI [0.35, 0.59]); p < 0.05). In sub-analyses, Textured-DL demonstrated significantly higher specificities in the peripheral zone (PZ) and solitary tumor lesions compared to the PI-RADS-CLA (0.78 (CI [0.66, 0.90]) vs. 0.42 (CI [0.28, 0.57]); 0.75 (CI [0.54, 0.96]) vs. 0.38 [0.14, 0.61]; all p values < 0.05). Moreover, Textured-DL demonstrated a high negative predictive value of 92% while maintaining a high positive predictive value of 58% among the lesions with a PI-RADS score of 3. In conclusion, the Textured-DL model was superior to the PI-RADS-CLA in the classification of PCa. In addition, Textured-DL demonstrated superior performance in the specificities for the peripheral zone and solitary tumors compared with PI-RADS-based risk assessment.

Statistical iterative reconstruction (SIR) for X-ray computed tomography (CT) under the penalized weighted least-squares criteria can yield significant gains over conventional analytical reconstruction from the noisy measurement. However, due to the nonlinear expression of the objective function, most exiting algorithms related to the SIR unavoidably suffer from heavy computation load and slow convergence rate, especially when an edge-preserving or sparsity-based penalty or regularization is incorporated. In this work, to address abovementioned issues of the general algorithms related to the SIR, we propose an adaptive nonmonotone alternating direction algorithm in the framework of augmented Lagrangian multiplier method, which is termed as "ALM-ANAD". The algorithm effectively combines an alternating direction technique with an adaptive nonmonotone line search to minimize the augmented Lagrangian function at each iteration. To evaluate the present ALM-ANAD algorithm, both qualitative and quantitative studies were conducted by using digital and physical phantoms. Experimental results show that the present ALM-ANAD algorithm can achieve noticeable gains over the classical nonlinear conjugate gradient algorithm and state-of-the-art split Bregman algorithm in terms of noise reduction, contrast-to-noise ratio, convergence rate, and universal quality index metrics.

We present a fully automatic mixture model-based tissue classification of multispectral (T1- and T2-weighted) magnetic resonance (MR) brain images. Unlike the conventional hard classification with a unique label for each voxel, our method models a mixture to estimate the partial volumes (PV) of multiple tissue types within a voxel. A new Markov random field (MRF) model is proposed to reflect the spatial information of tissue mixtures. A mixture classification algorithm is performed by the maximum a posterior (MAP) criterion, where the expectation maximization (EM) algorithm is utilized to estimate model parameters. The algorithm interleaves segmentation with parameter estimation and improves classification in an iterative manner. The presented method is evaluated by clinical MR image datasets for quantification of brain volumes and multiple sclerosis (MS).

X-ray computed tomography (CT) iterative image reconstruction from sparse-view projection data has been an important research topic for radiation reduction in clinic. In this paper, to relieve the requirement of misalignment reduction operation of the prior image constrained compressed sensing (PICCS) approach introduced by Chen et al, we present an iterative image reconstruction approach for sparse-view CT using a normal-dose image induced total variation (ndiTV) prior. The associative objective function of the present approach is constructed under the penalized weighed least-square (PWLS) criteria, which contains two terms, i.e., the weighted least-square (WLS) fidelity and the ndiTV prior, and is referred to as "PWLS-ndiTV". Specifically, the WLS fidelity term is built based on an accurate relationship between the variance and mean of projection data in the presence of electronic background noise. The ndiTV prior term is designed to reduce the influence of the misalignment between the desired- and prior- image by using a normal-dose image induced non-local means (ndiNLM) filter. Subsequently, a modified steepest descent algorithm is adopted to minimize the associative objective function. Experimental results on two different digital phantoms and an anthropomorphic torso phantom show that the present PWLS-ndiTV approach for sparse-view CT image reconstruction can achieve noticeable gains over the existing similar approaches in terms of noise reduction, resolution-noise tradeoff, and low-contrast object detection.