Search

Pronounced spin phase artifacts appear in diffusion-weighted imaging (DWI) with only minor subject motion. While DWI data corruption is often identified as signal drop out in diffusion-weighted (DW) magnitude images, DW phase images may have higher sensitivity for detecting subtle subject motion. This article describes a novel method to return a metric of subject motion, computed using an image texture analysis of the DW phase image. This Phase Image Texture Analysis for Motion Detection in dMRI (PITA-MDD) method is computationally fast and reliably detects subject motion from diffusion-weighted images. A threshold of the motion metric was identified to remove motion-corrupted slices, and the effect of removing corrupted slices was assessed on the reconstructed FA maps and fiber tracts. Using a motion-metric threshold to remove the motion-corrupted slices results in superior fiber tracts and fractional anisotropy maps. When further compared to a state-of-the-art magnitude-based motion correction method, PITA-MDD was able to detect comparable corrupted slices in a more computationally efficient manner. In this study, we evaluated the use of DW phase images to detect motion corruption. The proposed method can be a robust and fast alternative for automatic motion detection in the brain with multiple applications to inform prospective motion correction or as real-time feedback for data quality control during scanning, as well as after data is already acquired. [ABSTRACT FROM AUTHOR]

Self-training is an important class of unsupervised domain adaptation (UDA) approaches that are used to mitigate the problem of domain shift, when applying knowledge learned from a labeled source domain to unlabeled and heterogeneous target domains. While self-training-based UDA has shown considerable promise on discriminative tasks, including classification and segmentation, through reliable pseudo-label filtering based on the maximum softmax probability, there is a paucity of prior work on self-training-based UDA for generative tasks, including image modality translation. To fill this gap, in this work, we seek to develop a generative self-training (GST) framework for domain adaptive image translation with continuous value prediction and regression objectives. Specifically, we quantify both aleatoric and epistemic uncertainties within our GST using variational Bayes learning to measure the reliability of synthesized data. We also introduce a self-attention scheme that de-emphasizes the background region to prevent it from dominating the training process. The adaptation is then carried out by an alternating optimization scheme with target domain supervision that focuses attention on the regions with reliable pseudo-labels. We evaluated our framework on two cross-scanner/center, inter-subject translation tasks, including tagged-to-cine magnetic resonance (MR) image translation and T1-weighted MR-to-fractional anisotropy translation. Extensive validations with unpaired target domain data showed that our GST yielded superior synthesis performance in comparison to adversarial training UDA methods. [ABSTRACT FROM AUTHOR]

Muscle coordination patterns of lingual behaviors are synergies generated by deforming local muscle groups in a variety of ways. Functional units are functional muscle groups of local structural elements within the tongue that compress, expand, and move in a cohesive and consistent manner. Identifying the functional units using tagged-magnetic resonance imaging (MRI) sheds light on the mechanisms of normal and pathological muscle coordination patterns, yielding improvement in surgical planning, treatment, or rehabilitation procedures. In this paper, to mine this information, we propose a matrix factorization and probabilistic graphical model framework to produce building blocks and their associated weighting map using motion quantities extracted from tagged-MRI. Our tagged-MRI imaging and accurate voxel-level tracking provide previously unavailable internal tongue motion patterns, thus revealing the inner workings of the tongue during speech or other lingual behaviors. We then employ spectral clustering on the weighting map to identify the cohesive regions defined by the tongue motion that may involve multiple or undocumented regions. To evaluate our method, we perform a series of experiments. We first use two-dimensional images and synthetic data to demonstrate the accuracy of our method. We then use three-dimensional synthetic and in vivo tongue motion data using protrusion and simple speech tasks to identify subject-specific and data-driven functional units of the tongue in localized regions. [ABSTRACT FROM AUTHOR]

Diffusion magnetic resonance imaging (dMRI) has enabled in vivo investigation of white matter tracts. Fiber orientation (FO) estimation is a key step in tract reconstruction and has been a popular research topic in dMRI analysis. In particular, the sparsity assumption has been used in conjunction with a dictionary-based framework to achieve reliable FO estimation with a reduced number of gradient directions. Because image noise can have a deleterious effect on the accuracy of FO estimation, previous works have incorporated spatial consistency of FOs in the dictionary-based framework to improve the estimation. However, because FOs are only indirectly determined from the mixture fractions of dictionary atoms and not modeled as variables in the objective function, these methods do not incorporate FO smoothness directly, and their ability to produce smooth FOs could be limited. In this work, we propose an improvement to Fiber Orientation Reconstruction using Neighborhood Information (FORNI), which we call FORNI+; this method estimates FOs in a dictionary-based framework where FO smoothness is better enforced than in FORNI alone. We describe an objective function that explicitly models the actual FOs and the mixture fractions of dictionary atoms. Specifically, it consists of data fidelity between the observed signals and the signals represented by the dictionary, pairwise FO dissimilarity that encourages FO smoothness, and weighted ℓ 1 -norm terms that ensure the consistency between the actual FOs and the FO configuration suggested by the dictionary representation. The FOs and mixture fractions are then jointly estimated by minimizing the objective function using an iterative alternating optimization strategy. FORNI+ was evaluated on a simulation phantom, a physical phantom, and real brain dMRI data. In particular, in the real brain dMRI experiment, we have qualitatively and quantitatively evaluated the reproducibility of the proposed method. Results demonstrate that FORNI+ produces FOs with better quality compared with competing methods. [ABSTRACT FROM AUTHOR]

Diffusion magnetic resonance imaging (dMRI) can be used for noninvasive imaging of white matter tracts. Using fiber tracking, which propagates fiber streamlines according to fiber orientations (FOs) computed from dMRI, white matter tracts can be reconstructed for investigation of brain diseases and the brain connectome. Because of image noise, probabilistic tractography has been proposed to characterize uncertainties in FO estimation. Bootstrap provides a nonparametric approach to the estimation of FO uncertainties and residual bootstrap has been used for developing probabilistic tractography. However, recently developed models have incorporated sparsity regularization to reduce the required number of gradient directions to resolve crossing FOs, and the residual bootstrap used in previous methods is not applicable to these models. In this work, we propose a probabilistic tractography algorithm named Lasso bootstrap tractography (LBT) for the models that incorporate sparsity. Using a fixed tensor basis and a sparsity assumption, diffusion signals are modeled using a Lasso formulation. With the residuals from the Lasso model, a distribution of diffusion signals is obtained according to a modified Lasso bootstrap strategy. FOs are then estimated from the synthesized diffusion signals by an algorithm that improves FO estimation by enforcing spatial consistency of FOs. Finally, streamlining fiber tracking is performed with the computed FOs. The LBT algorithm was evaluated on simulated and real dMRI data both qualitatively and quantitatively. Results demonstrate that LBT outperforms state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

Diffusion magnetic resonance imaging (dMRI) provides information about the microstructure of white matter in the human brain. From dMRI, streamlining tractography is often used to reconstruct computational representations of white matter tracts from which differences in structural connectivity can be explored. In the fiber tracking process, anatomical information can help reduce tracking errors caused by crossing fibers and image noise. In this paper, we propose a Bayesian method for estimating fiber orientations (FOs) guided by anatomical tract information using diffusion tensor imaging (DTI), which is a standard clinical and research dMRI protocol. The proposed method is named Fiber Orientation Reconstruction guided by Tract Segmentation (FORTS). A first step segments and labels the white matter tracts volumetrically, including explicit representations of crossing regions. A second step estimates the FOs using the diffusion information and the anatomical knowledge from segmented white matter tracts. A single FO is estimated in the noncrossing regions while two FOs are estimated in the crossing regions. A third step carries out streamlining tractography that uses information from both the segmented tracts and the estimated FOs. Experiments performed on a digital crossing phantom, a physical phantom, and brain DTI of 18 healthy subjects show that FORTS is able to use the anatomical information to produce FOs with better accuracy and to reduce anatomically incorrect streamlines. In particular, on the brain DTI data, we studied the connectivity of anatomically defined tracts to cortical areas, which is not straightforwardly achievable using only volumetric tract segmentation. These connectivity results demonstrate the potential application of FORTS to scientific studies. [ABSTRACT FROM AUTHOR]

It is important to characterize the temporal trajectories of disease-related biomarkers in order to monitor progression and identify potential points of intervention. These are especially important for neurodegenerative diseases, as therapeutic intervention is most likely to be effective in the preclinical disease stages prior to significant neuronal damage. Neuroimaging allows for the measurement of structural, functional, and metabolic integrity of the brain at the level of voxels, whose volumes are on the order of mm 3 . These voxelwise measurements provide a rich collection of disease indicators. Longitudinal neuroimaging studies enable the analysis of changes in these voxelwise measures. However, commonly used longitudinal analysis approaches, such as linear mixed effects models, do not account for the fact that individuals enter a study at various disease stages and progress at different rates, and generally consider each voxelwise measure independently. We propose a multivariate nonlinear mixed effects model for estimating the trajectories of voxelwise neuroimaging biomarkers from longitudinal data that accounts for such differences across individuals. The method involves the prediction of a progression score for each visit based on a collective analysis of voxelwise biomarker data within an expectation–maximization framework that efficiently handles large amounts of measurements and variable number of visits per individual, and accounts for spatial correlations among voxels. This score allows individuals with similar progressions to be aligned and analyzed together, which enables the construction of a trajectory of brain changes as a function of an underlying progression or disease stage. We apply our method to studying cortical β -amyloid deposition, a hallmark of preclinical Alzheimer's disease, as measured using positron emission tomography. Results on 104 individuals with a total of 300 visits suggest that precuneus is the earliest cortical region to accumulate amyloid, closely followed by the cingulate and frontal cortices, then by the lateral parietal cortex. The extracted progression scores reveal a pattern similar to mean cortical distribution volume ratio (DVR), an index of global brain amyloid levels. The proposed method can be applied to other types of longitudinal imaging data, including metabolism, blood flow, tau, and structural imaging-derived measures, to extract individualized summary scores indicating disease progression and to provide voxelwise trajectories that can be compared between brain regions. [ABSTRACT FROM AUTHOR]

Image labeling is essential for analyzing morphometric features in medical imaging data. Labels can be obtained by either human interaction or automated segmentation algorithms, both of which suffer from errors. The Simultaneous Truth and Performance Level Estimation (STAPLE) algorithm for both discrete-valued and continuous-valued labels has been proposed to find the consensus fusion while simultaneously estimating rater performance. In this paper, we first show that the previously reported continuous STAPLE in which bias and variance are used to represent rater performance yields a maximum likelihood solution in which bias is indeterminate. We then analyze the major cause of the deficiency and evaluate two classes of auxiliary bias estimation processes, one that estimates the bias as part of the algorithm initialization and the other that uses a maximum a posteriori criterion with a priori probabilities on the rater bias. We compare the efficacy of six methods, three variants from each class, in simulations and through empirical human rater experiments. We comment on their properties, identify deficient methods, and propose effective methods as solution. [ABSTRACT FROM AUTHOR]

Imaging and quantification of tongue anatomy is helpful in surgical planning, post-operative rehabilitation of tongue cancer patients, and studying of how humans adapt and learn new strategies for breathing, swallowing and speaking to compensate for changes in function caused by disease, medical interventions or aging. In vivo acquisition of high-resolution three-dimensional (3D) magnetic resonance (MR) images with clearly visible tongue muscles is currently not feasible because of breathing and involuntary swallowing motions that occur over lengthy imaging times. However, recent advances in image reconstruction now allow the generation of super-resolution 3D MR images from sets of orthogonal images, acquired at a high in-plane resolution and combined using super-resolution techniques. This paper presents, to the best of our knowledge, the first attempt towards automatic tongue muscle segmentation from MR images. We devised a database of ten super-resolution 3D MR images, in which the genioglossus and inferior longitudinalis tongue muscles were manually segmented and annotated with landmarks. We demonstrate the feasibility of segmenting the muscles of interest automatically by applying the landmark-based game-theoretic framework (GTF), where a landmark detector based on Haar-like features and an optimal assignment-based shape representation were integrated. The obtained segmentation results were validated against an independent manual segmentation performed by a second observer, as well as against B-splines and demons atlasing approaches. The segmentation performance resulted in mean Dice coefficients of 85.3%, 81.8%, 78.8% and 75.8% for the second observer, GTF, B-splines atlasing and demons atlasing, respectively. The obtained level of segmentation accuracy indicates that computerized tongue muscle segmentation may be used in surgical planning and treatment outcome analysis of tongue cancer patients, and in studies of normal subjects and subjects with speech and swallowing problems. [ABSTRACT FROM AUTHOR]

Abstract: Quantifying the connectivity between arbitrary surface patches in the human brain cortex can be used in studies on brain function and to characterize clinical diseases involving abnormal connectivity. Cortical regions of human brain in their natural forms can be represented in surface formats. In this paper, we present a framework to quantify connectivity using cortical surface segmentation and labeling from structural magnetic resonance images, tractography from diffusion tensor images, and nonlinear inter-subject registration. For a single subject, the connectivity intensity of any point on the cortical surface is set to unity if the point is connected and zero if it is not connected. The connectivity proportion is defined as the ratio of the total connected surface area to the total area of the surface patch. By nonlinearly registering the connectivity data of a group of normal controls into a template space, a population connectivity metric can be defined as either the average connectivity intensity of a cortical point or the average connectivity proportion of a cortical region. In the template space, a connectivity profile and a connectivity histogram of an arbitrary cortical region of interest can then be derived from these connectivity quantification values. Results from the application of these quantification metrics to a population of schizophrenia patients and normal controls are presented, revealing connectivity signatures of specified cortical regions and detecting connectivity abnormalities. [Copyright &y& Elsevier]

Magnetic resonance tagging makes it possible to measure the motion of tissues such as muscles in the heart and tongue. The harmonic phase (HARP) method largely automates the process of tracking points within tagged MR images, permitting many motion properties to be computed. However, HARP tracking can yield erroneous motion estimates due to 1) large deformations between image frames, 2) through-plane motion, and 3) tissue boundaries. Methods that incorporate the spatial continuity of motion--so-called refinement or flood-filling methods--have previously been reported to reduce tracking errors. This paper presents a new refinement method based on shortest path computations. The method uses a graph representation of the image and seeks an optimal tracking order from a specified seed to each point in the image by solving a single source shortest path problem. This minimizes the potential errors for those path dependent solutions that are found in other refinement methods. In addition to this, tracking in the presence of through-plane motion is improved by introducing synthetic tags at the reference time (when the tissue is not deformed). Experimental results on both tongue and cardiac images show that the proposed method can track the whole tissue more robustly and is also computationally efficient. [ABSTRACT FROM AUTHOR]

Image registration is a crucial step in many medical image analysis procedures such as image fusion, surgical planning, segmentation and labeling, and shape comparison in population or longitudinal studies. A new approach to volumetric intersubject deformable image registration is presented. The method, called Mjolnir, is an extension of the highly successful method HAMMER.New image features in order to better localize points of correspondence between the two images are introduced as well as a novel approach to generate a dense displacement field based upon the weighted diffusion of automatically derived feature correspondences. An extensive validation of the algorithm was performed on T1-weighted SPGR MR brain images from the NIREP evaluation database. The results were compared with results generated by HAMMER and are shown to yield significant improvements in cortical alignment as well as reduced computation time. [ABSTRACT FROM AUTHOR]

Spatial normalization is frequently used to map data to a standard coordinate system by removing intersubject morphological differences, thereby allowing for group analysis to be carried out. The work presented in this paper is motivated by the need for an automated cortical surface normalization technique that will automatically identify homologous cortical landmarks and map them to the same coordinates on a standard manifold. The geometry of a cortical surface is analyzed using two shape measures that distinguish the sulcal and gyral regions in a multiscale framework. A multichannel optical flow warping procedure aligns these shape measures between a reference brain and a subject brain, creating the desired normalization. The partial differential equation that carries out the warping is implemented in a Euclidean framework in order to facilitate a multiresolution strategy, thereby permitting large deformations between the two surfaces. The technique is demonstrated by aligning 33 normal cortical surfaces and showing both improved structural alignment in manually labeled sulci and improved functional alignment in positron emission tomography data mapped to the surfaces. A quantitative comparison between our proposed surface-based spatial normalization method and a leading volumetric spatial normalization method is included to show that the surface-based spatial normalization performs better in matching homologous cortical anatomies. [ABSTRACT FROM AUTHOR]

Abstract: A method to track a grid of cardiac material points in three dimensions using slice-following (SF) tagged magnetic resonance imaging (MRI) and harmonic-phase MRI is presented. A three-dimensional grid of material points on the lines of intersections of short-axis (SA) and long-axis (LA) planes is automatically tracked by combining two-dimensional pathlines that are computed on both SA and LA image planes. This process yields the true three-dimensional motion of points originating on the image plane intersections. Experimental data from normal volunteers, each obtained in four short breath-holds using the SF harmonic phase MRI pulse sequence, is presented. A validation of two-dimensional in-plane tracks using this pulse sequence on a moving phantom is also presented. [Copyright &y& Elsevier]

A cine series of tagged magnetic resonance (MR) images of the tongue is used to measure tongue motion and its internal deformation during speech. Tagged images are collected in three slice orientations (sagittal, coronal, and axial) during repetitions of the utterance “disouk” (/disuk/). A new technique called harmonic phase MRI (HARP-MRI) is used to process the tagged MR images to measure the internal deformation of the tongue. The measurements include displacement and velocity of tissue points, principal strains, and strain in the line-of-action of specific muscles. These measurements are not restricted to tag intersections, but can be calculated at every pixel in the image. The different motion measurements complement each other in understanding the tongue kinematics and in hypothesizing the internal muscle activity of the tongue. [ABSTRACT FROM AUTHOR]

Magnetic resonance (MR) tagging is capable of accurate, noninvasive quantification of regional myocardial function. Routine clinical use, however, is hindered by cumbersome and time-consuming postprocessing procedures. We propose a fast, semiautomatic method for tracking three-dimensional (3-0) cardiac motion from a temporal sequence of short- and long-axis tagged MR images. The new method, called 3D-HARmonic Phase (3D-HARP), extends the HARP approach, previously described for two-dimensional (2-B) tag analysis, to 3-D. A 3-D material mesh model is built to represent a collection of material points inside the left ventricle (LV) wall at a reference time. Harmonic phase, a material property that is time-invariant, is used to track the motion of the mesh through a cardiac cycle. Various motion-related functional properties of the myocardium, such as circumferential strain and left ventricular twist, are computed from the tracked mesh. The correlation analysis of 3D-HARP and FINDTAGS + Tag Strain(E) Analysis (TEA), which are well-established tag analysis techniques, shows that the regression coefficients of circumferential strain (ECC) and twist angle are r2 = 0.8605 and r2 = 0.8645, respectively. The total time required for tracking 3-D cardiac motion is approximately 10 mm in a 9 timeframe tagged MRI dataset and has the potential to be much faster. [ABSTRACT FROM AUTHOR]

Magnetic resonance tagging has proven useful in the visualization and quantification of cardiac motion. Traditionally, tags are designed to have crisp geometric profiles in order to enhance both visualization and detection of tags. Recent image acquisition and analysis methods, however, have been designed to exploit sinusoidal tag profiles. This paper presents a method based on harmonic phase (HARP) concepts to synthesize tag lines that have both crisp profiles and alternative orientations from the original sinusoidal patterns. Results are demonstrated on images acquired with SPAMM, CSPAMM, and fast-HARP pulse sequences. [ABSTRACT FROM AUTHOR]

We outline an Eulerian framework for computing the thickness of tissues between two simply connected boundaries that does not require landmark points or parameterizations of either boundary. Thickness is defined as the length of correspondence trajectories, which run from one tissue boundary to the other, and which follow a smooth vector field constructed in the region between the boundaries. A pair of partial differential equations (PDEs) that are guided by this vector field are then solved over this region, and the sum of their solutions yields the thickness of the tissue region. Unlike other approaches, this approach does not require explicit construction of any correspondence trajectories. An efficient, stable, and computationally fast solution to these PDEs is found by careful selection of finite differences according to an upwinding condition. The behavior and performance of our method is demonstrated on two simulations and two magnetic resonance imaging data sets in two and three dimensions. These experiments reveal very good performance and show strong potential for application in tissue thickness visualization and quantification. [ABSTRACT FROM AUTHOR]

Describes a method for automated segmentation of major cortical sulci on the outer brain boundary. Formulation of the method; Information on statistical shape model for curves on unit spheres; Procedures for the automatic extraction of sulcal curves; Validation of the method.

Presents information on a study on the fuzzy segmentation of two-dimensional and three-dimensional multispectral magnetic resonance images that have been corrupted by intensity inhomogeneities. Overview of fuzzy C-means algorithm and two-dimensional adaptive fuzzy C-means algorithm; Results; Conclusion.

Presents information on a study which introduced temporal correlation to kriging in the form of a stochastic state equation representation, the kriging update model. Test cases to demonstrate the effectiveness of the kriging filter; Application in medical imaging; Conclusion.

Describes the derivation, implementation and initial validation of a vector or matrix version of the Wiener filter for use in dual-radionuclide imaging. Details on the problem associated with all dual-radionuclide imaging; Information on what the vector Wiener filtering is based on; Reason that Wiener restoration filtering is not widely used in nuclear medicine.

Presents information on the use of snakes, or active contours in computer vision and image processing applications. What active contours are; Background information on the contours; Details on gradient vector flow snake; Indepth look at gray-level images.

Presents three-dimensional (3-D) projection theorems for vector tomography. Convolution backprojection formulas; Simulations of 3-D reconstructions; Measurement of 3-D inner products using a magnetic resonance scanner.

The perivascular space (PVS) is important to brain waste clearance and brain metabolic homeostasis. Enlarged PVS (ePVS) becomes visible on magnetic resonance imaging (MRI) and is best appreciated on T2-weighted (T2w) images. However, quantification of ePVS is challenging because standard-of-care T1-weighted (T1w) and T2w images are often obtained via two-dimensional (2D) acquisition, whereas accurate quantification of ePVS normally requires high-resolution volumetric three-dimensional (3D) T1w and T2w images. The purpose of this study was to investigate the use of a deep-learning-based super-resolution (SR) technique to improve ePVS quantification from 2D T2w images for application in patients with traumatic brain injury (TBI). We prospectively recruited 26 volunteers (age: 31 ± 12 years, 12 male/14 female) where both 2D T2w and 3D T2w images were acquired along with 3D T1w images to validate the ePVS quantification using SR T2w images. We then applied the SR method to retrospectively acquired 2D T2w images in 41 patients with chronic TBI (age: 41 ± 16 years, 32 male/9 female). ePVS volumes were automatically quantified within the whole-brain white matter and major brain lobes (temporal, parietal, frontal, occipital) in all subjects. Pittsburgh Sleep Quality Index (PSQI) scores were obtained on all patients with TBI. Compared with the silver standard (3D T2w), in the validation study, the SR T2w provided similar whole-brain white matter ePVS volume (r = 0.98, p < 0.0001), and similar age-related ePVS burden increase (r = 0.80, p < 0.0001). In the patient study, patients with TBI with poor sleep showed a higher age-related ePVS burden increase than those with good sleep. Sleep status is a significant interaction factor in the whole brain (p = 0.047) and the frontal lobe (p = 0.027). We demonstrate that images produced by SR of 2D T2w images can be automatically analyzed to produce results comparable to those obtained by 3D T2 volumes. Reliable age-related ePVS burden across the whole-brain white matter was observed in all subjects. Poor sleep, affecting the glymphatic function, may contribute to the accelerated increase of ePVS burden following TBI. [ABSTRACT FROM AUTHOR]

Strain energy and kinetic energy in the human brain were estimated by magnetic resonance elastography (MRE) during harmonic excitation of the head, and compared to characterize the effect of loading direction and frequency on brain deformation. In brain MRE, shear waves are induced by external vibration of the skull and imaged by a modified MR imaging sequence; the resulting harmonic displacement fields are typically "inverted" to estimate mechanical properties, like stiffness or damping. However, measurements of tissue motion from MRE also illuminate key features of the response of the brain to skull loading. In this study, harmonic excitation was applied in two different directions and at five different frequencies from 20 to 90 Hz. Lateral loading induced primarily left-right head motion and rotation in the axial plane; occipital loading induced anterior-posterior head motion and rotation in the sagittal plane. The ratio of strain energy to kinetic energy (SE/KE) depended strongly on both direction and frequency. The ratio of SE/KE was approximately four times larger for lateral excitation than for occipital excitation and was largest at the lowest excitation frequencies studied. These results are consistent with clinical observations that suggest lateral impacts are more likely to cause injury than occipital or frontal impacts, and also with observations that the brain has low-frequency (~10 Hz) natural modes of oscillation. The SE/KE ratio from brain MRE is potentially a simple and powerful dimensionless metric of brain vulnerability to deformation and injury. [ABSTRACT FROM AUTHOR]

Optical coherence tomography (OCT) is a non‐invasive optical imaging modality, which provides rapid, high‐resolution and cross‐sectional morphology of macular area and optic nerve head for diagnosis and managing of different eye diseases. However, interpreting OCT images requires experts in both OCT images and eye diseases since many factors such as artefacts and concomitant diseases can affect the accuracy of quantitative measurements made by post‐processing algorithms. Currently, there is a growing interest in applying deep learning (DL) methods to analyse OCT images automatically. This review summarises the trends in DL‐based OCT image analysis in ophthalmology, discusses the current gaps, and provides potential research directions. DL in OCT analysis shows promising performance in several tasks: (1) layers and features segmentation and quantification; (2) disease classification; (3) disease progression and prognosis; and (4) referral triage level prediction. Different studies and trends in the development of DL‐based OCT image analysis are described and the following challenges are identified and described: (1) public OCT data are scarce and scattered; (2) models show performance discrepancies in real‐world settings; (3) models lack of transparency; (4) there is a lack of societal acceptance and regulatory standards; and (5) OCT is still not widely available in underprivileged areas. More work is needed to tackle the challenges and gaps, before DL is further applied in OCT image analysis for clinical use. [ABSTRACT FROM AUTHOR]

The ability to differentiate post-cancer from healthy tongue muscle coordination patterns is necessary for the advancement of speech motor control theories and for the development of therapeutic and rehabilitative strategies. A deep learning approach is presented to classify two groups using muscle coordination patterns from magnetic resonance imaging (MRI). The proposed method uses tagged-MRI to track the tongue's internal tissue points and atlas-driven non-negative matrix factorization to reduce the dimensionality of the deformation fields. A convolutional neural network is applied to the classification task yielding an accuracy of 96.90%, offering the potential to the development of therapeutic or rehabilitative strategies in speech-related disorders. [ABSTRACT FROM AUTHOR]

• An image-specific slice profile is estimated for a 2D multi-slice MR acquisition. • The slice profile is learned by matching distributions of internal patches of this image. • Super-resolution with the knowledge of this image-specific slice profile is improved. To reduce scan time, magnetic resonance (MR) images are often acquired using 2D multi-slice protocols with thick slices that may also have gaps between them. The resulting image volumes have lower resolution in the through-plane direction than in the in-plane direction, and the through-plane resolution is in part characterized by the protocol's slice profile which acts as a through-plane point spread function (PSF). Although super-resolution (SR) has been shown to improve the visualization and down-stream processing of 2D multi-slice MR acquisitions, previous algorithms are usually unaware of the true slice profile, which may lead to sub-optimal SR performance. In this work, we present an algorithm to estimate the slice profile of a 2D multi-slice acquisition given only its own image volume without any external training data. We assume that an anatomical image is isotropic in the sense that, after accounting for a correctly estimated slice profile, the image patches along different orientations have the same probability distribution. Our proposed algorithm uses a modified generative adversarial network (GAN) where the generator network estimates the slice profile to reduce the resolution of the in-plane direction, and the discriminator network determines whether a direction is generated or real low resolution. The proposed algorithm, ESPRESO, which stands for "estimating the slice profile for resolution enhancement of a single image only", was tested with a state-of-the-art internally supervised SR algorithm. Specifically, ESPRESO is used to create training data for this SR algorithm, and results show improvements when ESPRESO is used over commonly-used PSFs. [ABSTRACT FROM AUTHOR]

This editorial introduces the Special Issue on Simulation and Synthesis in Medical Imaging. In this editorial, we define so-far ambiguous terms of simulation and synthesis in medical imaging. We also briefly discuss the synergistic importance of mechanistic (hypothesis-driven) and phenomenological (data-driven) models of medical image generation. Finally, we introduce the twelve papers published in this issue covering both mechanistic (5) and phenomenological (7) medical image generation. This rich selection of papers covers applications in cardiology, retinopathy, histopathology, neurosciences, and oncology. It also covers all mainstream diagnostic medical imaging modalities. We conclude the editorial with a personal view on the field and highlight some existing challenges and future research opportunities. [ABSTRACT FROM PUBLISHER]

Automatic segmentation of the thalamus can be used to measure differences and track changes in thalamic volume that may occur due to disease, injury or normal aging. An automatic thalamus segmentation algorithm incorporating features from diffusion tensor imaging (DTI) and thalamus priors constructed from multiple atlases is proposed. Multiple atlases with corresponding manual thalamus segmentations are registered to the target image and averaged to generate the thalamus prior. At each voxel in a region of interest around the thalamus, a multidimensional feature vector that includes the thalamus prior as well as a set of DTI features, including fractional anisotropy, mean diffusivity, and fiber orientation is formed. A random forest is trained to classify each voxel as belonging to the thalamus or background within the region of interest. Using a leave-one-out cross-validation on nine subjects, the proposed algorithm achieves a mean Dice score of 0.878 and 0.890 for the left and right thalami, respectively, which are higher Dice scores than the three state-of-art methods we compared to. We demonstrate the utility of the method with a pilot study exploring the difference in the thalamus fraction between 21 multiple sclerosis (MS) patients and 21 age-matched healthy controls. The left and right thalamic volumes (normalized by intracranial volumes) are larger in healthy controls by 7.6% and 7.3% respectively, compared to MS patients (though neither result is statistically significant). [ABSTRACT FROM AUTHOR]

Purpose: Muscle groups within the tongue in healthy and diseased populations show different behaviors during speech. Visualizing and quantifying strain patterns of these muscle groups during tongue motion can provide insights into tongue motor control and adaptive behaviors of a patient. Method: We present a pipeline to estimate the strain along the muscle fiber directions in the deforming tongue during speech production. A deep convolutional network estimates the crossing muscle fiber directions in the tongue using diffusion-weighted magnetic resonance imaging (MRI) data acquired at rest. A phase-based registration algorithm is used to estimate motion of the tongue muscles from tagged MRI acquired during speech. After transforming both muscle fiber directions and motion fields into a common atlas space, strain tensors are computed and projected onto the muscle fiber directions, forming so-called strains in the line of actions (SLAs) throughout the tongue. SLAs are then averaged over individual muscles that have been manually labeled in the atlas space using high-resolution T2-weighted MRI. Data were acquired, and this pipeline was run on a cohort of eight healthy controls and two glossectomy patients. Results: The crossing muscle fibers reconstructed by the deep network show orthogonal patterns. The strain analysis results demonstrate consistency of muscle behaviors among some healthy controls during speech production. The patients show irregular muscle patterns, and their tongue muscles tend to show more extension than the healthy controls. Conclusions: The study showed visual evidence of correlation between two muscle groups during speech production. Patients tend to have different strain patterns compared to the controls. Analysis of variations in muscle strains can potentially help develop treatment strategies in oral diseases. [ABSTRACT FROM AUTHOR]

Objective: To explore longitudinal changes in brain volumetric measures and retinal layer thicknesses following acute optic neuritis (AON) in people with multiple sclerosis (PwMS), to investigate the process of trans‐synaptic degeneration, and determine its clinical relevance. Methods: PwMS were recruited within 40 days of AON onset (n = 49), and underwent baseline retinal optical coherence tomography and brain magnetic resonance imaging followed by longitudinal tracking for up to 5 years. A comparator cohort of PwMS without a recent episode of AON were similarly tracked (n = 73). Mixed‐effects linear regression models were used. Results: Accelerated atrophy of the occipital gray matter (GM), calcarine GM, and thalamus was seen in the AON cohort, as compared with the non‐AON cohort (−0.76% vs −0.22% per year [p = 0.01] for occipital GM, −1.83% vs −0.32% per year [p = 0.008] for calcarine GM, −1.17% vs −0.67% per year [p = 0.02] for thalamus), whereas rates of whole‐brain, cortical GM, non‐occipital cortical GM atrophy, and T2 lesion accumulation did not differ significantly between the cohorts. In the AON cohort, greater AON‐induced reduction in ganglion cell+inner plexiform layer thickness over the first year was associated with faster rates of whole‐brain (r = 0.32, p = 0.04), white matter (r = 0.32, p = 0.04), and thalamic (r = 0.36, p = 0.02) atrophy over the study period. Significant relationships were identified between faster atrophy of the subcortical GM and thalamus, with worse visual function outcomes after AON. Interpretation: These results provide in‐vivo evidence for anterograde trans‐synaptic degeneration following AON in PwMS, and suggest that trans‐synaptic degeneration may be related to clinically‐relevant visual outcomes. ANN NEUROL 2023;93:76–87 [ABSTRACT FROM AUTHOR]

Optical coherence tomography angiography (OCTA) is an imaging modality that can be used for analyzing retinal vasculature. Quantitative assessment of en face OCTA images requires accurate segmentation of the capillaries. Using deep learning approaches for this task faces two major challenges. First, acquiring sufficient manual delineations for training can take hundreds of hours. Second, OCTA images suffer from numerous contrast-related artifacts that are currently inherent to the modality and vary dramatically across scanners. We propose to solve both problems by learning a disentanglement of an anatomy component and a local contrast component from paired OCTA scans. With the contrast removed from the anatomy component, a deep learning model that takes the anatomy component as input can learn to segment vessels with a limited portion of the training images being manually labeled. Our method demonstrates state-of-the-art performance for OCTA vessel segmentation. [ABSTRACT FROM AUTHOR]

Purpose: The goal of this study is to validate the muscle architecture derived from both ex vivo and in vivo diffusion-weighted magnetic resonance imaging (dMRI) of the human tongue with histology of an ex vivo tongue. Method: dMRI was acquired with a 200-direction high angular resolution diffusion imaging (HARDI) diffusion scheme for both a postmortem head (imaged within 48 hr after death) and a healthy volunteer. After MRI, the postmortem head was fixed and the tongue excised for hematoxylin and eosin (H&E) staining and histology imaging. Structure tensor images were generated from the stained images to better demonstrate muscle fiber orientations. The tongue muscle fiber orientations, estimated from dMRI, were visualized using the tractogram, a novel representation of crossing fiber orientations, and compared against the histology images of the ex vivo tongue. Results: Muscle fibers identified in the tractograms showed good correspondence with those appearing in the histology images. We further demonstrated tongue muscle architecture in in vivo tractograms for the entire tongue. Conclusion: The study demonstrates that dMRI can accurately reveal the complex muscle architecture of the human tongue and may potentially benefit planning and evaluation of oral surgery and research on speech and swallowing. [ABSTRACT FROM AUTHOR]

The performance of image analysis algorithms applied to magnetic resonance images is strongly influenced by the pulse sequences used to acquire the images. Algorithms are typically optimized for a targeted tissue contrast obtained from a particular implementation of a pulse sequence on a specific scanner. There are many practical situations, including multi-institution trials, rapid emergency scans, and scientific use of historical data, where the images are not acquired according to an optimal protocol or the desired tissue contrast is entirely missing. This paper introduces an image restoration technique that recovers images with both the desired tissue contrast and a normalized intensity profile. This is done using patches in the acquired images and an atlas containing patches of the acquired and desired tissue contrasts. The method is an example-based approach relying on sparse reconstruction from image patches. Its performance in demonstrated using several examples, including image intensity normalization, missing tissue contrast recovery, automatic segmentation, and multimodal registration. These examples demonstrate potential practical uses and also illustrate limitations of our approach. [ABSTRACT FROM AUTHOR]

Abstract: Optimal interpretation of magnetic resonance image content often requires an estimate of the underlying image noise, which is typically realized as a spatially invariant estimate of the noise distribution. This is not an ideal practice in diffusion tensor imaging because the noise distribution is usually spatially varying due to the use of fast imaging and noise suppression techniques. A new estimation approach for spatially varying noise fields (NFs) is proposed in this article. The approach is based on a noise invariance property in scenarios in which more than one image, each with potentially different signal levels, is acquired on each slice, as in diffusion-weighted MRI. This technique leads to improved NF estimates in simulations, phantom experiments and in vivo studies when compared to traditional NF estimators that use regional variability or background intensity histograms. The proposed method reduces the NF estimation error by a factor of 100 in simulations, shows a strong linear correlation (R 2=0.99) between theoretical and estimated noise changes in phantoms and demonstrates consistent (<5% variability) NF estimates in vivo. The advantages of spatially varying NF estimation are demonstrated for power analysis, outlier detection and tensor estimation. [Copyright &y& Elsevier]

Abstract: Measurement of myocardial strain provides direct information about heart function that can be correlated with disease. We present an MRI pulse sequence that acquires in just six heartbeats both harmonic phase (HARP) and strain-encoded (SENC) images and provides dense measurements of radial, circumferential and longitudinal strains within a single short-axis slice. Normal volunteer data confirm the feasibility of this pulse sequence, and acquired data demonstrate the strain measurement reliability. [Copyright &y& Elsevier]

Abstract: Images of myocardial strain can be used to diagnose heart disease, plan and monitor treatment, and to learn about cardiac structure and function. Three-dimensional (3D) strain is typically quantified using many magnetic resonance (MR) images obtained in two or three orthogonal planes. Problems with this approach include long scan times, image misregistration, and through-plane motion. This article presents a novel method for calculating cardiac 3D strain using a stack of two or more images acquired in only one orientation. The zHARP pulse sequence encodes in-plane motion using MR tagging and out-of-plane motion using phase encoding, and has been previously shown to be capable of computing 3D displacement within a single image plane. Here, data from two adjacent image planes are combined to yield a 3D strain tensor at each pixel; stacks of zHARP images can be used to derive stacked arrays of 3D strain tensors without imaging multiple orientations and without numerical interpolation. The performance and accuracy of the method is demonstrated in vitro on a phantom and in vivo in four healthy adult human subjects. [Copyright &y& Elsevier]

• We presented a method to identify both common and subject-specific functional units within a material coordinate system from MRI. • We proposed to convert non-negative matrix factorization with sparse and manifold regularizations into modular structures. • We provided validation to demonstrate superior performance over the comparison methods on both simulated and in vivo tongue data. [Display omitted] Intelligible speech is produced by creating varying internal local muscle groupings—i.e., functional units—that are generated in a systematic and coordinated manner. There are two major challenges in characterizing and analyzing functional units. First, due to the complex and convoluted nature of tongue structure and function, it is of great importance to develop a method that can accurately decode complex muscle coordination patterns during speech. Second, it is challenging to keep identified functional units across subjects comparable due to their substantial variability. In this work, to address these challenges, we develop a new deep learning framework to identify common and subject-specific functional units of tongue motion during speech. Our framework hinges on joint deep graph-regularized sparse non-negative matrix factorization (NMF) using motion quantities derived from displacements by tagged Magnetic Resonance Imaging. More specifically, we transform NMF with sparse and graph regularizations into modular architectures akin to deep neural networks by means of unfolding the Iterative Shrinkage-Thresholding Algorithm to learn interpretable building blocks and associated weighting map. We then apply spectral clustering to common and subject-specific weighting maps from which we jointly determine the common and subject-specific functional units. Experiments carried out with simulated datasets show that the proposed method achieved on par or better clustering performance over the comparison methods.Experiments carried out with in vivo tongue motion data show that the proposed method can determine the common and subject-specific functional units with increased interpretability and decreased size variability. [ABSTRACT FROM AUTHOR]

We present a novel approach to efficiently compute thickness, correspondence, and gridding of tissues between two simply connected boundaries. The solution of Laplace's equation within the tissue region provides a harmonic function whose gradient flow determines the correspondence trajectories going from one boundary to the other. The proposed method uses and expands upon two recently introduced techniques in order to compute thickness and correspondences based on these trajectories. Pairs of partial differential equations are efficiently computed within an Eulerian framework and combined with a Lagrangian approach so that correspondences trajectories are partially constructed when necessary. Examples are presented in order to compare the performance of this method with those of the pure Lagrangian and pure Eulerian approaches. Results show that the proposed technique takes advantage of both the speed of the Eulerian approach and the accuracy of the Lagrangian approach. [ABSTRACT FROM AUTHOR]

Background: Prior studies have suggested that subclinical retinal abnormalities may be present in aquaporin-4 immunoglobulin G (AQP4-IgG) seropositive neuromyelitis optica spectrum disorder (NMOSD), in the absence of a clinical history of optic neuritis (ON). Objective: Our aim was to compare retinal layer thicknesses at the fovea and surrounding macula between AQP4-IgG+ NMOSD eyes without a history of ON (AQP4-nonON) and healthy controls (HC). Methods: In this single-center cross-sectional study, 83 AQP4-nonON and 154 HC eyes were studied with spectral-domain optical coherence tomography (OCT). Results: Total foveal thickness did not differ between AQP4-nonON and HC eyes. AQP4-nonON eyes exhibited lower outer nuclear layer (ONL) and inner photoreceptor segment (IS) thickness at the fovea (ONL: −4.01 ± 2.03 μm, p = 0.049; IS: −0.32 ± 0.14 μm, p = 0.029) and surrounding macula (ONL: −1.98 ± 0.95 μm, p = 0.037; IS: −0.16 ± 0.07 μm, p = 0.023), compared to HC. Macular retinal nerve fiber layer (RNFL: −1.34 ± 0.51 μm, p = 0.009) and ganglion cell + inner plexiform layer (GCIPL: −2.44 ± 0.93 μm, p = 0.009) thicknesses were also lower in AQP4-nonON compared to HC eyes. Results were similar in sensitivity analyses restricted to AQP4-IgG+ patients who had never experienced ON in either eye. Conclusions: AQP4-nonON eyes exhibit evidence of subclinical retinal ganglion cell neuronal and axonal loss, as well as structural evidence of photoreceptor layer involvement. These findings support that subclinical anterior visual pathway involvement may occur in AQP4-IgG+ NMOSD. [ABSTRACT FROM AUTHOR]

Background: Sphingolipids are myelin components and inflammatory signaling intermediates. Sphingolipid metabolism may be altered in people with multiple sclerosis (PwMS), but existing studies are limited by small sample sizes. Objectives: To compare the levels of serum ceramides between PwMS and healthy controls (HCs) and to determine whether ceramide levels correlate with disability status, as well as optical coherence tomography (OCT)-derived rates of retinal layer atrophy. Methods: We performed targeted lipidomics analyses for 45 ceramides in PwMS (n = 251) and HCs (n = 68). For a subset of PwMS, baseline and 5-year Expanded Disability Status Scale (EDSS) assessments (n = 185), or baseline and serial spectral-domain OCT (n = 180) were assessed. Results: Several ceramides, including hexosylceramides, lactosylceramides, and dihydroceramides, were altered in PwMS compared with HCs. Higher levels of Cer16:0 were associated with higher odds of EDSS worsening at 5 years in univariable (odds ratio (OR) = 3.84, 95% confidence interval (CI) = 1.41–10.43) and multivariable analyses accounting for age, sex, and race (OR = 2.97, 95% CI = 1.03–8.59). Each 1 ng/mL higher concentration of Hex-Cer22:0 and DH-HexCer22:0 was associated with accelerated rates (μm/year) of ganglion cell + inner plexiform layer (–0.138 ± 0.053, p = 0.01; –0.158 ± 0.053, p = 0.003, respectively) and peripapillary retinal nerve fiber layer thinning (–0.305 ± 0.107, p = 0.004; –0.358 ± 0.106, p = 0.001, respectively). Conclusion: Ceramide levels are altered in PwMS and may be associated with retinal neurodegeneration and physical disability. [ABSTRACT FROM AUTHOR]

Analyzing the motion of the human tongue surface provides valuable information about speech and swallowing. One method to analyse this motion is to acquire two-dimensional ultrasound images and extract the tongue surface contours from them. Quantitative and statistical analysis of these extracted contours is made difficult because of the absence of physical fleshpoint markers on them. In this research, this problem is overcome by pre-processing the contours using Kriging. Pre-processing includes extrapolating and resampling the contours on a regular spatial grid. The preprocessed contours can then be visualized as spatiotemporal surfaces. A dedicated user interface called SURFACES is designed to aid in the generation, visualization and quantitative comparisons of these spariotemporal surfaces. [ABSTRACT FROM AUTHOR]

Visualization and mapping of function on the cortical surface is difficult because of its sulcal and gyral convolutions. Methods to unfold and flatten the cortical surface for visualization and measurement have been described in the literature. This makes visualization and measurement possible, but comparison across multiple subjects is still difficult because of the lack of a standard mapping technique. In this paper, we describe two methods that map each hemisphere of the cortex to a portion of a sphere in a standard way. To quantify how accurately the geometric features of the cortex – i.e., sulci and gyri – are mapped into the same location, sulcal alignment across multiple brains is analyzed, and probabilistic maps for different sulcal regions are generated to be used in automatic labelling of segmented sulcal regions. [Copyright &y& Elsevier]

Active contour and surface models, also known as deformable models, are powerful image segmentation techniques. Geometric deformable models implemented using level set methods have advantages over parametric models due to their intrinsic behavior, parameterization independence, and ease of implementation. However, a long claimed advantage of geometric deformable models—the ability to automatically handle topology changes—turns out to be a liability in applications where the object to be segmented has a known topology that must be preserved. In this paper, we present a new class of geometric deformable models designed using a novel topology-preserving level set method, which achieves topology preservation by applying the simple point concept from digital topology. These new models maintain the other advantages of standard geometric deformable models including subpixel accuracy and production of nonintersecting curves or surfaces. Moreover, since the topology-preserving constraint is enforced efficiently through local computations, the resulting algorithm incurs only nominal computational overhead over standard geometric deformable models. Several experiments on simulated and real data are provided to demonstrate the performance of this new deformable model algorithm. [ABSTRACT FROM AUTHOR]

Image segmentation plays a crucial role in many medical-imaging applications, by automating or facilitating the delineation of anatomical structures and other regions of interest. We present a critical appraisal of the current status of semiautomated and automated methods for the segmentation of anatomical medical images. Terminology and important issues in image segmentation are first presented. Current segmentation approaches are then reviewed with an emphasis on the advantages and disadvantages of these methods for medical imaging applications. We conclude with a discussion on the future of image segmentation methods in biomedical research. [ABSTRACT FROM AUTHOR]

Objective: To investigate early brain volumetric changes from acute to 6 months following mild traumatic brain injury (mTBI) in deep gray matter regions and their association with patient 6-month outcome. Methods: Fifty-six patients with mTBI underwent MRI and behavioral evaluation at acute (<10 days) and approximately 1 and 6 months post injury. Regional volume changes were investigated in key gray matter regions: thalamus, hippocampus, putamen, caudate, pallidum, and amygdala, and compared with volumes from 34 healthy control subjects. In patients with mTBI, we further assessed associations between longitudinal regional volume changes with patient outcome measures at 6 months including postconcussive symptoms, cognitive performance, and overall satisfaction with life. Results: Reduction in thalamic and hippocampal volumes was observed at 1 month among patients with mTBI. Such volume reduction persisted in the thalamus until 6 months. Changes in thalamic volumes also correlated with multiple symptom and functional outcome measures in patients at 6 months. Conclusion: Our results indicate that the thalamus may be differentially affected among patients with mTBI, resulting in both structural and functional deficits with subsequent post-concussive sequelae and may serve as a biomarker for the assessment of efficacy of novel therapeutic interventions. [ABSTRACT FROM AUTHOR]