Search

Background: Real‐time tumor tracking is one motion management method to address motion‐induced uncertainty. To date, fiducial markers are often required to reliably track lung tumors with X‐ray imaging, which carries risks of complications and leads to prolonged treatment time. A markerless tracking approach is thus desirable. Deep learning‐based approaches have shown promise for markerless tracking, but systematic evaluation and procedures to investigate applicability in individual cases are missing. Moreover, few efforts have been made to provide bounding box prediction and mask segmentation simultaneously, which could allow either rigid or deformable multi‐leaf collimator tracking. Purpose: The purpose of this study was to implement a deep learning‐based markerless lung tumor tracking model exploiting patient‐specific training which outputs both a bounding box and a mask segmentation simultaneously. We also aimed to compare the two kinds of predictions and to implement a specific procedure to understand the feasibility of markerless tracking on individual cases. Methods: We first trained a Retina U‐Net baseline model on digitally reconstructed radiographs (DRRs) generated from a public dataset containing 875 CT scans and corresponding lung nodule annotations. Afterwards, we used an independent cohort of 97 lung patients to develop a patient‐specific refinement procedure. In order to determine the optimal hyperparameters for automatic patient‐specific training, we selected 13 patients for validation where the baseline model predicted a bounding box on planning CT (PCT)‐DRR with intersection over union (IoU) with the ground‐truth higher than 0.7. The final test set contained the remaining 84 patients with varying PCT‐DRR IoU. For each testing patient, the baseline model was refined on the PCT‐DRR to generate a patient‐specific model, which was then tested on a separate 10‐phase 4DCT‐DRR to mimic the intrafraction motion during treatment. A template matching algorithm served as benchmark model. The testing results were evaluated by four metrics: the center of mass (COM) error and the Dice similarity coefficient (DSC) for segmentation masks, and the center of box (COB) error and the DSC for bounding box detections. Performance was compared to the benchmark model including statistical testing for significance. Results: A PCT‐DRR IoU value of 0.2 was shown to be the threshold dividing inconsistent (68%) and consistent (100%) success (defined as mean bounding box DSC > 0.6) of PS models on 4DCT‐DRRs. Thirty‐seven out of the eighty‐four testing cases had a PCT‐DRR IoU above 0.2. For these 37 cases, the mean COM error was 2.6 mm, the mean segmentation DSC was 0.78, the mean COB error was 2.7 mm, and the mean box DSC was 0.83. Including the validation cases, the model was applicable to 50 out of 97 patients when using the PCT‐DRR IoU threshold of 0.2. The inference time per frame was 170 ms. The model outperformed the benchmark model on all metrics, and the comparison was significant (p < 0.001) over the 37 PCT‐DRR IoU > 0.2 cases, but not over the undifferentiated 84 testing cases. Conclusions: The implemented patient‐specific refinement approach based on a pre‐trained baseline model was shown to be applicable to markerless tumor tracking in simulated radiographs for lung cases. [ABSTRACT FROM AUTHOR]

Background: Current commercially available hybrid magnetic resonance linear accelerators (MR‐Linac) use 2D+t cine MR imaging to provide intra‐fractional motion monitoring. However, given the limited temporal resolution of cine MR imaging, target intra‐frame motion deterioration effects, resulting in effective time latency and motion artifacts in the image domain, can be appreciable, especially in the case of fast breathing. Purpose: The aim of this work is to investigate intra‐frame motion deterioration effects in MR‐guided radiotherapy (MRgRT) by simulating the motion‐corrupted image acquisition, and to explore the feasibility of deep‐learning‐based compensation approaches, relying on the intra‐frame motion information which is spatially and temporally encoded in the raw data (k‐space). Methods: An intra‐frame motion model was defined to simulate motion‐corrupted MR images, with 4D anthropomorphic digital phantoms being exploited to provide ground truth 2D+t cine MR sequences. A total number of 10 digital phantoms were generated for lung cancer patients, with randomly selected eight patients for training or validation and the remaining two for testing. The simulation code served as the data generator, and a dedicated motion pattern perturbation scheme was proposed to build the intra‐frame motion database, where three degrees of freedom were designed to guarantee the diversity of intra‐frame motion trajectories, enabling a thorough exploration in the domain of the potential anatomical structure positions. U‐Nets with three types of loss functions: L1 or L2 loss defined in image or Fourier domain, referred to as NNImgLoss‐L1, NNFloss‐L1 and NNL2‐Loss were trained to extract information from the motion‐corrupted image and used to estimate the ground truth final‐position image, corresponding to the end of the acquisition. Images before and after compensation were evaluated in terms of (i) image mean‐squared error (MSE) and mean absolute error (MAE), and (ii) accuracy of gross tumor volume (GTV) contouring, based on optical‐flow image registration. Results: Image degradation caused by intra‐frame motion was observed: for a linearly and fully acquired Cartesian readout k‐space trajectory, intra‐frame motion resulted in an imaging latency of approximately 50% of the acquisition time; in comparison, the motion artifacts exhibited only a negligible contribution to the overall geometric errors. All three compensation models led to a decrease in image MSE/MAE and GTV position offset compared to the motion‐corrupted image. In the investigated testing dataset for GTV contouring, the average dice similarity coefficients (DSC) improved from 88% to 96%, and the 95th percentile Hausdorff distance (HD95) dropped from 4.8 mm to 2.1 mm. Different models showed slight performance variations across different intra‐frame motion amplitude categories: NNImgLoss‐L1 excelled for small/medium amplitudes, whereas NNFloss‐L1 demonstrated higher DSC median values at larger amplitudes. The saliency maps of the motion‐corrupted image highlighted the major contribution of the later acquired k‐space data, as well as the edges of the moving anatomical structures at their final positions, during the model inference stage. Conclusions: Our results demonstrate the deep‐learning‐based approaches have the potential to compensate for intra‐frame motion by utilizing the later acquired data to drive the convergence of the earlier acquired k‐space components. [ABSTRACT FROM AUTHOR]

Background: Online adaptive radiation therapy (RT) using hybrid magnetic resonance linear accelerators (MR-Linacs) can administer a tailored radiation dose at each treatment fraction. Daily MR imaging followed by organ and target segmentation adjustments allow to capture anatomical changes, improve target volume coverage, and reduce the risk of side effects. The introduction of automatic segmentation techniques could help to further improve the online adaptive workflow by shortening the re-contouring time and reducing intra- and inter-observer variability. In fractionated RT, prior knowledge, such as planning images and manual expert contours, is usually available before irradiation, but not used by current artificial intelligence-based autocontouring approaches. Purpose: The goal of this study was to train convolutional neural networks (CNNs) for automatic segmentation of bladder, rectum (organs at risk, OARs), and clinical target volume (CTV) for prostate cancer patients treated at 0.35 T MR-Linacs. Furthermore, we tested the CNNs generalization on data from independent facilities and compared them with the MR-Linac treatment planning system (TPS) propagated structures currently used in clinics. Finally, expert planning delineations were utilized for patient- (PS) and facility-specific (FS) transfer learning to improve auto-segmentation of CTV and OARs on fraction images. Methods: In this study, data from fractionated treatments at 0.35 T MR-Linacs were leveraged to develop a 3D U-Net-based automatic segmentation. Cohort C1 had 73 planning images and cohort C2 had 19 planning and 240 fraction images. The baseline models (BMs) were trained solely on C1 planning data using 53 MRIs for training and 10 for validation. To assess their accuracy, the models were tested on three data subsets: (i) 10 C1 planning images not used for training, (ii) 19 C2 planning,and (iii) 240 C2 fraction images.BMs also served as a starting point for FS and PS transfer learning, where the planning images from C2 were used for network parameter fine tuning.The segmentation output of the different trained models was compared against expert ground truth by means of geometric metrics.Moreover, a trained physician graded the network segmentations as well as the segmentations propagated by the clinical TPS. Results: The BMs showed dice similarity coefficients (DSC) of 0.88(4) and 0.93(3) for the rectum and the bladder, respectively, independent of the facility. CTV segmentation with the BM was the best for intermediate- and high-risk cancer patients from C1 with DSC=0.84(5) and worst for C2 with DSC=0.74(7). The PS transfer learning brought a significant improvement in the CTV segmentation, yielding DSC=0.72(4) for post-prostatectomy and low-risk patients and DSC=0.88(5) for intermediate- and high-risk patients. The FS training did not improve the segmentation accuracy considerably. The physician’s assessment of the TPS-propagated versus network-generated structures showed a clear advantage of the latter. Conclusions: The obtained results showed that the presented segmentation technique has potential to improve automatic segmentation for MR-guided RT. [ABSTRACT FROM AUTHOR]