Purpose: To develop a deep learning approach that enables ultra-low-dose, 1% of the standard clinical dosage (3 MBq/kg), ultrafast whole-body PET reconstruction in cancer imaging., Materials and Methods: In this Health Insurance Portability and Accountability Act-compliant study, serial fluorine 18-labeled fluorodeoxyglucose PET/MRI scans of pediatric patients with lymphoma were retrospectively collected from two cross-continental medical centers between July 2015 and March 2020. Global similarity between baseline and follow-up scans was used to develop Masked-LMCTrans, a longitudinal multimodality coattentional convolutional neural network (CNN) transformer that provides interaction and joint reasoning between serial PET/MRI scans from the same patient. Image quality of the reconstructed ultra-low-dose PET was evaluated in comparison with a simulated standard 1% PET image. The performance of Masked-LMCTrans was compared with that of CNNs with pure convolution operations (classic U-Net family), and the effect of different CNN encoders on feature representation was assessed. Statistical differences in the structural similarity index measure (SSIM), peak signal-to-noise ratio (PSNR), and visual information fidelity (VIF) were assessed by two-sample testing with the Wilcoxon signed rank t test., Results: The study included 21 patients (mean age, 15 years ± 7 [SD]; 12 female) in the primary cohort and 10 patients (mean age, 13 years ± 4; six female) in the external test cohort. Masked-LMCTrans-reconstructed follow-up PET images demonstrated significantly less noise and more detailed structure compared with simulated 1% extremely ultra-low-dose PET images. SSIM, PSNR, and VIF were significantly higher for Masked-LMCTrans-reconstructed PET ( P < .001), with improvements of 15.8%, 23.4%, and 186%, respectively., Conclusion: Masked-LMCTrans achieved high image quality reconstruction of 1% low-dose whole-body PET images. Keywords: Pediatrics, PET, Convolutional Neural Network (CNN), Dose Reduction Supplemental material is available for this article. © RSNA, 2023., Competing Interests: Disclosures of conflicts of interest: Y.R.J.W. Grant from the National Cancer Institute of the U.S. National Institutes of Health, grant number R01CA269231, and the Andrew McDonough B + Foundation. L.Q. No relevant relationships. N.D.S. National Institutes of Health Director's Early Independence Award DP5 (DP5OD031846), National Cancer Institute F99/K00 Predoctoral to Postdoctoral Fellow Transition Award (K00CA234954). X.L. No relevant relationships. J.W. No relevant relationships. K.E.H. No relevant relationships. A.J.T. No relevant relationships. S.G. No relevant relationships. X.X. No relevant relationships. A.P. No relevant relationships. D.R. Grant support from NCI; associate editor of Radiology: Artificial Intelligence. H.E.D.L. Grant from the National Cancer Institute of the US National Institutes of Health, grant number R01CA269231; 5R01AR054458-11, NIH/NIAMS Title: Monitoring Stem Cell Engraftment in Arthritic Joints with MR Imaging Dates: 8/01/2017-7/31/2023, Role: PI 10% effort; R01CA269231 NIH/NCI Title: Advanced Imaging Tools to Assess Cancer Therapeutics in Pediatric Patients, Dates: 2/1/2022-01/31/2027, Role: PI 10% effort; R01HD103638 NIH/NICHD Title: Theranostics for Pediatric Brain Cancer Dates: 4/15/2021-4/15/2026, Role: PI 20% effort; UG3CA268112 NIH/NCI Title: Cellular Senescence Network: New Imaging Tools for Arthritis Imaging; Dates: 10/1/2021-11/31/2026, Role: PI 10% effort; R21AR075863 NIH/NIAMS Title: Instant Stem Cell Labeling with a New Microfluidic Device Dates: 7/1/2019-6/30/2023 (one year NCE), Role: PI 5% effort; R21HD101129 Title: Imaging Chemotherapy-Induced Brain Damage in Pediatric Cancer Survivors Dates: 8/1/2020-7/31/2023 (one year NCE), Role: PI 5% effort; U24CA264298 NIH/NCI Title: Co-clinical research for imaging tumor associated macrophages Dates: 7/1/2021-6/30/2026, Role: Co-PI 10% effort; 5P30CA124435-10 NIH/NCI Title: Stanford Cancer Institute Support Grant (PI: Steven Artandi) Dates: 6/01/2017-5/31/2027, Role: Co-I 10% effort (H. Daldrup-Link, Codirector, Cancer Imaging & Early Detection Program); Cancer Research Institute Technology Impact Award Title: Mechanoporation creates new Biomarkers for Cancer Immunotherapy Dates: 7/1/2021-6/30/2023, Role: PI 1% effort; Sarcoma Foundation of America Title: Imaging response to CD47 mAb immunotherapy in pediatric patients with osteosarcoma Dates: 6/1/2020-5/31/2023, Role: PI 1% effort; R24OD019813-01 NIH Office of the Director Title: Expanding the Utility of Severe Combined ImmunoDeficient (SCID) pig models Dates: 5/1/2015-4/30/2025 Role: External Advisory Board Member (PI Christopher Tuggle); The ReMission Alliance Against Brain Tumors Title: Imaging CAR-T cells in Glioblastoma Dates: 9/1/2020-8/30/2023, Role: PI of subaward 5% effort; MegaPro Inc. Title: Evaluation of MegaPro Nanoparticles for MRI monitoring of Cancer Immunotherapy Dates: 7/1/2021-6/30/2023 Role: PI 1% effort; R01CA263500 NIH/NCI (PI C. Mackall) Title: Developing Safe and Effective GD2-CAR T Cell Therapy for Diffuse Midline Gliomas Dates: 7/1/2021–6/30/2026, Role: Co-Investigator 2% effort; Stanford Center for Artificial Intelligence in Medicine and Imaging (AIMI) Title: Standardized Therapy Response Assessments of Pediatric Cancers Dates: 11/1/2021–10/31/2023 Role: PI 2% effort; Patent: US6009342 Patent Assignee: University of California; Daldrup-Link, H.: Immunotherapy for cancer treatment using iron oxide nanoparticles; Patent: US20130344003 Patent Assignee: Stanford University; Daldrup-Link, H.: In vivo iron labeling of stem cells and tracking these labeled stem cells after their transplantation; Patent: US9579349, issued 2/28/17 Patent Assignee: Stanford University; Nejadnik H., Lenkov O., Daldrup-Link, H.: Compositions and methods for mesenchymal and/or chondrogenic differentiation of stem cells Patent: US20140271616 A Patent Assignee: Stanford University; Falconer R., Loadman P., Gill J.; Rao, J.; Daldrup H.E.: Activatable theranostic nanoparticles; Patent: WO 2015014756. Patent Assignee: Bradford University, UK and Stanford University, USA; Li K., Nejadnik H., Daldrup-Link, H.: Dual-modality Imaging Probe for Combined Localization and Apoptosis Detection of Stem Cells; Patent: US20180036435 Patent Assignee: Stanford University; Daldrup-Link, H., Mohanty S.: AntiWarburg Nanoparticles; Patent: WO/2018/217943 Patent Assignee: Stanford University; Co-Chair, Steering Committee, The NIH Common Fund's Cellular Senescence Network (SenNet) Program; Awards Committee, World Molecular Imaging Society (WMIS); MR Imaging Committee, Society for Pediatric Radiology (SPR) Diversity & Inclusion Committee, Society for Pediatric Radiology (SPR); Oncology Imaging Committee, Society for Pediatric Radiology (SPR); ad hoc reviewer, Nanotechnology (Nano) Study Section. NIH CSR (Center for Scientific Review); Ad Hoc Reviewer, ZRG1 SBIB-Q 03 Study Section; Biomedical Imaging & Bioengineering, Center for Scientific Reviews; reviewer for research grant applications for Emerson Collective Cancer Research Fund; reviewer for research grant applications for the Swiss Cancer Research Foundation; reviewer for the Florida Department of Health's Biomedical Research Program; reviewer for the Belgian Foundation Against Cancer; receipt of equipment, materials, drugs or other services from MegaPro Biomedical; Managing Director of Monasteria Press; associate editor for Radiology: Imaging Cancer; associate chair for Diversity, Department of Radiology, Stanford School of Medicine, Co-Program Director, Mentoring to AdVance womEN in Science (MAVENS) program, Stanford School of Medicine, Advisory committee member, Justice Diversity, Equity and Inclusion (JEDI) at the Stanford Cancer Institute (SCI)., (© 2023 by the Radiological Society of North America, Inc.)