Search

The development of novel imaging platforms has improved our ability to collect and analyze large three-dimensional (3D) biological imaging datasets. Advances in computing have led to an ability to extract complex spatial information from these data, such as the composition, morphology, and interactions of multi-cellular structures, rare events, and integration of multi-modal features combining anatomical, molecular, and transcriptomic (among other) information. Yet, the accuracy of these quantitative results is intrinsically limited by the quality of the input images, which can contain missing or damaged regions, or can be of poor resolution due to mechanical, temporal, or financial constraints. In applications ranging from intact imaging (e.g. light-sheet microscopy and magnetic resonance imaging) to sectioning based platforms (e.g. serial histology and serial section transmission electron microscopy), the quality and resolution of imaging data has become paramount. Here, we address these challenges by leveraging frame interpolation for large image motion (FILM), a generative AI model originally developed for temporal interpolation, for spatial interpolation of a range of 3D image types. Comparative analysis demonstrates the superiority of FILM over traditional linear interpolation to produce functional synthetic images, due to its ability to better preserve biological information including microanatomical features and cell counts, as well as image quality, such as contrast, variance, and luminance. FILM repairs tissue damages in images and reduces stitching artifacts. We show that FILM can decrease imaging time by synthesizing skipped images. We demonstrate the versatility of our method with a wide range of imaging modalities (histology, tissue-clearing/light-sheet microscopy, magnetic resonance imaging, serial section transmission electron microscopy), species (human, mouse), healthy and diseased tissues (pancreas, lung, brain), staining techniques (IHC, H&E), and pixel resolutions (8 nm, 2 μm, 1mm). Overall, we demonstrate the potential of generative AI in improving the resolution, throughput, and quality of biological image datasets, enabling improved 3D imaging., Competing Interests: Conflict of interest statement The authors declare no conflicts of interest.

Methods for spatially resolved cellular profiling using thinly cut sections have enabled in-depth quantitative tissue mapping to study inter-sample and intra-sample differences in normal human anatomy and disease onset and progression. These methods often profile extremely limited regions, which may impact the evaluation of heterogeneity due to tissue sub-sampling. Here, we applied CODA, a deep learning-based tissue mapping platform, to reconstruct the three-dimensional (3D) microanatomy of grossly normal and cancer-containing human pancreas biospecimens obtained from individuals who underwent pancreatic resection. To compare inter- and intra-sample heterogeneity, we assessed bulk and spatially resolved tissue composition in a cohort of two-dimensional (2D) whole slide images (WSIs) and a cohort of thick slabs of pancreas tissue that were digitally reconstructed in 3D from serial sections. To demonstrate the marked under sampling of 2D assessments, we simulated the number of WSIs and tissue microarrays (TMAs) necessary to represent the compositional heterogeneity of 3D data within 10% error to reveal that tens of WSIs and hundreds of TMA cores are sometimes needed. We show that spatial correlation of different pancreatic structures decay significantly within a span of microns, demonstrating that 2D histological sections may not be representative of their neighboring tissues. In sum, we demonstrate that 3D assessments are necessary to accurately assess tissue composition in normal and abnormal specimens and in order to accurately determine neoplastic content. These results emphasize the importance of intra-sample heterogeneity in tissue mapping efforts., Competing Interests: Conflict of interest statement The authors declare no conflicts of interest.

Chimeric antigen receptor (CAR) T cells express antigen-specific synthetic receptors, which upon binding to cancer cells, elicit T cell anti-tumor responses. CAR T cell therapy has enjoyed success in the clinic for hematological cancer indications, giving rise to decade-long remissions in some cases. However, CAR T therapy for patients with solid tumors has not seen similar success. Solid tumors constitute 90% of adult human cancers, representing an enormous unmet clinical need. Current approaches do not solve the central problem of limited ability of therapeutic cells to migrate through the stromal matrix. We discover that T cells at low and high density display low- and high-migration phenotypes, respectively. The highly migratory phenotype is mediated by a paracrine pathway from a group of self-produced cytokines that include IL5, TNFα, IFNγ, and IL8. We exploit this finding to "lock-in" a highly migratory phenotype by developing and expressing receptors, which we call velocity receptors (VRs). VRs target these cytokines and signal through these cytokines' cognate receptors to increase T cell motility and infiltrate lung, ovarian, and pancreatic tumors in large numbers and at doses for which control CAR T cells remain confined to the tumor periphery. In contrast to CAR therapy alone, VR-CAR T cells significantly attenuate tumor growth and extend overall survival. This work suggests that approaches to the design of immune cell receptors that focus on migration signaling will help current and future CAR cellular therapies to infiltrate deep into solid tumors., Competing Interests: Conflict of interest statement ACJ and DW are inventors on a patent application based on the work presented here.

Failure of septation of the interventricular septum (IVS) is the most common congenital heart defect (CHD), but mechanisms for patterning the IVS are largely unknown. We show that a Tbx5 + /Mef2cAHF + progenitor lineage forms a compartment boundary bisecting the IVS. This coordinated population originates at a first- and second heart field interface, subsequently forming a morphogenetic nexus. Ablation of Tbx5 + /Mef2cAHF + progenitors cause IVS disorganization, right ventricular hypoplasia and mixing of IVS lineages. Reduced dosage of the CHD transcription factor TBX5 disrupts boundary position and integrity, resulting in ventricular septation defects (VSDs) and patterning defects, including Slit2 and Ntn1 misexpression. Reducing NTN1 dosage partly rescues cardiac defects in Tbx5 mutant embryos. Loss of Slit2 or Ntn1 causes VSDs and perturbed septal lineage distributions. Thus, we identify essential cues that direct progenitors to pattern a compartment boundary for proper cardiac septation, revealing new mechanisms for cardiac birth defects., Competing Interests: Declaration of Interests: B.G.B. is a co-founder and shareholder of Tenaya Therapeutics. B.G.B. is an advisor for Silver Creek Pharmaceuticals. None of the work presented here is related to these commercial interests.

Pancreatic ductal adenocarcinoma is a rare but lethal cancer. Recent evidence reveals that pancreatic intraepithelial neoplasms (PanINs), the microscopic precursor lesions in the pancreatic ducts that can give rise to invasive pancreatic cancer, are significantly larger and more prevalent than previously believed. Better understanding of the growth law dynamics of PanINs may improve our ability to understand how a miniscule fraction of these lesions makes the transition to invasive cancer. Here, using artificial intelligence (AI)-based three-dimensional (3D) tissue mapping method, we measured the volumes of >1,000 PanIN and found that lesion size is distributed according to a power law with a fitted exponent of -1.7 over > 3 orders of magnitude. Our data also suggest that PanIN growth is not very sensitive to the pancreatic microenvironment or an individual's age, family history, and lifestyle, and is rather shaped by general growth behavior. We analyze several models of PanIN growth and fit the predicted size distributions to the observed data. The best fitting models suggest that both intraductal spread of PanIN lesions and fusing of multiple lesions into large, highly branched structures drive PanIN growth patterns. This work lays the groundwork for future mathematical modeling efforts integrating PanIN incidence, morphology, genomic, and transcriptomic features to understand pancreas tumorigenesis, and demonstrates the utility of combining experimental measurement of human tissues with dynamic modeling for understanding cancer tumorigenesis., Competing Interests: Conflict of interest statement The authors declare no conflicts of interest

Cells are fundamental units of life, constantly interacting and evolving as dynamical systems. While recent spatial multi-omics can quantitate individual cells' characteristics and regulatory programs, forecasting their evolution ultimately requires mathematical modeling. We develop a conceptual framework-a cell behavior hypothesis grammar-that uses natural language statements (cell rules) to create mathematical models. This allows us to systematically integrate biological knowledge and multi-omics data to make them computable. We can then perform virtual "thought experiments" that challenge and extend our understanding of multicellular systems, and ultimately generate new testable hypotheses. In this paper, we motivate and describe the grammar, provide a reference implementation, and demonstrate its potential through a series of examples in tumor biology and immunotherapy. Altogether, this approach provides a bridge between biological, clinical, and systems biology researchers for mathematical modeling of biological systems at scale, allowing the community to extrapolate from single-cell characterization to emergent multicellular behavior., Competing Interests: Declaration of interests JZ receives other support from Roche/Genentech. LZ receives grant support from Bristol-Myers Squibb, Merck, Astrazeneca, iTeos, Amgen, NovaRock, Inxmed, and Halozyme. LZ is a paid consultant/Advisory Board Member at Biosion, Alphamab, NovaRock, Ambrx, Akrevia/Xilio, QED, Tempus, Pfizer, Novagenesis, Snow Lake Capitals, Amberstone, Tavotek Lab, ClinicalTrial Options, LLC, and Mingruizhiyao. LZ holds shares at Amberstone, Alphamab, Cellaration, and Mingruizhiyao. EJ reports other support from Abmeta, Adventris, personal fees from Achilles, DragonFly, Neuvogen, Parker Institute, CPRIT, Surge, Mestag, Medical Home Group, and HDTbio, grants from Lustgarten, and other grant support from Genentech, BMS, NeoTX, and Break Through Cancer outside the submitted work. Dr. Jaffee is the Dana and Albert “Cubby” Broccoli Professor of Oncology. EJF is on the Scientific Advisory of Resistance Bio/Viosera Therapeutics, a paid consultant for Merck and Mestag, and receives research funds from Abbvie Inc and Roche/Genetech.

Matrix stiffness and corresponding mechano-signaling play indispensable roles in cellular phenotypes and functions. How tissue stiffness influences the behavior of monocytes, a major circulating leukocyte of the innate system, and how it may promote the emergence of collective cell behavior is less understood. Here, using tunable collagen-coated hydrogels of physiological stiffness, we show that human primary monocytes undergo a dynamic local phase separation to form highly patterned multicellular multi-layered domains on soft matrix. Local activation of the β2 integrin initiates inter-cellular adhesion, while global soluble inhibitory factors maintain the steady-state domain pattern over days. Patterned domain formation generated by monocytes is unique among other key immune cells, including macrophages, B cells, T cells, and NK cells. While inhibiting their phagocytic capability, domain formation promotes monocytes' survival. We develop a computational model based on the Cahn-Hilliard equation, which includes combined local activation and global inhibition mechanisms of intercellular adhesion suggested by our experiments, and provides experimentally validated predictions of the role of seeding density and both chemotactic and random cell migration on pattern formation.

Pancreatic intraepithelial neoplasia (PanIN) is a precursor to pancreatic cancer and represents a critical opportunity for cancer interception. However, the number, size, shape, and connectivity of PanINs in human pancreatic tissue samples are largely unknown. In this study, we quantitatively assessed human PanINs using CODA, a novel machine-learning pipeline for 3D image analysis that generates quantifiable models of large pieces of human pancreas with single-cell resolution. Using a cohort of 38 large slabs of grossly normal human pancreas from surgical resection specimens, we identified striking multifocality of PanINs, with a mean burden of 13 spatially separate PanINs per cm 3 of sampled tissue. Extrapolating this burden to the entire pancreas suggested a median of approximately 1000 PanINs in an entire pancreas. In order to better understand the clonal relationships within and between PanINs, we developed a pipeline for CODA-guided multi-region genomic analysis of PanINs, including targeted and whole exome sequencing. Multi-region assessment of 37 PanINs from eight additional human pancreatic tissue slabs revealed that almost all PanINs contained hotspot mutations in the oncogene KRAS , but no gene other than KRAS was altered in more than 20% of the analyzed PanINs. PanINs contained a mean of 13 somatic mutations per region when analyzed by whole exome sequencing. The majority of analyzed PanINs originated from independent clonal events, with distinct somatic mutation profiles between PanINs in the same tissue slab. A subset of the analyzed PanINs contained multiple KRAS mutations, suggesting a polyclonal origin even in PanINs that are contiguous by rigorous 3D assessment. This study leverages a novel 3D genomic mapping approach to describe, for the first time, the spatial and genetic multifocality of human PanINs, providing important insights into the initiation and progression of pancreatic neoplasia., Competing Interests: Competing Interests Statement: A pending patent application “COMPUTATIONAL TECHNIQUES FOR THREE-DIMENSIONAL RECONSTRUCTION AND MULTI-LABELING OF SERIALLY SECTIONED TISSUE” was filed on 6/24/2022 by authors AK, RHH, PHW, DW, and LDW. The other authors report no competing interests.