Search

Deep neural networks can improve the quality of fluorescence microscopy images. Previous methods, based on Convolutional Neural Networks (CNNs), require time-consuming training of individual models for each experiment, impairing their applicability and generalization. In this study, we propose a novel imaging-transformer based model, Convolutional Neural Network Transformer (CNNT), that outperforms CNN based networks for image denoising. We train a general CNNT based backbone model from pairwise high-low Signal-to-Noise Ratio (SNR) image volumes, gathered from a single type of fluorescence microscope, an instant Structured Illumination Microscope. Fast adaptation to new microscopes is achieved by fine-tuning the backbone on only 5-10 image volume pairs per new experiment. Results show that the CNNT backbone and fine-tuning scheme significantly reduces training time and improves image quality, outperforming models trained using only CNNs such as 3D-RCAN and Noise2Fast. We show three examples of efficacy of this approach in wide-field, two-photon, and confocal fluorescence microscopy., (© 2024. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.)

Optical aberrations hinder fluorescence microscopy of thick samples, reducing image signal, contrast, and resolution. Here we introduce a deep learning-based strategy for aberration compensation, improving image quality without slowing image acquisition, applying additional dose, or introducing more optics into the imaging path. Our method (i) introduces synthetic aberrations to images acquired on the shallow side of image stacks, making them resemble those acquired deeper into the volume and (ii) trains neural networks to reverse the effect of these aberrations. We use simulations and experiments to show that applying the trained 'de-aberration' networks outperforms alternative methods, providing restoration on par with adaptive optics techniques; and subsequently apply the networks to diverse datasets captured with confocal, light-sheet, multi-photon, and super-resolution microscopy. In all cases, the improved quality of the restored data facilitates qualitative image inspection and improves downstream image quantitation, including orientational analysis of blood vessels in mouse tissue and improved membrane and nuclear segmentation in C. elegans embryos.

The proliferation of microscopy methods for live-cell imaging offers many new possibilities for users but can also be challenging to navigate. The prevailing challenge in live-cell fluorescence microscopy is capturing intra-cellular dynamics while preserving cell viability. Computational methods can help to address this challenge and are now shifting the boundaries of what is possible to capture in living systems. In this Review, we discuss these computational methods focusing on artificial intelligence-based approaches that can be layered on top of commonly used existing microscopies as well as hybrid methods that integrate computation and microscope hardware. We specifically discuss how computational approaches can improve the signal-to-noise ratio, spatial resolution, temporal resolution and multi-colour capacity of live-cell imaging., (© 2024. Springer Nature Limited.)

Stereocilia are unidirectional F-actin-based cylindrical protrusions on the apical surface of inner ear hair cells and function as biological mechanosensors of sound and acceleration. Development of functional stereocilia requires motor activities of unconventional myosins to transport proteins necessary for elongating the F-actin cores and to assemble the mechanoelectrical transduction (MET) channel complex. However, how each myosin localizes in stereocilia using the energy from ATP hydrolysis is only partially understood. In this study, we develop a methodology for live-cell single-molecule fluorescence microscopy of organelles protruding from the apical surface using a dual-view light-sheet microscope, diSPIM. We demonstrate that MYO7A, a component of the MET machinery, traffics as a dimer in stereocilia. Movements of MYO7A are restricted when scaffolded by the plasma membrane and F-actin as mediated by MYO7A's interacting partners. Here, we discuss the technical details of our methodology and its future applications including analyses of cargo transportation in various organelles., Competing Interests: Declaration of interests The authors declare no conflict of interest associated with this manuscript.

Deep neural networks have been applied to improve the image quality of fluorescence microscopy imaging. Previous methods are based on convolutional neural networks (CNNs) which generally require more time-consuming training of separate models for each new imaging experiment, impairing the applicability and generalization. Once the model is trained (typically with tens to hundreds of image pairs) it can then be used to enhance new images that are like the training data. In this study, we proposed a novel imaging-transformer based model, Convolutional Neural Network Transformer (CNNT), to outperform the CNN networks for image denoising. In our scheme we have trained a single CNNT based "backbone model" from pairwise high-low SNR images for one type of fluorescence microscope (instance structured illumination, iSim). Fast adaption to new applications was achieved by fine-tuning the backbone on only 5-10 sample pairs per new experiment. Results show the CNNT backbone and fine-tuning scheme significantly reduces the training time and improves the image quality, outperformed training separate models using CNN approaches such as - RCAN and Noise2Fast. Here we show three examples of the efficacy of this approach on denoising wide-field, two-photon and confocal fluorescence data. In the confocal experiment, which is a 5×5 tiled acquisition, the fine-tuned CNNT model reduces the scan time form one hour to eight minutes, with improved quality., Competing Interests: Conflict of Interest The authors declare no conflict of interest.

Starvation triggers bacterial spore formation, a committed differentiation program that transforms a vegetative cell into a dormant spore. Cells in a population enter sporulation non-uniformly to secure against the possibility that favorable growth conditions, which puts sporulation-committed cells at a disadvantage, may resume. This heterogeneous behavior is initiated by a passive mechanism: stochastic activation of a master transcriptional regulator. Here, we identify a cell-cell communication pathway that actively promotes phenotypic heterogeneity, wherein Bacillus subtilis cells that start sporulating early utilize a calcineurin-like phosphoesterase to release glycerol, which simultaneously acts as a signaling molecule and a nutrient to delay non-sporulating cells from entering sporulation. This produced a more diverse population that was better poised to exploit a sudden influx of nutrients compared to those generating heterogeneity via stochastic gene expression alone. Although conflict systems are prevalent among microbes, genetically encoded cooperative behavior in unicellular organisms can evidently also boost inclusive fitness., Competing Interests: Competing Interests: The authors declare no competing interests.

When faced with starvation, the bacterium Bacillus subtilis transforms itself into a dormant cell type called a "spore". Sporulation initiates with an asymmetric division event, which requires the relocation of the core divisome components FtsA and FtsZ, after which the sigma factor σ F is exclusively activated in the smaller daughter cell. Compartment-specific activation of σ F requires the SpoIIE phosphatase, which displays a biased localization on one side of the asymmetric division septum and associates with the structural protein DivIVA, but the mechanism by which this preferential localization is achieved is unclear. Here, we isolated a variant of DivIVA that indiscriminately activates σ F in both daughter cells due to promiscuous localization of SpoIIE, which was corrected by overproduction of FtsA and FtsZ. We propose that the core components of the redeployed cell division machinery drive the asymmetric localization of DivIVA and SpoIIE to trigger the initiation of the sporulation program., Competing Interests: Competing interests statement:The authors declare no competing interest.

Protrusions at the leading-edge of a cell play an important role in sensing the extracellular cues during cellular spreading and motility. Recent studies provided indications that these protrusions wrap (coil) around the extracellular fibers. However, the physics of this coiling process, and the mechanisms that drive it, are not well understood. We present a combined theoretical and experimental study of the coiling of cellular protrusions on fibers of different geometry. Our theoretical model describes membrane protrusions that are produced by curved membrane proteins that recruit the protrusive forces of actin polymerization, and identifies the role of bending and adhesion energies in orienting the leading-edges of the protrusions along the azimuthal (coiling) direction. Our model predicts that the cell's leading-edge coils on fibers with circular cross-section (above some critical radius), but the coiling ceases for flattened fibers of highly elliptical cross-section. These predictions are verified by 3D visualization and quantitation of coiling on suspended fibers using Dual-View light-sheet microscopy (diSPIM). Overall, we provide a theoretical framework, supported by experiments, which explains the physical origin of the coiling phenomenon., (© 2023. Springer Nature Limited.)

The axial resolution of three-dimensional structured illumination microscopy (3D SIM) is limited to ∼300 nm. Here we present two distinct, complementary methods to improve axial resolution in 3D SIM with minimal or no modification to the optical system. We show that placing a mirror directly opposite the sample enables four-beam interference with higher spatial frequency content than 3D SIM illumination, offering near-isotropic imaging with ∼120-nm lateral and 160-nm axial resolution. We also developed a deep learning method achieving ∼120-nm isotropic resolution. This method can be combined with denoising to facilitate volumetric imaging spanning dozens of timepoints. We demonstrate the potential of these advances by imaging a variety of cellular samples, delineating the nanoscale distribution of vimentin and microtubule filaments, observing the relative positions of caveolar coat proteins and lysosomal markers and visualizing cytoskeletal dynamics within T cells in the early stages of immune synapse formation., (© 2023. The Author(s).)

Tissue clearing of whole intact organs has enhanced imaging by enabling the exploration of tissue structure at a subcellular level in three-dimensional space. Although clearing and imaging of the whole organ have been used to study tissue biology, the microenvironment in which cells evolve to adapt to biomaterial implants or allografts in the body is poorly understood. Obtaining high-resolution information from complex cell-biomaterial interactions with volumetric landscapes represents a key challenge in the fields of biomaterials and regenerative medicine. To provide a new approach to examine how tissue responds to biomaterial implants, we apply cleared tissue light-sheet microscopy and three-dimensional reconstruction to utilize the wealth of autofluorescence information for visualizing and contrasting anatomical structures. This study demonstrates the adaptability of the clearing and imaging technique to provide sub-cellular resolution (0.6 μm isotropic) 3D maps of various tissue types, using samples from fully intact peritoneal organs to volumetric muscle loss injury specimens. Specifically, in the volumetric muscle loss injury model, we provide 3D visualization of the implanted extracellular matrix biomaterial in the wound bed of the quadricep muscle groups and further apply computational-driven image classification to analyze the autofluorescence spectrum at multiple emission wavelengths to categorize tissue types at the injured site interacting with the biomaterial scaffolds., (Published 2023. This article is a U.S. Government work and is in the public domain in the USA. Journal of Biomedical Materials Research Part A published by Wiley Periodicals LLC.)

Fluorescence microscopy has evolved from a purely observational tool to a platform for quantitative, hypothesis-driven research. As such, the demand for faster and less phototoxic imaging modalities has spurred a rapid growth in light sheet fluorescence microscopy (LSFM). By restricting the excitation to a thin plane, LSFM reduces the overall light dose to a specimen while simultaneously improving image contrast. However, the defining characteristics of light sheet microscopes subsequently warrant unique considerations in their use for quantitative experiments. In this Perspective, we outline many of the pitfalls in LSFM that can compromise analysis and confound interpretation. Moreover, we offer guidance in addressing these caveats when possible. In doing so, we hope to provide a useful resource for life scientists seeking to adopt LSFM to quantitatively address complex biological hypotheses., (© 2022. Springer Nature America, Inc.)

The nematode Caenorhabditis elegans (C. elegans) is a model organism used frequently in developmental biology and neurobiology [White, (1986), Sulston, (1983), Chisholm, (2016) and Rapti, (2020)]. The C. elegans embryo can be used for cell tracking studies to understand how cell movement drives the development of specific embryonic tissues. Analyses in late-stage development are complicated by bouts of rapid twitching motions which invalidate traditional cell tracking approaches. However, the embryo possesses a small set of cells which may be identified, thereby defining the coiled embryo's posture [Christensen, 2015]. The posture serves as a frame of reference, facilitating cell tracking even in the presence of twitching. Posture identification is nevertheless challenging due to the complete repositioning of the embryo between sampled images. Current approaches to posture identification rely on time-consuming manual efforts by trained users which limits the efficiency of subsequent cell tracking. Here, we cast posture identification as a point-set matching task in which coordinates of seam cell nuclei are identified to jointly recover the posture. Most point-set matching methods comprise coherent point transformations that use low order objective functions [Zhou, (2016) and Zhang, (2019)]. Hypergraphs, an extension of traditional graphs, allow more intricate modeling of relationships between objects, yet existing hypergraphical point-set matching methods are limited to heuristic algorithms which do not easily scale to handle higher degree hypergraphs [Duchenne, (2010), Chertok, (2010) and Lee, (2011)]. Our algorithm, Exact Hypergraph Matching (EHGM), adapts the classical branch-and-bound paradigm to dynamically identify a globally optimal correspondence between point-sets under an arbitrarily intricate hypergraphical model. EHGM with hypergraphical models inspired by C. elegans embryo shape identified posture more accurately (56%) than established point-set matching methods (27%), correctly identifying twice as many sampled postures as a leading graphical approach. Posterior region seeding empowered EHGM to correctly identify 78% of postures while reducing runtime, demonstrating the efficacy of the method on a cutting-edge problem in developmental biology., Competing Interests: The authors have declared that no competing interests exist., (Copyright: This is an open access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.)

We present Richardson-Lucy network (RLN), a fast and lightweight deep learning method for three-dimensional fluorescence microscopy deconvolution. RLN combines the traditional Richardson-Lucy iteration with a fully convolutional network structure, establishing a connection to the image formation process and thereby improving network performance. Containing only roughly 16,000 parameters, RLN enables four- to 50-fold faster processing than purely data-driven networks with many more parameters. By visual and quantitative analysis, we show that RLN provides better deconvolution, better generalizability and fewer artifacts than other networks, especially along the axial dimension. RLN outperforms classic Richardson-Lucy deconvolution on volumes contaminated with severe out of focus fluorescence or noise and provides four- to sixfold faster reconstructions of large, cleared-tissue datasets than classic multi-view pipelines. We demonstrate RLN's performance on cells, tissues and embryos imaged with widefield-, light-sheet-, confocal- and super-resolution microscopy., (© 2022. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.)

Fluorescence microscopy is a highly effective tool for interrogating biological structure and function, particularly when imaging across multiple spatiotemporal scales. Here we survey recent innovations and applications in the relatively understudied area of multiscale fluorescence imaging of living samples. We discuss fundamental challenges in live multiscale imaging and describe successful examples that highlight the power of this approach. We attempt to synthesize general strategies from these test cases, aiming to help accelerate progress in this exciting area., (© 2022. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.)

Exposure to MHC-antigen complexes on the surface of antigen-presenting cells (APCs) activates T cells, inducing the formation of the immune synapse (IS). Antigen detection at the APC surface is thus a critical step in the adaptive immune response. The physical properties of antigen-presenting surfaces encountered by T cells in vivo are believed to modulate T cell activation and proliferation. Although stiffness and ligand mobility influence IS formation, the effect of the complex topography of the APC surface on this process is not well understood. Here we investigate how nanotopography modulates cytoskeletal dynamics and signaling during the early stages of T cell activation using high-resolution fluorescence microscopy on nanofabricated surfaces with parallel nanoridges of different spacings. We find that although nanoridges reduce the maximum spread area as compared with cells on flat surfaces, the ridges enhance the accumulation of actin and the signaling kinase ZAP-70 at the IS. Actin polymerization is more dynamic in the presence of ridges, which influence the directionality of both actin flows and microtubule (MT) growth. Our results demonstrate that the topography of the activating surface exerts both global effects on T cell morphology and local changes in actin and MT dynamics, collectively influencing T cell signaling.

Systematic analysis of rich behavioral recordings is being used to uncover how circuits encode complex behaviors. Here, we apply this approach to embryos. What are the first embryonic behaviors and how do they evolve as early neurodevelopment ensues? To address these questions, we present a systematic description of behavioral maturation for Caenorhabditis elegans embryos. Posture libraries were built using a genetically encoded motion capture suit imaged with light-sheet microscopy and annotated using custom tracking software. Analysis of cell trajectories, postures, and behavioral motifs revealed a stereotyped developmental progression. Early movement is dominated by flipping between dorsal and ventral coiling, which gradually slows into a period of reduced motility. Late-stage embryos exhibit sinusoidal waves of dorsoventral bends, prolonged bouts of directed motion, and a rhythmic pattern of pausing, which we designate slow wave twitch (SWT). Synaptic transmission is required for late-stage motion but not for early flipping nor the intervening inactive phase. A high-throughput behavioral assay and calcium imaging revealed that SWT is elicited by the rhythmic activity of a quiescence-promoting neuron (RIS). Similar periodic quiescent states are seen prenatally in diverse animals and may play an important role in promoting normal developmental outcomes., Competing Interests: EA, AL, SX, BH, RC, SN, JK, HS No competing interests declared

Worldwide SARS-CoV-2 sequencing efforts track emerging mutations in its spike protein, as well as characteristic mutations in other viral proteins. Besides their epidemiological importance, the observed SARS-CoV-2 sequences present an ensemble of viable protein variants, and thereby a source of information on viral protein structure and function. Charting the mutational landscape of the nucleocapsid (N) protein that facilitates viral assembly, we observe variability exceeding that of the spike protein, with more than 86% of residues that can be substituted, on average by three to four different amino acids. However, mutations exhibit an uneven distribution that tracks known structural features but also reveals highly protected stretches of unknown function. One of these conserved regions is in the central disordered linker proximal to the N-G215C mutation that has become dominant in the Delta variant, outcompeting G215 variants without further spike or N-protein substitutions. Structural models suggest that the G215C mutation stabilizes conserved transient helices in the disordered linker serving as protein-protein interaction interfaces. Comparing Delta variant N-protein to its ancestral version in biophysical experiments, we find a significantly more compact and less disordered structure. N-G215C exhibits substantially stronger self-association, shifting the unliganded protein from a dimeric to a tetrameric oligomeric state, which leads to enhanced coassembly with nucleic acids. This suggests that the sequence variability of N-protein is mirrored by high plasticity of N-protein biophysical properties, which we hypothesize can be exploited by SARS-CoV-2 to achieve greater efficiency of viral assembly, and thereby enhanced infectivity., (Published by Oxford University Press on behalf of the National Academy of Sciences 2021.)

HIV-1 encodes a viral protease that is essential for the maturation of infectious viral particles. While protease inhibitors are effective antiretroviral agents, recent studies have shown that prematurely activating, rather than inhibiting, protease function leads to the pyroptotic death of infected cells, with exciting implications for efforts to eradicate viral reservoirs. Despite 40 years of research into the kinetics of protease activation, it remains unclear exactly when protease becomes activated. Recent reports have estimated that protease activation occurs minutes to hours after viral release, suggesting that premature protease activation is challenging to induce efficiently. Here, monitoring viral protease activity with sensitive techniques, including nanoscale flow cytometry and instant structured illumination microscopy, we demonstrate that the viral protease is activated within cells prior to the release of free virions. Using genetic mutants that lock protease into a precursor conformation, we further show that both the precursor and mature protease have rapid activation kinetics and that the activity of the precursor protease is sufficient for viral fusion with target cells. Our finding that HIV-1 protease is activated within producer cells prior to release of free virions helps resolve a long-standing question of when protease is activated and suggests that only a modest acceleration of protease activation kinetics is required to induce potent and specific elimination of HIV-infected cells. IMPORTANCE HIV-1 protease inhibitors have been a mainstay of antiretroviral therapy for more than 2 decades. Although antiretroviral therapy is effective at controlling HIV-1 replication, persistent reservoirs of latently infected cells quickly reestablish replication if therapy is halted. A promising new strategy to eradicate the latent reservoir involves prematurely activating the viral protease, which leads to the pyroptotic killing of infected cells. Here, we use highly sensitive techniques to examine the kinetics of protease activation during and shortly after particle formation. We found that protease is fully activated before virus is released from the cell membrane, which is hours earlier than recent estimates. Our findings help resolve a long-standing debate as to when the viral protease is initially activated during viral assembly and confirm that prematurely activating HIV-1 protease is a viable strategy to eradicate infected cells following latency reversal.

Stereocilia protrude up to 100 µm from the apical surface of vertebrate inner ear hair cells and are packed with cross-linked filamentous actin (F-actin). They function as mechanical switches to convert sound vibration into electrochemical neuronal signals transmitted to the brain. Several genes encode molecular components of stereocilia including actin monomers, actin regulatory and bundling proteins, motor proteins and the proteins of the mechanotransduction complex. A stereocilium F-actin core is a dynamic system, which is continuously being remodeled while maintaining an outwardly stable architecture under the regulation of F-actin barbed-end cappers, severing proteins and crosslinkers. The F-actin cores of stereocilia also provide a pathway for motor proteins to transport cargos including components of tip-link densities, scaffolding proteins and actin regulatory proteins. Deficiencies and mutations of stereocilia components that disturb this "dynamic equilibrium" in stereocilia can induce morphological changes and disrupt mechanotransduction causing sensorineural hearing loss, best studied in mouse and zebrafish models. Currently, at least 23 genes, associated with human syndromic and nonsyndromic hearing loss, encode proteins involved in the development and maintenance of stereocilia F-actin cores. However, it is challenging to predict how variants associated with sensorineural hearing loss segregating in families affect protein function. Here, we review the functions of several molecular components of stereocilia F-actin cores and provide new data from our experimental approach to directly evaluate the pathogenicity and functional impact of reported and novel variants of DIAPH1 in autosomal-dominant DFNA1 hearing loss using single-molecule fluorescence microscopy., (© 2021. This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply.)

Asymmetric signaling and organization in the stem-cell niche determine stem-cell fates. Here, we investigate the basis of asymmetric signaling and stem-cell organization using the Drosophila wing-disc that creates an adult muscle progenitor (AMP) niche. We show that AMPs extend polarized cytonemes to contact the disc epithelial junctions and adhere themselves to the disc/niche. Niche-adhering cytonemes localize FGF-receptor to selectively adhere to the FGF-producing disc and receive FGFs in a contact-dependent manner. Activation of FGF signaling in AMPs, in turn, reinforces disc-specific cytoneme polarity/adhesion, which maintains their disc-proximal positions. Loss of cytoneme-mediated adhesion promotes AMPs to lose niche occupancy and FGF signaling, occupy a disc-distal position, and acquire morphological hallmarks of differentiation. Niche-specific AMP organization and diversification patterns are determined by localized expression and presentation patterns of two different FGFs in the wing-disc and their polarized target-specific distribution through niche-adhering cytonemes. Thus, cytonemes are essential for asymmetric signaling and niche-specific AMP organization., (© 2022. The Author(s).)

Confocal microscopy 1 remains a major workhorse in biomedical optical microscopy owing to its reliability and flexibility in imaging various samples, but suffers from substantial point spread function anisotropy, diffraction-limited resolution, depth-dependent degradation in scattering samples and volumetric bleaching 2 . Here we address these problems, enhancing confocal microscopy performance from the sub-micrometre to millimetre spatial scale and the millisecond to hour temporal scale, improving both lateral and axial resolution more than twofold while simultaneously reducing phototoxicity. We achieve these gains using an integrated, four-pronged approach: (1) developing compact line scanners that enable sensitive, rapid, diffraction-limited imaging over large areas; (2) combining line-scanning with multiview imaging, developing reconstruction algorithms that improve resolution isotropy and recover signal otherwise lost to scattering; (3) adapting techniques from structured illumination microscopy, achieving super-resolution imaging in densely labelled, thick samples; (4) synergizing deep learning with these advances, further improving imaging speed, resolution and duration. We demonstrate these capabilities on more than 20 distinct fixed and live samples, including protein distributions in single cells; nuclei and developing neurons in Caenorhabditis elegans embryos, larvae and adults; myoblasts in imaginal disks of Drosophila wings; and mouse renal, oesophageal, cardiac and brain tissues., (© 2021. This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply.)

During development, neurites and synapses segregate into specific neighborhoods or layers within nerve bundles. The developmental programs guiding placement of neurites in specific layers, and hence their incorporation into specific circuits, are not well understood. We implement novel imaging methods and quantitative models to document the embryonic development of the C. elegans brain neuropil , and discover that differential adhesion mechanisms control precise placement of single neurites onto specific layers. Differential adhesion is orchestrated via developmentally regulated expression of the IgCAM SYG-1, and its partner ligand SYG-2. Changes in SYG-1 expression across neuropil layers result in changes in adhesive forces, which sort SYG-2-expressing neurons. Sorting to layers occurs, not via outgrowth from the neurite tip, but via an alternate mechanism of retrograde zippering, involving interactions between neurite shafts. Our study indicates that biophysical principles from differential adhesion govern neurite placement and synaptic specificity in vivo in developing neuropil bundles., Competing Interests: TS, NK, NV, MM, LD, SE, XH, LS, YW, AS, LF, ZB, WM, HS, DC No competing interests declared

Activation of T-cells leads to the formation of immune synapses (ISs) with antigen-presenting cells. This requires T-cell polarization and coordination between the actomyosin and microtubule cytoskeletons. The interactions between these two cytoskeletal components during T-cell activation are not well understood. Here, we elucidate the interactions between microtubules and actin at the IS with high-resolution fluorescence microscopy. We show that microtubule growth dynamics in the peripheral actin-rich region is distinct from that in the central actin-free region. We further demonstrate that these differences arise from differential involvement of Arp2/3- and formin-nucleated actin structures. Formin inhibition results in a moderate decrease in microtubule growth rates, which is amplified in the presence of integrin engagement. In contrast, Arp2/3 inhibition leads to an increase in microtubule growth rates. We find that microtubule filaments are more deformed and exhibit greater shape fluctuations in the periphery of the IS than at the center. Using small molecule inhibitors, we show that actin dynamics and actomyosin contractility play key roles in defining microtubule deformations and shape fluctuations. Our results indicate a mechanical coupling between the actomyosin and microtubule systems during T-cell activation, whereby different actin structures influence microtubule dynamics in distinct ways.

Identifying neural substrates of behavior requires defining actions in terms that map onto brain activity. Brain and muscle activity naturally correlate via the output of motor neurons, but apart from simple movements it has been difficult to define behavior in terms of muscle contractions. By mapping the musculature of the pupal fruit fly and comprehensively imaging muscle activation at single-cell resolution, we here describe a multiphasic behavioral sequence in Drosophila . Our characterization identifies a previously undescribed behavioral phase and permits extraction of major movements by a convolutional neural network. We deconstruct movements into a syllabary of co-active muscles and identify specific syllables that are sensitive to neuromodulatory manipulations. We find that muscle activity shows considerable variability, with sequential increases in stereotypy dependent upon neuromodulation. Our work provides a platform for studying whole-animal behavior, quantifying its variability across multiple spatiotemporal scales, and analyzing its neuromodulatory regulation at cellular resolution., Competing Interests: AE, AB, MH, SR, RS, CC, HS, BW No competing interests declared

We demonstrate residual channel attention networks (RCAN) for the restoration and enhancement of volumetric time-lapse (four-dimensional) fluorescence microscopy data. First we modify RCAN to handle image volumes, showing that our network enables denoising competitive with three other state-of-the-art neural networks. We use RCAN to restore noisy four-dimensional super-resolution data, enabling image capture of over tens of thousands of images (thousands of volumes) without apparent photobleaching. Second, using simulations we show that RCAN enables resolution enhancement equivalent to, or better than, other networks. Third, we exploit RCAN for denoising and resolution improvement in confocal microscopy, enabling ~2.5-fold lateral resolution enhancement using stimulated emission depletion microscopy ground truth. Fourth, we develop methods to improve spatial resolution in structured illumination microscopy using expansion microscopy data as ground truth, achieving improvements of ~1.9-fold laterally and ~3.6-fold axially. Finally, we characterize the limits of denoising and resolution enhancement, suggesting practical benchmarks for evaluation and further enhancement of network performance.

The adaptive immune system serves as a potent and highly specific defense mechanism against pathogen infection. One component of this system, the effector T cell, facilitates pathogen clearance upon detection of specific antigens by the T cell receptor (TCR). A critical process in effector T cell activation is transmission of signals from the TCR to a key transcriptional regulator, NF-κB. The transmission of this signal involves a highly dynamic process in which helical filaments of Bcl10, a key protein constituent of the TCR signaling cascade, undergo competing processes of polymeric assembly and macroautophagy-dependent degradation. Through computational analysis of three-dimensional, super-resolution optical micrographs, we quantitatively characterize TCR-stimulated Bcl10 filament assembly and length dynamics, and demonstrate that filaments become shorter over time. Additionally, we develop an image-based, bootstrap-like resampling method that demonstrates the preferred association between autophagosomes and both Bcl10-filament ends and punctate-Bcl10 structures, implying that autophagosome-driven macroautophagy is directly responsible for Bcl10 filament shortening. We probe Bcl10 polymerization-depolymerization dynamics with a stochastic Monte-Carlo simulation of nucleation-limited filament assembly and degradation, and we show that high probabilities of filament nucleation in response to TCR engagement could provide the observed robust, homogeneous, and tunable response dynamic. Furthermore, we demonstrate that the speed of filament disassembly preferentially at filament ends provides effective regulatory control. Taken together, these data suggest that Bcl10 filament growth and degradation act as an excitable system that provides a digital response mechanism and the reliable timing critical for T cell activation and regulatory processes., Competing Interests: The authors have declared that no competing interests exist.

We demonstrate diffraction-limited and super-resolution imaging through thick layers (tens-hundreds of microns) of BIO-133, a biocompatible, UV-curable, commercially available polymer with a refractive index (RI) matched to water. We show that cells can be directly grown on BIO-133 substrates without the need for surface passivation and use this capability to perform extended time-lapse volumetric imaging of cellular dynamics 1) at isotropic resolution using dual-view light-sheet microscopy, and 2) at super-resolution using instant structured illumination microscopy. BIO-133 also enables immobilization of 1) Drosophila tissue, allowing us to track membrane puncta in pioneer neurons, and 2) Caenorhabditis elegans, which allows us to image and inspect fine neural structure and to track pan-neuronal calcium activity over hundreds of volumes. Finally, BIO-133 is compatible with other microfluidic materials, enabling optical and chemical perturbation of immobilized samples, as we demonstrate by performing drug and optogenetic stimulation on cells and C. elegans.

Neuropil is a fundamental form of tissue organization within the brain 1 , in which densely packed neurons synaptically interconnect into precise circuit architecture 2,3 . However, the structural and developmental principles that govern this nanoscale precision remain largely unknown 4,5 . Here we use an iterative data coarse-graining algorithm termed 'diffusion condensation' 6 to identify nested circuit structures within the Caenorhabditis elegans neuropil, which is known as the nerve ring. We show that the nerve ring neuropil is largely organized into four strata that are composed of related behavioural circuits. The stratified architecture of the neuropil is a geometrical representation of the functional segregation of sensory information and motor outputs, with specific sensory organs and muscle quadrants mapping onto particular neuropil strata. We identify groups of neurons with unique morphologies that integrate information across strata and that create neural structures that cage the strata within the nerve ring. We use high resolution light-sheet microscopy 7,8 coupled with lineage-tracing and cell-tracking algorithms 9,10 to resolve the developmental sequence and reveal principles of cell position, migration and outgrowth that guide stratified neuropil organization. Our results uncover conserved structural design principles that underlie the architecture and function of the nerve ring neuropil, and reveal a temporal progression of outgrowth-based on pioneer neurons-that guides the hierarchical development of the layered neuropil. Our findings provide a systematic blueprint for using structural and developmental approaches to understand neuropil organization within the brain.

Inferring the organization of fluorescently labeled nanosized structures from single molecule localization microscopy (SMLM) data, typically obscured by stochastic noise and background, remains challenging. To overcome this, we developed a method to extract high-resolution ordered features from SMLM data that requires only a low fraction of targets to be localized with high precision. First, experimentally measured localizations are analyzed to produce relative position distributions (RPDs). Next, model RPDs are constructed using hypotheses of how the molecule is organized. Finally, a statistical comparison is used to select the most likely model. This approach allows pattern recognition at sub-1% detection efficiencies for target molecules, in large and heterogeneous samples and in 2D and 3D data sets. As a proof-of-concept, we infer ultrastructure of Nup107 within the nuclear pore, DNA origami structures, and α-actinin-2 within the cardiomyocyte Z-disc and assess the quality of images of centrioles to improve the averaged single-particle reconstruction.

Fast-dissociating, specific antibodies are single-molecule imaging probes that transiently interact with their targets and are used in biological applications including image reconstruction by integrating exchangeable single-molecule localization (IRIS), a multiplexable super-resolution microscopy technique. Here, we introduce a semi-automated screen based on single-molecule total internal reflection fluorescence (TIRF) microscopy of antibody-antigen binding, which allows for identification of fast-dissociating monoclonal antibodies directly from thousands of hybridoma cultures. We develop monoclonal antibodies against three epitope tags (FLAG-tag, S-tag, and V5-tag) and two F-actin crosslinking proteins (plastin and espin). Specific antibodies show fast dissociation with half-lives ranging from 0.98 to 2.2 s. Unexpectedly, fast-dissociating yet specific antibodies are not so rare. A combination of fluorescently labeled Fab probes synthesized from these antibodies and light-sheet microscopy, such as dual-view inverted selective plane illumination microscopy (diSPIM), reveal rapid turnover of espin within long-lived F-actin cores of inner-ear sensory hair cell stereocilia, demonstrating that fast-dissociating specific antibodies can identify novel biological phenomena., Competing Interests: Declaration of interests The authors declare no conflict of interest associated with this manuscript., (Copyright © 2021 The Authors. Published by Elsevier Inc. All rights reserved.)

The Zebrafish Posterior Lateral Line primordium migrates in a channel between the skin and somites. Its migration depends on the coordinated movement of its mesenchymal-like leading cells and trailing cells, which form epithelial rosettes, or protoneuromasts. We describe a superficial population of flat primordium cells that wrap around deeper epithelialized cells and extend polarized lamellipodia to migrate apposed to the overlying skin. Polarization of lamellipodia extended by both superficial and deeper protoneuromast-forming cells depends on Fgf signaling. Removal of the overlying skin has similar effects on superficial and deep cells: lamellipodia are lost, blebs appear instead, and collective migration fails. When skinned embryos are embedded in Matrigel, basal and superficial lamellipodia are recovered; however, only the directionality of basal protrusions is recovered, and migration is not rescued. These observations support a key role played by superficial primordium cells and the skin in directed migration of the Posterior Lateral Line primordium., Competing Interests: DD, NN, HV, HS, AC No competing interests declared

The contrast and resolution of images obtained with optical microscopes can be improved by deconvolution and computational fusion of multiple views of the same sample, but these methods are computationally expensive for large datasets. Here we describe theoretical and practical advances in algorithm and software design that result in image processing times that are tenfold to several thousand fold faster than with previous methods. First, we show that an 'unmatched back projector' accelerates deconvolution relative to the classic Richardson-Lucy algorithm by at least tenfold. Second, three-dimensional image-based registration with a graphics processing unit enhances processing speed 10- to 100-fold over CPU processing. Third, deep learning can provide further acceleration, particularly for deconvolution with spatially varying point spread functions. We illustrate our methods from the subcellular to millimeter spatial scale on diverse samples, including single cells, embryos and cleared tissue. Finally, we show performance enhancement on recently developed microscopes that have improved spatial resolution, including dual-view cleared-tissue light-sheet microscopes and reflective lattice light-sheet microscopes.

We investigate rotational diffusion of fluorescent molecules in angular potential wells, the excitation and subsequent emissions from these diffusing molecules, and the imaging of these emissions with high-NA aplanatic optical microscopes. Although dipole emissions only transmit six low-frequency angular components, we show that angular structured illumination can alias higher-frequency angular components into the passband of the imaging system. We show that the number of measurable angular components is limited by the relationships between three time scales: the rotational diffusion time, the fluorescence decay time, and the acquisition time. We demonstrate our model by simulating a numerical phantom in the limits of fast angular diffusion, slow angular diffusion, and weak potentials.

mRNAs enriched in membraneless condensates provide functional compartmentalization within cells. The mechanisms that recruit transcripts to condensates are under intense study; however, how mRNAs organize once they reach a granule remains poorly understood. Here, we report on a self-sorting mechanism by which multiple mRNAs derived from the same gene assemble into discrete homotypic clusters. We demonstrate that in vivo mRNA localization to granules and self-assembly within granules are governed by different mRNA features: localization is encoded by specific RNA regions, whereas self-assembly involves the entire mRNA, does not involve sequence-specific, ordered intermolecular RNA:RNA interactions, and is thus RNA sequence independent. We propose that the ability of mRNAs to self-sort into homotypic assemblies is an inherent property of an messenger ribonucleoprotein (mRNP) that is augmented under conditions that increase RNA concentration, such as upon enrichment in RNA-protein granules, a process that appears conserved in diverse cellular contexts and organisms., Competing Interests: Declaration of Interests H.S. receives royalties, as co-inventor, from sales of iSIM by Visitech. The NIH, its officers, and staff do not recommend or endorse any company, product, or service., (Copyright © 2020 Elsevier Inc. All rights reserved.)

Regulation of membrane receptor mobility tunes cellular response to external signals, such as in binding of B cell receptors (BCR) to antigen, which initiates signaling. However, whether BCR signaling is regulated by BCR mobility, and what factors mediate this regulation, are not well understood. Here we use single molecule imaging to examine BCR movement during signaling activation and a novel machine learning method to classify BCR trajectories into distinct diffusive states. Inhibition of actin dynamics downstream of the actin nucleating factors, Arp2/3 and formin, decreases BCR mobility. Constitutive loss or acute inhibition of the Arp2/3 regulator, N-WASP, which is associated with enhanced signaling, increases the proportion of BCR trajectories with lower diffusivity. Furthermore, loss of N-WASP reduces the diffusivity of CD19, a stimulatory co-receptor, but not that of FcγRIIB, an inhibitory co-receptor. Our results implicate a dynamic actin network in fine-tuning receptor mobility and receptor-ligand interactions for modulating B cell signaling.

Assembly of infectious influenza A viruses (IAV) is a complex process involving transport from the nucleus to the plasma membrane. Rab11A-containing recycling endosomes have been identified as a platform for intracellular transport of viral RNA (vRNA). Here, using high spatiotemporal resolution light-sheet microscopy (~1.4 volumes/second, 330 nm isotropic resolution), we quantify Rab11A and vRNA movement in live cells during IAV infection and report that IAV infection decreases speed and increases arrest of Rab11A. Unexpectedly, infection with respiratory syncytial virus alters Rab11A motion in a manner opposite to IAV, suggesting that Rab11A is a common host component that is differentially manipulated by respiratory RNA viruses. Using two-color imaging we demonstrate co-transport of Rab11A and IAV vRNA in infected cells and provide direct evidence that vRNA-associated Rab11A have altered transport. The mechanism of altered Rab11A movement is likely related to a decrease in dynein motors bound to Rab11A vesicles during IAV infection.

Bacterial spores are dormant cells that are encased in a thick protein shell, the "coat," which participates in protecting the organism's DNA from environmental insults. The coat is composed of dozens of proteins that assemble in an orchestrated fashion during sporulation. In Bacillus subtilis , 2 proteins initiate coat assembly: SpoVM, which preferentially binds to micron-scale convex membranes and marks the surface of the developing spore as the site for coat assembly; and SpoIVA, a structural protein recruited by SpoVM that uses ATP hydrolysis to drive its irreversible polymerization around the developing spore. Here, we describe the initiation of coat assembly by SpoVM and SpoIVA. Using single-molecule fluorescence microscopy in vivo in sporulating cells and in vitro on synthetic spores, we report that SpoVM's localization is primarily driven by a lower off-rate on membranes of preferred curvature in the absence of other coat proteins. Recruitment and polymerization of SpoIVA results in the entrapment of SpoVM on the forespore surface. Using experimentally derived reaction parameters, we show that a 2-dimensional ratchet model can describe the interdependent localization dynamics of SpoVM and SpoIVA, wherein SpoVM displays a longer residence time on the forespore surface, which favors recruitment of SpoIVA to that location. Localized SpoIVA polymerization in turn prevents further sampling of other membranes by prelocalized SpoVM molecules. Our model therefore describes the dynamics of structural proteins as they localize and assemble at the correct place and time within a cell to form a supramolecular complex., Competing Interests: The authors declare no competing interest.

We introduce the basic elements of a spatio-angular theory of fluorescence microscopy, providing a unified framework for analyzing systems that image single fluorescent dipoles and ensembles of overlapping dipoles that label biological molecules. We model an aplanatic microscope imaging an ensemble of fluorescent dipoles as a linear Hilbert-space operator, and we show that the operator takes a particularly convenient form when expressed in a basis of complex exponentials and spherical harmonics-a form we call the dipole spatio-angular transfer function. We discuss the implications of our analysis for all quantitative fluorescence microscopy studies and lay out a path toward a complete theory.

We investigate the properties of a single-view fluorescence microscope in a 4f geometry when imaging fluorescent dipoles without using the monopole or scalar approximations. We show that this imaging system has a spatio-angular band limit, and we exploit the band limit to perform efficient simulations. Notably, we show that information about the out-of-plane orientation of ensembles of in-focus fluorophores is recorded by paraxial fluorescence microscopes. Additionally, we show that the monopole approximation may cause biased estimates of fluorophore concentrations, but these biases are small when the sample contains either many randomly oriented fluorophores in each resolvable volume or unconstrained rotating fluorophores.