Search

Public participation in research, also known as citizen science, is being increasingly adopted for the analysis of biological volumetric data. Researchers working in this domain are applying online citizen science as a scalable distributed data analysis approach, with recent research demonstrating that non-experts can productively contribute to tasks such as the segmentation of organelles in volume electron microscopy data. This, alongside the growing challenge to rapidly process the large amounts of biological volumetric data now routinely produced, means there is increasing interest within the research community to apply online citizen science for the analysis of data in this context. Here, we synthesise core methodological principles and practices for applying citizen science for analysis of biological volumetric data. We collate and share the knowledge and experience of multiple research teams who have applied online citizen science for the analysis of volumetric biological data using the Zooniverse platform (www.zooniverse.org). We hope this provides inspiration and practical guidance regarding how contributor effort via online citizen science may be usefully applied in this domain.

This manuscript summarizes the capabilities of the new DIAD beamline for dual imaging and diffraction (DIAD) at Diamond Light Source, dedicated to quasi-simultaneous, time-resolved imaging/tomography and powder diffraction for 3D microstructure and phase identification/strain analysis studies., The Dual Imaging and Diffraction (DIAD) beamline at Diamond Light Source is a new dual-beam instrument for full-field imaging/tomography and powder diffraction. This instrument provides the user community with the capability to dynamically image 2D and 3D complex structures and perform phase identification and/or strain mapping using micro-diffraction. The aim is to enable in situ and in operando experiments that require spatially correlated results from both techniques, by providing measurements from the same specimen location quasi-simultaneously. Using an unusual optical layout, DIAD has two independent beams originating from one source that operate in the medium energy range (7–38 keV) and are combined at one sample position. Here, either radiography or tomography can be performed using monochromatic or pink beam, with a 1.4 mm × 1.2 mm field of view and a feature resolution of 1.2 µm. Micro-diffraction is possible with a variable beam size between 13 µm × 4 µm and 50 µm × 50 µm. One key functionality of the beamline is image-guided diffraction, a setup in which the micro-diffraction beam can be scanned over the complete area of the imaging field-of-view. This moving beam setup enables the collection of location-specific information about the phase composition and/or strains at any given position within the image/tomography field of view. The dual beam design allows fast switching between imaging and diffraction mode without the need of complicated and time-consuming mode switches. Real-time selection of areas of interest for diffraction measurements as well as the simultaneous collection of both imaging and diffraction data of (irreversible) in situ and in operando experiments are possible.

Electron cryo-tomography (cryo-ET) is an imaging technique for probing 3D structures with at the nanometre scale. This technique has been used extensively in the biomedical field to study the complex structures of proteins and other macromolecules. With the advancement in technology, microscopes are currently capable of producing images amounting to terabytes of data per day, posing great challenges for scientists as the speed of processing of the images cannot keep up with the ever-higher throughput of the microscopes. Therefore, automation is an essential and natural pathway on which image processing – from individual micrographs to full tomograms – is developing. In this paper, we present Ot2Rec, an open-source pipelining tool which aims to enable scientists to build their own processing workflows in a flexible and automatic manner. The basic building blocks of Ot2Rec are plugins which follow a unified API structure, making it simple for scientists to contribute to Ot2Rec by adding features which are not already available. In this paper, we also present three case studies of image processing using Ot2Rec, through which we demonstrate the speedup of using a semi-automatic workflow over a manual one, the possibility of writing and using custom (prototype) plugins, and the flexibility of Ot2Rec which enables the mix-and-match of plugins. We also demonstrate, in the supplementary information, a built-in reporting feature in Ot2Rec which aggregates the metadata from all process being run, and output them in the Jupyter Notebook and/or HTML formats for quick review of image processing quality. Ot2Rec can be found athttps://github.com/rosalindfranklininstitute/ot2rec.Impact StatementThe field of cryo electron tomography has grown substantially in recent years, bringing about new advances in hardware and software which enable visualisation of cell and tissue architecture and proteins found in their native context. These same advances have, in some ways, stratified the field into those with access and those without. On the software side, this has emphasised the need for open-source options that do not require high levels of computational literacy to access. Additionally, it has highlighted the need for ways to both mix-and-match software for easy prototyping and comparisons between parameters and methods. Ot2Rec addresses these needs through a simple, unified plugin structure allowing the addition of existing software or the development of new and does so in a way which democratises access.

An emergent volume electron microscopy (vEM) technique called cryogenic serial plasma focused ion beam milling scanning electron microscopy (pFIB/SEM) can decipher complex biological structures by building a three-dimensional picture of biological samples at mesoscale resolution. This is achieved by collecting consecutive SEM images after successive rounds of FIB milling that expose a new surface after each milling step. Due to instrumental limitations, some image processing is necessary before 3D visualisation and analysis of the data is possible. SEM images are affected by noise, drift, and charging effects, that can make precise 3D reconstruction of biological features difficult. This paper presents Okapi-EM, an open-source Napari plugin(1)developed to process and analyse cryogenic serial FIB/SEM images. Okapi-EM enables automated image registration of slices, evaluation of image quality metrics specific to FIB-SEM imaging, and mitigation of charging artefacts. Implementation of Okapi-EM within the Napari framework ensures that the tools are both user- and developer-friendly, through provision of a graphical user interface and access to Python programming. Napari also hosts a variety of other image processing plugins so Okapi-EM tools can be integrated into and combined with other workflows. Okapi-EM can be downloaded freely athttps://github.com/rosalindfranklininstitute/okapi-em, or installed from Python package index (PyPI).Impact statementCryogenic serial pFIB/SEM is an emerging microscopy technique that is used to visualise 3D structures of biological features at mesoscale resolutions(2). This technique requires common post processing of data such as alignment and charge mitigation to enable robust segmentation and analysis. In addition, approaches are needed to quantify data quality to enable an assessment of features and tune data acquisition parameters to enable optimal image acquisition. This article presents Okapi-EM, a combination of software tools designed to facilitate these important initial steps in assessing and processing images from these experiments. These tools have been assembled as a plugin for a popular 3D biological image visualiser called Napari, making their usage user-friendly and readily accessible.

Serial focussed ion beam scanning electron microscopy (FIB/SEM) enables imaging and assessment of sub-cellular structures on the mesoscale (10 nm to 10 μm). When applied to vitrified samples, serial FIB/SEM is also a means to target specific structures in cells and tissues while maintaining constituents’ hydration shells for in-situ structural biology downstream. However, the application of serial FIB/SEM imaging of non-stained cryogenic biological samples is limited due to low contrast, curtaining and charging artefacts. We address these challenges using a cryogenic plasma FIB/SEM (cryo-pFIB/SEM). We evaluated the choice of plasma ion source and imaging regimes to produce high quality SEM images of a range of different biological samples. Using an automated workflow we produced three dimensional volumes of bacteria, human cells, and tissue, and calculated estimates for their resolution, typically achieving 20 to 50 nm. Additionally, a tag-free tool is needed to drive the application of in situ structural biology towards tissue. The combination of serial FIB/SEM with plasmabased ion sources promises a framework for targeting specific features in bulk-frozen samples (>100 μm) to produce lamella for cryogenic electron tomography.

Diamond: The Game is a board game designed for secondary school students (aged 11–18) to enable them to explore a broad variety of science, technology, engineering and mathematics (STEM) careers, STEM subjects and life as a scientist. Board games are a reusable and entertaining way to directly engage students in STEM, but careful consideration of mechanics, messages and accessibility is required to successfully deliver on this goal. Diamond: The Game was designed and evaluated against these considerations. The inclusive approach to design resulted in a better and more accessible game for all. Its success is further evident in the rise in the number of players who would consider a career as a scientist or an engineer after playing. The opportunities to explore collaboration, failure and the interdisciplinary nature of science in the game were particularly highlighted in discussions with students, teachers and careers advisers.

Presentation delivered by Edward Rial on the Opt-ID software, given at SRI 2021 on the 28th March, 2022., Work on Opt-ID is funded by the Ada Lovelace Centre.

This work presents the Opt-ID software developed by the Rosalind Franklin Institute (RFI) and Diamond Light Source (DLS) in collaboration with Helmholtz-Zentrum Berlin (HZB). Opt-ID allows for efficient simulation of synchrotron Insertion Devices (ID) and the B fields produced by a given arrangement of candidate magnets. It provides an optimization framework built on the Artificial Immune System (AIS) algorithm for swapping and adjusting magnets within an ID to observe how these changes would affect the magnetic field of a real-world device, guiding ID builders in the steps they should take during ID tuning. Code for Opt-ID is provided open-source under the Apache-2.0 License on Github: https://github.com/rosalindfranklininstitute/Opt-ID

As sample preparation and imaging techniques have expanded and improved to include a variety of options for larger sized and numbers of samples, the bottleneck in volumetric imaging is now data analysis. Annotation and segmentation are both common, yet difficult, data analysis tasks which are required to bring meaning to the volumetric data. The SuRVoS application has been updated and redesigned to provide access to both manual and machine learning-based segmentation and annotation techniques, including support for crowd sourced data. Combining adjacent, similar voxels (supervoxels) provides a mechanism for speeding up segmentation both in the painting of annotation and by training a segmentation model on a small amount of annotation. The support for layers allows multiple datasets to be viewed and annotated together which, for example, enables the use of correlative data (e.g. crowd-sourced annotations or secondary imaging techniques) to guide segmentation. The ability to work with larger data on high-performance servers with GPUs has been added through a client-server architecture and the Pytorch-based image processing and segmentation server is flexible and extensible, and allows the implementation of deep learning-based segmentation modules. The client side has been built around Napari allowing integration of SuRVoS into an ecosystem for open-source image analysis while the server side has been built with cloud computing and extensibility through plugins in mind. Together these improvements to SuRVoS provide a platform for accelerating the annotation and segmentation of volumetric and correlative imaging data across modalities and scales.

Recently, several convolutional neural networks have been proposed not only for 2D images, but also for 3D and 4D volume segmentation. Nevertheless, due to the large data size of the latter, acquiring a sufficient amount of training annotations is much more strenuous than in 2D images. For 4D time-series tomograms, this is usually handled by segmenting the constituent tomograms independently through time with 3D convolutional neural networks. Inter-volume information is therefore not utilized, potentially leading to temporal incoherence. In this paper, we attempt to resolve this by proposing two hidden Markov model variants that refine 4D segmentation labels made by 3D convolutional neural networks working on each time point. Our models utilize not only inter-volume information, but also the prediction confidence generated by the 3D segmentation convolutional neural networks themselves. To the best of our knowledge, this is the first attempt to refine 4D segmentations made by 3D convolutional neural networks using hidden Markov models. During experiments we test our models, qualitatively, quantitatively and behaviourally, using prespecified segmentations. We demonstrate in the domain of time series tomograms which are typically undersampled to allow more frequent capture; a particularly challenging problem. Finally, our dataset and code is publicly available.

In cryo-electron tomography (cryo-ET) of biological samples, the quality of tomographic reconstructions can vary depending on the transmission electron microscope (TEM) instrument and data acquisition parameters. In this paper, we present Parakeet, a ‘digital twin’ software pipeline for the assessment of the impact of various TEM experiment parameters on the quality of three-dimensional tomographic reconstructions. The Parakeet digital twin is a digital model that can be used to optimize the performance and utilization of a physical instrument to enable in silico optimization of sample geometries, data acquisition schemes and instrument parameters. The digital twin performs virtual sample generation, TEM image simulation, and tilt series reconstruction and analysis within a convenient software framework. As well as being able to produce physically realistic simulated cryo-ET datasets to aid the development of tomographic reconstruction and subtomogram averaging programs, Parakeet aims to enable convenient assessment of the effects of different microscope parameters and data acquisition parameters on reconstruction quality. To illustrate the use of the software, we present the example of a quantitative analysis of missing wedge artefacts on simulated planar and cylindrical biological samples and discuss how data collection parameters can be modified for cylindrical samples where a full 180° tilt range might be measured.

Over recent years, many approaches have been proposed for the denoising or semantic segmentation of X-ray computed tomography (CT) scans. In most cases, high-quality CT reconstructions are used; however, such reconstructions are not always available. When the X-ray exposure time has to be limited, undersampled tomograms (in terms of their component projections) are attained. This low number of projections offers low-quality reconstructions that are difficult to segment. Here, we consider CT time-series (i.e. 4D data), where the limited time for capturing fast-occurring temporal events results in the time-series tomograms being necessarily undersampled. Fortunately, in these collections, it is common practice to obtain representative highly sampled tomograms before or after the time-critical portion of the experiment. In this paper, we propose an end-to-end network that can learn to denoise and segment the time-series’ undersampled CTs, by training with the earlier highly sampled representative CTs. Our single network can offer two desired outputs while only training once, with the denoised output improving the accuracy of the final segmentation. Our method is able to outperform state-of-the-art methods in the task of semantic segmentation and offer comparable results in regard to denoising. Additionally, we propose a knowledge transfer scheme using synthetic tomograms. This not only allows accurate segmentation and denoising using less real-world data, but also increases segmentation accuracy. Finally, we make our datasets, as well as the code, publicly available.

A convolutional neural network has been designed to quickly and accurately upscale the sinograms of X-ray tomograms captured with a low number of projections, effectively increasing the number of projections. This is particularly useful for tomograms that are part of a time-series as, in order to capture fast-occurring temporal events, tomograms have to be collected quickly, requiring a low number of projections. The upscaling process is facilitated using a single tomogram with a high number of projections for training, which is usually captured at the end or the beginning of the time-series when capturing the tomogram quickly is no longer needed., X-ray computed tomography and, specifically, time-resolved volumetric tomography data collections (4D datasets) routinely produce terabytes of data, which need to be effectively processed after capture. This is often complicated due to the high rate of data collection required to capture at sufficient time-resolution events of interest in a time-series, compelling the researchers to perform data collection with a low number of projections for each tomogram in order to achieve the desired ‘frame rate’. It is common practice to collect a representative tomogram with many projections, after or before the time-critical portion of the experiment without detrimentally affecting the time-series to aid the analysis process. For this paper these highly sampled data are used to aid feature detection in the rapidly collected tomograms by assisting with the upsampling of their projections, which is equivalent to upscaling the θ-axis of the sinograms. In this paper, a super-resolution approach is proposed based on deep learning (termed an upscaling Deep Neural Network, or UDNN) that aims to upscale the sinogram space of individual tomograms in a 4D dataset of a sample. This is done using learned behaviour from a dataset containing a high number of projections, taken of the same sample and occurring at the beginning or the end of the data collection. The prior provided by the highly sampled tomogram allows the application of an upscaling process with better accuracy than existing interpolation techniques. This upscaling process subsequently permits an increase in the quality of the tomogram’s reconstruction, especially in situations that require capture of only a limited number of projections, as is the case in high-frequency time-series capture. The increase in quality can prove very helpful for researchers, as downstream it enables easier segmentation of the tomograms in areas of interest, for example. The method itself comprises a convolutional neural network which through training learns an end-to-end mapping between sinograms with a low and a high number of projections. Since datasets can differ greatly between experiments, this approach specifically develops a lightweight network that can easily and quickly be retrained for different types of samples. As part of the evaluation of our technique, results with different hyperparameter settings are presented, and the method has been tested on both synthetic and real-world data. In addition, accompanying real-world experimental datasets have been released in the form of two 80 GB tomograms depicting a metallic pin that undergoes corruption from a droplet of salt water. Also a new engineering-based phantom dataset has been produced and released, inspired by the experimental datasets.

Diamond: the Game has been played globally by >11,500 people during the pandemic. The game enables people to explore a broad variety of STEM careers, STEM subjects and life as a scientist.

Multi-scale structural assessment of biological soft tissue is challenging but essential to gain insight into structure-function relationships of tissue/organ. Using the human placenta as an example, this study brings together sophisticated sample preparation protocols, advanced imaging, and robust, validated machine-learning segmentation techniques to provide the first massively multi-scale and multi-domain information that enables detailed morphological and functional analyses of both maternal and fetal placental domains. Finally, we quantify the scale-dependent error in morphological metrics of heterogeneous placental tissue, estimating the minimal tissue scale needed in extracting meaningful biological data. The developed protocol is beneficial for high-throughput investigation of structure-function relationships in both normal and diseased placentas, allowing us to optimise therapeutic approaches for pathological pregnancies. In addition, the methodology presented is applicable in characterisation of tissue architecture and physiological behaviours of other complex organs with similarity to the placenta, where an exchange barrier possesses circulating vascular and avascular fluid spaces. Summary Using the human placenta as an example, this study brings together sophisticated sample preparation protocols, advanced 3D X-ray imaging, and robust, validated machine-learning segmentation techniques to provide massively multi-scale and multi-domain insights on vascular-rich organ morphology and function.

Automatic segmentation methods developed for tomography data collected on macromolecular crystallography beamline I23, Diamond Light Source, to assist with absorption corrections for very long wavelengths X-ray diffraction data are presented., In this paper a practical solution for the reconstruction and segmentation of low-contrast X-ray tomographic data of protein crystals from the long-wavelength macromolecular crystallography beamline I23 at Diamond Light Source is provided. The resulting segmented data will provide the path lengths through both diffracting and non-diffracting materials as basis for analytical absorption corrections for X-ray diffraction data taken in the same sample environment ahead of the tomography experiment. X-ray tomography data from protein crystals can be difficult to analyse due to very low or absent contrast between the different materials: the crystal, the sample holder and the surrounding mother liquor. The proposed data processing pipeline consists of two major sequential operations: model-based iterative reconstruction to improve contrast and minimize the influence of noise and artefacts, followed by segmentation. The segmentation aims to partition the reconstructed data into four phases: the crystal, mother liquor, loop and vacuum. In this study three different semi-automated segmentation methods are experimented with by using Gaussian mixture models, geodesic distance thresholding and a novel morphological method, RegionGrow, implemented specifically for the task. The complete reconstruction-segmentation pipeline is integrated into the MPI-based data analysis and reconstruction framework Savu, which is used to reduce computation time through parallelization across a computing cluster and makes the developed methods easily accessible.

Diamond Light Source is the UK's national synchrotron facility, entering user operation in 2007 with seven beamlines. With 33 operational beamlines, it has delivered user operations for over 10 yea...

Ill-posed image recovery requires regularisation to ensure stability. The presented open-source regularisation toolkit consists of state-of-the-art variational algorithms which can be embedded in a plug-and-play fashion into the general framework of proximal splitting methods. The packaged regularisers aim to satisfy various prior expectations of the investigated objects, e.g., their structural characteristics, smooth or non-smooth surface morphology. The flexibility of the toolkit helps with the design of more advanced model-based iterative reconstruction methods for different imaging modalities while operating with simpler building blocks. The toolkit is written for CPU and GPU architectures and wrapped for Python/MATLAB. We demonstrate the functionality of the toolkit in application to Positron Emission Tomography (PET) and X-ray synchrotron computed tomography (CT).