Search

The ability to detect interesting events is instrumental to effectively steer experiments and maximize their scientific efficiency. To address this, here we introduce and validate three frameworks based on self-supervised learning which are capable of classifying 1D spectral data using a limited amount of labeled data. In particular, in this work we focus on the identification of phase transitions in samples investigated by x-ray diffraction. We demonstrate that the three frameworks, based either on relational reasoning, contrastive learning, or a combination of the two, are capable of accurately identifying phase transitions. Furthermore, we discuss in detail the selection of data augmentations, crucial to ensure that scientifically meaningful information is retained.

IUCrJ 7(5), 784 - 792 (2020). doi:10.1107/S2052252520008672, Macromolecular crystallography (MX) is the dominant means of determining the three-dimensional structures of biological macromolecules. Over the last few decades, most MX data have been collected at synchrotron beamlines using a large number of different detectors produced by various manufacturers and taking advantage of various protocols and goniometries. These data came in their own formats: sometimes proprietary, sometimes open. The associated metadata rarely reached the degree of completeness required for data management according to Findability, Accessibility, Interoperability and Reusability (FAIR) principles. Efforts to reuse old data by other investigators or even by the original investigators some time later were often frustrated. In the culmination of an effort dating back more than two decades, a large portion of the research community concerned with high data-rate macromolecular crystallography (HDRMX) has now agreed to an updated specification of data and metadata for diffraction images produced at synchrotron light sources and X-ray free-electron lasers (XFELs). This `Gold Standard' will facilitate the processing of data sets independent of the facility at which they were collected and enable data archiving according to FAIR principles, with a particular focus on interoperability and reusability. This agreed standard builds on the NeXus/HDF5 NXmx application definition and the International Union of Crystallography (IUCr) imgCIF/CBF dictionary, and it is compatible with major data-processing programs and pipelines. Just as with the IUCr CBF/imgCIF standard from which it arose and to which it is tied, the NeXus/HDF5 NXmx Gold Standard application definition is intended to be applicable to all detectors used for crystallography, and all hardware and software developers in the field are encouraged to adopt and contribute to the standard., Published by Chester

The single-crystal structures of calcium D-gluconate and calcium α-D-isosaccharinate have been determined using X-ray diffraction at 100 K. Surprisingly, given its significance in industrial and medical applications, the structure of calcium D-gluconate has not previously been reported. Unexpectedly, the gluconate crystal structure comprises coordination polymers. Unusually, the calcium coordination number is nine. Adjacent metal centres are linked by three μ-oxo bridges, with a metal–metal separation of 3.7312 (2) Å. One of the gluconate ligands contradicts a suggestion from 1974 that a straight chain conformation is associated with an intramolecular hydrogen bond. This ligand binds to three adjacent metal centres. The use of synchrotron radiation provided an improved crystal structure with respect to that previously reported for the isosaccharinate complex, allowing the location of the hydroxy hydrogen sites to be elucidated. In contrast to the gluconate structure, there are no μ-oxo bridges in the isosaccharinate coordination polymer and the isosaccharinate bridging coordination is such that the distance between adjacent metal centres, each of which is eight-coordinate, is 6.7573 (4) Å. Complementing the crystal structure determinations, modelling studies of the geometries and coordination modes for the aqueous [CaGluc]+ and [CaIsa]+ complexes are presented and discussed.

Nature Communications 10(1), 11 (2019). doi:10.1038/s41467-019-12955-3, The world’s first superconducting megahertz repetition rate hard X-ray free-electron laser (XFEL), the European XFEL, began operation in 2017, featuring a unique pulse train structure with 886 ns between pulses. With its rapid pulse rate, the European XFEL may alleviate some of the increasing demand for XFEL beamtime, particularly for membrane protein serial femtosecond crystallography (SFX), leveraging orders-of-magnitude faster data collection. Here, we report the first membrane protein megahertz SFX experiment, where we determined a 2.9 Å-resolution SFX structure of the large membrane protein complex, Photosystem I, a > 1 MDa complex containing 36 protein subunits and 381 cofactors. We address challenges to megahertz SFX for membrane protein complexes, including growth of large quantities of crystals and the large molecular and unit cell size that influence data collection and analysis. The results imply that megahertz crystallography could have an important impact on structure determination of large protein complexes with XFELs., Published by Nature Publishing Group UK, [London]

Scientific data 6(1), 18 (2019). doi:10.1038/s41597-019-0010-0, We provide a detailed description of a serial femtosecond crystallography (SFX) dataset collected at the European X-ray free-electron laser facility (EuXFEL). The EuXFEL is the first high repetition rate XFEL delivering MHz X-ray pulse trains at 10 Hz. The short spacing (, Published by Nature Publ. Group, London

In macromolecular crystallography, a great deal of effort has been invested in understanding radiation-damage progression. While the sensitivity of protein crystals has been well characterized, crystals of DNA and of DNA–protein complexes have not thus far been studied as thoroughly. Here, a systematic investigation of radiation damage to a crystal of a DNA 16-mer diffracting to 1.8 Å resolution and held at 100 K, up to an absorbed dose of 45 MGy, is reported. The RIDL (Radiation-Induced Density Loss) automated computational tool was used for electron-density analysis. Both the global and specific damage to the DNA crystal as a function of dose were monitored, following careful calibration of the X-ray flux and beam profile. The DNA crystal was found to be fairly radiation insensitive to both global and specific damage, with half of the initial diffraction intensity being lost at an absorbed average diffraction-weighted dose, D 1/2, of 19 MGy, compared with 9 MGy for chicken egg-white lysozyme crystals under the same beam conditions but at the higher resolution of 1.4 Å. The coefficient of sensitivity of the DNA crystal was 0.014 Å2 MGy−1, which is similar to that observed for proteins. These results imply that the significantly greater radiation hardness of DNA and RNA compared with protein observed in a DNA–protein complex and an RNA–protein complex could be due to scavenging action by the protein, thereby protecting the DNA and RNA in these studies. In terms of specific damage, the regions of DNA that were found to be sensitive were those associated with some of the bound calcium ions sequestered from the crystallization buffer. In contrast, moieties farther from these sites showed only small changes even at higher doses.

Journal of synchrotron radiation 26(5), 1448 - 1461 (2019). doi:10.1107/S1600577519006696, The Karabo distributed control system has been developed to address the challenging requirements of the European X-ray Free Electron Laser facility, including complex and custom-made hardware, high data rates and volumes, and close integration of data analysis for distributed processing and rapid feedback. Karabo is a pluggable, distributed application management system forming a supervisory control and data acquisition environment as part of a distributed control system. Karabo provides integrated control of hardware, monitoring, data acquisition and data analysis on distributed hardware, allowing rapid control feedback based on complex algorithms. Services exist for access control, data logging, configuration management and situational awareness through alarm indicators. The flexible framework enables quick response to the changing requirements in control and analysis, and provides an efficient environment for development, and a single interface to make all changes immediately available to operators and experimentalists., Published by Wiley-Blackwell, [S.l.]

High-energy phase-contrast X-ray microscopy and tomography of protein crystals in an optically opaque matrix is demonstrated with micrometre resolution on the macromolecular crystallography beamline P14 at PETRA III., For the extraction of the best possible X-ray diffraction data from macromolecular crystals, accurate positioning of the crystals with respect to the X-ray beam is crucial. In addition, information about the shape and internal defects of crystals allows the optimization of data-collection strategies. Here, it is demonstrated that the X-ray beam available on the macromolecular crystallo­graphy beamline P14 at the high-brilliance synchrotron-radiation source PETRA III at DESY, Hamburg, Germany can be used for high-energy phase-contrast microtomography of protein crystals mounted in an optically opaque lipidic cubic phase matrix. Three-dimensional tomograms have been obtained at X-ray doses that are substantially smaller and on time scales that are substantially shorter than those used for diffraction-scanning approaches that display protein crystals at micrometre resolution. Adding a compound refractive lens as an objective to the imaging setup, two-dimensional imaging at sub-micrometre resolution has been achieved. All experiments were performed on a standard macromolecular crystallography beamline and are compatible with standard diffraction data-collection workflows and apparatus. Phase-contrast X-ray imaging of macromolecular crystals could find wide application at existing and upcoming low-emittance synchrotron-radiation sources.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

The Femtosecond X-ray Experiments scientific instrument is a versatile instrument for ultrafast pump–probe X-ray absorption, emission and scattering experiments at the European XFEL; the instrumentation, commissioning results and operation performance status are presented., The European X-ray Free-Electron Laser (EuXFEL) delivers extremely intense (>1012 photons pulse−1 and up to 27000 pulses s−1), ultrashort (

Nature Communications 9(1), 3487 (2018). doi:10.1038/s41467-018-05953-4, X-ray free-electron lasers (XFELs) enable novel experiments because of their high peak brilliance and femtosecond pulse duration. However, non-superconducting XFELs offer repetition rates of only 10–120 Hz, placing significant demands on beam time and sample consumption. We describe serial femtosecond crystallography experiments performed at the European XFEL, the first MHz repetition rate XFEL, delivering 1.128 MHz X-ray pulse trains at 10 Hz. Given the short spacing between pulses, damage caused by shock waves launched by one XFEL pulse on sample probed by subsequent pulses is a concern. To investigate this issue, we collected data from lysozyme microcrystals, exposed to a ~15 μm XFEL beam. Under these conditions, data quality is independent of whether the first or subsequent pulses of the train were used for data collection. We also analyzed a mixture of microcrystals of jack bean proteins, from which the structure of native, magnesium-containing concanavalin A was determined., Published by Springer Nature, London

DAWN is a generic data analysis software platform that has been developed for use at synchrotron beamlines for data visualization and analysis. Its generic design makes it suitable for use in a range of scientific and engineering applications., Synchrotron light source facilities worldwide generate terabytes of data in numerous incompatible data formats from a wide range of experiment types. The Data Analysis WorkbeNch (DAWN) was developed to address the challenge of providing a single visualization and analysis platform for data from any synchrotron experiment (including single-crystal and powder diffraction, tomography and spectroscopy), whilst also being sufficiently extensible for new specific use case analysis environments to be incorporated (e.g. ARPES, PEEM). In this work, the history and current state of DAWN are presented, with two case studies to demonstrate specific functionality. The first is an example of a data processing and reduction problem using the generic tools, whilst the second shows how these tools can be targeted to a specific scientific area.

Scientific software often presents very particular requirements regarding usability, which is often completely overlooked in this setting. As computational science has emerged as its own discipline, distinct from theoretical and experimental science, it has put new requirements on future scientific software developments. In this paper, we discuss the background of these problems and introduce nine aspects of good usability. We also highlight best practices for each aspect with an emphasis on applications in computational science.

Hardware and software solutions for MX data-collection strategies using the EMBL/ESRF miniaturized multi-axis goniometer head are presented., Most macromolecular crystallography (MX) diffraction experiments at synchrotrons use a single-axis goniometer. This markedly contrasts with small-molecule crystallography, in which the majority of the diffraction data are collected using multi-axis goniometers. A novel miniaturized κ-gonio­meter head, the MK3, has been developed to allow macromolecular crystals to be aligned. It is available on the majority of the structural biology beamlines at the ESRF, as well as elsewhere. In addition, the Strategy for the Alignment of Crystals (STAC) software package has been developed to facilitate the use of the MK3 and other similar devices. Use of the MK3 and STAC is streamlined by their incorporation into online analysis tools such as EDNA. The current use of STAC and MK3 on the MX beamlines at the ESRF is discussed. It is shown that the alignment of macromolecular crystals can result in improved diffraction data quality compared with data obtained from randomly aligned crystals.

A rapid, easy-to-perform translation calibration procedure has been developed for use with the EMBL/ESRF mini-κ goniometer head and for other inverse-kappa goniometers designed for macromolecular crystallography. Regular calibration ensures the precision of experiments that rely on many degrees of freedom in crystal reorientation., Precise and convenient crystal reorientation is of experimental importance in macromolecular crystallography (MX). The development of multi-axis goniometers, such as the ESRF/EMBL mini-κ, necessitates the corresponding development of calibration procedures that can be used for the setup, maintenance and troubleshooting of such devices. While traditional multi-axis goniometers require all rotation axes to intersect the unique point of the sample position, recently developed miniaturized instruments for sample reorientation in MX are not as restricted. However, the samples must always be re-centred following a change in orientation. To overcome this inconvenience and allow the use of multi-axis goniometers without the fundamental restriction of having all axes intersecting in the same point, an automatic translation correction protocol has been developed for such instruments. It requires precise information about the direction and location of the rotation axes. To measure and supply this information, a general, easy-to-perform translation calibration (TC) procedure has also been developed. The TC procedure is routinely performed on most MX beamlines at the ESRF and some results are presented for reference.

MxCuBE is a beamline control environment optimized for the needs of macromolecular crystallography. This paper describes the design of the software and the features that MxCuBE currently provides., The design and features of a beamline control software system for macromolecular crystallography (MX) experiments developed at the European Synchrotron Radiation Facility (ESRF) are described. This system, MxCuBE, allows users to easily and simply interact with beamline hardware components and provides automated routines for common tasks in the operation of a synchrotron beamline dedicated to experiments in MX. Additional functionality is provided through intuitive interfaces that enable the assessment of the diffraction characteristics of samples, experiment planning, automatic data collection and the on-line collection and analysis of X-ray emission spectra. The software can be run in a tandem client-server mode that allows for remote control and relevant experimental parameters and results are automatically logged in a relational database, ISPyB. MxCuBE is modular, flexible and extensible and is currently deployed on eight macromolecular crystallography beamlines at the ESRF. Additionally, the software is installed at MAX-lab beamline I911-3 and at BESSY beamline BL14.1.

The improvement of the X-ray beam quality achieved on ID14-4 by the installation of new X-ray optical elements is described., ID14-4 at the ESRF is the first tunable undulator-based macromolecular crystallography beamline that can celebrate a decade of user service. During this time ID14-4 has not only been instrumental in the determination of the structures of biologically important molecules but has also contributed significantly to the development of various instruments, novel data collection schemes and pioneering radiation damage studies on biological samples. Here, the evolution of ID14-4 over the last decade is presented, and some of the major improvements that were carried out in order to maintain its status as one of the most productive macromolecular crystallography beamlines are highlighted. The experimental hutch has been upgraded to accommodate a high-precision diffractometer, a sample changer and a large CCD detector. More recently, the optical hutch has been refurbished in order to improve the X-ray beam quality on ID14-4 and to incorporate the most modern and robust optical elements used at other ESRF beamlines. These new optical elements will be described and their effect on beam stability discussed. These studies may be useful in the design, construction and maintenance of future X-ray beamlines for macromolecular crystallography and indeed other applications, such as those planned for the ESRF upgrade.

The anomalous scattering properties of innate sulfur for proteins and phosphorus for DNA and RNA can be used to solve the phase problem in macromolecular crystallography (MX)viathe single-wavelength anomalous dispersion method (SAD). However, this method, which is carried out at longer X-ray wavelengths (1.5–2.5 Å), is still not a routine tool in MX. The increased absorption from both air and sample associated with the use of longer X-ray wavelengths presents a key difficulty. The absorption can be corrected for through empirical algorithms, provided truly redundant data are available. Unfortunately, weakly diffracting macromolecular crystals suffer from radiation damage, resulting in a dose-dependent non-isomorphism which violates the assumption upon which these empirical algorithms are based. In this report, X-ray microtomography is used to reconstruct the three-dimensional shapes of vitrified macromolecular crystals including the surrounding solvent and sample holder. The setup can be integrated within an MX beamline environment and exploits both absorption and phase contrast. The dose needed for the tomographic measurements could be low enough to allow the technique to be used for crystal integrity characterization and alignment. X-ray tomography has some major benefits compared with the optical-light-based crystal alignment protocols currently used.

The Common Instrument Middleware Architecture (CIMA) model for Web services based monitoring of remote scientific instruments is being extended and enhanced to provide a capability for remote instrument control. X-ray diffraction has been selected as an ideal domain for prototype development, with the goal being a comprehensive and feature rich portal system for access to remote instruments and their data. The system has two principle components, one of which serves the instrument and data, and the second serves the client user. Plugin modules are used to provide flexibility and re-use, and the notion of plugin control is being developed. The architecture supports remote access to multiple instruments from a single portal. The use of Web 2.0 Pushlet and AJAX technologies has been introduced for push based portlet refresh and updating. An X3D based 3D virtual representation of the instrument provides data collection simulation and (pseudo) real time instrument representation.

To obtain short duration electromagnetic signals, the carrier frequency of the waves has to be increased. The first few cycle electromagnetic waves in the optical domain, that is laser pulses lasting less than 10 fs, were generated in the late 80s'. At the turn of the century, a train of attosecond pulses was first demonstrated, now in the soft X-ray regime.

International audience; Controlled dehydration of macromolecular crystals can lead to significant improvements in crystalline order, which often manifests itself in higher diffraction quality. Devices that can accurately control the humidity surrounding crystals on a beamline have led to this technique being increasingly adopted as experiments become easier and more reproducible. However, these experiments are often carried out by trial and error, and in order to facilitate and streamline them four European synchrotrons have established a collaboration around the HC1b dehydration device. The MAX IV Laboratory, Diamond Light Source, BESSY II, and the EMBL Grenoble Outstation/ESRF have pooled information gathered from user experiments, and on the use of the device, to propose a set of guidelines for these experiments. Here, we present the status and automation of the installations, advice on how best to perform experiments using the device, and an analysis of successful experiments that begins to show some trends in the type of protocols required by some systems. The dehydration methods shown are applicable to any device that allows control of the relative humidity of the air surrounding a macromolecular crystal

The common Instrument Middleware Architecture (CIMA) has been adopted and is being further developed as part of a project that includes the use of virtual instruments in a Web browser driven system for remote access to scientific instruments. Enhancements include distinct separation of concern for the modular components that make up the system, and a flexible message parcel schema.

While routine Macromolecular x‐ray (MX) crystallography has relied on well established techniques for some years all the synchrotrons around the world are improving the throughput of their MX beamlines. Third generation synchrotrons provide small intense beams that make data collection of 5–10 microns sized crystals possible. The EMBL/ESRF MX Group in Grenoble has developed a new generation of instruments to easily collect data on 10 μm size crystals in an automated environment. This work is part of the Grenoble automation program that enables FedEx like crystallography using fully automated data collection and web monitored experiments. Seven ESRF beamlines and the MRC BM14 ESRF/CRG beamline are currently equipped with these latest instruments. We describe here the main features of the MD2x diffractometer family and the SC3 sample changer robot. Although the SC3 was primarily designed to increase the throughput of MX beamlines, it has also been shown to be efficient in improving the quality of the data collected. Strategies in screening a large number of crystals, selecting the best, and collecting a full data set from several re‐oriented micro‐crystals can now be run with minimum time and effort. The MD2x and SC3 instruments are now commercialised by the company ACCEL GmbH.

The high performance of modern synchrotron facilities means there is an increasing reliance on automated data analysis and collection methods. The EMBL and ESRF are actively involved in designing and implementing such automated methods. However, as these methods are evolving there is also a need to continually integrate newer and more sophisticated data analysis and collection protocols with experimental control. This integration often poses a challenge, requiring a high level software environment to automatically coordinate beamline control with data acquisition and analysis. This is why we have extended the Eclipse RCP version of the workflow tool Passerelle into a user friendly GUI for experiment design by scientists and programmers [1], which is now part of the Data Analysis WorkbeNch (DAWN) collaboration (http://www.dawnsci.org). The execution of several complex workflows using this technology are now fully integrated in the new version of MxCuBE [2] and deployed on the ESRF macromolecular crystallography beamlines. Here, I will present their current implementation and the data quality improvements that can be achieved. In particular we have developed automated crystal re-orientation workflows that can improve the success of ab initio phasing experiments and help mitigate against radiation damage effect [3]. Other protocols implemented include a 3D diffraction based centring routine, a dehydration protocol and the automated measurement of a crystals radiation sensitivity. Lastly I will present our future plans for other new advanced diffraction based workflow routines, including automated crystal screening and data collection protocols.

This paper presents the implementation of irregularly shaped horizontal and slanted Wells in a fieldscale reservoir simulation model.

The paper presents an improved method for constructing 3-dimensional KPEBI grids taking into consideration variable K-tensors and internal surfaces (layers, faults and hydraulic fracture planes) near slanted or horizontal wells.

The anomalous scattering properties of innate sulphur can be used to solve the phase problem in macromolecular crystallography (MX) via the SAD method. However, this method, which is used at longer X-ray wavelengths (1.5 – 2.5 A), is still not a routine tool in MX. One of the difficulties associated with the longer wavelengths, is the increased absorption from both air and sample. So far, only empirical absorption algorithms exist, because of the difficulties of routinely and precisely measuring the shape of the absorbing objects. In this report [1], we present the use of X-ray microtomography to reconstruct the 3D shape of crystal, surrounding solvent and sample holder. The setup can be integrated within a general MX environment. The dose needed for the tomographic measurements could be low enough to allow the technique to be used for crystal integrity characterization and alignment.