Scipion3: A workflow engine for cryo-electron microscopy image processing and structural biology.

Image-processing pipelines require the design of complex workflows combining many different steps that bring the raw acquired data to a final result with biological meaning. In the image-processing domain of cryo-electron microscopy single-particle analysis (cryo-EM SPA), hundreds of steps must be performed to obtain the three-dimensional structure of a biological macromolecule by integrating data spread over thousands of micrographs containing millions of copies of allegedly the same macromolecule. The execution of such complicated workflows demands a specific tool to keep track of all these steps performed. Additionally, due to the extremely low signal-to-noise ratio (SNR), the estimation of any image parameter is heavily affected by noise resulting in a significant fraction of incorrect estimates. Although low SNR and processing millions of images by hundreds of sequential steps requiring substantial computational resources are specific to cryo-EM, these characteristics may be shared by other biological imaging domains. Here, we present Scipion, a Python generic open-source workflow engine specifically adapted for image processing. Its main characteristics are: (a) interoperability, (b) smart object model, (c) gluing operations, (d) comparison operations, (e) wide set of domain-specific operations, (f) execution in streaming, (g) smooth integration in high-performance computing environments, (h) execution with and without graphical capabilities, (i) flexible visualization, (j) user authentication and private access to private data, (k) scripting capabilities, (l) high performance, (m) traceability, (n) reproducibility, (o) self-reporting, (p) reusability, (q) extensibility, (r) software updates, and (s) non-restrictive software licensing.

Advances in Xmipp for Cryo-Electron Microscopy: From Xmipp to Scipion.

Xmipp is an open-source software package consisting of multiple programs for processing data originating from electron microscopy and electron tomography, designed and managed by the Biocomputing Unit of the Spanish National Center for Biotechnology, although with contributions from many other developers over the world. During its 25 years of existence, Xmipp underwent multiple changes and updates. While there were many publications related to new programs and functionality added to Xmipp, there is no single publication on the Xmipp as a package since 2013. In this article, we give an overview of the changes and new work since 2013, describe technologies and techniques used during the development, and take a peek at the future of the package.

Image Processing in Cryo-Electron Microscopy of Single Particles: The Power of Combining Methods.

Cryo-electron microscopy has established as a mature structural biology technique to elucidate the three-dimensional structure of biological macromolecules. The Coulomb potential of the sample is imaged by an electron beam, and fast semi-conductor detectors produce movies of the sample under study. These movies have to be further processed by a whole pipeline of image-processing algorithms that produce the final structure of the macromolecule. In this chapter, we illustrate this whole processing pipeline putting in value the strength of "meta algorithms," which are the combination of several algorithms, each one with different mathematical rationale, in order to distinguish correctly from incorrectly estimated parameters. We show how this strategy leads to superior performance of the whole pipeline as well as more confident assessments about the reconstructed structures. The "meta algorithms" strategy is common to many fields and, in particular, it has provided excellent results in bioinformatics. We illustrate this combination using the workflow engine, Scipion.

Near-atomic structure of an atadenovirus reveals a conserved capsid-binding motif and intergenera variations in cementing proteins.

Of five known adenovirus genera, high-resolution structures are available only for mammalian-infecting mastadenoviruses. We present the first high-resolution structure of an adenovirus with nonmammalian host: lizard atadenovirus LAdV-2. We find a large conformational difference in the internal vertex protein IIIa between mast- and atadenoviruses, induced by the presence of an extended polypeptide. This polypeptide, and α-helical clusters beneath the facet, likely correspond to genus-specific proteins LH2 and p32k. Another genus-specific protein, LH3, with a fold typical of bacteriophage tailspikes, contacts the capsid surface via a triskelion structure identical to that used by mastadenovirus protein IX, revealing a conserved capsid-binding motif and an ancient gene duplication event. Our data also suggest that mastadenovirus E1B-55 K was exapted from the atadenovirus-like LH3 protein. This work provides new information on the evolution of adenoviruses, emphasizing the importance of minor coat proteins for determining specific physicochemical properties of virions and most likely their tropism.

Cryo-EM structure of enteric adenovirus HAdV-F41 highlights structural variations among human adenoviruses.

Enteric adenoviruses, one of the main causes of viral gastroenteritis in the world, must withstand the harsh conditions found in the gut. This requirement suggests that capsid stability must be different from that of other adenoviruses. We report the 4-Å-resolution structure of a human enteric adenovirus, HAdV-F41, and compare it with that of other adenoviruses with respiratory (HAdV-C5) and ocular (HAdV-D26) tropisms. While the overall structures of hexon, penton base, and internal minor coat proteins IIIa and VIII are conserved, we observe partially ordered elements reinforcing the vertex region, which suggests their role in enhancing the physicochemical capsid stability of HAdV-F41. Unexpectedly, we find an organization of the external minor coat protein IX different from all previously characterized human and nonhuman mastadenoviruses. Knowledge of the structure of enteric adenoviruses provides a starting point for the design of vectors suitable for oral delivery or intestinal targeting.

FSC-Q: a CryoEM map-to-atomic model quality validation based on the local Fourier shell correlation.

In recent years, advances in cryoEM have dramatically increased the resolution of reconstructions and, with it, the number of solved atomic models. It is widely accepted that the quality of cryoEM maps varies locally; therefore, the evaluation of the maps-derived structural models must be done locally as well. In this article, a method for the local analysis of the map-to-model fit is presented. The algorithm uses a comparison of two local resolution maps. The first is the local FSC (Fourier shell correlation) between the full map and the model, while the second is calculated between the half maps normally used in typical single particle analysis workflows. We call the quality measure "FSC-Q", and it is a quantitative estimation of how much of the model is supported by the signal content of the map. Furthermore, we show that FSC-Q may be helpful to detect overfitting. It can be used to complement other methods, such as the Q-score method that estimates the resolvability of atoms.

Continuous flexibility analysis of SARS-CoV-2 spike prefusion structures.

Using a new consensus-based image-processing approach together with principal component analysis, the flexibility and conformational dynamics of the SARS-CoV-2 spike in the prefusion state have been analysed. These studies revealed concerted motions involving the receptor-binding domain (RBD), N-terminal domain, and subdomains 1 and 2 around the previously characterized 1-RBD-up state, which have been modeled as elastic deformations. It is shown that in this data set there are not well defined, stable spike conformations, but virtually a continuum of states. An ensemble map was obtained with minimum bias, from which the extremes of the change along the direction of maximal variance were modeled by flexible fitting. The results provide a warning of the potential image-processing classification instability of these complicated data sets, which has a direct impact on the interpretability of the results.

Continuous flexibility analysis of SARS-CoV-2 Spike prefusion structures.

With the help of novel processing workflows and algorithms, we have obtained a better understanding of the flexibility and conformational dynamics of the SARS-CoV-2 spike in the prefusion state. We have re-analyzed previous cryo-EM data combining 3D clustering approaches with ways to explore a continuous flexibility space based on 3D Principal Component Analysis. These advanced analyses revealed a concerted motion involving the receptor-binding domain (RBD), N-terminal domain (NTD), and subdomain 1 and 2 (SD1 & SD2) around the previously characterized 1-RBD-up state, which have been modeled as elastic deformations. We show that in this dataset there are not well-defined, stable, spike conformations, but virtually a continuum of states moving in a concerted fashion. We obtained an improved resolution ensemble map with minimum bias, from which we model by flexible fitting the extremes of the change along the direction of maximal variance. Moreover, a high-resolution structure of a recently described biochemically stabilized form of the spike is shown to greatly reduce the dynamics observed for the wild-type spike. Our results provide new detailed avenues to potentially restrain the spike dynamics for structure-based drug and vaccine design and at the same time give a warning of the potential image processing classification instability of these complicated datasets, having a direct impact on the interpretability of the results.

Automatic local resolution-based sharpening of cryo-EM maps.

MOTIVATION: Recent technological advances and computational developments have allowed the reconstruction of Cryo-Electron Microscopy (cryo-EM) maps at near-atomic resolution. On a typical workflow and once the cryo-EM map has been calculated, a sharpening process is usually performed to enhance map visualization, a step that has proven very important in the key task of structural modeling. However, sharpening approaches, in general, neglects the local quality of the map, which is clearly suboptimal. RESULTS: Here, a new method for local sharpening of cryo-EM density maps is proposed. The algorithm, named LocalDeblur, is based on a local resolution-guided Wiener restoration approach of the original map. The method is fully automatic and, from the user point of view, virtually parameter-free, without requiring either a starting model or introducing any additional structure factor correction or boosting. Results clearly show a significant impact on map interpretability, greatly helping modeling. In particular, this local sharpening approach is especially suitable for maps that present a broad resolution range, as is often the case for membrane proteins or macromolecules with high flexibility, all of them otherwise very suitable and interesting specimens for cryo-EM. To our knowledge, and leaving out the use of local filters, it represents the first application of local resolution in cryo-EM sharpening. AVAILABILITY AND IMPLEMENTATION: The source code (LocalDeblur) can be found at https://github.com/I2PC/xmipp and can be run using Scipion (http://scipion.cnb.csic.es) (release numbers greater than or equal 1.2.1). SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

Validation of electron microscopy initial models via small angle X-ray scattering curves.

MOTIVATION: Cryo electron microscopy (EM) is currently one of the main tools to reveal the structural information of biological macromolecules. The re-construction of three-dimensional (3D) maps is typically carried out following an iterative process that requires an initial estimation of the 3D map to be refined in subsequent steps. Therefore, its determination is key in the quality of the final results, and there are cases in which it is still an open issue in single particle analysis (SPA). Small angle X-ray scattering (SAXS) is a well-known technique applied to structural biology. It is useful from small nanostructures up to macromolecular ensembles for its ability to obtain low resolution information of the biological sample measuring its X-ray scattering curve. These curves, together with further analysis, are able to yield information on the sizes, shapes and structures of the analyzed particles. RESULTS: In this paper, we show how the low resolution structural information revealed by SAXS is very useful for the validation of EM initial 3D models in SPA, helping the following refinement process to obtain more accurate 3D structures. For this purpose, we approximate the initial map by pseudo-atoms and predict the SAXS curve expected for this pseudo-atomic structure. The match between the predicted and experimental SAXS curves is considered as a good sign of the correctness of the EM initial map. AVAILABILITY AND IMPLEMENTATION: The algorithm is freely available as part of the Scipion 1.2 software at http://scipion.i2pc.es/.

The first single particle analysis Map Challenge: A summary of the assessments.

The recent successes of cryo-electron microscopy fostered great expectation of solving many new and previously recalcitrant biomolecular structures. However, it also brings with it the danger of compromising the validity of the outcomes if not done properly. The Map Challenge is a first step in assessing the state of the art and to shape future developments in data processing. The organizers presented seven cases for single particle reconstruction, and 27 members of the community responded with 66 submissions. Seven groups analyzed these submissions, resulting in several assessment reports, summarized here. We devised a range of analyses to evaluate the submitted maps, including visual impressions, Fourier shell correlation, pairwise similarity and interpretation through modeling. Unfortunately, we did not find strong trends. We ascribe this to the complexity of the challenge, dealing with multiple cases, software packages and processing approaches. This puts the user in the spotlight, where his/her choices becomes the determinant of map quality. The future focus should therefore be on promulgating best practices and encapsulating these in the software. Such practices include adherence to validation principles, most notably the processing of independent sets, proper resolution-limited alignment, appropriate masking and map sharpening. We consider the Map Challenge to be a highly valuable exercise that should be repeated frequently or on an ongoing basis.

MonoRes: Automatic and Accurate Estimation of Local Resolution for Electron Microscopy Maps.

Since the beginning of electron microscopy, resolution has been a critical parameter. In this article, we propose a fully automatic, accurate method for determining the local resolution of a 3D map (MonoRes). The foundation of this algorithm is an extension of the concept of analytic signal, termed monogenic signal. The map is filtered at different frequencies and the amplitude of the monogenic signal is calculated, after which a criterion is applied to determine the resolution at each voxel. MonoRes is fully automatic without compulsory user parameters, with great accuracy in all tests, and is computationally more rapid than existing methods in the field. In addition, MonoRes offers the option of local filtering of the original map based on the calculated local resolution.

ScipionCloud: An integrative and interactive gateway for large scale cryo electron microscopy image processing on commercial and academic clouds.

New instrumentation for cryo electron microscopy (cryoEM) has significantly increased data collection rate as well as data quality, creating bottlenecks at the image processing level. Current image processing model of moving the acquired images from the data source (electron microscope) to desktops or local clusters for processing is encountering many practical limitations. However, computing may also take place in distributed and decentralized environments. In this way, cloud is a new form of accessing computing and storage resources on demand. Here, we evaluate on how this new computational paradigm can be effectively used by extending our current integrative framework for image processing, creating ScipionCloud. This new development has resulted in a full installation of Scipion both in public and private clouds, accessible as public "images", with all the required preinstalled cryoEM software, just requiring a Web browser to access all Graphical User Interfaces. We have profiled the performance of different configurations on Amazon Web Services and the European Federated Cloud, always on architectures incorporating GPU's, and compared them with a local facility. We have also analyzed the economical convenience of different scenarios, so cryoEM scientists have a clearer picture of the setup that is best suited for their needs and budgets.

XTEND: Extending the depth of field in cryo soft X-ray tomography.

We have developed a new data collection method and processing framework in full field cryo soft X-ray tomography to computationally extend the depth of field (DOF) of a Fresnel zone plate lens. Structural features of 3D-reconstructed eukaryotic cells that are affected by DOF artifacts in standard reconstruction are now recovered. This approach, based on focal series projections, is easily applicable with closed expressions to select specific data acquisition parameters.

Characterization of transfer function, resolution and depth of field of a soft X-ray microscope applied to tomography enhancement by Wiener deconvolution.

Full field soft X-ray microscopy is becoming a powerful imaging technique to analyze whole cells preserved under cryo conditions. Images obtained in these X-ray microscopes can be combined by tomographic reconstruction to quantitatively estimate the three-dimensional (3D) distribution of absorption coefficients inside the cell. The impulse response of an imaging system is one of the factors that limits the quality of the X-ray microscope reconstructions. The main goal of this work is to experimentally measure the 3D impulse response and to assess the optical resolution and depth of field of the Mistral microscope at ALBA synchrotron (Barcelona, Spain). To this end we measure the microscope apparent transfer function (ATF) and we use it to design a deblurring Wiener filter, obtaining an increase in the image quality when applied to experimental datasets collected at ALBA.

The Electron Microscopy eXchange (EMX) initiative.

Three-dimensional electron microscopy (3DEM) of ice-embedded samples allows the structural analysis of large biological macromolecules close to their native state. Different techniques have been developed during the last forty years to process cryo-electron microscopy (cryo-EM) data. Not surprisingly, success in analysis and interpretation is highly correlated with the continuous development of image processing packages. The field has matured to the point where further progress in data and methods sharing depends on an agreement between the packages on how to describe common image processing tasks. Such standardization will facilitate the use of software as well as seamless collaboration, allowing the sharing of rich information between different platforms. Our aim here is to describe the Electron Microscopy eXchange (EMX) initiative, launched at the 2012 Instruct Image Processing Center Developer Workshop, with the intention of developing a first set of standard conventions for the interchange of information for single-particle analysis (EMX version 1.0). These conventions cover the specification of the metadata for micrograph and particle images, including contrast transfer function (CTF) parameters and particle orientations. EMX v1.0 has already been implemented in the Bsoft, EMAN, Xmipp and Scipion image processing packages. It has been and will be used in the CTF and EMDataBank Validation Challenges respectively. It is also being used in EMPIAR, the Electron Microscopy Pilot Image Archive, which stores raw image data related to the 3DEM reconstructions in EMDB.

Structures of Adenovirus Incomplete Particles Clarify Capsid Architecture and Show Maturation Changes of Packaging Protein L1 52/55k.

UNLABELLED: Adenovirus is one of the most complex icosahedral, nonenveloped viruses. Even after its structure was solved at near-atomic resolution by both cryo-electron microscopy and X-ray crystallography, the location of minor coat proteins is still a subject of debate. The elaborated capsid architecture is the product of a correspondingly complex assembly process, about which many aspects remain unknown. Genome encapsidation involves the concerted action of five virus proteins, and proteolytic processing by the virus protease is needed to prime the virion for sequential uncoating. Protein L1 52/55k is required for packaging, and multiple cleavages by the maturation protease facilitate its release from the nascent virion. Light-density particles are routinely produced in adenovirus infections and are thought to represent assembly intermediates. Here, we present the molecular and structural characterization of two different types of human adenovirus light particles produced by a mutant with delayed packaging. We show that these particles lack core polypeptide V but do not lack the density corresponding to this protein in the X-ray structure, thereby adding support to the adenovirus cryo-electron microscopy model. The two types of light particles present different degrees of proteolytic processing. Their structures provide the first glimpse of the organization of L1 52/55k protein inside the capsid shell and of how this organization changes upon partial maturation. Immature, full-length L1 52/55k is poised beneath the vertices to engage the virus genome. Upon proteolytic processing, L1 52/55k disengages from the capsid shell, facilitating genome release during uncoating. IMPORTANCE: Adenoviruses have been extensively characterized as experimental systems in molecular biology, as human pathogens, and as therapeutic vectors. However, a clear picture of many aspects of their basic biology is still lacking. Two of these aspects are the location of minor coat proteins in the capsid and the molecular details of capsid assembly. Here, we provide evidence supporting one of the two current models for capsid architecture. We also show for the first time the location of the packaging protein L1 52/55k in particles lacking the virus genome and how this location changes during maturation. Our results contribute to clarifying standing questions in adenovirus capsid architecture and provide new details on the role of L1 52/55k protein in assembly.

Measurement of the modulation transfer function of an X-ray microscope based on multiple Fourier orders analysis of a Siemens star.

Soft X-ray tomography (SXT) is becoming a powerful imaging technique to analyze eukaryotic whole cells close to their native state. Central to the analysis of the quality of SXT 3D reconstruction is the estimation of the spatial resolution and Depth of Field of the X-ray microscope. In turn, the characterization of the Modulation Transfer Function (MTF) of the optical system is key to calculate both parameters. Consequently, in this work we introduce a fully automated technique to accurately estimate the transfer function of such an optical system. Our proposal is based on the preprocessing of the experimental images to obtain an estimate of the input pattern, followed by the analysis in Fourier space of multiple orders of a Siemens Star test sample, extending in this way its measured frequency range.

CTF Challenge: Result summary.

Image formation in bright field electron microscopy can be described with the help of the contrast transfer function (CTF). In this work the authors describe the "CTF Estimation Challenge", called by the Madrid Instruct Image Processing Center (I2PC) in collaboration with the National Center for Macromolecular Imaging (NCMI) at Houston. Correcting for the effects of the CTF requires accurate knowledge of the CTF parameters, but these have often been difficult to determine. In this challenge, researchers have had the opportunity to test their ability in estimating some of the key parameters of the electron microscope CTF on a large micrograph data set produced by well-known laboratories on a wide set of experimental conditions. This work presents the first analysis of the results of the CTF Estimation Challenge, including an assessment of the performance of the different software packages under different conditions, so as to identify those areas of research where further developments would be desirable in order to achieve high-resolution structural information.

MRC2014: Extensions to the MRC format header for electron cryo-microscopy and tomography.

The MRC binary file format is widely used in the three-dimensional electron microscopy field for storing image and volume data. Files contain a header which describes the kind of data held, together with other important metadata. In response to advances in electron microscopy techniques, a number of variants to the file format have emerged which contain useful additional data, but which limit interoperability between different software packages. Following extensive discussions, the authors, who represent leading software packages in the field, propose a set of extensions to the MRC format standard designed to accommodate these variants, while restoring interoperability. The MRC format is equivalent to the map format used in the CCP4 suite for macromolecular crystallography, and the proposal also maintains interoperability with crystallography software. This Technical Note describes the proposed extensions, and serves as a reference for the standard.