Scipion3: A workflow engine for cryo-electron microscopy image processing and structural biology.

Image-processing pipelines require the design of complex workflows combining many different steps that bring the raw acquired data to a final result with biological meaning. In the image-processing domain of cryo-electron microscopy single-particle analysis (cryo-EM SPA), hundreds of steps must be performed to obtain the three-dimensional structure of a biological macromolecule by integrating data spread over thousands of micrographs containing millions of copies of allegedly the same macromolecule. The execution of such complicated workflows demands a specific tool to keep track of all these steps performed. Additionally, due to the extremely low signal-to-noise ratio (SNR), the estimation of any image parameter is heavily affected by noise resulting in a significant fraction of incorrect estimates. Although low SNR and processing millions of images by hundreds of sequential steps requiring substantial computational resources are specific to cryo-EM, these characteristics may be shared by other biological imaging domains. Here, we present Scipion, a Python generic open-source workflow engine specifically adapted for image processing. Its main characteristics are: (a) interoperability, (b) smart object model, (c) gluing operations, (d) comparison operations, (e) wide set of domain-specific operations, (f) execution in streaming, (g) smooth integration in high-performance computing environments, (h) execution with and without graphical capabilities, (i) flexible visualization, (j) user authentication and private access to private data, (k) scripting capabilities, (l) high performance, (m) traceability, (n) reproducibility, (o) self-reporting, (p) reusability, (q) extensibility, (r) software updates, and (s) non-restrictive software licensing.

Image Processing in Cryo-Electron Microscopy of Single Particles: The Power of Combining Methods.

Cryo-electron microscopy has established as a mature structural biology technique to elucidate the three-dimensional structure of biological macromolecules. The Coulomb potential of the sample is imaged by an electron beam, and fast semi-conductor detectors produce movies of the sample under study. These movies have to be further processed by a whole pipeline of image-processing algorithms that produce the final structure of the macromolecule. In this chapter, we illustrate this whole processing pipeline putting in value the strength of "meta algorithms," which are the combination of several algorithms, each one with different mathematical rationale, in order to distinguish correctly from incorrectly estimated parameters. We show how this strategy leads to superior performance of the whole pipeline as well as more confident assessments about the reconstructed structures. The "meta algorithms" strategy is common to many fields and, in particular, it has provided excellent results in bioinformatics. We illustrate this combination using the workflow engine, Scipion.

FSC-Q: a CryoEM map-to-atomic model quality validation based on the local Fourier shell correlation.

In recent years, advances in cryoEM have dramatically increased the resolution of reconstructions and, with it, the number of solved atomic models. It is widely accepted that the quality of cryoEM maps varies locally; therefore, the evaluation of the maps-derived structural models must be done locally as well. In this article, a method for the local analysis of the map-to-model fit is presented. The algorithm uses a comparison of two local resolution maps. The first is the local FSC (Fourier shell correlation) between the full map and the model, while the second is calculated between the half maps normally used in typical single particle analysis workflows. We call the quality measure "FSC-Q", and it is a quantitative estimation of how much of the model is supported by the signal content of the map. Furthermore, we show that FSC-Q may be helpful to detect overfitting. It can be used to complement other methods, such as the Q-score method that estimates the resolvability of atoms.