Deep Learning Approach for High-accuracy Electron Counting of Monolithic Active Pixel Sensor-type Direct Electron Detectors at Increased Electron Dose.

Electron counting can be performed algorithmically for monolithic active pixel sensor direct electron detectors to eliminate readout noise and Landau noise arising from the variability in the amount of deposited energy for each electron. Errors in existing counting algorithms include mistakenly counting a multielectron strike as a single electron event, and inaccurately locating the incident position of the electron due to lateral spread of deposited energy and dark noise. Here, we report a supervised deep learning (DL) approach based on Faster region-based convolutional neural network (R-CNN) to recognize single electron events at varying electron doses and voltages. The DL approach shows high accuracy according to the near-ideal modulation transfer function (MTF) and detector quantum efficiency for sparse images. It predicts, on average, 0.47 pixel deviation from the incident positions for 200 kV electrons versus 0.59 pixel using the conventional counting method. The DL approach also shows better robustness against coincidence loss as the electron dose increases, maintaining the MTF at half Nyquist frequency above 0.83 as the electron density increases to 0.06 e-/pixel. Thus, the DL model extends the advantages of counting analysis to higher dose rates than conventional methods.

Effect of self and extrinsic encapsulation on electron resilience of porous 2D polymer nanosheets.

Despite the exceptional resolution in aberration-corrected high-resolution transmission electron microscope (AC-HRTEM) images of inorganic two-dimensional (2D) materials, achieving high-resolution imaging of organic 2D materials remains a daunting challenge due to their low electron resilience. Optimizing the critical dose (the electron exposure, the material can accept before it is noticeably damaged) is vital to mitigate this challenge. An understanding of electron resilience in porous crystalline 2D polymers including the effect of sample thickness has not been derived thus far. It is assumed, that additional layers of the sample form a cage around inner layers, which are preventing fragments from escaping into the vacuum and enabling recombination. In the literature this so called caging effect has been reported for perylene and pythalocyanine. In this work we determine the critical dose of a porous, triazine-based 2D polymer as function of the sample thickness. The results show that the caging effect should not be generalized to more sophisticated polymer systems. We argue that pore channels in the framework structure serve as escape routes for free fragments preventing the caging effect and thus showing surprisingly a thickness-independent critical dose. Moreover, we demonstrate that graphene encapsulation prevents fragment escape and results in an increase in the critical electron dose and unit-cell image resolution.

Characterizing the resolution and throughput of the Apollo direct electron detector.

Advances in electron detection have been essential to the success of high-resolution cryo-EM structure determination. A new generation of direct electron detector called the Apollo, has been developed by Direct Electron. The Apollo uses a novel event-based MAPS detector custom designed for ultra-fast electron counting. We have evaluated this new camera, finding that it delivers high detective quantum efficiency (DQE) and low coincidence loss, enabling high-quality electron counting data acquisition at up to nearly 80 input electrons per pixel per second. We further characterized the performance of Apollo for single particle cryo-EM on real biological samples. Using mouse apoferritin, Apollo yielded better than 1.9 Å resolution reconstructions at all three tested dose rates from a half-day data collection session each. With longer collection time and improved specimen preparation, mouse apoferritin was reconstructed to 1.66 Å resolution. Applied to a more challenging small protein aldolase, we obtained a 2.24 Å resolution reconstruction. The high quality of the map indicates that the Apollo has sufficiently high DQE to reconstruct smaller proteins and complexes with high-fidelity. Our results demonstrate that the Apollo camera performs well across a broad range of dose rates and is capable of capturing high quality data that produce high-resolution reconstructions for large and small single particle samples.

Electron crystallography of chiral and non-chiral small molecules.

Electron crystallography has recently gained attentions in multiple fields of research, as it has been demonstrated to determine atomic structures for inorganic, organic, and macromolecular materials from nano-sized crystals that were not amenable to conventional X-ray crystallography. Here, we demonstrate continuous-rotation microcrystal electron diffraction (microED) in a 200 kV transmission electron microscope using a DE-64 camera-a low-noise direct electron detector that can accommodate a linear response up to ∼1200 electrons per pixel per second at 20 fps with 2x-hardware-binning, making it ideal for acquisition of high-quality diffraction patterns. We have used this method and camera to determine a 0.75 Å structure of an organic molecule, biotin, with an exceptional goodness-of-fit, as well as a 0.88 Å structure of a chiral molecule, L-serine.

Electron backscattered diffraction using a new monolithic direct detector: High resolution and fast acquisition.

A monolithic active pixel sensor based direct detector that is optimized for the primary beam energies in scanning electron microscopes is implemented for electron back-scattered diffraction (EBSD) applications. The high detection efficiency of the detector and its large array of pixels allow sensitive and accurate detection of Kikuchi bands arising from primary electron beam excitation energies of 4 keV to 28 keV, with the optimal contrast occurring in the range of 8-16 keV. The diffraction pattern acquisition speed is substantially improved via a sparse sampling mode, resulting from the acquisition of a reduced number of pixels on the detector. Standard inpainting algorithms are implemented to effectively estimate the information in the skipped regions in the acquired diffraction pattern. For EBSD mapping, an acquisition speed as high as 5988 scan points per second is demonstrated, with a tolerable fraction of indexed points and accuracy. The collective capabilities spanning from high angular resolution EBSD patterns to high speed pattern acquisition are achieved on the same detector, facilitating simultaneous detection modalities that enable a multitude of advanced EBSD applications, including lattice strain mapping, structural refinement, low-dose characterization, 3D-EBSD and dynamic in situ EBSD.

An atomic model of brome mosaic virus using direct electron detection and real-space optimization.

Advances in electron cryo-microscopy have enabled structure determination of macromolecules at near-atomic resolution. However, structure determination, even using de novo methods, remains susceptible to model bias and overfitting. Here we describe a complete workflow for data acquisition, image processing, all-atom modelling and validation of brome mosaic virus, an RNA virus. Data were collected with a direct electron detector in integrating mode and an exposure beyond the traditional radiation damage limit. The final density map has a resolution of 3.8 Å as assessed by two independent data sets and maps. We used the map to derive an all-atom model with a newly implemented real-space optimization protocol. The validity of the model was verified by its match with the density map and a previous model from X-ray crystallography, as well as the internal consistency of models from independent maps. This study demonstrates a practical approach to obtain a rigorously validated atomic resolution electron cryo-microscopy structure.

Direct electron detection yields cryo-EM reconstructions at resolutions beyond 3/4 Nyquist frequency.

One limitation in electron cryo-microscopy (cryo-EM) is the inability to recover high-resolution signal from the image-recording media at the full-resolution limit of the transmission electron microscope. Direct electron detection using CMOS-based sensors for digitally recording images has the potential to alleviate this shortcoming. Here, we report a practical performance evaluation of a Direct Detection Device (DDD®) for biological cryo-EM at two different microscope voltages: 200 and 300 kV. Our DDD images of amorphous and graphitized carbon show strong per-pixel contrast with image resolution near the theoretical sampling limit of the data. Single-particle reconstructions of two frozen-hydrated bacteriophages, P22 and ε15, establish that the DDD is capable of recording usable signal for 3D reconstructions at about 4/5 of the Nyquist frequency, which is a vast improvement over the performance of conventional imaging media. We anticipate the unparalleled performance of this digital recording device will dramatically benefit cryo-EM for routine tomographic and single-particle structural determination of biological specimens.

Practical performance evaluation of a 10k × 10k CCD for electron cryo-microscopy.

Electron cryo-microscopy (cryo-EM) images are commonly collected using either charge-coupled devices (CCD) or photographic film. Both film and the current generation of 16 megapixel (4k × 4k) CCD cameras have yielded high-resolution structures. Yet, despite the many advantages of CCD cameras, more than two times as many structures of biological macromolecules have been published in recent years using photographic film. The continued preference to film, especially for subnanometer-resolution structures, may be partially influenced by the finer sampling and larger effective specimen imaging area offered by film. Large format digital cameras may finally allow them to overtake film as the preferred detector for cryo-EM. We have evaluated a 111-megapixel (10k × 10k) CCD camera with a 9 µm pixel size. The spectral signal-to-noise ratios of low dose images of carbon film indicate that this detector is capable of providing signal up to at least 2/5 Nyquist frequency potentially retrievable for 3D reconstructions of biological specimens, resulting in more than double the effective specimen imaging area of existing 4k × 4k CCD cameras. We verified our estimates using frozen-hydrated ε15 bacteriophage as a biological test specimen with previously determined structure, yielding a ∼7 Å resolution single particle reconstruction from only 80 CCD frames. Finally, we explored the limits of current CCD technology by comparing the performance of this detector to various CCD cameras used for recording data yielding subnanometer resolution cryo-EM structures submitted to the electron microscopy data bank (http://www.emdatabank.org/).

Automated specimen search in cryo-TEM observation with DIFF-defocus imaging.

We have developed an automated specimen search algorithm for cryo-electron microscopy imaging of ice-embedded single particles suspended across regularly spaced holes. To maximize the particle visibility under a low electron exposure rate condition, specimen searching is carried out in diffraction mode. However, images in diffraction mode contain significant pincushion distortion, making it difficult to computationally predict the locations of the regularly spaced holes. We have implemented a distortion-correction mechanism to restore the primitive distortion-free image and a correlation-based algorithm to accurately determine the periodicity of the holes. A stage-shift method to optimize positional reproducibility is also implemented. Addition of our algorithms to the JADAS software for automated transmission electron microscopy data acquisition has significantly improved the accuracy of specimen search.

Radiation damage effects at four specimen temperatures from 4 to 100 K.

Radiation damage is the primary factor that limits resolution in electron cryo-microscopy (cryo-EM) of frozen-hydrated biological samples. Negative effects of radiation damage are attenuated by cooling specimens to cryogenic temperatures using liquid nitrogen or liquid helium. We have examined the relationship between specimen temperature and radiation damage across a broad spectrum of resolution by analyzing images of frozen-hydrated catalase crystal at four specimen temperatures: 4, 25, 42, and 100K. For each temperature, "exposure series" were collected consisting of consecutive images of the same area of sample, each with 10 e(-)/A(2) exposure per image. Radiation damage effects were evaluated by examining the correlation between cumulative exposure and normalized amplitudes or IQ values of Bragg peaks across a broad range of resolution (4.0-173.5A). Results indicate that for sub-nanometer resolution, liquid nitrogen specimen temperature (100K) provides the most consistent high-quality data while yielding statistically equivalent protection from radiation damage compared to the three lower temperatures. At lower resolution, suitable for tomography, intermediate temperatures (25 or 42K) may provide a modest improvement in cryo-protection without introducing deleterious effects evident at 4 K.