Dense cellular segmentation for EM using 2D-3D neural network ensembles.

Biologists who use electron microscopy (EM) images to build nanoscale 3D models of whole cells and their organelles have historically been limited to small numbers of cells and cellular features due to constraints in imaging and analysis. This has been a major factor limiting insight into the complex variability of cellular environments. Modern EM can produce gigavoxel image volumes containing large numbers of cells, but accurate manual segmentation of image features is slow and limits the creation of cell models. Segmentation algorithms based on convolutional neural networks can process large volumes quickly, but achieving EM task accuracy goals often challenges current techniques. Here, we define dense cellular segmentation as a multiclass semantic segmentation task for modeling cells and large numbers of their organelles, and give an example in human blood platelets. We present an algorithm using novel hybrid 2D-3D segmentation networks to produce dense cellular segmentations with accuracy levels that outperform baseline methods and approach those of human annotators. To our knowledge, this work represents the first published approach to automating the creation of cell models with this level of structural detail.

Compressed Sensing Electron Tomography for Determining Biological Structure.

There has been growing interest in applying compressed sensing (CS) theory and practice to reconstruct 3D volumes at the nanoscale from electron tomography datasets of inorganic materials, based on known sparsity in the structure of interest. Here we explore the application of CS for visualizing the 3D structure of biological specimens from tomographic tilt series acquired in the scanning transmission electron microscope (STEM). CS-ET reconstructions match or outperform commonly used alternative methods in full and undersampled tomogram recovery, but with less significant performance gains than observed for the imaging of inorganic materials. We propose that this disparity stems from the increased structural complexity of biological systems, as supported by theoretical CS sampling considerations and numerical results in simulated phantom datasets. A detailed analysis of the efficacy of CS-ET for undersampled recovery is therefore complicated by the structure of the object being imaged. The numerical nonlinear decoding process of CS shares strong connections with popular regularized least-squares methods, and the use of such numerical recovery techniques for mitigating artifacts and denoising in reconstructions of fully sampled datasets remains advantageous. This article provides a link to the software that has been developed for CS-ET reconstruction of electron tomographic data sets.