Imaging extended single crystal lattice distortion fields with multi-peak Bragg ptychography.

Recent advances in phase-retrieval-based x-ray imaging methods have demonstrated the ability to reconstruct 3D distortion vector fields within a nanocrystal by using coherent diffraction information from multiple crystal Bragg reflections. However, these works do not provide a solution to the challenges encountered in imaging lattice distortions in crystals with significant defect content that result in phase wrapping. Moreover, these methods only apply to isolated crystals smaller than the x-ray illumination, and therefore cannot be used for imaging of distortions in extended crystals. We introduce multi-peak Bragg ptychography which addresses both challenges via an optimization framework that combines stochastic gradient descent and phase unwrapping methods for robust image reconstruction of lattice distortions and defects in extended crystals. Our work uses modern automatic differentiation toolsets so that the method is easy to extend to other settings and easy to implement in high-performance computers. This work is particularly timely given the broad interest in using the increased coherent flux in fourth-generation synchrotrons for innovative material research.

Counting on the future: fast charge-integrating detectors for X-ray nanoimaging.

A fast charge-integrating detector has been showcased for high-resolution X-ray ptychography. The advancement in developing detectors of this kind, with rapid framing capabilities, holds paramount significance in harnessing the full potential of emerging diffraction-limited synchrotron sources for X-ray nanoimaging.

Fast scanning in x-ray microscopy: the effects of offset in the central stop position.

Scanning of lightweight circular diffractive optics, separate from central stops and apertures, is emerging as an approach to exploit advances in synchrotron x-ray sources. We consider the effects in a scanning microscope of offsets between the optic and its central stop and find that scan ranges of up to about half the diameter of the optic are possible with only about a 10% increase in the focal spot width. For large scanning ranges, we present criteria for the working distance between the last aperture and the specimen to be imaged.

Fast and noise-tolerant determination of the center of rotation in tomography.

High-quality tomographic reconstruction is not possible without the accurate localization of the center of rotation. Poor localization leads to artifacts in the data and can even cause reconstructions to fail. There are many approaches to solving this problem, some of which involve the collection of full sinograms, or even provisional tomographic reconstructions, in order to determine the center of rotation. Here, a simple method based on the expected symmetry of the Fourier transform of summed projections approximately 180° apart is presented; unlike cross-correlation methods, it requires only a single Fourier transform to compute, and uses mainly low spatial frequency information which is less susceptible to noise. This approach is shown to be fast, and robust against poor signal-to-noise as well as to projection images acquired at angles that are not exactly 180° apart. This rapid method can be useful as a first step in the processing of tomographic data.

Development of Fe3O4 core-TiO2 shell nanocomposites and nanoconjugates as a foundation for neuroblastoma radiosensitization.

BACKGROUND: Neuroblastoma is the most common extracranial solid malignancy in childhood which, despite the current progress in radiotherapy and chemotherapy protocols, still has a high mortality rate in high risk tumors. Nanomedicine offers exciting and unexploited opportunities to overcome the shortcomings of conventional medicine. The photocatalytic properties of Fe3O4 core-TiO2 shell nanocomposites and their potential for cell specific targeting suggest that nanoconstructs produced using Fe3O4 core-TiO2 shell nanocomposites could be used to enhance radiation effects in neuroblastoma. In this study, we evaluated bare, metaiodobenzylguanidine (MIBG) and 3,4-Dihydroxyphenylacetic acid (DOPAC) coated Fe3O4@TiO2 as potential radiosensitizers for neuroblastoma in vitro. RESULTS: The uptake of bare and MIBG coated nanocomposites modestly sensitized neuroblastoma cells to ionizing radiation. Conversely, cells exposed to DOPAC coated nanocomposites exhibited a five-fold enhanced sensitivity to radiation, increased numbers of radiation induced DNA double-strand breaks, and apoptotic cell death. The addition of a peptide mimic of the epidermal growth factor (EGF) to nanoconjugates coated with MIBG altered their intracellular distribution. Cryo X-ray fluorescence microscopy tomography of frozen hydrated cells treated with these nanoconjugates revealed cytoplasmic as well as nuclear distribution of the nanoconstructs. CONCLUSIONS: The intracellular distribution pattern of different nanoconjugates used in this study was different for different nanoconjugate surface molecules. Cells exposed to DOPAC covered nanoconjugates showed the smallest nanoconjugate uptake, with the most prominent pattern of large intracellular aggregates. Interestingly, cells treated with this nanoconjugate also showed the most pronounced radiosensitization effect in combination with the external beam x-ray irradiation. Further studies are necessary to evaluate mechanistic basis for this increased radiosensitization effect. Preliminary studies with the nanoparticles carrying an EGF mimicking peptide showed that this approach to targeting could perhaps be combined with a different approach to radiosensitization - use of nanoconjugates in combination with the radioactive iodine. Much additional work will be necessary in order to evaluate possible benefits of targeted nanoconjugates carrying radionuclides. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12645-021-00081-z.

Efficient ptychographic phase retrieval via a matrix-free Levenberg-Marquardt algorithm.

The phase retrieval problem, where one aims to recover a complex-valued image from far-field intensity measurements, is a classic problem encountered in a range of imaging applications. Modern phase retrieval approaches usually rely on gradient descent methods in a nonlinear minimization framework. Calculating closed-form gradients for use in these methods is tedious work, and formulating second order derivatives is even more laborious. Additionally, second order techniques often require the storage and inversion of large matrices of partial derivatives, with memory requirements that can be prohibitive for data-rich imaging modalities. We use a reverse-mode automatic differentiation (AD) framework to implement an efficient matrix-free version of the Levenberg-Marquardt (LM) algorithm, a longstanding method that finds popular use in nonlinear least-square minimization problems but which has seen little use in phase retrieval. Furthermore, we extend the basic LM algorithm so that it can be applied for more general constrained optimization problems (including phase retrieval problems) beyond just the least-square applications. Since we use AD, we only need to specify the physics-based forward model for a specific imaging application; the first and second-order derivative terms are calculated automatically through matrix-vector products, without explicitly forming the large Jacobian or Gauss-Newton matrices typically required for the LM method. We demonstrate that this algorithm can be used to solve both the unconstrained ptychographic object retrieval problem and the constrained "blind" ptychographic object and probe retrieval problems, under the popular Gaussian noise model as well as the Poisson noise model. We compare this algorithm to state-of-the-art first order ptychographic reconstruction methods to demonstrate empirically that this method outperforms best-in-class first-order methods: it provides excellent convergence guarantees with (in many cases) a superlinear rate of convergence, all with a computational cost comparable to, or lower than, the tested first-order algorithms.

Development of Multi-Scale X-ray Fluorescence Tomography for Examination of Nanocomposite-Treated Biological Samples.

Research in cancer nanotechnology is entering its third decade, and the need to study interactions between nanomaterials and cells remains urgent. Heterogeneity of nanoparticle uptake by different cells and subcellular compartments represent the greatest obstacles to a full understanding of the entire spectrum of nanomaterials' effects. In this work, we used flow cytometry to evaluate changes in cell cycle associated with non-targeted nanocomposite uptake by individual cells and cell populations. Analogous single cell and cell population changes in nanocomposite uptake were explored by X-ray fluorescence microscopy (XFM). Very few nanoparticles are visible by optical imaging without labeling, but labeling increases nanoparticle complexity and the risk of modified cellular uptake. XFM can be used to evaluate heterogeneity of nanocomposite uptake by directly imaging the metal atoms present in the metal-oxide nanocomposites under investigation. While XFM mapping has been performed iteratively in 2D with the same sample at different resolutions, this study is the first example of serial tomographic imaging at two different resolutions. A cluster of cells exposed to non-targeted nanocomposites was imaged with a micron-sized beam in 3D. Next, the sample was sectioned for immunohistochemistry as well as a high resolution "zoomed in" X-ray fluorescence (XRF) tomography with 80 nm beam spot size. Multiscale XRF tomography will revolutionize our ability to explore cell-to-cell differences in nanomaterial uptake.

Using a modified double deep image prior for crosstalk mitigation in multislice ptychography.

Multislice ptychography is a high-resolution microscopy technique used to image multiple separate axial planes using a single illumination direction. However, multislice ptychography reconstructions are often degraded by crosstalk, where some features on one plane erroneously contribute to the reconstructed image of another plane. Here, the use of a modified `double deep image prior' (DDIP) architecture is demonstrated in mitigating crosstalk artifacts in multislice ptychography. Utilizing the tendency of generative neural networks to produce natural images, a modified DDIP method yielded good results on experimental data. For one of the datasets, it is shown that using DDIP could remove the need of using additional experimental data, such as from X-ray fluorescence, to suppress the crosstalk. This method may help X-ray multislice ptychography work for more general experimental scenarios.

Is regression gain or instantaneous gain the most reliable and reproducible gain value when performing video head impulse testing of the lateral semicircular canals?

BACKGROUND: Several different video Head Impulse Test (vHIT) systems exist. The function of each individual semicircular canal (SCC) may be determined by performing this test. All vHIT systems provide information about the function of the vestibular ocular reflex by means of two modalities: SACCADES and GAIN. However, different gain calculation methods exist. OBJECTIVE: Primary endpoint:•Is instantaneous gain or regression gain the most reproducible and reliable gain value when performing vHIT with testing of the lateral SCCs?Secondary endpoints:•Comparison of each of the instantaneous gain values at 40, 60, and 80ms with the regression gain.•Examination of any intra- and inter examiner variability.•Mean instantaneous gain values, and at different velocities, compared with regression gain values of the lateral SCCs. METHODS: 60 subjects between 18-65 years were included. All patients filled out the Dizziness Handicap Inventory (DHI) questionnaire and underwent four separate vHIT tests, two by an experienced neurotologist and two by an inexperienced examiner. RESULTS/CONCLUSIONS: 240 datasets were obtained, displaying both regression and instantaneous gain values. Regression gain was more reproducible than instantaneous gain. The experienced examiner provided the most reproducible results.When comparing instantaneous gain, we found the gain at 40 ms to be the least reproducible. There was no significant difference between 60 ms and 80 ms.For both examiners no significant intra examiner variability was found.

Upscaling X-ray nanoimaging to macroscopic specimens.

Upscaling X-ray nanoimaging to macroscopic specimens has the potential for providing insights across multiple length scales, but its feasibility has long been an open question. By combining the imaging requirements and existing proof-of-principle examples in large-specimen preparation, data acquisition and reconstruction algorithms, the authors provide imaging time estimates for howX-ray nanoimaging can be scaled to macroscopic specimens. To arrive at this estimate, a phase contrast imaging model that includes plural scattering effects is used to calculate the required exposure and corresponding radiation dose. The coherent X-ray flux anticipated from upcoming diffraction-limited light sources is then considered. This imaging time estimation is in particular applied to the case of the connectomes of whole mouse brains. To image the connectome of the whole mouse brain, electron microscopy connectomics might require years, whereas optimized X-ray microscopy connectomics could reduce this to one week. Furthermore, this analysis points to challenges that need to be overcome (such as increased X-ray detector frame rate) and opportunities that advances in artificial-intelligence-based 'smart' scanning might provide. While the technical advances required are daunting, it is shown that X-ray microscopy is indeed potentially applicable to nanoimaging of millimetre- or even centimetre-size specimens.

Adorym: a multi-platform generic X-ray image reconstruction framework based on automatic differentiation.

We describe and demonstrate an optimization-based X-ray image reconstruction framework called Adorym. Our framework provides a generic forward model, allowing one code framework to be used for a wide range of imaging methods ranging from near-field holography to fly-scan ptychographic tomography. By using automatic differentiation for optimization, Adorym has the flexibility to refine experimental parameters including probe positions, multiple hologram alignment, and object tilts. It is written with strong support for parallel processing, allowing large datasets to be processed on high-performance computing systems. We demonstrate its use on several experimental datasets to show improved image quality through parameter refinement.

Fast digital lossy compression for X-ray ptychographic data.

Increases in X-ray brightness from synchrotron light sources lead to a requirement for higher frame rates from hybrid pixel array detectors (HPADs), while also favoring charge integration over photon counting. However, transfer of the full uncompressed data will begin to constrain detector design, as well as limit the achievable continuous frame rate. Here a data compression scheme that is easy to implement in a HPAD's application-specific integrated circuit (ASIC) is described, and how different degrees of compression affect image quality in ptychography, a commonly employed coherent imaging method, is examined. Using adaptive encoding quantization, it is shown in simulations that one can digitize signals up to 16383 photons per pixel (corresponding to 14 bits of information) using only 8 or 9 bits for data transfer, with negligible effect on the reconstructed image.

Tunable hard x-ray nanofocusing with Fresnel zone plates fabricated using deep etching.

Fresnel zone plates are widely used for x-ray nanofocusing, due to their ease of alignment and energy tunability. Their spatial resolution is limited in part by their outermost zone width dr N , while their efficiency is limited in part by their thickness t zp. We demonstrate the use of Fresnel zone plate optics for x-ray nanofocusing with dr N = 16 nm outermost zone width and a thickness of about t zp = 1.8 µm (or an aspect ratio of 110) with an absolute focusing efficiency of 4.7% at 12 keV, and 6.2% at 10 keV. Using partially coherent illumination at 12 keV, the zone plate delivered a FWHM focus of 46 × 60 nm at 12 keV, with the first order coherent mode in a ptychographic reconstruction showing a probe size of 16 nm FWHM. These optics were fabricated using a combination of metal assisted chemical etching and atomic layer deposition for the diffracting structures, and silicon wafer back-thinning to produce optics useful for real applications. This approach should enable new higher resolution views of thick materials, especially when energy tunability is required.

A three-dimensional thalamocortical dataset for characterizing brain heterogeneity.

Neural microarchitecture is heterogeneous, varying both across and within brain regions. The consistent identification of regions of interest is one of the most critical aspects in examining neurocircuitry, as these structures serve as the vital landmarks with which to map brain pathways. Access to continuous, three-dimensional volumes that span multiple brain areas not only provides richer context for identifying such landmarks, but also enables a deeper probing of the microstructures within. Here, we describe a three-dimensional X-ray microtomography imaging dataset of a well-known and validated thalamocortical sample, encompassing a range of cortical and subcortical structures from the mouse brain . In doing so, we provide the field with access to a micron-scale anatomical imaging dataset ideal for studying heterogeneity of neural structure.

Comparison of distributed memory algorithms for X-ray wave propagation in inhomogeneous media.

Calculations of X-ray wave propagation in large objects are needed for modeling diffractive X-ray optics and for optimization-based approaches to image reconstruction for objects that extend beyond the depth of focus. We describe three methods for calculating wave propagation with large arrays on parallel computing systems with distributed memory: (1) a full-array Fresnel multislice approach, (2) a tiling-based short-distance Fresnel multislice approach, and (3) a finite difference approach. We find that the first approach suffers from internode communication delays when the transverse array size becomes large, while the second and third approaches have similar scaling to large array size problems (with the second approach offering about three times the compute speed).

Near, far, wherever you are: simulations on the dose efficiency of holographic and ptychographic coherent imaging.

Different studies in X-ray microscopy have arrived at conflicting conclusions about the dose efficiency of imaging modes involving the recording of intensity distributions in the near (Fresnel regime) or far (Fraunhofer regime) field downstream of a specimen. A numerical study is presented on the dose efficiency of near-field holography, near-field ptychography and far-field ptychography, where ptychography involves multiple overlapping finite-sized illumination positions. Unlike what has been reported for coherent diffraction imaging, which involves recording a single far-field diffraction pattern, it is found that all three methods offer similar image quality when using the same fluence on the specimen, with far-field ptychography offering slightly better spatial resolution and a lower mean error. These results support the concept that (if the experiment and image reconstruction are done properly) the sample can be near or far; wherever you are, photon fluence on the specimen sets one limit to spatial resolution.

Corrigendum to: "Relative merits and limiting factors for x-ray and electron microscopy of thick, hydrated organic materials" [Ultramicroscopy 184 (2018) 293-309].

During follow-on calculations, we found a few minor errors in our previous publication [Ultramicroscopy184, 293-309 (2018); doi:10.1016/j.ultramic.2017.10.003]. We present here the necessary corrections. The full revised manuscript, with the corrected parts indicated in blue color text, is available at https://arxiv.org/abs/2004.10069.

Three dimensions, two microscopes, one code: Automatic differentiation for x-ray nanotomography beyond the depth of focus limit.

Conventional tomographic reconstruction algorithms assume that one has obtained pure projection images, involving no within-specimen diffraction effects nor multiple scattering. Advances in x-ray nanotomography are leading toward the violation of these assumptions, by combining the high penetration power of x-rays, which enables thick specimens to be imaged, with improved spatial resolution that decreases the depth of focus of the imaging system. We describe a reconstruction method where multiple scattering and diffraction effects in thick samples are modeled by multislice propagation and the 3D object function is retrieved through iterative optimization. We show that the same proposed method works for both full-field microscopy and for coherent scanning techniques like ptychography. Our implementation uses the optimization toolbox and the automatic differentiation capability of the open-source deep learning package TensorFlow, demonstrating a straightforward way to solve optimization problems in computational imaging with flexibility and portability.

Effect of tilt on circular zone plate performance.

Fresnel zone plates are frequently used as focusing and imaging optics in x-ray microscopy, as they provide the ease of use of normal incidence optics. We consider here the effects of tilt misalignment on their optical performance, both in the thin optics limit and in the case of zone plates that are sufficiently thick so that volume diffraction effects come into play. Using multislice propagation, we show that simple analytical models describe the tilt sensitivity of thin zone plates and the thickness at which volume diffraction must be considered, and examine numerically the performance of example zone plates for soft x-ray focusing at 0.5 keV and hard x-ray focusing at 10 keV.

A new synthetic lure for management of the invasive giant African snail, Lissachatina fulica.

Synthetic chemical lures mimicking pheromones or food attractants are essential tools in eradication programs for invasive species. However, their uses in programs aiming to control or eradicate terrestrial gastropods are largely unexplored. The goal of this study was to find a synthetic attractant that could aid in the eradication or management of the giant African snail (Lissachatina fulica). Field studies in Hawaii showed that a commercial papaya-flavored oil attracted snails. Analysis of the odor profile of the oil identified a total of 22 chemicals, which comprised > 98% of the volatile compounds emitted by the oil. A synthetic blend was reconstructed that mirrored the release rates of the papaya oil odors. In laboratory and field bioassays, the reconstructed blend, applied to cotton wicks as water and canola oil or water and mineral emulsions, attracted more snails than the water and oil emulsion control wicks. Field studies in Hawaii and Florida showed that the reconstructed blend in an oil emulsion was not attractive to non-target species such as butterflies or bees. The snails were attracted from distances > 1 m and entered traps baited with the attractant emulsion. When tested in the South Florida giant African snail eradication program, direct ground application of the reconstructed papaya-flavored oil emulsion increased the number of snails killed by over 87% compared to water emulsion controls. Integrating tactics using the synthetic papaya oil attractant into control measures should increase the effectiveness of eradication and management programs.