A machine learning based method for tracking of simultaneously imaged neural activity and body posture of freely moving maggot.

To understand neural basis of animal behavior, it is necessary to monitor neural activity and behavior in freely moving animal before building relationship between them. Here we use light sheet fluorescence microscope (LSFM) combined with microfluidic chip to simultaneously capture neural activity and body movement in small freely behaving Drosophila larva. We develop a transfer learning based method to simultaneously track the continuously changing body posture and activity of neurons that move together using a sub-region tracking network with a precise landmark estimation network for the inference of target landmark trajectory. Based on the tracking of each labelled neuron, the activity of the neuron indicated by fluorescent intensity is calculated. For each video, annotation of only 20 frames in a video is sufficient to yield human-level accuracy for all other frames. The validity of this method is further confirmed by reproducing the activity pattern of PMSIs (period-positive median segmental interneurons) and larval movement as previously reported. Using this method, we disclosed the correlation between larval movement and left-right asymmetry in activity of a group of unidentified neurons labelled by R52H01-Gal4 and further confirmed the roles of these neurons in bilateral balance of body contraction during larval crawling by genetic inhibition of these neurons. Our method provides a new tool for accurate extraction of neural activities and movement of freely behaving small-size transparent animals.

Deep-learning on-chip light-sheet microscopy enabling video-rate volumetric imaging of dynamic biological specimens.

Volumetric imaging of dynamic signals in a large, moving, and light-scattering specimen is extremely challenging, owing to the requirement on high spatiotemporal resolution and difficulty in obtaining high-contrast signals. Here we report that through combining a microfluidic chip-enabled digital scanning light-sheet illumination strategy with deep-learning based image restoration, we can realize isotropic 3D imaging of a whole crawling Drosophila larva on an ordinary inverted microscope at a single-cell resolution and a high volumetric imaging rate up to 20 Hz. Enabled with high performances even unmet by current standard light-sheet fluorescence microscopes, we in toto record the neural activities during the forward and backward crawling of a 1st instar larva, and successfully correlate the calcium spiking of motor neurons with the locomotion patterns.

Fast, 3D Isotropic Imaging of Whole Mouse Brain Using Multiangle-Resolved Subvoxel SPIM.

The recent integration of light-sheet microscopy and tissue-clearing has facilitated an important alternative to conventional histological imaging approaches. However, the in toto cellular mapping of neural circuits throughout an intact mouse brain remains highly challenging, requiring complicated mechanical stitching, and suffering from anisotropic resolution insufficient for high-quality reconstruction in 3D. Here, the use of a multiangle-resolved subvoxel selective plane illumination microscope (Mars-SPIM) is proposed to achieve high-throughput imaging of whole mouse brain at isotropic cellular resolution. This light-sheet imaging technique can computationally improve the spatial resolution over six times under a large field of view, eliminating the use of slow tile stitching. Furthermore, it can recover complete structural information of the sample from images subject to thick-tissue scattering/attenuation. With Mars-SPIM, a digital atlas of a cleared whole mouse brain (≈7 mm × 9.5 mm × 5 mm) can readily be obtained with an isotropic resolution of ≈2 µm (1 µm voxel) and a short acquisition time of 30 min. It provides an efficient way to implement system-level cellular analysis, such as the mapping of different neuron populations and tracing of long-distance neural projections over the entire brain. Mars-SPIM is thus well suited for high-throughput cell-profiling phenotyping of brain and other mammalian organs.

Propagating-path uniformly scanned light sheet excitation microscopy for isotropic volumetric imaging of large specimens.

We demonstrate a propagating-path uniformly scanned light sheet excitation (PULSE) microscopy based on the oscillation of voice coil motor that can rapidly drive a thin light sheet along its propagation direction. By synchronizing the rolling shutter of a camera with the motion of laser sheet, we can obtain a uniform plane-illuminated image far beyond the confocal range of Gaussian beam. A stable 1.7-µm optical sectioning under a 3.3 mm × 3.3 mm wide field of view (FOV) has been achieved for up to 20 Hz volumetric imaging of large biological specimens. PULSE method transforms the extent of plane illumination from one intrinsically limited by the short confocal range (µm scale) to one defined by the motor oscillation range (mm scale). Compared to the conventional Gaussian light sheet imaging, our method greatly mitigates the compromise of axial resolution and successfully extends the FOV over 100 times. We demonstrate the applications of PULSE method by rapidly imaging cleared mouse spinal cord and live zebrafish larva at isotropic subcellular resolution.