ABSTRACT
Experimentally recorded point cloud data, such as those generated by single-molecule localization microscopy, are continuously increasing in size and dimension. Gaining an intuitive understanding and facilitating the analysis of such multidimensional data remains challenging. Here we report a new open-source software platform, Genuage, that enables the easy perception of, interaction with and analysis of multidimensional point clouds in virtual reality. Genuage is compatible with arbitrary multidimensional data extending beyond single-molecule localization microscopy.
Subject(s)
Image Processing, Computer-Assisted/methods , Single Molecule Imaging/methods , Software , Virtual Reality , Algorithms , Artificial Intelligence , HeLa Cells , Humans , Mitochondria/chemistry , Tubulin/chemistryABSTRACT
As three-dimensional microscopy becomes commonplace in biological research, there is an increasing need for researchers to be able to view experimental image stacks in a natural three-dimensional viewing context. Through stereoscopy and motion tracking, commercial virtual reality headsets provide a solution to this important visualization challenge by allowing researchers to view volumetric objects in an entirely intuitive fashion. With this motivation, we present DIVA, a user-friendly software tool that automatically creates detailed three-dimensional reconstructions of raw experimental image stacks that are integrated in virtual reality. In DIVA's immersive virtual environment, users can view, manipulate and perform volumetric measurements on their microscopy images as they would to real physical objects. In contrast to similar solutions, our software provides high-quality volume rendering with native TIFF file compatibility. We benchmark the software with diverse image types including those generated by confocal, light-sheet and electron microscopy. DIVA is available at https://diva.pasteur.fr and will be regularly updated.
Subject(s)
Imaging, Three-Dimensional/instrumentation , Virtual Reality , Humans , Microscopy , Software , User-Computer InterfaceABSTRACT
Virtual reality (VR) has recently become an affordable technology. A wide range of options are available to access this unique visualization medium, from simple cardboard inserts for smartphones to truly advanced headsets tracked by external sensors. While it is now possible for any research team to gain access to VR, we can still question what it brings to scientific research. Visualization and the ability to navigate complex three-dimensional data are undoubtedly a gateway to many scientific applications; however, we are convinced that data treatment and numerical simulations, especially those mixing interactions with data, human cognition, and automated algorithms will be the future of VR in scientific research. Moreover, VR might soon merit the same level of attention to imaging data as machine learning currently has. In this short perspective, we discuss approaches that employ VR in scientific research based on some concrete examples.
