RESUMO
The elemental images (EIs) generation of complex real-world scenes can be challenging for conventional integral imaging (InIm) capture techniques since the pseudoscopic effect, characterized by a depth inversion of the reconstructed 3D scene, occurs in this process. To address this problem, we present in this paper a new approach using a custom neural radiance field (NeRF) model to form real and/or virtual 3D image reconstruction from a complex real-world scene while avoiding distortion and depth inversion. One of the advantages of using a NeRF is that the 3D information of a complex scene (including transparency and reflection) is not stored by meshes or voxel grid but by a neural network that can be queried to extract desired data. The Nerfstudio API was used to generate a custom NeRF-related model while avoiding the need for a bulky acquisition system. A general workflow that includes the use of ray-tracing-based lens design software is proposed to facilitate the different processing steps involved in managing NeRF data. Through this workflow, we introduced a new mapping method for extracting desired data from the custom-trained NeRF-related model, enabling the generation of undistorted orthoscopic EIs. An experimental 3D reconstruction was conducted using an InIm-based 3D light field display (LFD) prototype to validate the effectiveness of the proposed method. A qualitative comparison with the actual real-world scene showed that the 3D reconstructed scene is accurately rendered. The proposed work can be used to manage and render undistorted orthoscopic 3D images from custom-trained NeRF-related models for various InIm applications.
RESUMO
PURPOSE: To demonstrate the feasibility of a three-plenoptic camera projection, scintillation-based dosimetry system for measuring three-dimensional (3D) dose distributions of static photon radiation fields. METHODS: Static x-ray photon beams were delivered to a cubic plastic scintillator volume embedded within acrylic blocks. For each beam, three orthogonal projections of the scintillating light emission were recorded using a multifocus plenoptic camera. Experimental 3D reconstructions of the light distribution were obtained using an iterative maximum likelihood-expectation maximization (ML-EM) algorithm. For this purpose, the elements of the system matrix representing the contribution of the scintillator volume voxels to the camera sensor pixels were calculated using optical design software. A reconstruction-specific correction was applied to light reconstructions to account for scintillating light imaged by the camera but not directly resulting from dose deposition. Cross beam profiles (CBPs) and percentage depth dose (PDD) curves were compared to treatment planning system data for square fields. Three-dimensional and 3D gamma analyses were performed for concave-shaped dose distributions and the Pearson correlation coefficient and reconstruction error were employed to assess the quality of the measured relative 3D dose distributions. RESULTS: A full and accurate model of the plenoptic camera-based scintillation dosimetry system was implemented using the light ray tracing capabilities of optical design software. With this model, light distributions were successfully reconstructed over a volume of 60 × 60 × 60 mm 3 at a resolution of 2 mm. For relative 3D measurements of square radiation fields of 2 × 2 cm 2 , 3 × 3 cm 2 and 4 × 4 cm 2 compared with treatment planning system reference distributions, the maximum root-mean-square error of the CBPs evaluated at two different depths was of 3.2%, 1.2%, and 1.1%, respectively; as for the corresponding linearly fitted PDDs of the square fields, the slopes of the reconstructed dose distributions overestimated those of the reference distributions by at most 0.2%/ cm. The 2D gamma passing rate with a criterion of 2%/2 mm for the concave-shaped photon field was of 61.6%, 66.1%, and 76.4% using one, two, and three plenoptic projections; the respective success rates become 77.1%, 87.5%, and 94.9% using a criterion of 3%/3 mm. The 3D correlation coefficient for the corresponding reconstructions was of 0.688, 0.905, and 0.976, respectively. CONCLUSIONS: Three-dimensional light distributions emitted from within a plastic scintillator volume were successfully recovered using optical design software to establish a complete tomographic model of a plenoptic camera-based prototype. The tomographic model can equivalently extend to dynamic dose delivery measurements, providing temporal resolution limited by the camera's exposure time. This feasibility study enables a simplified design-to-implementation process for volumetric scintillation dosimetry prototypes toward fully meeting the clinical needs of 3D dose measurements for static and dynamic delivery techniques.
