Ray-transfer functions for camera simulation of 3D scenes with hidden lens design.

Combining image sensor simulation tools with physically based ray tracing enables the design and evaluation (soft prototyping) of novel imaging systems. These methods can also synthesize physically accurate, labeled images for machine learning applications. One practical limitation of soft prototyping has been simulating the optics precisely: lens manufacturers generally prefer to keep lens design confidential. We present a pragmatic solution to this problem using a black box lens model in Zemax; such models provide necessary optical information while preserving the lens designer's intellectual property. First, we describe and provide software to construct a polynomial ray transfer function that characterizes how rays entering the lens at any position and angle subsequently exit the lens. We implement the ray-transfer calculation as a camera model in PBRT and confirm that the PBRT ray-transfer calculations match the Zemax lens calculations for edge spread functions and relative illumination.

Crosstalk elimination by rearranging thin-film filters.

Patterned thin-film Fabry-Pérot filters are used to develop compact spectral cameras. Recent articles report on crosstalk in such devices, raising concerns regarding spectral and spatial resolution. It has been suggested that light entering a filter might spill over to neighboring filters but this has not yet been analyzed in detail. The proposed mechanism in this Letter is that the Fabry-Pérot filters act as coupled waveguides that can propagate crosstalk above the pixel array. The results show that the crosstalk can be asymmetric, enabling elimination by rearranging the filters on the sensor. Interestingly, the logical strategy where crosstalk to all neighbors is eliminated appears suboptimal due to additional resonances. These findings reveal untapped opportunities for developing better sensors and a corresponding need for further systematic investigations.

Filter width affects the transmittance of patterned all-dielectric Fabry-Perot filters.

Thin-film all-dielectric Fabry-Perot filters can nowadays be patterned onto pixels of commercial imaging sensors used for spectral imaging. For these patterned filters, standard transfer-matrix thin-film calculations fail to predict their angular dependency. This Letter attributes the discrepancy to the finite filter size and is also, to my knowledge, the first study to analyze this for patterned all-dielectric Fabry-Perot filters. An angular spectrum approach that enables prediction without full knowledge of the filter design is introduced. In addition, the contribution of diffraction at normal incidence is characterized by a single dimensionless parameter. Knowing that patterned filter size matters and having a method to efficiently simulate its effect can guide ongoing miniaturization efforts and filter design.

Thin-film interference filters illuminated by tilted apertures.

Thin-film interference filters can be illuminated by a circular aperture at different angles. Each situation produces a different transmittance spectrum. We present an analytical model that, for small tilt angles, predicts the change in transmittance for an arbitrary position of the filter in three-dimensional space. The model is extended to take into account higher-order harmonics. We also derive a formula to predict the change in central wavelength, and we validate our results by comparison with thin-film transfer-matrix calculations. A key property of our approach is that the model can be combined with empirical data to predict the transmittance without knowing the filter design.

Vignetted-aperture correction for spectral cameras with integrated thin-film Fabry-Perot filters.

Spectral cameras with integrated thin-film Fabry-Perot filters have become increasingly important in many applications. These applications often require the detection of spectral features at specific wavelengths or to quantify small variations in the spectrum. This can be challenging since thin-film filters are sensitive to the angle of incidence of the light. In prior work, we modeled and corrected for the distribution of incident angles for an ideal finite aperture. Many real lenses, however, experience vignetting. Therefore, in this paper, we generalize our model to the more common case of a vignetted aperture, which changes the distribution of incident angles. We propose a practical method to estimate the model parameters and correct undesired shifts in measured spectra. This is experimentally validated for a lens mounted on a visible-to-near-infrared spectral camera.

Finite aperture correction for spectral cameras with integrated thin-film Fabry-Perot filters.

Spectral cameras with integrated thin-film Fabry-Perot filters enable many different applications. Some applications require the detection of spectral features that are only visible at specific wavelengths, and some need to quantify small spectral differences that are undetectable with RGB color cameras. One factor that influences the central wavelength of thin-film filters is the angle of incidence. Therefore, when light is focused from an imaging lens onto the filter array, undesirable shifts in the measured spectra are observed. These shifts limit the use of the sensor in applications that require fast lenses or lenses with large chief ray angles. To increase flexibility and enable new applications, we derive an analytical model that explains and can correct the observed shifts in measured spectra. The model includes the size of the aperture and physical position of each filter on the sensor. We experimentally validate the model with two spectral cameras: one in the visible and near-infrared region and one in the short wave infrared region.