Single-Image-Based 3D Reconstruction of Endoscopic Images.

A wireless capsule endoscope (WCE) is a medical device designed for the examination of the human gastrointestinal (GI) tract. Three-dimensional models based on WCE images can assist in diagnostics by effectively detecting pathology. These 3D models provide gastroenterologists with improved visualization, particularly in areas of specific interest. However, the constraints of WCE, such as lack of controllability, and requiring expensive equipment for operation, which is often unavailable, pose significant challenges when it comes to conducting comprehensive experiments aimed at evaluating the quality of 3D reconstruction from WCE images. In this paper, we employ a single-image-based 3D reconstruction method on an artificial colon captured with an endoscope that behaves like WCE. The shape from shading (SFS) algorithm can reconstruct the 3D shape using a single image. Therefore, it has been employed to reconstruct the 3D shapes of the colon images. The camera of the endoscope has also been subjected to comprehensive geometric and radiometric calibration. Experiments are conducted on well-defined primitive objects to assess the method's robustness and accuracy. This evaluation involves comparing the reconstructed 3D shapes of primitives with ground truth data, quantified through measurements of root-mean-square error and maximum error. Afterward, the same methodology is applied to recover the geometry of the colon. The results demonstrate that our approach is capable of reconstructing the geometry of the colon captured with a camera with an unknown imaging pipeline and significant noise in the images. The same procedure is applied on WCE images for the purpose of 3D reconstruction. Preliminary results are subsequently generated to illustrate the applicability of our method for reconstructing 3D models from WCE images.

Mapping Quantitative Observer Metamerism of Displays.

Observer metamerism (OM) is the name given to the variability between the color matches that individual observers consider accurate. The standard color imaging approach, which uses color-matching functions of a single representative observer, does not accurately represent every individual observer's perceptual properties. This paper investigates OM in color displays and proposes a quantitative assessment of the OM distribution across the chromaticity diagram. An OM metric is calculated from a database of individual LMS cone fundamentals and the spectral power distributions of the display's primaries. Additionally, a visualization method is suggested to map the distribution of OM across the display's color gamut. Through numerical assessment of OM using two distinct publicly available sets of individual observers' functions, the influence of the selected dataset on the intensity and distribution of OM has been underscored. The case study of digital cinema has been investigated, specifically the transition from xenon-arc to laser projectors. The resulting heatmaps represent the "topography" of OM for both types of projectors. The paper also presents color difference values, showing that achromatic highlights could be particularly prone to disagreements between observers in laser-based cinema theaters. Overall, this study provides valuable resources for display manufacturers and researchers, offering insights into observer metamerism and facilitating the development of improved display technologies.

Measuring the Optical Properties of Highly Diffuse Materials.

Measuring the optical properties of highly diffuse materials is a challenge as it could be related to the white colour or an oversaturation of pixels in the acquisition system. We used a spatially resolved method and adapted a nonlinear trust-region algorithm to the fit Farrell diffusion theory model. We established an inversion method to estimate two optical properties of a material through a single reflectance measurement: the absorption and the reduced scattering coefficient. We demonstrate the validity of our method by comparing results obtained on milk samples, with a good fitting and a retrieval of linear correlations with the fat content, given by R2 scores over 0.94 with low p-values. The values of absorption coefficients retrieved vary between 1 × 10-3 and 8 × 10-3 mm-1, whilst the values of the scattering coefficients obtained from our method are between 3 and 8 mm-1 depending on the percentage of fat in the milk sample, and under the assumption of the anisotropy factor g>0.8. We also measured and analyzed the results on white paint and paper, although the paper results were difficult to relate to indicators. Thus, the method designed works for highly diffuse isotropic materials.

Additivity Constrained Linearisation of Camera Calibration Data.

When characterising a digital camera spectrally or colourimetrically, the camera response to a generally diffusely reflecting colour chart is often employed. The recorded responses to the light incident from each colour patch are typically not linearly related to the power of the irradiance on the chart, and the irradiance varies with position on the chart. This necessitates a linearisation of the responses. We present a new single image colour chart-based estimation method of responses, that are linearly related to camera response values known as ground truth. The method estimates the spatial geometry of the irradiance incident on the chart attenuated by lens vignetting and compensates individually for volumetric and per colour channel non-linearities, including compensation for physical scene and camera properties in a pipeline of successive signal transformations between the estimated linear and the given recorded responses. The estimation is controlled by introducing a novel Additivity Principle of linear responses, which is derived from the spectral reflectances of the coloured surfaces on the colour chart, observing that linear relations of the spectral reflectances are equal to the relations of the corresponding linear responses. Crucially, the additivity principle is not subject to metamerism. The method is fundamentally solely reliant on a one-shot set of one triplet of response values sampled from each patch of a colour chart with known spectral reflectances, where rendition level, gray scale, illuminant, camera sensor curves, irradiance geometry, vignetting, moderate specular reflection, colour space, colour correction, gamut correction and noise level are unknown.

Variational Anisotropic Gradient-Domain Image Processing.

Gradient-domain image processing is a technique where, instead of operating directly on the image pixel values, the gradient of the image is computed and processed. The resulting image is obtained by reintegrating the processed gradient. This is normally done by solving the Poisson equation, most often by means of a finite difference implementation of the gradient descent method. However, this technique in some cases lead to severe haloing artefacts in the resulting image. To deal with this, local or anisotropic diffusion has been added as an ad hoc modification of the Poisson equation. In this paper, we show that a version of anisotropic gradient-domain image processing can result from a more general variational formulation through the minimisation of a functional formulated in terms of the eigenvalues of the structure tensor of the differences between the processed gradient and the gradient of the original image. Example applications of linear and nonlinear local contrast enhancement and colour image Daltonisation illustrate the behaviour of the method.

Correlations in Joint Spectral and Polarization Imaging.

Recent imaging techniques enable the joint capture of spectral and polarization image data. In order to permit the design of computational imaging techniques and future processing of this information, it is interesting to describe the related image statistics. In particular, in this article, we present observations for different correlations between spectropolarimetric channels. The analysis is performed on several publicly available databases that are unified for joint processing. We perform global investigation and analysis on several specific clusters of materials or reflection types. We observe that polarization channels generally have more inter-channel correlation than the spectral channels.

Individualised Halo-Free Gradient-Domain Colour Image Daltonisation.

Daltonisation refers to the recolouring of images such that details normally lost by colour vision deficient observers become visible. This comes at the cost of introducing artificial colours. In a previous work, we presented a gradient-domain colour image daltonisation method that outperformed previously known methods both in behavioural and psychometric experiments. In the present paper, we improve the method by (i) finding a good first estimate of the daltonised image, thus reducing the computational time significantly, and (ii) introducing local linear anisotropic diffusion, thus effectively removing the halo artefacts. The method uses a colour vision deficiency simulation algorithm as an ingredient, and can thus be applied for any colour vision deficiency, and can even be individualised if the exact individual colour vision is known.

Evaluating an image-based bidirectional reflectance distribution function measurement setup: erratum.

Two typographical errors in [Appl. Opt.57, 1918 (2018)]APOPAI0003-693510.1364/AO.57.001918 are identified and have been corrected here.

Evaluating an image-based bidirectional reflectance distribution function measurement setup.

We evaluate an image-based multiangle bidirectional reflectance distribution function measurement setup by comparing it to measurements from two commercially available goniospectrophotometers. The image-based setup uses an RGB camera to perform bidirectional measurements of the sample material. We use a conversion matrix to calculate luminance from the captured data. The matrix is calculated using camera spectral sensitivities that are measured with a monochromator. Radiance factor of the sample material is measured using a commercially available tabletop goniospectrophotometer and compared to measurements made using the image-based setup in the colorimetric domain. Our measurement setup is validated by comparing the measurements performed using a goniospectrophotometer. Uncertainty and error propagation is calculated and taken into account for validation. The sample material measured is wax-based ink printed on packaging paper substrate commonly used in the print and packaging industry. Results obtained show that the image-based setup can perform bidirectional reflectance measurements with a known uncertainty. The goniospectrophotometer measurements lie within the uncertainty of the measurements performed by the image-based measurement setup. The setup can be used to perform bidirectional reflectance measurements on samples with properties similar to the samples used in this paper.

Hyperbolic geometry for colour metrics.

It is well established from both colour difference and colour order perpectives that the colour space cannot be Euclidean. In spite of this, most colour spaces still in use today are Euclidean, and the best Euclidean colour metrics are performing comparably to state-of-the-art non-Euclidean metrics. In this paper, it is shown that a transformation from Euclidean to hyperbolic geometry (i.e., constant negative curvature) for the chromatic plane can significantly improve the performance of Euclidean colour metrics to the point where they are statistically significantly better than state-of-the-art non-Euclidean metrics on standard data sets. The resulting hyperbolic geometry nicely models both qualitatively and quantitatively the hue super-importance phenomenon observed in colour order systems.

A multiscale framework for spatial gamut mapping.

Image reproduction devices, such as displays or printers, can reproduce only a limited set of colors, denoted the color gamut. The gamut depends on both theoretical and technical limitations. Reproduction device gamuts are significantly different from acquisition device gamuts. These facts raise the problem of reproducing similar color images across different devices. This is well known as the gamut mapping problem. Gamut mapping algorithms have been developed mainly using colorimetric pixel-wise principles, without considering the spatial properties of the image. The recently proposed multilevel gamut mapping approach takes spatial properties into account and has been demonstrated to outperform spatially invariant approaches. However, they have some important drawbacks. To analyze these drawbacks, we build a common framework that encompasses at least two important previous multilevel gamut mapping algorithms. Then, when the causes of the drawbacks are understood, we solve the typical problem of possible hue shifts. Next, we design appropriate operators and functions to strongly reduce both haloing and possible undesired over compression. We use challenging synthetic images, as well as real photographs, to practically show that the improvements give the expected results.

Generating light with a specified spectral power distribution.

A particular version of a spectral integrator has been designed. It consists of a xenon lamp whose light is dispersed into a color spectrum by dispersing prisms. Using a transmissive LCD panel controlled by a computer, certain fractions of the light in different parts of the spectrum are masked out. The remaining transmitted light is integrated and projected onto a translucent diffusing plate. A spectroradiometer that measures the generated light is also attached to the computer, thus making the spectral integrator a closed-loop system. An algorithm for generating the light of a specified spectral power distribution has been developed. The resulting measured spectra differ from the specified ones with relative rms errors in the range of 1%-20% depending on the shape of the spectral power distribution.

Colorimetry and prime colours--a theorem.

Human colour vision is the result of a complex process involving topics ranging from physics of light to perception. Whereas the diversity of light entering the eye in principle span an infinite-dimensional vector space in terms of the spectral power distributions, the space of human colour perceptions is three dimensional. One important consequence of this is that a variety of colours can be visually matched by a mixture of only three adequately chosen reference lights. It has been observed that there exists one particular set of monochromatic reference lights that, according to a certain definition, is optimal for producing colour matches. These reference lights are commonly denoted prime colours. In the present paper, we intend to rigorously show that the existence of prime colours is not particular to the human visual system as sometimes stated, but rather an algebraic consequence of the manner in which a kind of colorimetric functions called colour-matching functions are defined and transformed. The solution is based on maximisation of a determinant determining the gamut size of the colour space spanned by the prime colours. Cramer's rule for solving a set of linear equations is an essential part of the proof. By means of examples, it is shown that mathematically the optimal set of reference lights is not unique in general, and that the existence of a maximum determinant is not a necessary condition for the existence of prime colours.