Diffraction-engineered holography: Beyond the depth representation limit of holographic displays.

Holography is one of the most prominent approaches to realize true-to-life reconstructions of objects. However, owing to the limited resolution of spatial light modulators compared to static holograms, reconstructed objects exhibit various coherent properties, such as content-dependent defocus blur and interference-induced noise. The coherent properties severely distort depth perception, the core of holographic displays to realize 3D scenes beyond 2D displays. Here, we propose a hologram that imitates defocus blur of incoherent light by engineering diffracted pattern of coherent light with adopting multi-plane holography, thereby offering real world-like defocus blur and photorealistic reconstruction. The proposed hologram is synthesized by optimizing a wave field to reconstruct numerous varifocal images after propagating the corresponding focal distances where the varifocal images are rendered using a physically-based renderer. Moreover, to reduce the computational costs associated with rendering and optimizing, we also demonstrate a network-based synthetic method that requires only an RGB-D image.

Actuating compact wearable augmented reality devices by multifunctional artificial muscle.

An artificial muscle actuator resolves practical engineering problems in compact wearable devices, which are limited to conventional actuators such as electromagnetic actuators. Abstracting the fundamental advantages of an artificial muscle actuator provides a small-scale, high-power actuating system with a sensing capability for developing varifocal augmented reality glasses and naturally fit haptic gloves. Here, we design a shape memory alloy-based lightweight and high-power artificial muscle actuator, the so-called compliant amplified shape memory alloy actuator. Despite its light weight (0.22 g), the actuator has a high power density of 1.7 kW/kg, an actuation strain of 300% under 80 g of external payload. We show how the actuator enables image depth control and an immersive tactile response in the form of augmented reality glasses and two-way communication haptic gloves whose thin form factor and high power density can hardly be achieved by conventional actuators.

Learning-based compensation of spatially varying aberrations for holographic display [Invited].

We propose a hologram generation technique to compensate for spatially varying aberrations of holographic displays through machine learning. The image quality of the holographic display is severely degraded when there exist optical aberrations due to misalignment of optical elements or off-axis projection. One of the main advantages of holographic display is that aberrations can be compensated for without additional optical elements. Conventionally, computer-generated holograms for compensation are synthesized through a point-wise integration method, which requires large computational loads. Here, we propose to replace the integration with a combination of fast-Fourier-transform-based convolutions and forward computation of a deep neural network. The point-wise integration method took approximately 95.14 s to generate a hologram of 1024×1024pixels, while the proposed method took about 0.13 s, which corresponds to ×732 computation speed improvement. Furthermore, the aberration compensation by the proposed method is verified through experiments.

Aberration-corrected full-color holographic augmented reality near-eye display using a Pancharatnam-Berry phase lens.

We present a full-color holographic augmented reality near-eye display using a Pancharatnam-Berry phase lens (PBP lens) and its aberration correction method. Monochromatic and chromatic aberrations of the PBP lens are corrected by utilizing complex wavefront modulation of the holographic display. A hologram calculation method incorporating the phase profile of the PBP lens is proposed to correct the monochromatic aberration. Moreover, the chromatic aberration is corrected by warping the image using the mapping function obtained from ray tracing. The proposed system is demonstrated with the benchtop prototype, and the experimental results show that the proposed system offers 50° field of view full-color holographic images without optical aberrations.

Foveated display system based on a doublet geometric phase lens.

We propose a new concept of a foveated display with a single display module. A multi-resolution and wide field of view (FOV) can be simultaneously achieved using only a single display, based on temporal polarization-multiplexing. The polarization-dependent lens set functions as an optical window or beam expander system depending on the polarization state, which can provide two operating modes: fovea mode for a high-resolution and peripheral mode for a wide viewing angle. By superimposing two-mode images, the proposed system supports a foveated and wide FOV image without an ultra-high-resolution display. We demonstrate the feasibility of the proposed configuration through the proof-of-concept system.

Augmented reality near-eye display using Pancharatnam-Berry phase lenses.

An augmented reality (AR) near-eye display using Pancharatnam-Berry (PB) phase lenses is proposed. PB phase lenses provide different optical effects depending on the polarization state of the incident light. By exploiting this characteristic, it is possible to manufacture an AR combiner with a small form factor and a large numerical aperture value. The AR combiner adopted in the proposed system operates as a convex lens for right-handed circularly polarized light and operates as transparent glass for left-handed circularly polarized light. By merging this combiner with a transparent screen, such as diffuser-holographic optical elements (DHOEs), it is possible to make an AR near-eye display with a small form factor and a wide field of view. In addition, the proposed AR system compensates the chromatic aberration that occurs in PB phase lens by adopting three-layered DHOEs. The operating principle of the proposed system is covered, and its feasibility is verified with experiments and analysis.

Dual-focal waveguide see-through near-eye display with polarization-dependent lenses.

A waveguide near-eye display (NED) with a dual-focal plane using a polarization-dependent lens device is proposed. The novel optical device is composed of a geometric phase holographic lens, a wave plate, and a circular polarizer, which is operating as a concave lens or a see-through optical window, depending on the polarization state of the input beam. Such property and ultra-thinness of about 1.5 mm can be applied to a combiner-eyepiece lens for augmented reality. This optical device attached to the waveguide provides two depth planes with polarization multiplexing. We have demonstrated that our proof-of-concept system has image planes at infinity and 20 diopters. The devised system can be expected to offer a better immersive experience, compared to a NED system with a single-focal plane.

Printed cylindrical lens pair for application to the seam concealment in tiled displays.

Seamless tiling of displays is one of the key enabling technologies for the next-generation large-area electronics applications. In this paper, we propose a facile method to demonstrate a seamless display using cylindrical lens pair (CLP) fabricated by dispenser printing method. Optical properties of the printed CLP and corresponding capability of concealing seam in the display are analyzed by a set of luminance simulation and measurement in terms of geometric parameters of the lens. The seamless display with an optimized CLP features a viewing angle of the seam concealment of 40°.

See-through optical combiner for augmented reality head-mounted display: index-matched anisotropic crystal lens.

A novel see-through optical device to combine the real world and the virtual image is proposed which is called an index-matched anisotropic crystal lens (IMACL). The convex lens made of anisotropic crystal is enveloped with the isotropic material having same refractive index with the extraordinary refractive index of the anisotropic crystal. This optical device functions as the transparent glass or lens according to the polarization state of the incident light. With the novel optical property, IMACL can be utilized in the see-through near eye display, or head-mounted display for augmented reality. The optical property of the proposed optical device is analyzed and aberration by the anisotropic property of the index-matched anisotropic crystal lens is described with the simulation. The concept of the head-mounted display using IMACL is introduced and various optical performances such as field of view, form factor and transmittance are analyzed. The prototype is implemented to verify the proposed system and experimental results show the mixture between the virtual image and real world scene.

Compact three-dimensional head-mounted display system with Savart plate.

We propose three-dimensional (3D) head-mounted display (HMD) providing multi-focal and wearable functions by using polarization-dependent optical path switching in Savart plate. The multi-focal function is implemented as micro display with high pixel density of 1666 pixels per inches is optically duplicated in longitudinal direction according to the polarization state. The combination of micro display, fast switching polarization rotator and Savart plate retains small form factor suitable for wearable function. The optical aberrations of duplicated panels are investigated by ray tracing according to both wavelength and polarization state. Astigmatism and lateral chromatic aberration of extraordinary wave are compensated by modification of the Savart plate and sub-pixel shifting method, respectively. To verify the feasibility of the proposed system, a prototype of the HMD module for monocular eye is implemented. The module has the compact size of 40 mm by 90 mm by 40 mm and the weight of 131 g with wearable function. The micro display and polarization rotator are synchronized in real-time as 30 Hz and two focal planes are formed at 640 and 900 mm away from eye box, respectively. In experiments, the prototype also provides augmented reality function by combining the optically duplicated panels with a beam splitter. The multi-focal function of the optically duplicated panels without astigmatism and color dispersion compensation is verified. When light field optimization for two additive layers is performed, perspective images are observed, and the integration of real world scene and high quality 3D images is confirmed.

See-through multi-projection three-dimensional display using transparent anisotropic diffuser.

We propose a see-through multi-projection three-dimensional (3D) display using a transparent anisotropic diffuser. By immersing a metal-coated anisotropic diffuser into index matching oil which has the same refractive index of anisotropic diffuser, a transparent anisotropic diffuser is implemented. The reflectance of the transparent anisotropic diffuser is analyzed with the transfer matrix. Two multi-projection methods are proposed based on reflection type integral imaging and multi-view method. Especially, the reflection type multi-view-based system is realized with a curved anisotropic diffuser. High resolution see-through 3D display can be realized with the proposed methods. They can be used in various applications with the two multi-projection methods. In order to show the augmented reality features, real objects and virtual 3D images are presented at the same time in the experimental setup.

F-number matching method in light field microscopy using an elastic micro lens array.

In light field microscopy (LFM), the F-number of the micro lens array (MLA) should be matched with the image-side F-number of the objective lens to utilize full resolution of an image sensor. We propose a new F-number matching method that can be applied to multiple objective lenses by using an elastic MLA. We fabricate an elastic MLA with polydimethylsiloxane (PDMS) using a micro contact printing method and address the strain for the F-number variation. The strain response is analyzed, and the LFM system with the elastic MLA is demonstrated. Our proposed system can increase the F-number up to 27.3% and can be applied to multiple objective lenses.

Viewing zone duplication of multi-projection 3D display system using uniaxial crystal.

We propose a novel multiplexing technique for increasing the viewing zone of a multi-view based multi-projection 3D display system by employing double refraction in uniaxial crystal. When linearly polarized images from projector pass through the uniaxial crystal, two possible optical paths exist according to the polarization states of image. Therefore, the optical paths of the image could be changed, and the viewing zone is shifted in a lateral direction. The polarization modulation of the image from a single projection unit enables us to generate two viewing zones at different positions. For realizing full-color images at each viewing zone, a polarization-based temporal multiplexing technique is adopted with a conventional polarization switching device of liquid crystal (LC) display. Through experiments, a prototype of a ten-view multi-projection 3D display system presenting full-colored view images is implemented by combining five laser scanning projectors, an optically clear calcite (CaCO3) crystal, and an LC polarization rotator. For each time sequence of temporal multiplexing, the luminance distribution of the proposed system is measured and analyzed.

Computational multi-projection display.

A computational multi-projection display is proposed by employing a multi-projection system combining with compressive light field displays. By modulating the intensity of light rays from a spatial light modulator inside a single projector, the proposed system can offer several compact views to observer. Since light rays are spread to all directions, the system can provide flexible positioning of viewpoints without stacking projectors in vertical direction. Also, if the system is constructed properly, it is possible to generate view images with inter-pupillary gap and satisfy the super multi-view condition. We explain the principle of the proposed system and verify its feasibility with simulations and experimental results.

Recent progress in see-through three-dimensional displays using holographic optical elements [Invited].

The principles and characteristics of see-through 3D displays are presented. We especially focus on the integral-imaging display system using a holographic optical element (IDHOE), which is able to display 3D images and satisfy the see-through property at the same time. The technique has the advantage of the high transparency and capability of displaying autostereoscopic 3D images. We have analyzed optical properties of IDHOE for both recording and displaying stages. Furthermore, various studies of new applications and system improvements for IDHOE are introduced. Thanks to the characteristics of holographic volume grating, it is possible to implement a full-color lens-array holographic optical element and conjugated reconstruction as well as 2D/3D convertible IDHOE. Studies on the improvements of viewing characteristics including a viewing angle, fill factor, and resolution are also presented. Lastly, essential issues and their possible solutions are discussed as future work.

Compact multi-projection 3D display system with light-guide projection.

We propose a compact multi-projection based multi-view 3D display system using an optical light-guide, and perform an analysis of the characteristics of the image for distortion compensation via an optically equivalent model of the light-guide. The projected image traveling through the light-guide experiences multiple total internal reflections at the interface. As a result, the projection distance in the horizontal direction is effectively reduced to the thickness of the light-guide, and the projection part of the multi-projection based multi-view 3D display system is minimized. In addition, we deduce an equivalent model of such a light-guide to simplify the analysis of the image distortion in the light-guide. From the equivalent model, the focus of the image is adjusted, and pre-distorted images for each projection unit are calculated by two-step image rectification in air and the material. The distortion-compensated view images are represented on the exit surface of the light-guide when the light-guide is located in the intended position. Viewing zones are generated by combining the light-guide projection system, a vertical diffuser, and a Fresnel lens. The feasibility of the proposed method is experimentally verified and a ten-view 3D display system with a minimized structure is implemented.

Real-mode depth-fused display with viewer tracking.

A real-mode depth-fused display is proposed by employing an integral imaging method in the depth-fused display system with viewer tracking. By giving depth-fusing effect between a transparent display and a floated planar two-dimensional image generated by the real-mode integral imaging method, a three-dimensional image is generated in front of the display plane unlike conventional depth-fused displays. The viewing angle of the system is expanded with a viewer tracking method. In addition, dynamic vertical and horizontal motion parallax can be given according to the tracked position of the viewer. As the depth-fusing effect is not dependent on the viewing distance, accommodation cue and motion parallax are provided for a wide range of viewing position. We demonstrate the feasibility of our proposed method by experimental system.

Real-time depth controllable integral imaging pickup and reconstruction method with a light field camera.

In this paper, we develop a real-time depth controllable integral imaging system. With a high-frame-rate camera and a focus controllable lens, light fields from various depth ranges can be captured. According to the image plane of the light field camera, the objects in virtual and real space are recorded simultaneously. The captured light field information is converted to the elemental image in real time without pseudoscopic problems. In addition, we derive characteristics and limitations of the light field camera as a 3D broadcasting capturing device with precise geometry optics. With further analysis, the implemented system provides more accurate light fields than existing devices without depth distortion. We adapt an f-number matching method at the capture and display stage to record a more exact light field and solve depth distortion, respectively. The algorithm allows the users to adjust the pixel mapping structure of the reconstructed 3D image in real time. The proposed method presents a possibility of a handheld real-time 3D broadcasting system in a cheaper and more applicable way as compared to the previous methods.

Projection-type dual-view three-dimensional display system based on integral imaging.

A dual-view display system provides two different images in different directions. Most of them only present two-dimensional images for observers. In this paper, we propose a projection-type dual-view three-dimensional (3D) display system based on integral imaging. To assign directivities to the images, a projection-type display and dual-view screen with lenticular lenses are implemented. The lenticular lenses split the collimated image from the projection device into two different directions. The separated images are integrated by a single lens array in front of the screen, and full-parallax 3D images are observed in two different viewing regions. The visibility of the reconstructed 3D images can be improved by using high-density lenticular lenses and a high numerical aperture lens array. We explain the principle of the proposed method and verify the feasibility of the proposed system with simulations and experimental results.