Three-dimensional display technologies.

The physical world around us is three-dimensional (3D), yet traditional display devices can show only two-dimensional (2D) flat images that lack depth (i.e., the third dimension) information. This fundamental restriction greatly limits our ability to perceive and to understand the complexity of real-world objects. Nearly 50% of the capability of the human brain is devoted to processing visual information [Human Anatomy & Physiology (Pearson, 2012)]. Flat images and 2D displays do not harness the brain's power effectively. With rapid advances in the electronics, optics, laser, and photonics fields, true 3D display technologies are making their way into the marketplace. 3D movies, 3D TV, 3D mobile devices, and 3D games have increasingly demanded true 3D display with no eyeglasses (autostereoscopic). Therefore, it would be very beneficial to readers of this journal to have a systematic review of state-of-the-art 3D display technologies.

Tracking multiple visual targets via particle-based belief propagation.

Multiple-target tracking in video (MTTV) presents a technical challenge in video surveillance applications. In this paper, we formulate the MTTV problem using dynamic Markov network (DMN) techniques. Our model consists of three coupled Markov random fields: 1) a field for the joint state of the multitarget; 2) a binary random process for the existence of each individual target; and 3) a binary random process for the occlusion of each dual adjacent target. To make the inference tractable, we introduce two robust functions that eliminate the two binary processes. We then propose a novel belief propagation (BP) algorithm called particle-based BP and embed it into a Markov chain Monte Carlo approach to obtain the maximum a posteriori estimation in the DMN. With a stratified sampler, we incorporate the information obtained from a learned bottom-up detector (e.g., support-vector-machine-based classifier) and the motion model of the target into the message propagation. Other low-level visual cues such as motion and shape can be easily incorporated into our framework to obtain better tracking results. We have performed extensive experimental verification, and the results suggest that our method is comparable to the state-of-art multitarget tracking methods in all the cases we tested.

Real-time 3D-surface-guided head refixation useful for fractionated stereotactic radiotherapy.

Accurate and precise head refixation in fractionated stereotactic radiotherapy has been achieved through alignment of real-time 3D-surface images with a reference surface image. The reference surface image is either a 3D optical surface image taken at simulation with the desired treatment position, or a CT/MRI-surface rendering in the treatment plan with corrections for patient motion during CT/MRI scans and partial volume effects. The real-time 3D surface images are rapidly captured by using a 3D video camera mounted on the ceiling of the treatment vault. Any facial expression such as mouth opening that affects surface shape and location can be avoided using a new facial monitoring technique. The image artifacts on the real-time surface can generally be removed by setting a threshold of jumps at the neighboring points while preserving detailed features of the surface of interest. Such a real-time surface image, registered in the treatment machine coordinate system, provides a reliable representation of the patient head position during the treatment. A fast automatic alignment between the real-time surface and the reference surface using a modified iterative-closest-point method leads to an efficient and robust surface-guided target refixation. Experimental and clinical results demonstrate the excellent efficacy of <2 min set-up time, the desired accuracy and precision of <1 mm in isocenter shifts, and <1 degree in rotation.

Breast deformation modelling for image reconstruction in near infrared optical tomography.

Near infrared tomography (NIR) is a novel imaging technique that can be used to reconstruct tissue optical properties from measurements of light propagation through tissue. More specifically NIR measurements over a range of wavelengths can be used to obtain internal images of physiologic parameters and these images can be used to detect and characterize breast tumour. To obtain good NIR measurements, it is essential to have good contact between the optical fibres and the breast which in-turn results in the deformation of the breast due to the soft plasticity of the tissue. In this work, a tissue deformation model of the female breast is presented that will account for the altered shape of the breast during clinical NIR measurements. Using a deformed model of a breast, simulated NIR data were generated and used to reconstruct images of tissue absorption and reduced scatter using several assumptions about the imaging domain. Using either a circular or irregular 2D geometry for image reconstruction produces good localization of the absorbing anomaly, but it leads to degradation of the image quality. By modifying the assumptions about the imaging domain to a 3D conical model, with the correct diameter at the plane of NIR measurement, significantly improves the quality of reconstructed images and helps reduce image artefacts. Finally, assuming a non-deformed breast shape for image reconstruction is shown to lead to poor quality images since the geometry of the breast is greatly altered, whereas using the correct deformed geometry produces the best images.

A real-time image-guided intraoperative high-dose-rate brachytherapy system.

PURPOSE: To develop a real-time, image-guided intraoperative high-dose-rate brachytherapy system. METHODS AND MATERIALS: The surface applicator, a catheter array on a 1-mm-thick soft and semitransparent silicone rubber sheet, was directly sutured on the surgical bed. A three-dimensional video camera was then used to instantly capture images of the catheters and the surgical surface. Tracing the catheters on the images allowed us to automatically determine the dwell source positions. Dwell times in the dwell positions were optimized to minimize the dose variation and deviation from the treatment prescription. A dose-texture plot was created to quantify the dose distribution. RESULTS: Treatment planning time was reduced from hours to a few minutes. Phantom tests have shown that the new source localization is accurate with sigma<1.5 mm. All hot spots and cold spots had been eliminated after the dwell-time optimization. CONCLUSIONS: This real-time, image-guided planning system can provide optimal image-guided intraoperative high-dose-rate brachytherapy with geometric and dosimetric improvements and a short planning time.

Clinical applications of three-dimensional photography in breast surgery.

Three-dimensional imaging in breast surgery has several uses clinically. The most practical applications are for the evaluation of breast asymmetries, both congenital and acquired, and for the evaluation of factors affecting breast shape in augmentation mammaplasty. Other uses of three-dimensional imaging that we have found clinically helpful are for evaluation of patients desiring reduction mammaplasty and for evaluation of patients undergoing unilateral breast reconstruction to determine the expander and permanent implant size that gives the best symmetry with the contralateral breast. We present five cases in which we investigate the use of three-dimensional imaging clinically by using the images to determine quantitative information about the breast, such as volume or projection. Overall, three-dimensional imaging is very helpful in providing objective information about the breast for use in preoperative planning. In addition, by analyzing clinical cases, it can provide objective data about the breast and surgical mammaplasty (especially augmentation mammaplasty) that may help surgeons better understand those factors that contribute to breast shape and influence surgical outcomes. There are currently some limitations of this system, influenced by patients with significant ptosis or obesity, which may introduce errors into the three-dimensional data, making them unreliable. However, we believe three-dimensional imaging has great clinical potential in surgical mammaplasty.