Augmented reality for the surgeon: Systematic review.

INTRODUCTION: Since the introduction of wearable head-up displays, there has been much interest in the surgical community adapting this technology into routine surgical practice. METHODS: We used the keywords augmented reality OR wearable device OR head-up display AND surgery using PubMed, EBSCO, IEEE and SCOPUS databases. After exclusions, 74 published articles that evaluated the utility of wearable head-up displays in surgical settings were included in our review. RESULTS: Across all studies, the most common use of head-up displays was in cases of live streaming from surgical microscopes, navigation, monitoring of vital signs, and display of preoperative images. The most commonly used head-up display was Google Glass. Head-up displays enhanced surgeons' operating experience; common disadvantages include limited battery life, display size and discomfort. CONCLUSIONS: Due to ergonomic issues with dual-screen devices, augmented reality devices with the capacity to overlay images onto the surgical field will be key features of next-generation surgical head-up displays.

Technical feasibility and safety of image-guided parieto-occipital ventricular catheter placement with the assistance of a wearable head-up display.

BACKGROUND: Wearable technology is growing in popularity as a result of its ability to interface with normal human movement and function. METHODS: Using proprietary hardware and software, neuronavigation images were captured and transferred wirelessly via a password-encrypted network to the head-up display. The operating surgeon wore a loupe-mounted wearable head-up display during image-guided parieto-occipital ventriculoperitoneal shunt placement in two patients. RESULTS: The shunt placement was completed successfully without complications. The tip of the catheter ended well within the ventricles away from the ventricular wall. The wearable device allowed for continuous monitoring of neuronavigation images in the right upper corner of the surgeon's visual field without the need for the surgeon to turn his head to view the monitors. CONCLUSIONS: The adaptable nature of this proposed system permits the display of video data to the operating surgeon without diverting attention away from the operative task. This technology has the potential to enhance image-guided procedures.

Technical feasibility and safety of an intraoperative head-up display device during spine instrumentation.

BACKGROUND: The primary aim of this study was to determine the safety and feasibility of capturing and streaming neuronavigation images onto a head-up display during spine instrumentation. METHODS: Using a novel device, neuronavigation images were captured and transferred wirelessly via a password-encrypted network to the head-up display. At the end of the procedure, the surgeons completed a survey to gather their opinions of the system. RESULTS: Forty pedicle screws were placed using the head-up display. The average screw placement time was slightly shorter when the head-up display was used (4.13 min with vs. 4.86 min without). The post-procedure survey demonstrated that 79% of surgeon's responses were positive. CONCLUSION: A wearable head-up display can benefit current neuronavigation systems, but larger, outcomes-based trials are needed. Higher processing speed would allow streaming of higher resolution images. Along with an enlarged display, these may significantly improve utilization of this technology. Copyright © 2016 John Wiley & Sons, Ltd.

Two-way communication with neural networks in vivo using focused light.

Neuronal networks process information in a distributed, spatially heterogeneous manner that transcends the layout of electrodes. In contrast, directed and steerable light offers the potential to engage specific cells on demand. We present a unified framework for adapting microscopes to use light for simultaneous in vivo stimulation and recording of cells at fine spatiotemporal resolutions. We use straightforward optics to lock onto networks in vivo, to steer light to activate circuit elements and to simultaneously record from other cells. We then actualize this 'free' augmentation on both an 'open' two-photon microscope and a leading commercial one. By following this protocol, setup of the system takes a few days, and the result is a noninvasive interface to brain dynamics based on directed light, at a network resolution that was not previously possible and which will further improve with the rapid advance in development of optical reporters and effectors. This protocol is for physiologists who are competent with computers and wish to extend hardware and software to interface more fluidly with neuronal networks.