Can Mixed-Reality Improve the Training of Medical Procedures?

One cause of preventable death is a lack of proper skills for providing critical care. The conventional course taught to non-medical individuals involves instructions of advanced emergency procedures routinely limited to a verbal block of instructions in a standardized presentation (for example, an instructional video).In the present study, we evaluate the benefits of using an OST-HMD for training of caregivers in an emergency medical environment. A rich user interface was implemented that provides 3D visual aids including images, text and tracked 3D overlays corresponding to each task that needs to be performed. A user study with 20 participants is conducted which involves training of two tasks where each subject performs one task with the HMD and the other with standard training. Two evaluations were performed, with the first immediately after the training followed by a second one three weeks later. Our results indicate that using a mixed reality HMD is more engaging, improves the time-on-task, and increases the confidence level of users in providing emergency and critical care.

Using augmented reality as a clinical support tool to assist combat medics in the treatment of tension pneumothoraces.

This study was to extrapolate potential roles of augmented reality goggles as a clinical support tool assisting in the reduction of preventable causes of death on the battlefield. Our pilot study was designed to improve medic performance in accurately placing a large bore catheter to release tension pneumothorax (prehospital setting) while using augmented reality goggles. Thirty-four preclinical medical students recruited from Morehouse School of Medicine performed needle decompressions on human cadaver models after hearing a brief training lecture on tension pneumothorax management. Clinical vignettes identifying cadavers as having life-threatening tension pneumothoraces as a consequence of improvised explosive device attacks were used. Study group (n = 13) performed needle decompression using augmented reality goggles whereas the control group (n = 21) relied solely on memory from the lecture. The two groups were compared according to their ability to accurately complete the steps required to decompress a tension pneumothorax. The medical students using augmented reality goggle support were able to treat the tension pneumothorax on the human cadaver models more accurately than the students relying on their memory (p < 0.008). Although the augmented reality group required more time to complete the needle decompression intervention (p = 0.0684), this did not reach statistical significance.

Surgical navigation with a head-mounted tracking system and display.

We present the design of a self-contained head-mounted surgical navigation system, which consists of an optical tracking system and an optical see-through head-mounted display (HMD). While the current prototype is bulky, we envision a more compact solution via the eventual integration of the tracking camera(s) into the HMD goggles. Rather than attempting to accurately overlay preoperative models onto the field of view, we adopted a simpler approach of displaying a small "picture-in-picture" virtual view in the HMD. We believe this approach will provide suitable assistance for some image-guided procedures, such as tumor resection, while improving the ergonomics by reducing the need for the surgeon to look away from the patient to view an external monitor. We report the results of initial experiments performed with this system, while preparing for a more clinically realistic study.