Application of mixed reality technique for the surgery of oral and maxillofacial tumors / 北京大学学报(医学版)

OBJECTIVE@#To explore the application of mixed reality technique for the surgery of oral and maxillofacial tumors.@*METHODS@#In this study, patients with a diagnosis of an oral and maxillofacial tumor who were referred to Department of Oral and Maxillofacial Surgery, Peking University School and Hospital of Stomatology from December 2018 to January 2020 were selected. The preoperative contrast-enhanced computed tomography data of the patients were imported into StarAtlas Holographic Medical Imaging System (Visual 3D Corp., Beijing, China). Three-dimensional (3D) model of tumor and key structures, such as skeleton and vessels were reconstructed to three-dimensionally present the spatial relationship between them, followed with the key structures delineation and preoperative virtual surgical planning. By using mixed reality technique, the real-time 3D model was displayed stereotactically in the surgical site. While keeping sterile during operation, the surgeon could use simple gestures to adjust the 3D model, and observed the location, range, and size of tumor and the key structures adjacent to the tumor. Mixed reality technique was used to assist the operation: 3D model registration was performed for guidance before tumor excision; intraoperative real-time verification was performed during tumor exposure and after excision of the tumor. The Likert scale was used to evaluate the application of mixed reality technique after the operation.@*RESULTS@#Eight patients underwent mixed reality assisted tumor resection, and all of them successfully completed the operation. The average time of the 3D model registration was 12.0 minutes. In all the cases, the surgeon could intuitively and three-dimensionally observe the 3D model of the tumor and the surrounding anatomical structures, and could adjust the model during the operation. The results of the Likert scale showed that mixed reality technique got high scores in terms of perceptual accuracy, helping to locate the anatomical parts, the role of model guidance during surgery, and the potential for improving surgical safety (4.22, 4.19, 4.16, and 4.28 points respectively). Eight patients healed well without perioperative complications.@*CONCLUSION@#By providing real-time stereotactic visualization of anatomy of surgical site and guiding the operation process through 3D model, mixed reality technique could improve the accuracy and safety of the excision of oral and maxillofacial tumors.

Application and exploration of mixed reality technology in accurate operation of percutaneous vertebroplasty of spine / 上海交通大学学报（医学版）

Objective • To explore the application and clinical significance of mixed reality technology in percutaneous vertebroplasty of spine. Methods • A 79-year-old female patient with multiple osteoporotic compression fractures was selected in Department of Orthopedics, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine. Lumbar 64-row CT scan was performed to obtain digital imaging and communications in medicine (DICOM) data. Three-dimensional reconstruction software was imported to construct the model of spinal compression fracture. Visual edge detection, segmentation, extraction and calculation of spinal skeleton were performed to generate a three-dimensional network. Collateral model, by mixed reality smartglasses,three-dimensional image of the compression spine image was compared to the real world. Mixed reality technology could assist the surgeon to complete the preoperative simulation, communicate effectively with the patient, and guide percutaneous vertebroplasty of lumber. Results • With mixed reality, the puncture was accurate. The distribution of bone cement was good. The pain of patients was relieved obviously after operation. By mixed reality, the operation time was shortened and the side-effects were reduced. Based on reconstruction of mixed reality technology from original CT imaging data, the compression fracture and anatomical structure were visualized clearly during operation. The operation path was clear and the compression fracture forming site was accurately located. Conclusion •Mixed reality technology is helpful for accurate puncture in percutaneous vertebroplasty of spine, and has potential for development in minimally invasive treatment of spine.