Application of extended reality technology for real-time navigation in clinical operation / 南方医科大学学报

ABSTRACT

OBJECTIVE@#To explore the application of extended reality (XR) technology in clinical surgeries for improving the success rate of surgeries.@*METHODS@#To assist the surgeons to better understand the location, size and geometric shape of the lesions and reduce potential radiation exposure in minimally invasive surgical navigation based on two-dimensional images, we constructed three-dimensional models based on CT data and used XR technology to achieve intraoperative navigation. An improved quaternion method was used to improve the accuracy of electromagnetic positioning, with which the system error of positioning accuracy was reduced to below 2 mm. A 5G network was used to optimize the server GPU programming algorithm, and real-time video stream coding strategy and network design were adopted to reduce data transmission jam and delay in the remote surgery network, which achieved an average delay of less than 60 ms. A Gaussian distribution deformation model was used to simulate collision detection and stress deformation of the tissues to achieve a tactile perception effect.@*RESULTS AND CONCLUSION@#The intraoperative navigation system based on XR technology allowed more accurate determination of the location of the lesions, effectively reduced the surgical risk, and avoided the risk of intraoperative radiation exposure. The low latency and high fidelity of 5G network achieved real-time interaction during the surgery to provide a technical basis for multi-terminal remote cooperative surgery. The combination of force feedback technology and XR technology enables the surgeons to conduct deep immersion preoperative planning and virtual surgery to improve the success rate of surgery and shorten the learning curve.