A Method to Track 3D Knee Kinematics by Multi-Channel 3D-Tracked A-Mode Ultrasound.

This paper introduces a method for measuring 3D tibiofemoral kinematics using a multi-channel A-mode ultrasound system under dynamic conditions. The proposed system consists of a multi-channel A-mode ultrasound system integrated with a conventional motion capture system (i.e., optical tracking system). This approach allows for the non-invasive and non-radiative quantification of the tibiofemoral joint's six degrees of freedom (DOF). We demonstrated the feasibility and accuracy of this method in the cadaveric experiment. The knee joint's motions were mimicked by manually manipulating the leg through multiple motion cycles from flexion to extension. To measure it, six custom ultrasound holders, equipped with a total of 30 A-mode ultrasound transducers and 18 optical markers, were mounted on various anatomical regions of the lower extremity of the specimen. During experiments, 3D-tracked intra-cortical bone pins were inserted into the femur and tibia to measure the ground truth of tibiofemoral kinematics. The results were compared with the tibiofemoral kinematics derived from the proposed ultrasound system. The results showed an average rotational error of 1.51 ± 1.13° and a translational error of 3.14 ± 1.72 mm for the ultrasound-derived kinematics, compared to the ground truth. In conclusion, this multi-channel A-mode ultrasound system demonstrated a great potential of effectively measuring tibiofemoral kinematics during dynamic motions. Its improved accuracy, nature of non-invasiveness, and lack of radiation exposure make this method a promising alternative to incorporate into gait analysis and prosthetic kinematic measurements later.

State-of-the-Art of Non-Radiative, Non-Visual Spine Sensing with a Focus on Sensing Forces, Vibrations and Bioelectrical Properties: A Systematic Review.

In the research field of robotic spine surgery, there is a big upcoming momentum for surgeon-like autonomous behaviour and surgical accuracy in robotics which goes beyond the standard engineering notions such as geometric precision. The objective of this review is to present an overview of the state of the art in non-visual, non-radiative spine sensing for the enhancement of surgical techniques in robotic automation. It provides a vantage point that facilitates experimentation and guides new research projects to what has not been investigated or integrated in surgical robotics. Studies were identified, selected and processed according to the PRISMA guidelines. Relevant study characteristics that were searched for include the sensor type and measured feature, the surgical action, the tested sample, the method for data analysis and the system's accuracy of state identification. The 6DOF f/t sensor, the microphone and the electromyography probe were the most commonly used sensors in each category, respectively. The performance of the electromyography probe is unsatisfactory in terms of preventing nerve damage as it can only signal after the nerve is disturbed. Feature thresholding and artificial neural networks were the most common decision algorithms for state identification. The fusion of different sensor data in the decision algorithm improved the accuracy of state identification.

Robot-assisted ultrasound reconstruction for spine surgery: from bench-top to pre-clinical study.

PURPOSE: Robot-assisted ultrasound (rUS) systems have already been used to provide non-radiative three-dimensional (3D) reconstructions that form the basis for guiding spine surgical procedures. Despite promising studies on this technology, there are few studies that offer insight into the robustness and generality of the approach by verifying performance in various testing scenarios. Therefore, this study aims at providing an assessment of a rUS system, with technical details from experiments starting at the bench-top to the pre-clinical study. METHODS: A semi-automatic control strategy was proposed to ensure continuous and smooth robotic scanning. Next, a U-Net-based segmentation approach was developed to automatically process the anatomic features and derive a high-quality 3D US reconstruction. Experiments were conducted on synthetic phantoms and human cadavers to validate the proposed approach. RESULTS: Average deviations of scanning force were found to be 2.84±0.45 N on synthetic phantoms and to be 5.64±1.10 N on human cadavers. The anatomic features could be reliably reconstructed at mean accuracy of 1.28±0.87 mm for the synthetic phantoms and of 1.74±0.89 mm for the human cadavers. CONCLUSION: The results and experiments demonstrate the feasibility of the proposed system in a pre-clinical setting. This work is complementary to previous work, encouraging further exploration of the potential of this technology in in vivo studies.

An Augmented Reality-Based Interaction Scheme for Robotic Pedicle Screw Placement.

Robot-assisted surgery is becoming popular in the operation room (OR) for, e.g., orthopedic surgery (among other surgeries). However, robotic executions related to surgical steps cannot simply rely on preoperative plans. Using pedicle screw placement as an example, extra adjustments are needed to adapt to the intraoperative changes when the preoperative planning is outdated. During surgery, adjusting a surgical plan is non-trivial and typically rather complex since the available interfaces used in current robotic systems are not always intuitive to use. Recently, thanks to technical advancements in head-mounted displays (HMD), augmented reality (AR)-based medical applications are emerging in the OR. The rendered virtual objects can be overlapped with real-world physical objects to offer intuitive displays of the surgical sites and anatomy. Moreover, the potential of combining AR with robotics is even more promising; however, it has not been fully exploited. In this paper, an innovative AR-based robotic approach is proposed and its technical feasibility in simulated pedicle screw placement is demonstrated. An approach for spatial calibration between the robot and HoloLens 2 without using an external 3D tracking system is proposed. The developed system offers an intuitive AR-robot interaction approach between the surgeon and the surgical robot by projecting the current surgical plan to the surgeon for fine-tuning and transferring the updated surgical plan immediately back to the robot side for execution. A series of bench-top experiments were conducted to evaluate system accuracy and human-related errors. A mean calibration error of 3.61 mm was found. The overall target pose error was 3.05 mm in translation and 1.12∘ in orientation. The average execution time for defining a target entry point intraoperatively was 26.56 s. This work offers an intuitive AR-based robotic approach, which could facilitate robotic technology in the OR and boost synergy between AR and robots for other medical applications.

A Method Based on 3D Shape Analysis Towards the Design of Flexible Instruments for Endoscopic Maxillary Sinus Surgery.

The emergence of steerable flexible instruments has widened the uptake of minimally invasive surgical techniques. In sinus surgery, such flexible instruments could enable the access to difficult-to-reach anatomical areas. However, design-oriented metrics, essential for the development of steerable flexible instruments for maxillary sinus surgery, are still lacking. This paper proposes a method to process measurements and provides the instrument designer with essential information to develop adapted flexible instruments for limited access surgery. This method was applied to maxillary sinus surgery and showed that an instrument with a diameter smaller than 2.4 mm can be used on more than 72.5% of the subjects' set. Based on the statistical analysis and provided that this flexible instrument can bend up to [Formula: see text] it is estimated that all areas within the maxillary sinus could be reached through a regular antrostomy without resorting to extra incision or tissue removal in 94.9% of the population set. The presented method was partially validated by conducting cadaver experiments.

A Novel Ultrasound-Based Lower Extremity Motion Tracking System.

Tracking joint motion of the lower extremity is important for human motion analysis. In this study, we present a novel ultrasound-based motion tracking system for measuring three-dimensional (3D) position and orientation of the femur and tibia in 3D space and quantifying tibiofemoral kinematics under dynamic conditions. As ultrasound is capable of detecting underlying bone surface noninvasively through multiple layers of soft tissues, an integration of multiple A-mode ultrasound transducers with a conventional motion tracking system provides a new approach to track the motion of bone segments during dynamic conditions. To demonstrate the technical and clinical feasibilities of this concept, an in vivo experiment was conducted. For this purpose the kinematics of healthy individuals were determined in treadmill walking conditions and stair descending tasks. The results clearly demonstrated the potential of tracking skeletal motion of the lower extremity and measuring six-degrees-of-freedom (6-DOF) tibiofemoral kinematics and related kinematic alterations caused by a variety of gait parameters. It was concluded that this prototyping system has great potential to measure human kinematics in an ambulant, non-radiative, and noninvasive manner.

Feasibility of A-mode ultrasound based intraoperative registration in computer-aided orthopedic surgery: A simulation and experimental study.

PURPOSE: A fast and accurate intraoperative registration method is important for Computer-Aided Orthopedic Surgery (CAOS). A-mode ultrasound (US) is able to acquire bone surface data in a non-invasive manner. To utilize A-mode US in CAOS, a suitable registration algorithm is necessary with a small number of registration points and the presence of measurement errors. Therefore, we investigated the effects of (1) the number of registration points and (2) the Ultrasound Point Localization Error (UPLE) on the overall registration accuracy. METHODS: We proposed a new registration method (ICP-PS), including the Iterative Closest Points (ICP) algorithm and a Perturbation Search algorithm. This method enables to avoid getting stuck in the local minimum of ICP iterations and to find the adjacent global minimum. This registration method was subsequently validated in a numerical simulation and a cadaveric experiment using a 3D-tracked A-mode US system. RESULTS: The results showed that ICP-PS outperformed the standard ICP algorithm. The registration accuracy improved with the addition of ultrasound registration points. In the numerical simulation, for 25 sample points with zero UPLE, the averaged registration error of ICP-PS reached 0.25 mm, while 1.71 mm for ICP, decreasing by 85.38%. In the cadaver experiment, using 25 registration points, ICP-PS achieved an RMSE of 2.81 mm relative to 5.84 mm for the ICP, decreasing by 51.88%. CONCLUSIONS: The simulation approach provided a well-defined framework for estimating the necessary number of ultrasound registration points and acceptable level of UPLE for a given required level of accuracy for intraoperative registration in CAOS. ICP-PS method is suitable for A-mode US based intraoperative registration. This study would facilitate the application of A-mode US probe in registering the point cloud to a known shape model, which also has the potential for accurately estimating bone position and orientation for skeletal motion tracking and surgical navigation.

Measuring relative positions and orientations of the tibia with respect to the femur using one-channel 3D-tracked A-mode ultrasound tracking system: A cadaveric study.

The purpose of this study is to investigate the technical feasibility of measuring relative positions and orientations of the tibia with respect to the femur in an in-vitro experiment by using a 3D-tracked A-mode ultrasound system and to determine its accuracy of angular and translational measurements. As A-mode ultrasound is capable of detecting bone surface through soft tissue in a non-invasive manner, the combination of a single A-mode ultrasound transducer with an optical motion tracking system provides the possibility for digitizing the 3D locations of bony points at different anatomical regions on the thigh and the shank. After measuring bony points over a large area of both the femur and tibia, the bone models of the femur and tibia that were segmented from CT or MRI images were registered to the corresponding bony points. Then the relative position of the tibia with respect to the femur could be obtained and the angular and translational components could also be measured. A cadaveric experiment was conducted to assess its accuracy compared to the reference measurement obtained by optical markers fixed to intra-cortical bone pins placed in the femur and tibia. The results showed that the ultrasound system could achieve 0.49 ±â€¯0.83°, 0.85 ±â€¯1.86° and 1.85 ±â€¯2.78° (mean ±â€¯standard deviation) errors for Flexion-Extension, Adduction-Abduction and External-Internal rotations, respectively, and -2.22 ±â€¯3.62 mm, -2.80 ±â€¯2.35 mm and -1.44 ±â€¯2.90 mm errors for Anterior-Posterior, Proximal-Distal and Lateral-Medial translations, respectively. It was concluded that this technique is feasible and facilitates the integration of arrays of A-mode ultrasound transducers with an optical motion tracking system for non-invasive dynamic tibiofemoral kinematics measurement.

In situ comparison of A-mode ultrasound tracking system and skin-mounted markers for measuring kinematics of the lower extremity.

Skin-mounted marker based motion capture systems are widely used in measuring the movement of human joints. Kinematic measurements associated with skin-mounted markers are subject to soft tissue artifacts (STA), since the markers follow skin movement, thus generating errors when used to represent motions of underlying bone segments. We present a novel ultrasound tracking system that is capable of directly measuring tibial and femoral bone surfaces during dynamic motions, and subsequently measuring six-degree-of-freedom (6-DOF) tibiofemoral kinematics. The aim of this study is to quantitatively compare the accuracy of tibiofemoral kinematics estimated by the ultrasound tracking system and by a conventional skin-mounted marker based motion capture system in a cadaveric experimental scenario. Two typical tibiofemoral joint models (spherical and hinge models) were used to derive relevant kinematic outcomes. Intra-cortical bone pins equipped with optical markers were inserted in the tibial and femoral bones to serve as a reference to provide ground truth kinematics. The ultrasound tracking system resulted in lower kinematic errors than the skin-mounted markers (the ultrasound tracking system: maximum root-mean-square (RMS) error 3.44° for rotations and 4.88 mm for translations, skin-mounted markers with the spherical joint model: 6.32° and 6.26 mm, the hinge model: 6.38° and 6.52 mm). Our proposed ultrasound tracking system has the potential of measuring direct bone kinematics, thereby mitigating the influence and propagation of STA. Consequently, this technique could be considered as an alternative method for measuring 6-DOF tibiofemoral kinematics, which may be adopted in gait analysis and clinical practice.