Automatic assessment of laparoscopic surgical skill competence based on motion metrics.

The purpose of this study was to characterize the motion features of surgical devices associated with laparoscopic surgical competency and build an automatic skill-credential system in porcine cadaver organ simulation training. Participants performed tissue dissection around the aorta, dividing vascular pedicles after applying Hem-o-lok (tissue dissection task) and parenchymal closure of the kidney (suturing task). Movements of surgical devices were tracked by a motion capture (Mocap) system, and Mocap-metrics were compared according to the level of surgical experience (experts: ≥50 laparoscopic surgeries, intermediates: 10-49, novices: 0-9), using the Kruskal-Wallis test and principal component analysis (PCA). Three machine-learning algorithms: support vector machine (SVM), PCA-SVM, and gradient boosting decision tree (GBDT), were utilized for discrimination of the surgical experience level. The accuracy of each model was evaluated by nested and repeated k-fold cross-validation. A total of 32 experts, 18 intermediates, and 20 novices participated in the present study. PCA revealed that efficiency-related metrics (e.g., path length) significantly contributed to PC 1 in both tasks. Regarding PC 2, speed-related metrics (e.g., velocity, acceleration, jerk) of right-hand devices largely contributed to the tissue dissection task, while those of left-hand devices did in the suturing task. Regarding the three-group discrimination, in the tissue dissection task, the GBDT method was superior to the other methods (median accuracy: 68.6%). In the suturing task, SVM and PCA-SVM methods were superior to the GBDT method (57.4 and 58.4%, respectively). Regarding the two-group discrimination (experts vs. intermediates/novices), the GBDT method resulted in a median accuracy of 72.9% in the tissue dissection task, and, in the suturing task, the PCA-SVM method resulted in a median accuracy of 69.2%. Overall, the mocap-based credential system using machine-learning classifiers provides a correct judgment rate of around 70% (two-group discrimination). Together with motion analysis and wet-lab training, simulation training could be a practical method for objectively assessing the surgical competence of trainees.

Objective evaluation of laparoscopic surgical skills in wet lab training based on motion analysis and machine learning.

BACKGROUND: Our aim was to build a skill assessment system, providing objective feedback to trainees based on the motion metrics of laparoscopic surgical instruments. METHODS: Participants performed tissue dissection around the aorta (tissue dissection task) and renal parenchymal closure (parenchymal-suturing task), using swine organs in a box trainer under a motion capture (Mocap) system. Two experts assessed the recorded movies, according to the formula of global operative assessment of laparoscopic skills (GOALS: score range, 5-25), and the mean scores were utilized as objective variables in the regression analyses. The correlations between mean GOALS scores and Mocap metrics were evaluated, and potential Mocap metrics with a Spearman's rank correlation coefficient value exceeding 0.4 were selected for each GOALS item estimation. Four regression algorithms, support vector regression (SVR), principal component analysis (PCA)-SVR, ridge regression, and partial least squares regression, were utilized for automatic GOALS estimation. Model validation was conducted by nested and repeated k-fold cross validation, and the mean absolute error (MAE) was calculated to evaluate the accuracy of each regression model. RESULTS: Forty-five urologic, 9 gastroenterological, and 3 gynecologic surgeons, 4 junior residents, and 9 medical students participated in the training. In both tasks, a positive correlation was observed between the speed-related parameters (e.g., velocity, velocity range, acceleration, jerk) and mean GOALS scores, with a negative correlation between the efficiency-related parameters (e.g., task time, path length, number of opening/closing operations) and mean GOALS scores. Among the 4 algorithms, SVR showed the highest accuracy in the tissue dissection task ([Formula: see text]), and PCA-SVR in the parenchymal-suturing task ([Formula: see text]), based on 100 iterations of the validation process of automatic GOALS estimation. CONCLUSION: We developed a machine learning-based GOALS scoring system in wet lab training, with an error of approximately 1-2 points for the total score, and motion metrics that were explainable to trainees. Our future challenges are the further improvement of onsite GOALS feedback, exploring the educational benefit of our model and building an efficient training program.

Effects of simulated peripheral visual field loss on the static postural control in young healthy adults.

BACKGROUND: Integration of visual, vestibular, and proprioceptive sensations contributes to postural control. People with peripheral visual field loss have serious postural instability. However, the directional specificity of postural stability and sensory reweighting caused by gradual peripheral visual field loss remain unclear. RESEARCH QUESTION: What are the effects of peripheral visual field loss on static postural control? METHODS: Fifteen healthy young adults participated in this study. The participants were asked to stand quietly on a foam surface. Three conditions of virtual visual field loss (90°, 45°, and 15°) were provided by a head-mounted display, and ground reaction forces were collected using a force plate to calculate the displacements of the center of pressure (COP). RESULTS: The root mean square (RMS), mean velocity, and 95% ellipse area of COP displacements in the horizontal plane increased, and RMS in the anteroposterior (AP) direction was unchanged under the smallest visual field condition compared to the largest one. The power spectrum density of COP displacements in the low-frequency band was decreased and that in the medium-frequency band was increased in the AP direction. SIGNIFICANCE: During quiet standing of young healthy adults with peripheral visual field loss, increased peripheral visual field loss resulted in lower postural stability. Postural stability in the AP direction was maintained contrary to the functional sensitivity hypothesis. Peripheral visual field loss reduced the weighting of the visual input and increased that of the vestibular input in the AP direction to maintain equilibrium.

Construction of a detachable artificial trachea model for three age groups for use in an endotracheal suctioning training environment simulator.

Tracheal suctioning is an important procedure to maintain airway patency by removing secretions. Today, suctioning operators include not only medical staff, but also family caregivers. The use of a simulation system has been noted to be the most effective way to learn the tracheal suctioning technique for operators. While the size of the trachea varies across different age groups, the artificial trachea model in the simulation system has only one fixed model. Thus, this study aimed to construct multiple removable trachea models according to different age groups. We enrolled 20 patients who had previously received proton beam therapy in our institution and acquired the treatment planning computed tomography (CT) image data. To construct the artificial trachea model for three age groups (children, adolescents and young adults, and adults), we analyzed the three-dimensional coordinates of the entire trachea, tracheal carina, and the end of the main bronchus. We also analyzed the diameter of the trachea and main bronchus. Finally, we evaluated the accuracy of the model by analyzing the difference between the constructed model and actual measurements. The trachea model was 8 cm long for children and 12 cm for adolescents and young adults, and for adults. The angle between the trachea and bed was about 20 degrees, regardless of age. The mean model accuracy was less than 0.4 cm. We constructed detachable artificial trachea models for three age groups for implementation in the endotracheal suctioning training environment simulator (ESTE-SIM) based on the treatment planning CT image. Our constructed artificial trachea models will be able to provide a simulation environment for various age groups in the ESTE-SIM.

Motion analysis for better understanding of psychomotor skills in laparoscopy: objective assessment-based simulation training using animal organs.

BACKGROUND: Our aim was to characterize the motions of multiple laparoscopic surgical instruments among participants with different levels of surgical experience in a series of wet-lab training drills, in which participants need to perform a range of surgical procedures including grasping tissue, tissue traction and dissection, applying a Hem-o-lok clip, and suturing/knotting, and digitize the level of surgical competency. METHODS: Participants performed tissue dissection around the aorta, dividing encountered vessels after applying a Hem-o-lok (Task 1), and renal parenchymal closure (Task 2: suturing, Task 3: suturing and knot-tying), using swine cadaveric organs placed in a box trainer under a motion capture (Mocap) system. Motion-related metrics were compared according to participants' level of surgical experience (experts: 50 ≤ laparoscopic surgeries, intermediates: 10-49, novices: 0-9), using the Kruskal-Wallis test, and significant metrics were subjected to principal component analysis (PCA). RESULTS: A total of 15 experts, 12 intermediates, and 18 novices participated in the training. In Task 1, a shorter path length and faster velocity/acceleration/jerk were observed using both scissors and a Hem-o-lok applier in the experts, and Hem-o-lok-related metrics markedly contributed to the 1st principal component on PCA analysis, followed by scissors-related metrics. Higher-level skills including a shorter path length and faster velocity were observed in both hands of the experts also in tasks 2 and 3. Sub-analysis showed that, in experts with 100 ≤ cases, scissors moved more frequently in the "close zone (0 ≤ to < 2.0 cm from aorta)" than those with 50-99 cases. CONCLUSION: Our novel Mocap system recognized significant differences in several metrics in multiple instruments according to the level of surgical experience. "Applying a Hem-o-lok clip on a pedicle" strongly reflected the level of surgical experience, and zone-metrics may be a promising tool to assess surgical expertise. Our next challenge is to give completely objective feedback to trainees on-site in the wet-lab.

Effective Catheter Manoeuvre for the Removal of Phlegm by Suctioning: A Biomechanical Analysis of Experts and Novices.

Purpose: The aim of this study was to determine the effective biomechanical technique for suctioning phlegm. Methods: A novel tracheal suctioning simulator combined with a motion capture system was used to calculate the amount of simulated phlegm suctioned and the biomechanical parameters of the associated suctioning manoeuvre. A laboratory study, including 12 nurses with > 3 years of suctioning experience and 12 nursing students without any clinical suctioning experience, was conducted. The amount of phlegm suctioned, the maximum length of catheter insertion, and the biomechanical parameters of hand movement were calculated. Results: The mean amount of phlegm suctioned per second was significantly larger in the experienced group than in the non-experienced group. The amount of phlegm suctioned correlated positively with the length of the vertical path of motion of the wrist and forearm, and with the angular velocity of thumb rotation in both the groups. Conclusion: Greater vertical motion of the wrist and thumb rotation improved the effectiveness of phlegm suctioning and prevented the need for deep suctioning, which is unsafe.

Relationship Between Tracheal Suctioning Catheter Motion and Secretion Amount Based on Viscosity.

BACKGROUND: To provide safe tracheal suctioning, the American Association of Respiratory Care guideline discusses the length of suctioning catheter, but the most effective tracheal suctioning catheter technique is still unknown. OBJECTIVE: The aim of this study is to compare the amount of simulated secretion produced by five different handlings of a catheter at two different viscosities and in two different models to discover the most effective suctioning maneuver in the various mucus conditions. DESIGN: In vitro experimental design. METHODS: The amount of secretion aspirated by our researcher's manipulation of a suctioning catheter was measured. The tip of the catheter was recorded using a high-speed video camera to visualize the secretion motion. RESULTS: The most effective suctioning technique differed depending on the viscosity of the secretion. There were no significant differences between five suctioning methods applied to high-viscosity phlegm in a tracheal membrane model, but the flexion technique was the most efficient for low-viscosity secretion. CONCLUSIONS: Our results imply that the flexion technique was reasonably safe and the most effective of these five methods for low-viscosity secretion.