Comparison of Kinect and Leap Motion for Intraoperative Image Interaction.

Background. Touchless interaction devices have increasingly garnered attention for intraoperative imaging interaction, but there are limited recommendations on which touchless interaction mechanisms should be implemented in the operating room. The objective of this study was to evaluate the efficiency, accuracy, and satisfaction of 2 current touchless interaction mechanisms-hand motion and body motion for intraoperative image interaction. Methods. We used the TedCas plugin for ClearCanvas DICOM viewer to display and manipulate CT images. Ten surgeons performed 5 image interaction tasks-step-through, pan, zoom, circle measure, and line measure-on the 3 input interaction devices-the Microsoft Kinect, the Leap Motion, and a mouse. Results. The Kinect shared similar accuracy with the Leap Motion for most of the tasks. But it had an increased error rate in the step-through task. The Leap Motion led to shorter task completion time than the Kinect and was preferred by the surgeons, especially for the measure tasks. Discussion. Our study suggests that hand tracking devices, such as the Leap Motion, should be used for intraoperative imagining manipulation tasks that require high precision.

Virtual pointer for gaze guidance in laparoscopic surgery.

BACKGROUND: A challenge of laparoscopic surgery is learning how to interpret the indirect view of the operative field. Acquiring professional vision-understanding what to see and which information to attend to, is thereby an essential part of laparoscopic training and one in which trainers exert great effort to convey. We designed a virtual pointer (VP) that enables experts to point or draw free-hand sketches over an intraoperative laparoscopic video for a novice to see. This study aimed to investigate the efficacy of the virtual pointer in guiding novices' gaze patterns. METHODS: We conducted a counter-balanced, within-subject trial to compare the novices' gaze behaviors in laparoscopic training with the virtual pointer compared to a standard training condition, i.e., verbal instruction with un-mediated gestures. In the study, seven trainees performed four simulated laparoscopic tasks guided by an experienced surgeon as the trainer. A Tobii Pro X3-120 eye-tracker was used to capture the trainees' eye movements. The measures include fixation rate, i.e., the frequency of trainees' fixations, saccade amplitude, and fixation concentration, i.e., the closeness of trainees' fixations. RESULTS: No significant difference in fixation rate or saccade amplitude was found between the virtual pointer condition and the standard condition. In the virtual pointer condition, trainees' fixations were more concentrated (p = 0.039) and longer fixations were more clustered, compared to the Standard condition (p = 0.008). CONCLUSIONS: The virtual pointer effectively improved surgical trainees' in-the-moment gaze focus during the laparoscopic training by reducing their gaze dispersion and concentrating their attention on the anatomical target. These results suggest that technologies which support gaze training should be expert-driven and intraoperative to efficiently modify novices' gaze behaviors.

Perceived Usefulness and Acceptance of Communication Support System in Laparoscopic Surgery.

In laparoscopic surgery, senior surgeons spend great efforts to convey knowledge to their trainees. Any misinterpretation of the instructions may lead to inevitable errors that have a great impact on patient safety. To support efficient knowledge sharing, we design a communication support system, Virtual Pointer, to convey trainers' gestures directly onto the laparoscopic video for trainees to see. We implement the design in an international surgical conference and evaluate the perceived usefulness and acceptance of the system among senior surgeons and surgical trainees. The results showed that the system facilitated the trainees to complete the task, increased their knowledge, and reduced the trainers' guiding efforts. The study indicates that conveying the gestures directly onto video has the potential to support the intraoperative communication. Barriers in the acceptance of the system highlight the design of novel interaction mechanisms to unobtrusively integrate this technique into the surgical workflow.

Effects of a Virtual Pointer on Trainees' Cognitive Load and Communication Efficiency in Surgical Training.

We investigated the cognitive load effect of a trainer providing surgical instruction by pointing/drawing over laparoscopic video to a trainee. Results showed that while cognitive load is higher overall with the use of the instructional system, there is a decrease by the second experience of being instructed by the Virtual Pointer. Further analysis showed that trainees were more likely to perform the surgical task and watch/listen to the trainer's instruction at the same time when the instructional system was used. This is thought to be an indication of more efficient communication when using the instructional system. Thus, although there is a small cognitive overload with the instructional system initially, the more efficient communication allows trainees to better integrate the knowledge and instructions being conveyed into the actions they must perform - indicating a better learning environment.

A virtual pointer to support the adoption of professional vision in laparoscopic training.

PURPOSE: To assess a virtual pointer in supporting surgical trainees' development of professional vision in laparoscopic surgery. METHODS: We developed a virtual pointing and telestration system utilizing the Microsoft Kinect movement sensor as an overlay for any imagine system. Training with the application was compared to a standard condition, i.e., verbal instruction with un-mediated gestures, in a laparoscopic training environment. Seven trainees performed four simulated laparoscopic tasks guided by an experienced surgeon as the trainer. Trainee performance was subjectively assessed by the trainee and trainer, and objectively measured by number of errors, time to task completion, and economy of movement. RESULTS: No significant differences in errors and time to task completion were obtained between virtual pointer and standard conditions. Economy of movement in the non-dominant hand was significantly improved when using virtual pointer ([Formula: see text]). The trainers perceived a significant improvement in trainee performance in virtual pointer condition ([Formula: see text]), while the trainees perceived no difference. The trainers' perception of economy of movement was similar between the two conditions in the initial three runs and became significantly improved in virtual pointer condition in the fourth run ([Formula: see text]). CONCLUSIONS: Results show that the virtual pointer system improves the trainer's perception of trainee's performance and this is reflected in the objective performance measures in the third and fourth training runs. The benefit of a virtual pointing and telestration system may be perceived by the trainers early on in training, but this is not evident in objective trainee performance until further mastery has been attained. In addition, the performance improvement of economy of motion specifically shows that the virtual pointer improves the adoption of professional vision- improved ability to see and use laparoscopic video results in more direct instrument movement.

The bit doesn't fit: Evaluation of a commercial activity-tracker at slower walking speeds.

Accelerometer-based commercial activity trackers are a low-cost and convenient method for monitoring and assessing health measures such as gait. However, the accuracy of these activity trackers in slow walking conditions on a minute-by-minute basis is largely unknown. In this study, the accuracy of a hip-worn commercial activity tracker (FitBit Ultra) was examined through step counts. Accuracy was evaluated through four minute trials of treadmill walking at speeds representative of older adults (0.9, 1.1, and 1.3m/s). Minute-by-minute step count was extracted through the FitBit API and compared it to observer counted steps through video recordings. Results highlighted a significant over-reporting of steps at the highest speed, and a significant under-reporting of steps at the slowest speed, with the FitBit Ultra failing to count steps for one or more minutes at the slowest speed for 11 participants. This study highlights problems with using the FitBit Ultra by slow-walking populations, and recommends that researchers and clinicians should carefully consider the trade-off between accuracy and convenience when using commercial activity trackers with slow-walking populations.

Comparison of tri-axial accelerometers step-count accuracy in slow walking conditions.

Accelerometers have shown great promise and popularity for monitoring gait. However, the accuracy of accelerometers for gait analysis in slow walking conditions is largely unknown. In this study, we compared the accuracy of three accelerometers recommended for gait analysis - Axivity AX3, APDM Opal, and the Actigraph wGT3X-BT, by holding the step-count algorithm constant. We evaluated device accuracy in four minutes of treadmill walking at the speeds of 0.9m/s, 1.1m/s, and 1.3m/s. We constructed a symbolization of the gait data to count the steps using Piecewise Aggregate Approximation and compared the estimated step counts with observer counted steps from video recordings. Our results highlight the variation between the performance of devices - the Axivity AX3 provides more accurate step counts than the other two devices. In this, we provide evidence for future scientific teams to make decisions on selecting accelerometers which can more accurately measure steps taken at slower walking speeds, and suggest ways to improve the design of algorithms and accelerometers.

Improving Common Ground Development in Surgical Training through Talk and Action.

In surgical training, senior surgeons and residents rely on more than just verbal utterances to share information and coordinate their work practices - their actions also contribute to and shape the development of common ground. However, the function of actions in the grounding process and how that is interdependent with verbal utterances have not been made explicit. We have investigated actions and utterances using a dialogue act coding scheme that highlights the communicative functions of each act towards common ground development during a laparoscopic surgery. We show that utterances provide detailed information for surgeons to develop content common ground, whereas actions contribute to process common ground development. Thus, utterances and actions, by providing different forms of information, depend on each other to develop and maintain common ground. Based on this understanding, we discuss opportunities in transforming actions into perceivable knowledge on the laparoscopic display that supports effective communication and surgical training.

A systematic review of the effect of distraction on surgeon performance: directions for operating room policy and surgical training.

BACKGROUND: Distractions during surgical procedures have been linked to medical error and team inefficiency. This systematic review identifies the most common and most significant forms of distraction in order to devise guidelines for mitigating the effects of distractions in the OR. METHODS: In January 2015, a PubMed and Google Scholar search yielded 963 articles, of which 17 (2 %) either directly observed the occurrence of distractions in operating rooms or conducted a laboratory experiment to determine the effect of distraction on surgical performance. RESULTS: Observational studies indicated that movement and case-irrelevant conversation were the most frequently occurring distractions, but equipment and procedural distractions were the most severe. Laboratory studies indicated that (1) auditory and mental distractions can significantly impact surgical performance, but visual distractions do not incur the same level of effects; (2) task difficulty has an interaction effect with distractions; and (3) inexperienced subjects reduce their speed when faced with distractions, while experienced subjects did not. CONCLUSION: This systematic review suggests that operating room protocols should ensure that distractions from intermittent auditory and mental distractions are significantly reduced. In addition, surgical residents would benefit from training for intermittent auditory and mental distractions in order to develop automaticity and high skill performance during distractions, particularly during more difficult surgical tasks. It is unclear as to whether training should be done in the presence of distractions or distractions should only be used for post-training testing of levels of automaticity.

Taxonomy of instructions given to residents in laparoscopic cholecystectomy.

BACKGROUND: Although simulation-based training allows residents to become proficient in surgical skills outside the OR, residents still depend on senior surgeons' guidance in transferring skills accumulated from simulators into the operating room. This study aimed to identify and classify explicit instructions made by attending surgeons to their residents during laparoscopic surgery. Through these instructions, we examined the role gaze guidance plays in OR-based training. METHODS: A total of ten laparoscopic cholecystectomy cases being performed by PGY4 residents were analyzed. The explicit directional instructions given by the mentoring attending surgeons to their residents were identified and classified into four categories based on their locations in the coordinate system. These categories were further combined into two classes, based on the target of instructions. The frequencies of instructions in the two classes were compared, and effect size was calculated. RESULTS: There were 1984 instructions identified in the ten cases. The instructions were categorized into instrument guidance (38.51%) and gaze guidance (61.49%). The instrument guidance focused on moving the instruments to perform surgical tasks, including directions to targets, instrument manipulation, and instrument interaction. The gaze guidance focused on achieving common ground during the operation, including target identification and target fixation. The frequency of gaze guidance is significantly higher than instrument guidance in a laparoscopic cholecystectomy (p < 0.001) with a large effect size (r = 0.6). CONCLUSIONS: Gaze guidance has become the main focus of OR-based training. The results show a tight connection between adopting expert gaze and performing surgical tasks and suggest that gaze training should be integrated into the simulation training.

Vision-based body tracking: turning Kinect into a clinical tool.

PURPOSE: Vision-based body tracking technologies, originally developed for the consumer gaming market, are being repurposed to form the core of a range of innovative healthcare applications in the clinical assessment and rehabilitation of movement ability. Vision-based body tracking has substantial potential, but there are technical limitations. METHOD: We use our "stories from the field" to articulate the challenges and offer examples of how these can be overcome. RESULTS: We illustrate that: (i) substantial effort is needed to determine the measures and feedback vision-based body tracking should provide, accounting for the practicalities of the technology (e.g. range) as well as new environments (e.g. home). (ii) Practical considerations are important when planning data capture so that data is analysable, whether finding ways to support a patient or ensuring everyone does the exercise in the same manner. (iii) Home is a place of opportunity for vision-based body tracking, but what we do now in the clinic (e.g. balance tests) or in the home (e.g. play games) will require modifications to achieve capturable, clinically relevant measures. CONCLUSIONS: This article articulates how vision-based body tracking works and when it does not to continue to inspire our clinical colleagues to imagine new applications. Implications for Rehabilitation Vision-based body tracking has quickly been repurposed to form the core of innovative healthcare applications in clinical assessment and rehabilitation, but there are clinical as well as practical challenges to make such systems a reality. Substantial effort needs to go into determining what types of measures and feedback vision-based body tracking should provide. This needs to account for the practicalities of the technology (e.g. range) as well as the opportunities of new environments (e.g. the home). Practical considerations need to be accounted for when planning capture in a particular environment so that data is analysable, whether it be finding a chair substitute, ways to support a patient or ensuring everyone does the exercise in the same manner. The home is a place of opportunity with vision-based body tracking, but it would be naïve to think that we can do what we do now in the clinic (e.g. balance tests) or in the home (e.g. play games), without appropriate modifications to what constitutes a practically capturable, clinically relevant measure.

Achieving Interface and Environment Fidelity in the Virtual Basic Laparoscopic Surgical Trainer.

Virtual reality trainers are educational tools with great potential for laparoscopic surgery. They can provide basic skills training in a controlled environment and free of risks for patients. They can also offer objective performance assessment without the need for proctors. However, designing effective user interfaces that allow the acquisition of the appropriate technical skills on these systems remains a challenge. This paper aims to examine a process for achieving interface and environment fidelity during the development of the Virtual Basic Laparoscopic Surgical Trainer (VBLaST). Two iterations of the design process were conducted and evaluated. For that purpose, a total of 42 subjects participated in two experimental studies in which two versions of the VBLaST were compared to the accepted standard in the surgical community for training and assessing basic laparoscopic skills in North America, the FLS box-trainer. Participants performed 10 trials of the peg transfer task on each trainer. The assessment of task performance was based on the validated FLS scoring method. Moreover, a subjective evaluation questionnaire was used to assess the fidelity aspects of the VBLaST relative to the FLS trainer. Finally, a focus group session with expert surgeons was conducted as a comparative situated evaluation after the first design iteration. This session aimed to assess the fidelity aspects of the early VBLaST prototype as compared to the FLS trainer. The results indicate that user performance on the earlier version of the VBLaST resulting from the first design iteration was significantly lower than the performance on the standard FLS box-trainer. The comparative situated evaluation with domain experts permitted us to identify some issues related to the visual, haptic and interface fidelity on this early prototype. Results of the second experiment indicate that the performance on the second generation VBLaST was significantly improved as compared to the first generation and not significantly different from that of the standard FLS box-trainer. Furthermore, the subjects rated the fidelity features of the modified VBLaST version higher than the early version. These findings demonstrate the value of the comparative situated evaluation sessions entailing hands on reflection by domain experts to achieve the environment and interface fidelity and training objectives when designing a virtual reality laparoscopic trainer. This suggests that this method could be used successfully in the future to enhance the value of VR systems as an alternative to physical trainers for laparoscopic surgery skills. Some recommendations on how to use this method to achieve the environment and interface fidelity of a VR laparoscopic surgical trainer are identified.

Supporting Common Ground Development in the Operation Room through Information Display Systems.

Effective information sharing is crucial for clinical team coordination. Most information display systems have been designed to replace verbal communication. However, information may not be available for capture before a communication event and information needs often become clear and evident through an evolving discourse. Thus, to build tools to support clinical team in situ information sharing, we need a better understanding of how evolving information needs are identified and satisfied. In this study, we used sequential analysis techniques to explore the ways communication and information sharing events between an attending surgeon and a resident change throughout a laparoscopic surgery. We demonstrate how common ground is developed and maintained, and how information needs change through the efforts of grounding. From our findings, we suggest that the design for information display systems could encourage communication and support the articulation work that is necessary to accomplish the information sharing.

Turning to Peers: Integrating Understanding of the Self, the Condition, and Others' Experiences in Making Sense of Complex Chronic Conditions.

People are increasingly involved in the self-management of their own health, including chronic conditions. With technology advances, the choice of self-management practices, tools, and technologies has never been greater. The studies reported here investigated the information seeking practices of two different chronic health populations in their quest to manage their health conditions. Migraine and diabetes patients and clinicians in the UK and the US were interviewed about their information needs and practices, and representative online communities were explored to inform a qualitative study. We found that people with either chronic condition require personally relevant information and use a broad and varied set of practices and tools to make sense of their specific symptoms, triggers, and treatments. Participants sought out different types of information from varied sources about themselves, their medical condition, and their peers' experiences of the same chronic condition. People with diabetes and migraine expended great effort to validate their personal experiences of their condition and determine whether these experiences were 'normal'. Based on these findings, we discuss the need for future personal health technologies that support people in engaging in meaningful and personalised data collection, information seeking, and information sharing with peers in flexible ways that enable them to better understand their own condition.