Markerless gait analysis through a single camera and computer vision.

The assessment of gait performance using quantitative measures can yield crucial insights into an individual's health status. Recently, computer vision-based human pose estimation has emerged as a promising solution for markerless gait analysis, as it allows for the direct extraction of gait parameters from videos. This study aimed to compare the lower extremity kinematics and spatiotemporal gait parameters obtained from a single-camera-based markerless method with those acquired from a marker-based motion tracking system across a healthy population. Additionally, we investigated the impact of camera viewing angles and distances on the accuracy of the markerless method. Our findings demonstrated a robust correlation and agreement (Rxy > 0.75, Rc > 0.7) between the markerless and marker-based methods for most spatiotemporal gait parameters. We also observed strong correlations (Rxy > 0.8) between the two methods for hip flexion/extension, knee flexion/extension, hip abduction/adduction, and hip internal/external rotation. Statistical tests revealed significant effects of viewing angles and distances on the accuracy of the identified gait parameters. While the markerless method offers an alternative for general gait analysis, particularly when marker use is impractical, its accuracy for clinical applications remains insufficient and requires substantial improvement. Future investigations should explore the potential of the markerless system to measure gait parameters in pathological gaits.

Factors Affecting Workers' Mental Stress in Handover Activities During Human-Robot Collaboration.

OBJECTIVE: This study investigated the effects of different approach directions, movement speeds, and trajectories of a co-robot's end-effector on workers' mental stress during handover tasks. BACKGROUND: Human-robot collaboration (HRC) is gaining attention in industry and academia. Understanding robot-related factors causing mental stress is crucial for designing collaborative tasks that minimize workers' stress. METHODS: Mental stress in HRC tasks was measured subjectively through self-reports and objectively through galvanic skin response (GSR) and electromyography (EMG). Robot-related factors including approach direction, movement speed, and trajectory were analyzed. RESULTS: Movement speed and approach direction had significant effects on subjective ratings, EMG, and GSR. High-speed and approaching from one side consistently resulted in higher fear, lower comfort, and predictability, as well as increased EMG and GSR signals, indicating higher mental stress. Movement trajectory affected GSR, with the sudden stop condition eliciting a stronger response compared to the constrained trajectory. Interaction effects between speed and approach direction were observed for "surprise" and "predictability" subjective ratings. At high speed, approach direction did not significantly differ, but at low speeds, approaching from the side was found to be more surprising and unpredictable compared to approaching from the front. CONCLUSION: The mental stress of workers during HRC is lower when the robot's end effector (1) approaches a worker within the worker's field of view, (2) approaches at a lower speed, or (3) follows a constrained trajectory. APPLICATION: The outcome of this study can serve as a guide to design HRC tasks with a low level of workers' mental stress.

Exploring the impact of human-robot interaction on workers' mental stress in collaborative assembly tasks.

Advances in robotics have contributed to the prevalence of human-robot collaboration (HRC). However, working and interacting with collaborative robots in close proximity can be psychologically stressful. Therefore, understanding the impacts of human-robot interaction (HRI) on mental stress is crucial for enhancing workplace well-being. To this end, this study investigated how the HRI factors - presence, complexity, and modality - affect the psychological stress of workers. We employed both the NASA-Task Load Index for subjective assessment and physiological metrics including galvanic skin responses, electromyography, and heart rate for objective evaluation. An experimental setup was implemented in which human operators worked together with a collaborative robot on Lego assembly tasks, using different interaction paradigms including pressing buttons, showing hand gestures, and giving verbal commands. The results revealed that the introduction of interactions during HRC helped reduce mental stress and that complex interactions resulted in higher mental stress than simple interactions. Meanwhile, using hand gestures led to significantly higher mental stress than pressing buttons and verbal commands. The findings provided practical insights for mitigating mental stress in the workplace and promoting wellness in the era of HRC.

Improving Workers' Musculoskeletal Health During Human-Robot Collaboration Through Reinforcement Learning.

OBJECTIVE: This study aims to improve workers' postures and thus reduce the risk of musculoskeletal disorders in human-robot collaboration by developing a novel model-free reinforcement learning method. BACKGROUND: Human-robot collaboration has been a flourishing work configuration in recent years. Yet, it could lead to work-related musculoskeletal disorders if the collaborative tasks result in awkward postures for workers. METHODS: The proposed approach follows two steps: first, a 3D human skeleton reconstruction method was adopted to calculate workers' continuous awkward posture (CAP) score; second, an online gradient-based reinforcement learning algorithm was designed to dynamically improve workers' CAP score by adjusting the positions and orientations of the robot end effector. RESULTS: In an empirical experiment, the proposed approach can significantly improve the CAP scores of the participants during a human-robot collaboration task when compared with the scenarios where robot and participants worked together at a fixed position or at the individual elbow height. The questionnaire outcomes also showed that the working posture resulted from the proposed approach was preferred by the participants. CONCLUSION: The proposed model-free reinforcement learning method can learn the optimal worker postures without the need for specific biomechanical models. The data-driven nature of this method can make it adaptive to provide personalized optimal work posture. APPLICATION: The proposed method can be applied to improve the occupational safety in robot-implemented factories. Specifically, the personalized robot working positions and orientations can proactively reduce exposure to awkward postures that increase the risk of musculoskeletal disorders. The algorithm can also reactively protect workers by reducing the workload in specific joints.

A mobile platform-based app to assist undergraduate learning of human kinematics in biomechanics courses.

Whole-body biomechanics examines different physical characteristics of the human body movement by applying principles of Newtonian mechanics. Therefore, undergraduate biomechanics courses are highly demanding in mathematics and physics. While the inclusion of laboratory experiences can augment student comprehension of biomechanics concepts, the cost and the required expertise associated with experiment equipment can be a burden of offering laboratory sessions. In this study, we developed a mobile app to facilitate learning human kinematics in biomechanics curriculums. First, a mobile-based computer-vision algorithm that is based on Convolutional pose machine (CPM), MobileNet V2, and TensorFlow Lite framework is adopted to reconstruct 2D human poses from the images collected by a mobile device camera. Key joint locations are then applied to the human kinematics variable estimator for human kinematics analysis. Simultaneously, students can view various kinematics data for a selected joint or body segment in real-time through the user interface of the mobile device. The proposed app can serve as a potential instructional tool to assist in conducting human motion experiments in biomechanics courses.