Estimating 3D kinematics and kinetics from virtual inertial sensor data through musculoskeletal movement simulations.

Portable measurement systems using inertial sensors enable motion capture outside the lab, facilitating longitudinal and large-scale studies in natural environments. However, estimating 3D kinematics and kinetics from inertial data for a comprehensive biomechanical movement analysis is still challenging. Machine learning models or stepwise approaches performing Kalman filtering, inverse kinematics, and inverse dynamics can lead to inconsistencies between kinematics and kinetics. We investigated the reconstruction of 3D kinematics and kinetics of arbitrary running motions from inertial sensor data using optimal control simulations of full-body musculoskeletal models. To evaluate the feasibility of the proposed method, we used marker tracking simulations created from optical motion capture data as a reference and for computing virtual inertial data such that the desired solution was known exactly. We generated the inertial tracking simulations by formulating optimal control problems that tracked virtual acceleration and angular velocity while minimizing effort without requiring a task constraint or an initial state. To evaluate the proposed approach, we reconstructed three trials each of straight running, curved running, and a v-cut of 10 participants. We compared the estimated inertial signals and biomechanical variables of the marker and inertial tracking simulations. The inertial data was tracked closely, resulting in low mean root mean squared deviations for pelvis translation (≤20.2 mm), angles (≤1.8 deg), ground reaction forces (≤1.1 BW%), joint moments (≤0.1 BWBH%), and muscle forces (≤5.4 BW%) and high mean coefficients of multiple correlation for all biomechanical variables (≥0.99). Accordingly, our results showed that optimal control simulations tracking 3D inertial data could reconstruct the kinematics and kinetics of individual trials of all running motions. The simulations led to mutually and dynamically consistent kinematics and kinetics, which allows researching causal chains, for example, to analyze anterior cruciate ligament injury prevention. Our work proved the feasibility of the approach using virtual inertial data. When using the approach in the future with measured data, the sensor location and alignment on the segment must be estimated, and soft-tissue artifacts are potential error sources. Nevertheless, we demonstrated that optimal control simulation tracking inertial data is highly promising for estimating 3D kinematics and kinetics for a comprehensive biomechanical analysis.

Contributing Components of Metabolic Energy Models to Metabolic Cost Estimations in Gait.

OBJECTIVE: As metabolic cost is a primary factor influencing humans' gait, we want to deepen our understanding of metabolic energy expenditure models. Therefore, this paper identifies the parameters and input variables, such as muscle or joint states, that contribute to accurate metabolic cost estimations. METHODS: We explored the parameters of four metabolic energy expenditure models in a Monte Carlo sensitivity analysis. Then, we analysed the model parameters by their calculated sensitivity indices, physiological context, and the resulting metabolic rates during the gait cycle. The parameter combination with the highest accuracy in the Monte Carlo simulations represented a quasi-optimized model. In the second step, we investigated the importance of input parameters and variables by analysing the accuracy of neural networks trained with different input features. RESULTS: Power-related parameters were most influential in the sensitivity analysis and the neural network-based feature selection. We observed that the quasi-optimized models produced negative metabolic rates, contradicting muscle physiology. Neural network-based models showed promising abilities but have been unable to match the accuracy of traditional metabolic energy expenditure models. CONCLUSION: We showed that power-related metabolic energy expenditure model parameters and inputs are most influential during gait. Furthermore, our results suggest that neural network-based metabolic energy expenditure models are viable. However, bigger datasets are required to achieve better accuracy. SIGNIFICANCE: As there is a need for more accurate metabolic energy expenditure models, we explored which musculoskeletal parameters are essential when developing a model to estimate metabolic energy.

Refinement and Usability Analysis of an eHealth App for Ankylosing Spondylitis as a Complementary Treatment to Physical Therapy: Development and Usability Study.

BACKGROUND: Mobile eHealth apps have been used as a complementary treatment to increase the quality of life of patients and provide new opportunities for the management of rheumatic diseases. Telemedicine, particularly in the areas of prevention, diagnostics, and therapy, has become an essential cornerstone in the care of patients with rheumatic diseases. OBJECTIVE: This study aims to improve the design and technology of YogiTherapy and evaluate its usability and quality. METHODS: We newly implemented the mobile eHealth app YogiTherapy with a modern design, the option to change language, and easy navigation to improve the app's usability and quality for patients. After refinement, we evaluated the app by conducting a study with 16 patients with AS (4 female and 12 male; mean age 48.1, SD 16.8 y). We assessed the usability of YogiTherapy with a task performance test (TPT) with a think-aloud protocol and the quality with the German version of the Mobile App Rating Scale (MARS). RESULTS: In the TPT, the participants had to solve 6 tasks that should be performed on the app. The overall task completion rate in the TPT was high (84/96, 88% completed tasks). Filtering for videos and navigating to perform an assessment test caused the largest issues during the TPT, while registering in the app and watching a yoga video were highly intuitive. Additionally, 12 (75%) of the 16 participants completed the German version of MARS. The quality of YogiTherapy was rated with an average MARS score of 3.79 (SD 0.51) from a maximum score of 5. Furthermore, results from the MARS questionnaire demonstrated a positive evaluation regarding functionality and aesthetics. CONCLUSIONS: The refined and tested YogiTherapy app showed promising results among most participants. In the future, the app could serve its function as a complementary treatment for patients with AS. For this purpose, surveys with a larger number of patients should still be conducted. As a substantial advancement, we made the app free and openly available on the iOS App and Google Play stores.

Change the direction: 3D optimal control simulation by directly tracking marker and ground reaction force data.

Optimal control simulations of musculoskeletal models can be used to reconstruct motions measured with optical motion capture to estimate joint and muscle kinematics and kinetics. These simulations are mutually and dynamically consistent, in contrast to traditional inverse methods. Commonly, optimal control simulations are generated by tracking generalized coordinates in combination with ground reaction forces. The generalized coordinates are estimated from marker positions using, for example, inverse kinematics. Hence, inaccuracies in the estimated coordinates are tracked in the simulation. We developed an approach to reconstruct arbitrary motions, such as change of direction motions, using optimal control simulations of 3D full-body musculoskeletal models by directly tracking marker and ground reaction force data. For evaluation, we recorded three trials each of straight running, curved running, and a v-cut for 10 participants. We reconstructed the recordings with marker tracking simulations, coordinate tracking simulations, and inverse kinematics and dynamics. First, we analyzed the convergence of the simulations and found that the wall time increased three to four times when using marker tracking compared to coordinate tracking. Then, we compared the marker trajectories, ground reaction forces, pelvis translations, joint angles, and joint moments between the three reconstruction methods. Root mean squared deviations between measured and estimated marker positions were smallest for inverse kinematics (e.g., 7.6 ± 5.1 mm for v-cut). However, measurement noise and soft tissue artifacts are likely also tracked in inverse kinematics, meaning that this approach does not reflect a gold standard. Marker tracking simulations resulted in slightly higher root mean squared marker deviations (e.g., 9.5 ± 6.2 mm for v-cut) than inverse kinematics. In contrast, coordinate tracking resulted in deviations that were nearly twice as high (e.g., 16.8 ± 10.5 mm for v-cut). Joint angles from coordinate tracking followed the estimated joint angles from inverse kinematics more closely than marker tracking (e.g., root mean squared deviation of 1.4 ± 1.8 deg vs. 3.5 ± 4.0 deg for v-cut). However, we did not have a gold standard measurement of the joint angles, so it is unknown if this larger deviation means the solution is less accurate. In conclusion, we showed that optimal control simulations of change of direction running motions can be created by tracking marker and ground reaction force data. Marker tracking considerably improved marker accuracy compared to coordinate tracking. Therefore, we recommend reconstructing movements by directly tracking marker data in the optimal control simulation when precise marker tracking is required.

A Yoga Exercise App Designed for Patients With Axial Spondylarthritis: Development and User Experience Study.

BACKGROUND: Besides anti-inflammatory medication, physical exercise represents a cornerstone of modern treatment for patients with axial spondyloarthritis (AS). Digital health apps (DHAs) such as the yoga app YogiTherapy could remotely empower patients to autonomously and correctly perform exercises. OBJECTIVE: This study aimed to design and develop a smartphone-based app, YogiTherapy, for patients with AS. To gain additional insights into the usability of the graphical user interface (GUI) for further development of the app, this study focused exclusively on evaluating users' interaction with the GUI. METHODS: The development of the app and the user experience study took place between October 2020 and March 2021. The DHA was designed by engineering students, rheumatologists, and patients with AS. After the initial development process, a pilot version of the app was evaluated by 5 patients and 5 rheumatologists. The participants had to interact with the app's GUI and complete 5 navigation tasks within the app. Subsequently, the completion rate and experience questionnaire (attractiveness, perspicuity, efficiency, dependability, stimulation, and novelty) were completed by the patients. RESULTS: The results of the posttest questionnaires showed that most patients were already familiar with digital apps (4/5, 80%). The task completion rates of the usability test were 100% (5/5) for the tasks T1 and T2, which included selecting and starting a yoga lesson and navigating to an information page. Rheumatologists indicated that they were even more experienced with digital devices (2/5, 40% experts; 3/5, 60% intermediates). In this case, they scored task completion rates of 100% (5/5) for all 5 usability tasks T1 to T5. The mean results from the User Experience Questionnaire range from -3 (most negative) to +3 (most positive). According to rheumatologists' evaluations, attractiveness (mean 2.267, SD 0.401) and stimulation (mean 2.250, SD 0.354) achieved the best mean results compared with dependability (mean 2.000, SD 0.395). Patients rated attractiveness at a mean of 2.167 (SD 0.565) and stimulation at a mean of 1.950 (SD 0.873). The lowest mean score was reported for perspicuity (mean 1.250, SD 1.425). CONCLUSIONS: The newly developed and tested DHA YogiTherapy demonstrated moderate usability among rheumatologists and patients with rheumatic diseases. The app can be used by patients with AS as a complementary treatment. The initial evaluation of the GUI identified significant usability problems that need to be addressed before the start of a clinical evaluation. Prospective trials are also needed in the second step to prove the clinical benefits of the app.

Rigid and Non-Rigid Motion Compensation in Weight-Bearing CBCT of the Knee Using Simulated Inertial Measurements.

OBJECTIVE: Involuntary subject motion is the main source of artifacts in weight-bearing cone-beam CT of the knee. To achieve image quality for clinical diagnosis, the motion needs to be compensated. We propose to use inertial measurement units (IMUs) attached to the leg for motion estimation. METHODS: We perform a simulation study using real motion recorded with an optical tracking system. Three IMU-based correction approaches are evaluated, namely rigid motion correction, non-rigid 2D projection deformation and non-rigid 3D dynamic reconstruction. We present an initialization process based on the system geometry. With an IMU noise simulation, we investigate the applicability of the proposed methods in real applications. RESULTS: All proposed IMU-based approaches correct motion at least as good as a state-of-the-art marker-based approach. The structural similarity index and the root mean squared error between motion-free and motion corrected volumes are improved by 24-35% and 78-85%, respectively, compared with the uncorrected case. The noise analysis shows that the noise levels of commercially available IMUs need to be improved by a factor of 105 which is currently only achieved by specialized hardware not robust enough for the application. CONCLUSION: Our simulation study confirms the feasibility of this novel approach and defines improvements necessary for a real application. SIGNIFICANCE: The presented work lays the foundation for IMU-based motion compensation in cone-beam CT of the knee and creates valuable insights for future developments.

Efficient trajectory optimization for curved running using a 3D musculoskeletal model with implicit dynamics.

Trajectory optimization with musculoskeletal models can be used to reconstruct measured movements and to predict changes in movements in response to environmental changes. It enables an exhaustive analysis of joint angles, joint moments, ground reaction forces, and muscle forces, among others. However, its application is still limited to simplified problems in two dimensional space or straight motions. The simulation of movements with directional changes, e.g. curved running, requires detailed three dimensional models which lead to a high-dimensional solution space. We extended a full-body three dimensional musculoskeletal model to be specialized for running with directional changes. Model dynamics were implemented implicitly and trajectory optimization problems were solved with direct collocation to enable efficient computation. Standing, straight running, and curved running were simulated starting from a random initial guess to confirm the capabilities of our model and approach: efficacy, tracking and predictive power. Altogether the simulations required 1 h 17 min and corresponded well to the reference data. The prediction of curved running using straight running as tracking data revealed the necessity of avoiding interpenetration of body segments. In summary, the proposed formulation is able to efficiently predict a new motion task while preserving dynamic consistency. Hence, labor-intensive and thus costly experimental studies could be replaced by simulations for movement analysis and virtual product design.

CNN-Based Estimation of Sagittal Plane Walking and Running Biomechanics From Measured and Simulated Inertial Sensor Data.

Machine learning is a promising approach to evaluate human movement based on wearable sensor data. A representative dataset for training data-driven models is crucial to ensure that the model generalizes well to unseen data. However, the acquisition of sufficient data is time-consuming and often infeasible. We present a method to create realistic inertial sensor data with corresponding biomechanical variables by 2D walking and running simulations. We augmented a measured inertial sensor dataset with simulated data for the training of convolutional neural networks to estimate sagittal plane joint angles, joint moments, and ground reaction forces (GRFs) of walking and running. When adding simulated data, the root mean square error (RMSE) of the test set of hip, knee, and ankle joint angles decreased up to 17%, 27% and 23%, the RMSE of knee and ankle joint moments up to 6% and the RMSE of anterior-posterior and vertical GRF up to 2 and 6%. Simulation-aided estimation of joint moments and GRFs was limited by inaccuracies of the biomechanical model. Improving the physics-based model and domain adaptation learning may further increase the benefit of simulated data. Future work can exploit biomechanical simulations to connect different data sources in order to create representative datasets of human movement. In conclusion, machine learning can benefit from available domain knowledge on biomechanical simulations to supplement cumbersome data collections.

Estimation of gait kinematics and kinetics from inertial sensor data using optimal control of musculoskeletal models.

Inertial sensing enables field studies of human movement and ambulant assessment of patients. However, the challenge is to obtain a comprehensive analysis from low-quality data and sparse measurements. In this paper, we present a method to estimate gait kinematics and kinetics directly from raw inertial sensor data performing a single dynamic optimization. We formulated an optimal control problem to track accelerometer and gyroscope data with a planar musculoskeletal model. In addition, we minimized muscular effort to ensure a unique solution and to prevent the model from tracking noisy measurements too closely. For evaluation, we recorded data of ten subjects walking and running at six different speeds using seven inertial measurement units (IMUs). Results were compared to a conventional analysis using optical motion capture and a force plate. High correlations were achieved for gait kinematics (ρ⩾0.93) and kinetics (ρ⩾0.90). In contrast to existing IMU processing methods, a dynamically consistent simulation was obtained and we were able to estimate running kinetics. Besides kinematics and kinetics, further metrics such as muscle activations and metabolic cost can be directly obtained from simulated model movements. In summary, the method is insensitive to sensor noise and drift and provides a detailed analysis solely based on inertial sensor data.