Multi-Modal Data Correspondence for the 4D Analysis of the Spine with Adolescent Idiopathic Scoliosis.

Adolescent idiopathic scoliosis is a three-dimensional spinal deformity that evolves during adolescence. Combined with static 3D X-ray acquisitions, novel approaches using motion capture allow for the analysis of the patient dynamics. However, as of today, they cannot provide an internal analysis of the spine in motion. In this study, we investigated the use of personalized kinematic avatars, created with observations of the outer (skin) and internal shape (3D spine) to infer the actual anatomic dynamics of the spine when driven by motion capture markers. Towards that end, we propose an approach to create a subject-specific digital twin from multi-modal data, namely, a surface scan of the back of the patient and a reconstruction of the 3D spine (EOS). We use radio-opaque markers to register the inner and outer observations. With respect to the previous work, our method does not rely on a precise palpation for the placement of the markers. We present the preliminary results on two cases, for which we acquired a second biplanar X-ray in a bending position. Our model can infer the spine motion from mocap markers with an accuracy below 1 cm on each anatomical axis and near 5 degrees in orientations.

Accuracy and Precision of 3-dimensional Optical Imaging for Body Composition by Age, BMI, and Ethnicity.

BACKGROUND: The obesity epidemic brought a need for accessible methods to monitor body composition, as excess adiposity has been associated with cardiovascular disease, metabolic disorders, and some cancers. Recent 3-dimensional optical (3DO) imaging advancements have provided opportunities for assessing body composition. However, the accuracy and precision of an overall 3DO body composition model in specific subgroups are unknown. OBJECTIVES: This study aimed to evaluate 3DO's accuracy and precision by subgroups of age, body mass index, and ethnicity. METHODS: A cross-sectional analysis was performed using data from the Shape Up! Adults study. Each participant received duplicate 3DO and dual-energy X-ray absorptiometry (DXA) scans. 3DO meshes were digitally registered and reposed using Meshcapade. Principal component analysis was performed on 3DO meshes. The resulting principal components estimated DXA whole-body and regional body composition using stepwise forward linear regression with 5-fold cross-validation. Duplicate 3DO and DXA scans were used for test-retest precision. Student's t tests were performed between 3DO and DXA by subgroup to determine significant differences. RESULTS: Six hundred thirty-four participants (females = 346) had completed the study at the time of the analysis. 3DO total fat mass in the entire sample achieved R2 of 0.94 with root mean squared error (RMSE) of 2.91 kg compared to DXA in females and similarly in males. 3DO total fat mass achieved a % coefficient of variation (RMSE) of 1.76% (0.44 kg), whereas DXA was 0.98% (0.24 kg) in females and similarly in males. There were no mean differences for total fat, fat-free, percent fat, or visceral adipose tissue by age group (P > 0.068). However, there were mean differences for underweight, Asian, and Black females as well as Native Hawaiian or other Pacific Islanders (P < 0.038). CONCLUSIONS: A single 3DO body composition model produced accurate and precise body composition estimates that can be used on diverse populations. However, adjustments to specific subgroups may be warranted to improve the accuracy in those that had significant differences. This trial was registered at clinicaltrials.gov as NCT03637855 (Shape Up! Adults).

Vertebrae localization, segmentation and identification using a graph optimization and an anatomic consistency cycle.

Vertebrae localization, segmentation and identification in CT images is key to numerous clinical applications. While deep learning strategies have brought to this field significant improvements over recent years, transitional and pathological vertebrae are still plaguing most existing approaches as a consequence of their poor representation in training datasets. Alternatively, proposed non-learning based methods take benefit of prior knowledge to handle such particular cases. In this work we propose to combine both strategies. To this purpose we introduce an iterative cycle in which individual vertebrae are recurrently localized, segmented and identified using deep-networks, while anatomic consistency is enforced using statistical priors. In this strategy, the transitional vertebrae identification is handled by encoding their configurations in a graphical model that aggregates local deep-network predictions into an anatomically consistent final result. Our approach achieves the state-of-the-art results on the VerSe20 challenge benchmark, and outperforms all methods on transitional vertebrae as well as the generalization to the VerSe19 challenge benchmark. Furthermore, our method can detect and report inconsistent spine regions that do not satisfy the anatomic consistency priors. Our code and model are openly available for research purposes.1.

A pose-independent method for accurate and precise body composition from 3D optical scans.

OBJECTIVE: The aim of this study was to investigate whether digitally re-posing three-dimensional optical (3DO) whole-body scans to a standardized pose would improve body composition accuracy and precision regardless of the initial pose. METHODS: Healthy adults (n = 540), stratified by sex, BMI, and age, completed whole-body 3DO and dual-energy X-ray absorptiometry (DXA) scans in the Shape Up! Adults study. The 3DO mesh vertices were represented with standardized templates and a low-dimensional space by principal component analysis (stratified by sex). The total sample was split into a training (80%) and test (20%) set for both males and females. Stepwise linear regression was used to build prediction models for body composition and anthropometry outputs using 3DO principal components (PCs). RESULTS: The analysis included 472 participants after exclusions. After re-posing, three PCs described 95% of the shape variance in the male and female training sets. 3DO body composition accuracy compared with DXA was as follows: fat mass R2 = 0.91 male, 0.94 female; fat-free mass R2 = 0.95 male, 0.92 female; visceral fat mass R2 = 0.77 male, 0.79 female. CONCLUSIONS: Re-posed 3DO body shape PCs produced more accurate and precise body composition models that may be used in clinical or nonclinical settings when DXA is unavailable or when frequent ionizing radiation exposure is unwanted.

Learning and Tracking the 3D Body Shape of Freely Moving Infants from RGB-D sequences.

Statistical models of the human body surface are generally learned from thousands of high-quality 3D scans in predefined poses to cover the wide variety of human body shapes and articulations. Acquisition of such data requires expensive equipment, calibration procedures, and is limited to cooperative subjects who can understand and follow instructions, such as adults. We present a method for learning a statistical 3D Skinned Multi-Infant Linear body model (SMIL) from incomplete, low-quality RGB-D sequences of freely moving infants. Quantitative experiments show that SMIL faithfully represents the RGB-D data and properly factorizes the shape and pose of the infants. To demonstrate the applicability of SMIL, we fit the model to RGB-D sequences of freely moving infants and show, with a case study, that our method captures enough motion detail for General Movements Assessment (GMA), a method used in clinical practice for early detection of neurodevelopmental disorders in infants. SMIL provides a new tool for analyzing infant shape and movement and is a step towards an automated system for GMA.

The Virtual Caliper: Rapid Creation of Metrically Accurate Avatars from 3D Measurements.

Creating metrically accurate avatars is important for many applications such as virtual clothing try-on, ergonomics, medicine, immersive social media, telepresence, and gaming. Creating avatars that precisely represent a particular individual is challenging however, due to the need for expensive 3D scanners, privacy issues with photographs or videos, and difficulty in making accurate tailoring measurements. We overcome these challenges by creating "The Virtual Caliper", which uses VR game controllers to make simple measurements. First, we establish what body measurements users can reliably make on their own body. We find several distance measurements to be good candidates and then verify that these are linearly related to 3D body shape as represented by the SMPL body model. The Virtual Caliper enables novice users to accurately measure themselves and create an avatar with their own body shape. We evaluate the metric accuracy relative to ground truth 3D body scan data, compare the method quantitatively to other avatar creation tools, and perform extensive perceptual studies. We also provide a software application to the community that enables novices to rapidly create avatars in fewer than five minutes. Not only is our approach more rapid than existing methods, it exports a metrically accurate 3D avatar model that is rigged and skinned.